Jul 13 13:42:35 devstack cinder-volume[75925]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 13 13:42:35 devstack cinder-volume[75925]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 13 13:42:35 devstack cinder-volume[75925]: we strongly recommend against using it for new projects. Jul 13 13:42:35 devstack cinder-volume[75925]: If you are already using Eventlet, we recommend migrating to a different Jul 13 13:42:35 devstack cinder-volume[75925]: framework. For more detail see Jul 13 13:42:35 devstack cinder-volume[75925]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 13 13:42:35 devstack cinder-volume[75925]: import eventlet # noqa Jul 13 13:42:38 devstack cinder-volume[75925]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=75925) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 13 13:42:38 devstack cinder-volume[75925]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=75925) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 13 13:42:38 devstack cinder-volume[75925]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=75925) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 13 13:42:39 devstack cinder-volume[75925]: INFO dbcounter [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] Registered counter for database cinder Jul 13 13:42:39 devstack cinder-volume[75925]: DEBUG oslo_db.sqlalchemy.engines [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75925) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 13 13:42:39 devstack cinder-volume[75925]: DEBUG dbcounter [-] [75925] Writer thread running {{(pid=75925) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 13 13:42:39 devstack cinder-volume[75925]: INFO cinder.rpc [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 13 13:42:39 devstack cinder-volume[75925]: INFO cinder.rpc [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 13 13:42:39 devstack cinder-volume[75925]: DEBUG oslo_db.sqlalchemy.engines [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75925) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 13 13:42:39 devstack cinder-volume[75925]: INFO cinder.volume.manager [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] Determined volume DB was empty at startup. Jul 13 13:42:39 devstack cinder-volume[75925]: DEBUG cinder.volume.manager [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] Cinder Volume DB check: vol_db_empty=True {{(pid=75925) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 13 13:42:39 devstack cinder-volume[75925]: INFO cinder.volume.manager [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] Service not found for updating active_backend_id, assuming default for driver init. Jul 13 13:42:39 devstack cinder-volume[75925]: WARNING stevedore.named [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 13 13:42:39 devstack cinder-volume[75925]: WARNING castellan.key_manager [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 13 13:42:39 devstack cinder-volume[75925]: WARNING cinder.keymgr.conf_key_mgr [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 13 13:42:39 devstack cinder-volume[75925]: DEBUG cinder.volume.drivers.lvm [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=75925) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}} Jul 13 13:42:39 devstack cinder-volume[75925]: DEBUG oslo_concurrency.processutils [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=75925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_concurrency.processutils [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] CMD "cinder-rtstool verify" returned: 0 in 0.430s {{(pid=75925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_db.sqlalchemy.engines [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75925) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 13 13:42:40 devstack cinder-volume[75925]: INFO cinder.rpc [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Jul 13 13:42:40 devstack cinder-volume[75925]: INFO cinder.rpc [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Jul 13 13:42:40 devstack cinder-volume[75925]: WARNING stevedore.named [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 13 13:42:40 devstack cinder-volume[75925]: WARNING castellan.key_manager [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 13 13:42:40 devstack cinder-volume[75925]: INFO cinder.volume.manager [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] Image-volume cache enabled for host devstack@lvmdriver-1. Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_db.sqlalchemy.engines [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75925) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 13 13:42:40 devstack cinder-volume[75925]: INFO oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] Starting 1 workers Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] Started child 76077 {{(pid=75925) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 13 13:42:40 devstack cinder-volume[76077]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] Full set of CONF: {{(pid=75925) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] ******************************************************************************** {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] Configuration options gathered from: {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] ================================================================================ {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] allow_availability_zone_fallback = False {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] allow_compression_on_image_upload = False {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] allowed_direct_url_schemes = [] {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] api_rate_limit = True {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] auth_strategy = keystone {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] az_cache_duration = 3600 {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] backend_availability_zone = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] backend_host = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] backend_name = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] backend_stats_polling_interval = 60 {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] backup_api_class = cinder.backup.api.API {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] backup_name_template = backup-%s {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] backup_use_same_host = False {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] backup_use_temp_snapshot = False {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] chap_password = **** {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] chap_username = {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] cinder_internal_tenant_project_id = f23f3258d3f24d7bae257d30c4583ef1 {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] cinder_internal_tenant_user_id = 25e9b69a76a441e6852258f8913f490b {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] cloned_volume_same_az = True {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] cluster = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] compression_format = gzip {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] compute_api_class = cinder.compute.nova.API {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] config_dir = [] {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] config_source = [] {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] control_exchange = openstack {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] debug = True {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] default_availability_zone = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] default_group_type = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] default_volume_type = lvmdriver-1 {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] disk_geometry = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] driver_client_cert = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] driver_client_cert_key = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] driver_data_namespace = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] driver_ssl_cert_path = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] driver_ssl_cert_verify = False {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] driver_use_ssl = False {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] enable_force_upload = False {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] enable_new_services = True {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] enable_unsupported_driver = False {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] enabled_backends = ['lvmdriver-1'] {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] enforce_multipath_for_image_xfer = False {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] filter_function = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] glance_api_insecure = False {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] glance_api_servers = ['http://192.168.122.10/image'] {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] glance_api_ssl_compression = False {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] glance_ca_certificates_file = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] glance_catalog_info = image:glance:publicURL {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] glance_certfile = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] glance_keyfile = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] glance_num_retries = 3 {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] glance_request_timeout = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] goodness_function = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] graceful_shutdown_timeout = 5 {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] group_api_class = cinder.group.api.API {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] host = devstack {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] image_compress_on_upload = True {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] image_conversion_address_space_limit = 1 {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] image_conversion_cpu_limit = 60 {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] image_conversion_disable = False {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] image_upload_use_cinder_backend = False {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] image_upload_use_internal_tenant = False {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] image_volume_cache_enabled = False {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] image_volume_cache_max_count = 0 {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] image_volume_cache_max_size_gb = 0 {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] init_host_max_objects_retrieval = 0 {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] instance_format = [instance: %(uuid)s] {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] iscsi_target_flags = {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] iscsi_write_cache = on {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] iser_helper = tgtadm {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] iser_ip_address = 192.168.122.10 {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] iser_port = 3260 {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] log_color = False {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] log_config_append = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:42:40 devstack cinder-volume[76077]: INFO cinder.volume.manager [None req-2e7f4571-b1f3-465a-b553-6e89de5cdf0a None None] Starting volume driver LVMVolumeDriver (3.0.0) Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] log_dir = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] log_file = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] log_options = True {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:42:40 devstack cinder-volume[76077]: DEBUG oslo_concurrency.processutils [None req-2e7f4571-b1f3-465a-b553-6e89de5cdf0a None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] log_rotate_interval = 1 {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] log_rotate_interval_type = days {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] log_rotation_type = none {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] max_age = 0 {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] max_logfile_count = 30 {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] max_logfile_size_mb = 200 {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] max_over_subscription_ratio = 20.0 {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] message_reap_interval = 86400 {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] message_ttl = 2592000 {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] migration_create_volume_timeout_secs = 300 {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] monkey_patch = False {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] monkey_patch_modules = [] {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] my_ip = 192.168.122.10 {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] no_snapshot_gb_quota = False {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] num_iser_scan_tries = 3 {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] num_shell_tries = 3 {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] num_volume_device_scan_tries = 3 {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] nvmeof_conn_info_version = 1 {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] nvmet_ns_id = 10 {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] nvmet_port_id = 1 {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] osapi_max_limit = 1000 {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] osapi_volume_ext_list = [] {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] osapi_volume_listen = 0.0.0.0 {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] osapi_volume_listen_port = 8776 {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] osapi_volume_use_ssl = False {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] osapi_volume_workers = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] per_volume_size_limit = -1 {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] periodic_fuzzy_delay = 60 {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] periodic_interval = 60 {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] project_id_regex = [0-9a-f\-]+ {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] public_endpoint = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] publish_errors = False {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] quota_backup_gigabytes = 1000 {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] quota_backups = 10 {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] quota_gigabytes = 1000 {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] quota_groups = 10 {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] quota_snapshots = 10 {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] quota_volumes = 10 {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] rate_limit_burst = 0 {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] rate_limit_except_level = CRITICAL {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] rate_limit_interval = 0 {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] reinit_driver_count = 3 {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] replication_device = **** {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] report_discard_supported = False {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] report_interval = 120 {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] reservation_clean_interval = 86400 {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] reservation_expire = 86400 {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] reserved_image_namespaces = [] {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] reserved_percentage = 0 {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] rpc_response_timeout = 120 {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] run_external_periodic_tasks = True {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] scst_target_driver = iscsi {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] scst_target_iqn_name = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] service_down_time = 720 {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] shell_completion = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] snapshot_name_template = snapshot-%s {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] snapshot_same_host = True {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] split_loggers = False {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] state_path = /opt/stack/data/cinder {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] storage_availability_zone = nova {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] storage_protocol = iSCSI {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] syslog_log_facility = LOG_USER {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] target_helper = lioadm {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] target_ip_address = 192.168.122.10 {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] target_port = 3260 {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] target_protocol = iscsi {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] target_secondary_ip_addresses = [] {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] trace_flags = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] transfer_api_class = cinder.transfer.api.API {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] transport_url = **** {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] until_refresh = 0 {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] use_chap_auth = False {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] use_default_quota_class = True {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] use_journal = False {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] use_json = False {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] use_multipath_for_image_xfer = False {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] use_stderr = False {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] use_syslog = False {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] verify_glance_signatures = enabled {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] volume_api_class = cinder.volume.api.API {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] volume_backend_name = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] volume_clear = zero {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] volume_clear_ionice = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] volume_clear_size = 0 {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] volume_copy_bps_limit = 0 {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] volume_dd_blocksize = 1M {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] volume_name_template = volume-%s {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] volume_service_inithost_offload = False {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] volume_usage_audit_period = month {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] zoning_mode = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:42:40 devstack cinder-volume[76077]: DEBUG oslo_concurrency.processutils [None req-2e7f4571-b1f3-465a-b553-6e89de5cdf0a None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.050s {{(pid=76077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:42:40 devstack cinder-volume[76077]: DEBUG oslo_concurrency.processutils [None req-2e7f4571-b1f3-465a-b553-6e89de5cdf0a None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] oslo_concurrency.disable_process_locking = False {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] os_brick.lightos_discovery_client_address = localhost {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] os_brick.wait_mpath_device_interval = 1 {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] keystone_authtoken.auth_section = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] keystone_authtoken.auth_type = password {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] keystone_authtoken.auth_version = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] keystone_authtoken.cache = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] keystone_authtoken.certfile = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] keystone_authtoken.delay_auth_decision = False {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] keystone_authtoken.http_connect_timeout = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] keystone_authtoken.include_service_catalog = True {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] keystone_authtoken.insecure = False {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] keystone_authtoken.interface = public {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] keystone_authtoken.keyfile = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] keystone_authtoken.memcache_password = {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[76077]: DEBUG oslo_concurrency.processutils [None req-2e7f4571-b1f3-465a-b553-6e89de5cdf0a None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.022s {{(pid=76077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] keystone_authtoken.memcache_secret_key = **** {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] keystone_authtoken.memcache_security_strategy = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[76077]: DEBUG oslo_concurrency.processutils [None req-2e7f4571-b1f3-465a-b553-6e89de5cdf0a None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] keystone_authtoken.memcache_username = {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] keystone_authtoken.region_name = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] keystone_authtoken.service_token_roles_required = True {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] keystone_authtoken.service_type = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] keystone_authtoken.token_cache_time = 300 {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.10/identity {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] cache.backend = dogpile.cache.null {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] cache.backend_argument = **** {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] cache.backend_expiration_time = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] cache.config_prefix = cache.oslo {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] cache.debug_cache_backend = False {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] cache.enable_retry_client = False {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] cache.enable_socket_keepalive = False {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] cache.enabled = False {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] cache.expiration_time = 600 {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] cache.hashclient_dead_timeout = 60.0 {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] cache.hashclient_retry_attempts = 2 {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] cache.hashclient_retry_timeout = 1.0 {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] cache.memcache_dead_retry = 300 {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] cache.memcache_pool_maxsize = 10 {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] cache.memcache_sasl_enabled = False {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] cache.memcache_servers = ['localhost:11211'] {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] cache.password = **** {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] cache.proxies = [] {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] cache.redis_db = 0 {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] cache.redis_sentinel_service_name = mymaster {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] cache.redis_server = localhost:6379 {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] cache.retry_attempts = 2 {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] cache.retry_delay = 0.0 {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] cache.socket_keepalive_count = 1 {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] cache.socket_keepalive_idle = 1 {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] cache.socket_keepalive_interval = 1 {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] cache.socket_timeout = 1.0 {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] cache.tls_allowed_ciphers = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] cache.tls_cafile = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] cache.tls_certfile = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] cache.tls_enabled = False {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] cache.tls_keyfile = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] cache.username = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] coordination.backend_url = **** {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] database.asyncio_connection = **** {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] database.asyncio_slave_connection = **** {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] database.backend = sqlalchemy {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] database.connection = **** {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] database.connection_debug = 0 {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] database.connection_parameters = {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] database.connection_recycle_time = 3600 {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] database.connection_trace = False {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] database.db_inc_retry_interval = True {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[76077]: DEBUG oslo_concurrency.processutils [None req-2e7f4571-b1f3-465a-b553-6e89de5cdf0a None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.027s {{(pid=76077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] database.db_max_retries = 20 {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[76077]: DEBUG oslo_concurrency.processutils [None req-2e7f4571-b1f3-465a-b553-6e89de5cdf0a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=76077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] database.db_max_retry_interval = 10 {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] database.db_retry_interval = 1 {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] database.max_overflow = 50 {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] database.max_pool_size = 5 {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] database.max_retries = 10 {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] database.mysql_sql_mode = TRADITIONAL {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] database.mysql_wsrep_sync_wait = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] database.pool_timeout = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] database.retry_interval = 10 {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] database.slave_connection = **** {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] database.sqlite_synchronous = True {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] database.synchronous_reader = True {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] database.use_db_reconnect = False {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] oslo_messaging_metrics.metrics_process_name = {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] profiler.connection_string = messaging:// {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] profiler.enabled = False {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] profiler.es_doc_type = notification {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] profiler.es_scroll_size = 10000 {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] profiler.es_scroll_time = 2m {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] profiler.filter_error_trace = False {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] profiler.hmac_keys = **** {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] profiler.sentinel_service_name = mymaster {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] profiler.socket_timeout = 0.1 {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] profiler.trace_requests = False {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] profiler.trace_sqlalchemy = False {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] profiler_jaeger.process_tags = {} {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] profiler_jaeger.service_name_prefix = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] profiler_otlp.service_name_prefix = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] oslo_policy.enforce_new_defaults = True {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] oslo_policy.enforce_scope = False {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] oslo_policy.policy_default_rule = default {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] oslo_policy.policy_file = policy.yaml {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] oslo_policy.remote_timeout = 60.0 {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] privsep_osbrick.capabilities = [21, 2] {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] privsep_osbrick.group = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] privsep_osbrick.helper_command = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] privsep_osbrick.log_daemon_traceback = False {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack sudo[76082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] privsep_osbrick.thread_pool_size = 4 {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] privsep_osbrick.user = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] cinder_sys_admin.group = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack sudo[76082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] cinder_sys_admin.helper_command = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] cinder_sys_admin.user = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] service_user.auth_section = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] service_user.auth_type = password {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] service_user.cafile = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] service_user.certfile = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] service_user.collect_timing = False {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] service_user.insecure = False {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] service_user.keyfile = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] service_user.send_service_user_token = True {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] service_user.split_loggers = False {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] service_user.timeout = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] glance.auth_section = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] glance.auth_type = password {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] glance.certfile = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] glance.collect_timing = False {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] glance.insecure = False {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] glance.keyfile = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] glance.region_name = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] glance.split_loggers = False {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] glance.timeout = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] backend_defaults.backend_availability_zone = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] backend_defaults.chap_password = **** {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] backend_defaults.chap_username = {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] backend_defaults.disk_geometry = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] backend_defaults.driver_client_cert = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] backend_defaults.driver_client_cert_key = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] backend_defaults.driver_data_namespace = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] backend_defaults.driver_ssl_cert_path = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] backend_defaults.driver_use_ssl = False {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] backend_defaults.enable_unsupported_driver = False {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] backend_defaults.extra_capabilities = {} {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] backend_defaults.filter_function = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] backend_defaults.goodness_function = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] backend_defaults.image_volume_cache_enabled = False {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] backend_defaults.iscsi_target_flags = {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] backend_defaults.iscsi_write_cache = on {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] backend_defaults.iser_helper = tgtadm {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] backend_defaults.iser_ip_address = 192.168.122.10 {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] backend_defaults.iser_port = 3260 {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] backend_defaults.lvm_mirrors = 0 {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] backend_defaults.lvm_share_target = False {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] backend_defaults.lvm_type = auto {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] backend_defaults.num_shell_tries = 3 {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] backend_defaults.nvmet_ns_id = 10 {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] backend_defaults.nvmet_port_id = 1 {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] backend_defaults.replication_device = **** {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] backend_defaults.report_discard_supported = False {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] backend_defaults.reserved_percentage = 0 {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] backend_defaults.scst_target_driver = iscsi {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] backend_defaults.scst_target_iqn_name = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] backend_defaults.storage_protocol = iSCSI {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] backend_defaults.target_helper = tgtadm {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] backend_defaults.target_ip_address = 192.168.122.10 {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] backend_defaults.target_port = 3260 {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] backend_defaults.target_protocol = iscsi {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] backend_defaults.trace_flags = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] backend_defaults.unique_fqdn_network = True {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] backend_defaults.use_chap_auth = False {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] backend_defaults.volume_backend_name = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] backend_defaults.volume_clear = zero {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] backend_defaults.volume_clear_ionice = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] backend_defaults.volume_clear_size = 0 {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] backend_defaults.volume_group = cinder-volumes {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] oslo_reports.file_event_handler = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] oslo_reports.log_dir = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] lvmdriver-1.backend_availability_zone = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] lvmdriver-1.backend_host = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] lvmdriver-1.chap_password = **** {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] lvmdriver-1.chap_username = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] lvmdriver-1.chiscsi_conf = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] lvmdriver-1.disk_geometry = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] lvmdriver-1.driver_client_cert = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] lvmdriver-1.driver_client_cert_key = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] lvmdriver-1.driver_data_namespace = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] lvmdriver-1.driver_use_ssl = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] lvmdriver-1.extra_capabilities = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] lvmdriver-1.filter_function = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] lvmdriver-1.goodness_function = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] lvmdriver-1.iscsi_target_flags = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] lvmdriver-1.iscsi_write_cache = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] lvmdriver-1.iser_helper = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] lvmdriver-1.iser_ip_address = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] lvmdriver-1.iser_port = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] lvmdriver-1.iser_target_prefix = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] lvmdriver-1.lvm_conf_file = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] lvmdriver-1.lvm_mirrors = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] lvmdriver-1.lvm_share_target = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] lvmdriver-1.lvm_type = auto {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] lvmdriver-1.num_shell_tries = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] lvmdriver-1.nvmet_ns_id = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] lvmdriver-1.nvmet_port_id = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] lvmdriver-1.replication_device = **** {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] lvmdriver-1.report_discard_supported = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] lvmdriver-1.reserved_percentage = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] lvmdriver-1.scst_target_driver = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] lvmdriver-1.storage_protocol = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] lvmdriver-1.target_helper = lioadm {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] lvmdriver-1.target_ip_address = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] lvmdriver-1.target_port = 3260 {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] lvmdriver-1.target_protocol = iscsi {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] lvmdriver-1.trace_flags = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] lvmdriver-1.unique_fqdn_network = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] lvmdriver-1.use_chap_auth = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] lvmdriver-1.volume_clear = zero {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] lvmdriver-1.volume_clear_ionice = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] lvmdriver-1.volume_clear_size = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] lvmdriver-1.volumes_dir = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] oslo_messaging_rabbit.hostname = devstack {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] oslo_messaging_rabbit.ssl = False {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] oslo_messaging_rabbit.ssl_version = {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] oslo_messaging_notifications.driver = [] {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] oslo_messaging_notifications.retry = -1 {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] oslo_messaging_notifications.transport_url = **** {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] key_manager.fixed_key = **** {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] barbican.barbican_api_version = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] barbican.barbican_endpoint = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] barbican.barbican_endpoint_type = public {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] barbican.barbican_region_name = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] barbican.cafile = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] barbican.certfile = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] barbican.collect_timing = False {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] barbican.insecure = False {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] barbican.keyfile = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] barbican.number_of_retries = 60 {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] barbican.retry_delay = 1 {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] barbican.send_service_user_token = False {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] barbican.split_loggers = False {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] barbican.timeout = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] barbican.verify_ssl = True {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] barbican.verify_ssl_path = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] barbican_service_user.auth_section = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] barbican_service_user.auth_type = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] barbican_service_user.cafile = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] barbican_service_user.certfile = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] barbican_service_user.collect_timing = False {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] barbican_service_user.insecure = False {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] barbican_service_user.keyfile = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] barbican_service_user.split_loggers = False {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] barbican_service_user.timeout = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] vault.approle_role_id = **** {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] vault.approle_secret_id = **** {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] vault.auth_method = approle {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] vault.auth_path = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] vault.kv_mountpoint = secret {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] vault.kv_path = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] vault.kv_version = 2 {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] vault.namespace = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] vault.root_token_id = **** {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] vault.ssl_ca_crt_file = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] vault.timeout = 60.0 {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] vault.token_file = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] vault.token_role = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] vault.use_ssl = False {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:42:40 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] ******************************************************************************** {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 13 13:42:41 devstack sudo[76082]: pam_unix(sudo:session): session closed for user root Jul 13 13:42:41 devstack cinder-volume[76077]: DEBUG oslo_concurrency.processutils [None req-2e7f4571-b1f3-465a-b553-6e89de5cdf0a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.271s {{(pid=76077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:42:41 devstack cinder-volume[76077]: DEBUG oslo_concurrency.processutils [None req-2e7f4571-b1f3-465a-b553-6e89de5cdf0a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:42:41 devstack sudo[76085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 13 13:42:41 devstack sudo[76085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:42:41 devstack sudo[76085]: pam_unix(sudo:session): session closed for user root Jul 13 13:42:41 devstack cinder-volume[76077]: DEBUG oslo_concurrency.processutils [None req-2e7f4571-b1f3-465a-b553-6e89de5cdf0a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.235s {{(pid=76077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:42:41 devstack cinder-volume[76077]: DEBUG oslo_concurrency.processutils [None req-2e7f4571-b1f3-465a-b553-6e89de5cdf0a None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=76077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 13 13:42:41 devstack cinder-volume[76077]: INFO cinder.brick.local_dev.lvm [None req-2e7f4571-b1f3-465a-b553-6e89de5cdf0a None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Jul 13 13:42:41 devstack cinder-volume[76077]: DEBUG oslo_concurrency.processutils [None req-2e7f4571-b1f3-465a-b553-6e89de5cdf0a None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:42:41 devstack cinder-volume[76077]: DEBUG oslo_concurrency.processutils [None req-2e7f4571-b1f3-465a-b553-6e89de5cdf0a None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.016s {{(pid=76077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:42:41 devstack cinder-volume[76077]: DEBUG oslo_concurrency.processutils [None req-2e7f4571-b1f3-465a-b553-6e89de5cdf0a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:42:41 devstack sudo[76089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 13 13:42:41 devstack sudo[76089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:42:41 devstack sudo[76089]: pam_unix(sudo:session): session closed for user root Jul 13 13:42:41 devstack cinder-volume[76077]: DEBUG oslo_concurrency.processutils [None req-2e7f4571-b1f3-465a-b553-6e89de5cdf0a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.243s {{(pid=76077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:42:41 devstack cinder-volume[76077]: DEBUG cinder.brick.local_dev.lvm [None req-2e7f4571-b1f3-465a-b553-6e89de5cdf0a None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=76077) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}} Jul 13 13:42:41 devstack cinder-volume[76077]: DEBUG oslo_concurrency.processutils [None req-2e7f4571-b1f3-465a-b553-6e89de5cdf0a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:42:41 devstack sudo[76217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 13 13:42:41 devstack sudo[76217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:42:42 devstack sudo[76217]: pam_unix(sudo:session): session closed for user root Jul 13 13:42:42 devstack cinder-volume[76077]: DEBUG oslo_concurrency.processutils [None req-2e7f4571-b1f3-465a-b553-6e89de5cdf0a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.510s {{(pid=76077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:42:42 devstack cinder-volume[76077]: DEBUG oslo_concurrency.processutils [None req-2e7f4571-b1f3-465a-b553-6e89de5cdf0a None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:42:42 devstack cinder-volume[76077]: DEBUG oslo_concurrency.processutils [None req-2e7f4571-b1f3-465a-b553-6e89de5cdf0a None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=76077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:42:42 devstack cinder-volume[76077]: DEBUG oslo_concurrency.processutils [None req-2e7f4571-b1f3-465a-b553-6e89de5cdf0a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:42:42 devstack sudo[76419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 13 13:42:42 devstack sudo[76419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:42:42 devstack sudo[76419]: pam_unix(sudo:session): session closed for user root Jul 13 13:42:42 devstack cinder-volume[76077]: DEBUG oslo_concurrency.processutils [None req-2e7f4571-b1f3-465a-b553-6e89de5cdf0a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.267s {{(pid=76077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:42:42 devstack cinder-volume[76077]: DEBUG oslo_concurrency.processutils [None req-2e7f4571-b1f3-465a-b553-6e89de5cdf0a None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:42:42 devstack cinder-volume[76077]: DEBUG oslo_concurrency.processutils [None req-2e7f4571-b1f3-465a-b553-6e89de5cdf0a None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.016s {{(pid=76077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:42:42 devstack cinder-volume[76077]: DEBUG oslo_concurrency.processutils [None req-2e7f4571-b1f3-465a-b553-6e89de5cdf0a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=76077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:42:42 devstack sudo[76508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Jul 13 13:42:42 devstack sudo[76508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:42:42 devstack sudo[76508]: pam_unix(sudo:session): session closed for user root Jul 13 13:42:42 devstack cinder-volume[76077]: DEBUG oslo_concurrency.processutils [None req-2e7f4571-b1f3-465a-b553-6e89de5cdf0a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.250s {{(pid=76077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:42:42 devstack cinder-volume[76077]: DEBUG oslo_concurrency.processutils [None req-2e7f4571-b1f3-465a-b553-6e89de5cdf0a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:42:42 devstack sudo[76597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 13 13:42:42 devstack sudo[76597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:42:42 devstack sudo[76597]: pam_unix(sudo:session): session closed for user root Jul 13 13:42:42 devstack cinder-volume[76077]: DEBUG oslo_concurrency.processutils [None req-2e7f4571-b1f3-465a-b553-6e89de5cdf0a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.291s {{(pid=76077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:42:42 devstack cinder-volume[76077]: DEBUG oslo_concurrency.processutils [None req-2e7f4571-b1f3-465a-b553-6e89de5cdf0a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:42:42 devstack sudo[76692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 13 13:42:42 devstack sudo[76692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:42:43 devstack sudo[76692]: pam_unix(sudo:session): session closed for user root Jul 13 13:42:43 devstack cinder-volume[76077]: DEBUG oslo_concurrency.processutils [None req-2e7f4571-b1f3-465a-b553-6e89de5cdf0a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.266s {{(pid=76077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:42:43 devstack cinder-volume[76077]: DEBUG oslo_concurrency.processutils [None req-2e7f4571-b1f3-465a-b553-6e89de5cdf0a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:42:43 devstack sudo[76695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 13 13:42:43 devstack sudo[76695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:42:43 devstack sudo[76695]: pam_unix(sudo:session): session closed for user root Jul 13 13:42:43 devstack cinder-volume[76077]: DEBUG oslo_concurrency.processutils [None req-2e7f4571-b1f3-465a-b553-6e89de5cdf0a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.334s {{(pid=76077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:42:43 devstack cinder-volume[76077]: DEBUG oslo_concurrency.processutils [None req-2e7f4571-b1f3-465a-b553-6e89de5cdf0a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:42:43 devstack sudo[76779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 13 13:42:43 devstack sudo[76779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:42:43 devstack sudo[76779]: pam_unix(sudo:session): session closed for user root Jul 13 13:42:43 devstack cinder-volume[76077]: DEBUG oslo_concurrency.processutils [None req-2e7f4571-b1f3-465a-b553-6e89de5cdf0a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.275s {{(pid=76077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:42:43 devstack cinder-volume[76077]: DEBUG oslo_concurrency.processutils [None req-2e7f4571-b1f3-465a-b553-6e89de5cdf0a None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:42:43 devstack cinder-volume[76077]: DEBUG oslo_concurrency.processutils [None req-2e7f4571-b1f3-465a-b553-6e89de5cdf0a None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=76077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:42:43 devstack cinder-volume[76077]: DEBUG oslo_concurrency.processutils [None req-2e7f4571-b1f3-465a-b553-6e89de5cdf0a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:42:43 devstack sudo[76783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 13 13:42:43 devstack sudo[76783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:42:44 devstack sudo[76783]: pam_unix(sudo:session): session closed for user root Jul 13 13:42:44 devstack cinder-volume[76077]: DEBUG oslo_concurrency.processutils [None req-2e7f4571-b1f3-465a-b553-6e89de5cdf0a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.321s {{(pid=76077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:42:44 devstack cinder-volume[76077]: INFO cinder.volume.drivers.lvm [None req-2e7f4571-b1f3-465a-b553-6e89de5cdf0a None None] Enabling LVM thin provisioning by default because a thin pool exists. Jul 13 13:42:44 devstack cinder-volume[76077]: DEBUG oslo_concurrency.processutils [None req-2e7f4571-b1f3-465a-b553-6e89de5cdf0a None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:42:44 devstack cinder-volume[76077]: DEBUG oslo_concurrency.processutils [None req-2e7f4571-b1f3-465a-b553-6e89de5cdf0a None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=76077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:42:44 devstack cinder-volume[76077]: DEBUG oslo_concurrency.processutils [None req-2e7f4571-b1f3-465a-b553-6e89de5cdf0a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:42:44 devstack sudo[76873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 13 13:42:44 devstack sudo[76873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:42:44 devstack sudo[76873]: pam_unix(sudo:session): session closed for user root Jul 13 13:42:44 devstack cinder-volume[76077]: DEBUG oslo_concurrency.processutils [None req-2e7f4571-b1f3-465a-b553-6e89de5cdf0a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.264s {{(pid=76077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:42:44 devstack cinder-volume[76077]: DEBUG cinder.volume.drivers.lvm [None req-2e7f4571-b1f3-465a-b553-6e89de5cdf0a None None] Updating volume stats {{(pid=76077) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 13 13:42:44 devstack cinder-volume[76077]: DEBUG oslo_concurrency.processutils [None req-2e7f4571-b1f3-465a-b553-6e89de5cdf0a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:42:44 devstack sudo[76876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 13 13:42:44 devstack sudo[76876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:42:44 devstack sudo[76876]: pam_unix(sudo:session): session closed for user root Jul 13 13:42:44 devstack cinder-volume[76077]: DEBUG oslo_concurrency.processutils [None req-2e7f4571-b1f3-465a-b553-6e89de5cdf0a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.262s {{(pid=76077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:42:44 devstack cinder-volume[76077]: DEBUG oslo_concurrency.processutils [None req-2e7f4571-b1f3-465a-b553-6e89de5cdf0a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:42:44 devstack sudo[76879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 13 13:42:44 devstack sudo[76879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:42:44 devstack sudo[76879]: pam_unix(sudo:session): session closed for user root Jul 13 13:42:44 devstack cinder-volume[76077]: DEBUG oslo_concurrency.processutils [None req-2e7f4571-b1f3-465a-b553-6e89de5cdf0a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.247s {{(pid=76077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:42:44 devstack cinder-volume[76077]: DEBUG oslo_concurrency.processutils [None req-2e7f4571-b1f3-465a-b553-6e89de5cdf0a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:42:44 devstack sudo[76882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 13 13:42:44 devstack sudo[76882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:42:45 devstack sudo[76882]: pam_unix(sudo:session): session closed for user root Jul 13 13:42:45 devstack cinder-volume[76077]: DEBUG oslo_concurrency.processutils [None req-2e7f4571-b1f3-465a-b553-6e89de5cdf0a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.260s {{(pid=76077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:42:45 devstack cinder-volume[76077]: DEBUG oslo_concurrency.processutils [None req-2e7f4571-b1f3-465a-b553-6e89de5cdf0a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:42:45 devstack sudo[76885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 13 13:42:45 devstack sudo[76885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:42:45 devstack sudo[76885]: pam_unix(sudo:session): session closed for user root Jul 13 13:42:45 devstack cinder-volume[76077]: DEBUG oslo_concurrency.processutils [None req-2e7f4571-b1f3-465a-b553-6e89de5cdf0a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.284s {{(pid=76077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:42:45 devstack cinder-volume[76077]: INFO cinder.volume.driver [None req-2e7f4571-b1f3-465a-b553-6e89de5cdf0a None None] Driver hasn't implemented _init_vendor_properties() Jul 13 13:42:45 devstack cinder-volume[76077]: DEBUG cinder.volume.driver [None req-2e7f4571-b1f3-465a-b553-6e89de5cdf0a None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=76077) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 13 13:42:45 devstack cinder-volume[76077]: DEBUG oslo_db.sqlalchemy.engines [None req-2e7f4571-b1f3-465a-b553-6e89de5cdf0a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76077) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 13 13:42:45 devstack cinder-volume[76077]: DEBUG dbcounter [-] [76077] Writer thread running {{(pid=76077) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 13 13:42:45 devstack cinder-volume[76077]: DEBUG cinder.db.api [None req-2e7f4571-b1f3-465a-b553-6e89de5cdf0a None None] Building query based on filter {{(pid=76077) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 13 13:42:45 devstack cinder-volume[76077]: DEBUG cinder.image.image_utils [None req-2e7f4571-b1f3-465a-b553-6e89de5cdf0a None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=76077) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 13 13:42:45 devstack cinder-volume[76077]: INFO cinder.keymgr.migration [None req-ba468faf-a0e1-425f-896d-3ed542559fbf None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 13 13:42:45 devstack cinder-volume[76077]: DEBUG cinder.volume.drivers.lvm [None req-2e7f4571-b1f3-465a-b553-6e89de5cdf0a None None] Updating volume stats {{(pid=76077) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 13 13:42:45 devstack cinder-volume[76077]: DEBUG oslo_concurrency.processutils [None req-2e7f4571-b1f3-465a-b553-6e89de5cdf0a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:42:45 devstack sudo[76891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 13 13:42:45 devstack sudo[76891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:42:45 devstack sudo[76891]: pam_unix(sudo:session): session closed for user root Jul 13 13:42:45 devstack cinder-volume[76077]: DEBUG oslo_concurrency.processutils [None req-2e7f4571-b1f3-465a-b553-6e89de5cdf0a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.270s {{(pid=76077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:42:45 devstack cinder-volume[76077]: DEBUG oslo_concurrency.processutils [None req-2e7f4571-b1f3-465a-b553-6e89de5cdf0a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:42:45 devstack sudo[76894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 13 13:42:45 devstack sudo[76894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:42:46 devstack sudo[76894]: pam_unix(sudo:session): session closed for user root Jul 13 13:42:46 devstack cinder-volume[76077]: DEBUG oslo_concurrency.processutils [None req-2e7f4571-b1f3-465a-b553-6e89de5cdf0a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.271s {{(pid=76077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:42:46 devstack cinder-volume[76077]: DEBUG oslo_concurrency.processutils [None req-2e7f4571-b1f3-465a-b553-6e89de5cdf0a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:42:46 devstack sudo[76897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 13 13:42:46 devstack sudo[76897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:42:46 devstack sudo[76897]: pam_unix(sudo:session): session closed for user root Jul 13 13:42:46 devstack cinder-volume[76077]: DEBUG oslo_concurrency.processutils [None req-2e7f4571-b1f3-465a-b553-6e89de5cdf0a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.274s {{(pid=76077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:42:46 devstack cinder-volume[76077]: DEBUG oslo_concurrency.processutils [None req-2e7f4571-b1f3-465a-b553-6e89de5cdf0a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:42:46 devstack sudo[76908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 13 13:42:46 devstack sudo[76908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:42:46 devstack sudo[76908]: pam_unix(sudo:session): session closed for user root Jul 13 13:42:46 devstack cinder-volume[76077]: DEBUG oslo_concurrency.processutils [None req-2e7f4571-b1f3-465a-b553-6e89de5cdf0a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.262s {{(pid=76077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:42:46 devstack cinder-volume[76077]: DEBUG cinder.manager [None req-2e7f4571-b1f3-465a-b553-6e89de5cdf0a None None] Notifying Schedulers of capabilities ... {{(pid=76077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 13:42:46 devstack cinder-volume[76077]: INFO cinder.volume.manager [None req-2e7f4571-b1f3-465a-b553-6e89de5cdf0a None None] Driver initialization completed successfully. Jul 13 13:42:46 devstack cinder-volume[76077]: INFO cinder.manager [None req-2e7f4571-b1f3-465a-b553-6e89de5cdf0a None None] Initiating service 2 cleanup Jul 13 13:42:46 devstack cinder-volume[76077]: INFO cinder.manager [None req-2e7f4571-b1f3-465a-b553-6e89de5cdf0a None None] Service 2 cleanup completed. Jul 13 13:42:46 devstack cinder-volume[76077]: DEBUG cinder.service [None req-2e7f4571-b1f3-465a-b553-6e89de5cdf0a None None] Creating RPC server for service cinder-volume {{(pid=76077) start /opt/stack/cinder/cinder/service.py:231}} Jul 13 13:42:46 devstack cinder-volume[76077]: DEBUG cinder.service [None req-2e7f4571-b1f3-465a-b553-6e89de5cdf0a None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=76077) start /opt/stack/cinder/cinder/service.py:237}} Jul 13 13:42:46 devstack cinder-volume[76077]: INFO cinder.volume.manager [None req-2e7f4571-b1f3-465a-b553-6e89de5cdf0a None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Jul 13 13:42:46 devstack cinder-volume[76077]: DEBUG cinder.volume.drivers.lvm [None req-2e7f4571-b1f3-465a-b553-6e89de5cdf0a None None] Updating volume stats {{(pid=76077) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 13 13:42:46 devstack cinder-volume[76077]: DEBUG oslo_concurrency.processutils [None req-2e7f4571-b1f3-465a-b553-6e89de5cdf0a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:42:46 devstack sudo[76911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 13 13:42:46 devstack sudo[76911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:42:47 devstack sudo[76911]: pam_unix(sudo:session): session closed for user root Jul 13 13:42:47 devstack cinder-volume[76077]: DEBUG oslo_concurrency.processutils [None req-2e7f4571-b1f3-465a-b553-6e89de5cdf0a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.256s {{(pid=76077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:42:47 devstack cinder-volume[76077]: DEBUG oslo_concurrency.processutils [None req-2e7f4571-b1f3-465a-b553-6e89de5cdf0a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:42:47 devstack sudo[76916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 13 13:42:47 devstack sudo[76916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:42:47 devstack sudo[76916]: pam_unix(sudo:session): session closed for user root Jul 13 13:42:47 devstack cinder-volume[76077]: DEBUG oslo_concurrency.processutils [None req-2e7f4571-b1f3-465a-b553-6e89de5cdf0a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.245s {{(pid=76077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:42:47 devstack cinder-volume[76077]: DEBUG oslo_concurrency.processutils [None req-2e7f4571-b1f3-465a-b553-6e89de5cdf0a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:42:47 devstack sudo[76919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 13 13:42:47 devstack sudo[76919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:42:47 devstack sudo[76919]: pam_unix(sudo:session): session closed for user root Jul 13 13:42:47 devstack cinder-volume[76077]: DEBUG oslo_concurrency.processutils [None req-2e7f4571-b1f3-465a-b553-6e89de5cdf0a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.248s {{(pid=76077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:42:47 devstack cinder-volume[76077]: DEBUG oslo_concurrency.processutils [None req-2e7f4571-b1f3-465a-b553-6e89de5cdf0a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:42:47 devstack sudo[76922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 13 13:42:47 devstack sudo[76922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:42:47 devstack sudo[76922]: pam_unix(sudo:session): session closed for user root Jul 13 13:42:47 devstack cinder-volume[76077]: DEBUG oslo_concurrency.processutils [None req-2e7f4571-b1f3-465a-b553-6e89de5cdf0a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.250s {{(pid=76077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:42:47 devstack cinder-volume[76077]: INFO cinder.volume.manager [None req-2e7f4571-b1f3-465a-b553-6e89de5cdf0a None None] Driver post RPC initialization completed successfully. Jul 13 13:42:50 devstack cinder-volume[75925]: DEBUG dbcounter [-] [75925] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75925) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 13 13:42:57 devstack cinder-volume[76077]: DEBUG dbcounter [-] [76077] Writing DB stats cinder:SELECT=3 {{(pid=76077) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 13 13:42:58 devstack cinder-volume[76077]: DEBUG dbcounter [-] [76077] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=76077) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 13 13:43:46 devstack cinder-volume[76077]: DEBUG oslo_service.periodic_task [None req-87228c6b-84ab-42b4-812d-aabd9124218d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76077) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 13 13:43:46 devstack cinder-volume[76077]: DEBUG cinder.volume.drivers.lvm [None req-87228c6b-84ab-42b4-812d-aabd9124218d None None] Updating volume stats {{(pid=76077) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 13 13:43:46 devstack cinder-volume[76077]: DEBUG oslo_concurrency.processutils [None req-87228c6b-84ab-42b4-812d-aabd9124218d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:43:46 devstack sudo[78858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 13 13:43:46 devstack sudo[78858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:43:47 devstack sudo[78858]: pam_unix(sudo:session): session closed for user root Jul 13 13:43:47 devstack cinder-volume[76077]: DEBUG oslo_concurrency.processutils [None req-87228c6b-84ab-42b4-812d-aabd9124218d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.245s {{(pid=76077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:43:47 devstack cinder-volume[76077]: DEBUG oslo_concurrency.processutils [None req-87228c6b-84ab-42b4-812d-aabd9124218d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:43:47 devstack sudo[78901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 13 13:43:47 devstack sudo[78901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:43:47 devstack sudo[78901]: pam_unix(sudo:session): session closed for user root Jul 13 13:43:47 devstack cinder-volume[76077]: DEBUG oslo_concurrency.processutils [None req-87228c6b-84ab-42b4-812d-aabd9124218d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.258s {{(pid=76077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:43:47 devstack cinder-volume[76077]: DEBUG oslo_concurrency.processutils [None req-87228c6b-84ab-42b4-812d-aabd9124218d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:43:47 devstack sudo[78904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 13 13:43:47 devstack sudo[78904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:43:47 devstack sudo[78904]: pam_unix(sudo:session): session closed for user root Jul 13 13:43:47 devstack cinder-volume[76077]: DEBUG oslo_concurrency.processutils [None req-87228c6b-84ab-42b4-812d-aabd9124218d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.268s {{(pid=76077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:43:47 devstack cinder-volume[76077]: DEBUG oslo_concurrency.processutils [None req-87228c6b-84ab-42b4-812d-aabd9124218d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:43:47 devstack sudo[78907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 13 13:43:47 devstack sudo[78907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:43:48 devstack sudo[78907]: pam_unix(sudo:session): session closed for user root Jul 13 13:43:48 devstack cinder-volume[76077]: DEBUG oslo_concurrency.processutils [None req-87228c6b-84ab-42b4-812d-aabd9124218d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.250s {{(pid=76077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:43:48 devstack cinder-volume[76077]: DEBUG cinder.manager [None req-87228c6b-84ab-42b4-812d-aabd9124218d None None] Notifying Schedulers of capabilities ... {{(pid=76077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 13:43:48 devstack cinder-volume[76077]: DEBUG oslo_service.periodic_task [None req-87228c6b-84ab-42b4-812d-aabd9124218d None None] Running periodic task VolumeManager._thread_info {{(pid=76077) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 13 13:43:48 devstack cinder-volume[76077]: DEBUG cinder.volume.manager [None req-87228c6b-84ab-42b4-812d-aabd9124218d None None] thread count: 6 {{(pid=76077) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 13 13:43:48 devstack cinder-volume[76077]: DEBUG cinder.volume.manager [None req-87228c6b-84ab-42b4-812d-aabd9124218d None None] thread info: [<_MainThread(MainThread, started 127061427478656)>, , , , , ] {{(pid=76077) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 13 13:44:46 devstack cinder-volume[76077]: DEBUG oslo_service.periodic_task [None req-87228c6b-84ab-42b4-812d-aabd9124218d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76077) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 13 13:44:46 devstack cinder-volume[76077]: DEBUG cinder.volume.drivers.lvm [None req-87228c6b-84ab-42b4-812d-aabd9124218d None None] Updating volume stats {{(pid=76077) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 13 13:44:46 devstack cinder-volume[76077]: DEBUG oslo_concurrency.processutils [None req-87228c6b-84ab-42b4-812d-aabd9124218d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:44:47 devstack sudo[82165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 13 13:44:47 devstack sudo[82165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:44:47 devstack sudo[82165]: pam_unix(sudo:session): session closed for user root Jul 13 13:44:47 devstack cinder-volume[76077]: DEBUG oslo_concurrency.processutils [None req-87228c6b-84ab-42b4-812d-aabd9124218d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.258s {{(pid=76077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:44:47 devstack cinder-volume[76077]: DEBUG oslo_concurrency.processutils [None req-87228c6b-84ab-42b4-812d-aabd9124218d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:44:47 devstack sudo[82168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 13 13:44:47 devstack sudo[82168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:44:47 devstack sudo[82168]: pam_unix(sudo:session): session closed for user root Jul 13 13:44:47 devstack cinder-volume[76077]: DEBUG oslo_concurrency.processutils [None req-87228c6b-84ab-42b4-812d-aabd9124218d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.262s {{(pid=76077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:44:47 devstack cinder-volume[76077]: DEBUG oslo_concurrency.processutils [None req-87228c6b-84ab-42b4-812d-aabd9124218d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:44:47 devstack sudo[82171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 13 13:44:47 devstack sudo[82171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:44:47 devstack sudo[82171]: pam_unix(sudo:session): session closed for user root Jul 13 13:44:47 devstack cinder-volume[76077]: DEBUG oslo_concurrency.processutils [None req-87228c6b-84ab-42b4-812d-aabd9124218d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.256s {{(pid=76077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:44:47 devstack cinder-volume[76077]: DEBUG oslo_concurrency.processutils [None req-87228c6b-84ab-42b4-812d-aabd9124218d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:44:47 devstack sudo[82174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 13 13:44:47 devstack sudo[82174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:44:48 devstack sudo[82174]: pam_unix(sudo:session): session closed for user root Jul 13 13:44:48 devstack cinder-volume[76077]: DEBUG oslo_concurrency.processutils [None req-87228c6b-84ab-42b4-812d-aabd9124218d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.266s {{(pid=76077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:44:48 devstack cinder-volume[76077]: DEBUG cinder.manager [None req-87228c6b-84ab-42b4-812d-aabd9124218d None None] Notifying Schedulers of capabilities ... {{(pid=76077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 13:44:48 devstack cinder-volume[76077]: DEBUG oslo_service.periodic_task [None req-87228c6b-84ab-42b4-812d-aabd9124218d None None] Running periodic task VolumeManager._thread_info {{(pid=76077) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 13 13:44:48 devstack cinder-volume[76077]: DEBUG cinder.volume.manager [None req-87228c6b-84ab-42b4-812d-aabd9124218d None None] thread count: 6 {{(pid=76077) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 13 13:44:48 devstack cinder-volume[76077]: DEBUG cinder.volume.manager [None req-87228c6b-84ab-42b4-812d-aabd9124218d None None] thread info: [<_MainThread(MainThread, started 127061427478656)>, , , , , ] {{(pid=76077) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 13 13:44:57 devstack cinder-volume[76077]: DEBUG dbcounter [-] [76077] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=76077) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 13 13:45:46 devstack cinder-volume[76077]: DEBUG oslo_service.periodic_task [None req-87228c6b-84ab-42b4-812d-aabd9124218d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76077) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 13 13:45:46 devstack cinder-volume[76077]: DEBUG cinder.volume.drivers.lvm [None req-87228c6b-84ab-42b4-812d-aabd9124218d None None] Updating volume stats {{(pid=76077) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 13 13:45:46 devstack cinder-volume[76077]: DEBUG oslo_concurrency.processutils [None req-87228c6b-84ab-42b4-812d-aabd9124218d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:45:46 devstack sudo[84051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 13 13:45:46 devstack sudo[84051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:45:47 devstack sudo[84051]: pam_unix(sudo:session): session closed for user root Jul 13 13:45:47 devstack cinder-volume[76077]: DEBUG oslo_concurrency.processutils [None req-87228c6b-84ab-42b4-812d-aabd9124218d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.263s {{(pid=76077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:45:47 devstack cinder-volume[76077]: DEBUG oslo_concurrency.processutils [None req-87228c6b-84ab-42b4-812d-aabd9124218d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:45:47 devstack sudo[84054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 13 13:45:47 devstack sudo[84054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:45:47 devstack sudo[84054]: pam_unix(sudo:session): session closed for user root Jul 13 13:45:47 devstack cinder-volume[76077]: DEBUG oslo_concurrency.processutils [None req-87228c6b-84ab-42b4-812d-aabd9124218d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.260s {{(pid=76077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:45:47 devstack cinder-volume[76077]: DEBUG oslo_concurrency.processutils [None req-87228c6b-84ab-42b4-812d-aabd9124218d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:45:47 devstack sudo[84066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 13 13:45:47 devstack sudo[84066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:45:47 devstack sudo[84066]: pam_unix(sudo:session): session closed for user root Jul 13 13:45:47 devstack cinder-volume[76077]: DEBUG oslo_concurrency.processutils [None req-87228c6b-84ab-42b4-812d-aabd9124218d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.243s {{(pid=76077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:45:47 devstack cinder-volume[76077]: DEBUG oslo_concurrency.processutils [None req-87228c6b-84ab-42b4-812d-aabd9124218d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:45:47 devstack sudo[84069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 13 13:45:47 devstack sudo[84069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:45:48 devstack sudo[84069]: pam_unix(sudo:session): session closed for user root Jul 13 13:45:48 devstack cinder-volume[76077]: DEBUG oslo_concurrency.processutils [None req-87228c6b-84ab-42b4-812d-aabd9124218d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.266s {{(pid=76077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:45:48 devstack cinder-volume[76077]: DEBUG cinder.manager [None req-87228c6b-84ab-42b4-812d-aabd9124218d None None] Notifying Schedulers of capabilities ... {{(pid=76077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 13:45:48 devstack cinder-volume[76077]: DEBUG oslo_service.periodic_task [None req-87228c6b-84ab-42b4-812d-aabd9124218d None None] Running periodic task VolumeManager._thread_info {{(pid=76077) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 13 13:45:48 devstack cinder-volume[76077]: DEBUG cinder.volume.manager [None req-87228c6b-84ab-42b4-812d-aabd9124218d None None] thread count: 6 {{(pid=76077) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 13 13:45:48 devstack cinder-volume[76077]: DEBUG cinder.volume.manager [None req-87228c6b-84ab-42b4-812d-aabd9124218d None None] thread info: [<_MainThread(MainThread, started 127061427478656)>, , , , , ] {{(pid=76077) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 13 13:46:46 devstack cinder-volume[76077]: DEBUG oslo_service.periodic_task [None req-87228c6b-84ab-42b4-812d-aabd9124218d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76077) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 13 13:46:46 devstack cinder-volume[76077]: DEBUG cinder.volume.drivers.lvm [None req-87228c6b-84ab-42b4-812d-aabd9124218d None None] Updating volume stats {{(pid=76077) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 13 13:46:46 devstack cinder-volume[76077]: DEBUG oslo_concurrency.processutils [None req-87228c6b-84ab-42b4-812d-aabd9124218d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:46:46 devstack sudo[85374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 13 13:46:46 devstack sudo[85374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:46:47 devstack sudo[85374]: pam_unix(sudo:session): session closed for user root Jul 13 13:46:47 devstack cinder-volume[76077]: DEBUG oslo_concurrency.processutils [None req-87228c6b-84ab-42b4-812d-aabd9124218d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.265s {{(pid=76077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:46:47 devstack cinder-volume[76077]: DEBUG oslo_concurrency.processutils [None req-87228c6b-84ab-42b4-812d-aabd9124218d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:46:47 devstack sudo[85377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 13 13:46:47 devstack sudo[85377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:46:47 devstack sudo[85377]: pam_unix(sudo:session): session closed for user root Jul 13 13:46:47 devstack cinder-volume[76077]: DEBUG oslo_concurrency.processutils [None req-87228c6b-84ab-42b4-812d-aabd9124218d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.266s {{(pid=76077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:46:47 devstack cinder-volume[76077]: DEBUG oslo_concurrency.processutils [None req-87228c6b-84ab-42b4-812d-aabd9124218d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:46:47 devstack sudo[85380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 13 13:46:47 devstack sudo[85380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:46:47 devstack sudo[85380]: pam_unix(sudo:session): session closed for user root Jul 13 13:46:47 devstack cinder-volume[76077]: DEBUG oslo_concurrency.processutils [None req-87228c6b-84ab-42b4-812d-aabd9124218d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.251s {{(pid=76077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:46:47 devstack cinder-volume[76077]: DEBUG oslo_concurrency.processutils [None req-87228c6b-84ab-42b4-812d-aabd9124218d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:46:47 devstack sudo[85383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 13 13:46:47 devstack sudo[85383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:46:48 devstack sudo[85383]: pam_unix(sudo:session): session closed for user root Jul 13 13:46:48 devstack cinder-volume[76077]: DEBUG oslo_concurrency.processutils [None req-87228c6b-84ab-42b4-812d-aabd9124218d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.256s {{(pid=76077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:46:48 devstack cinder-volume[76077]: DEBUG cinder.manager [None req-87228c6b-84ab-42b4-812d-aabd9124218d None None] Notifying Schedulers of capabilities ... {{(pid=76077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 13:46:48 devstack cinder-volume[76077]: DEBUG oslo_service.periodic_task [None req-87228c6b-84ab-42b4-812d-aabd9124218d None None] Running periodic task VolumeManager._thread_info {{(pid=76077) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 13 13:46:48 devstack cinder-volume[76077]: DEBUG cinder.volume.manager [None req-87228c6b-84ab-42b4-812d-aabd9124218d None None] thread count: 6 {{(pid=76077) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 13 13:46:48 devstack cinder-volume[76077]: DEBUG cinder.volume.manager [None req-87228c6b-84ab-42b4-812d-aabd9124218d None None] thread info: [<_MainThread(MainThread, started 127061427478656)>, , , , , ] {{(pid=76077) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 13 13:46:57 devstack cinder-volume[76077]: DEBUG dbcounter [-] [76077] Writing DB stats cinder:SELECT=1 {{(pid=76077) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 13 13:46:57 devstack cinder-volume[76077]: DEBUG dbcounter [-] [76077] Writing DB stats cinder:UPDATE=1 {{(pid=76077) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 13 13:47:19 devstack cinder-volume[75925]: INFO oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] Caught SIGTERM, stopping children Jul 13 13:47:19 devstack cinder-volume[75925]: DEBUG oslo_concurrency.lockutils [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] Acquiring lock "singleton_lock" {{(pid=75925) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 13 13:47:19 devstack cinder-volume[75925]: DEBUG oslo_concurrency.lockutils [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] Acquired lock "singleton_lock" {{(pid=75925) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 13 13:47:19 devstack cinder-volume[75925]: DEBUG oslo_concurrency.lockutils [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] Releasing lock "singleton_lock" {{(pid=75925) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 13 13:47:19 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] Stop services. {{(pid=75925) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jul 13 13:47:19 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] Killing children. {{(pid=75925) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jul 13 13:47:19 devstack cinder-volume[75925]: INFO oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] Waiting on 1 children to exit Jul 13 13:47:21 devstack cinder-volume[76077]: DEBUG oslo_concurrency.lockutils [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] Acquiring lock "singleton_lock" {{(pid=76077) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 13 13:47:21 devstack cinder-volume[76077]: DEBUG oslo_concurrency.lockutils [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] Acquired lock "singleton_lock" {{(pid=76077) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 13 13:47:21 devstack cinder-volume[76077]: DEBUG oslo_concurrency.lockutils [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] Releasing lock "singleton_lock" {{(pid=76077) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 13 13:47:21 devstack cinder-volume[76077]: WARNING amqp [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 13 13:47:21 devstack cinder-volume[76077]: WARNING amqp [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 13 13:47:21 devstack cinder-volume[75925]: INFO oslo_service.backend._eventlet.service [None req-2da5123c-abff-44ec-a588-9e43a2bff4ae None None] Child 76077 exited with status 0 Jul 13 13:47:22 devstack cinder-volume[86195]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 13 13:47:22 devstack cinder-volume[86195]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 13 13:47:22 devstack cinder-volume[86195]: we strongly recommend against using it for new projects. Jul 13 13:47:22 devstack cinder-volume[86195]: If you are already using Eventlet, we recommend migrating to a different Jul 13 13:47:22 devstack cinder-volume[86195]: framework. For more detail see Jul 13 13:47:22 devstack cinder-volume[86195]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 13 13:47:22 devstack cinder-volume[86195]: import eventlet # noqa Jul 13 13:47:24 devstack cinder-volume[86195]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86195) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 13 13:47:24 devstack cinder-volume[86195]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86195) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 13 13:47:24 devstack cinder-volume[86195]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86195) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 13 13:47:25 devstack cinder-volume[86195]: INFO dbcounter [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] Registered counter for database cinder Jul 13 13:47:25 devstack cinder-volume[86195]: DEBUG oslo_db.sqlalchemy.engines [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86195) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 13 13:47:25 devstack cinder-volume[86195]: DEBUG dbcounter [-] [86195] Writer thread running {{(pid=86195) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 13 13:47:25 devstack cinder-volume[86195]: INFO cinder.rpc [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 13 13:47:25 devstack cinder-volume[86195]: INFO cinder.rpc [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 13 13:47:25 devstack cinder-volume[86195]: DEBUG oslo_db.sqlalchemy.engines [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86195) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 13 13:47:25 devstack cinder-volume[86195]: INFO cinder.volume.manager [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] Determined volume DB was empty at startup. Jul 13 13:47:25 devstack cinder-volume[86195]: DEBUG cinder.volume.manager [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86195) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 13 13:47:25 devstack cinder-volume[86195]: INFO cinder.volume.manager [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] Service not found for updating active_backend_id, assuming default for driver init. Jul 13 13:47:25 devstack cinder-volume[86195]: WARNING stevedore.named [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 13 13:47:25 devstack cinder-volume[86195]: WARNING castellan.key_manager [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 13 13:47:25 devstack cinder-volume[86195]: WARNING cinder.keymgr.conf_key_mgr [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 13 13:47:25 devstack cinder-volume[86195]: INFO cinder.volume.manager [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] Image-volume cache disabled for host devstack@QuobyteHD. Jul 13 13:47:25 devstack cinder-volume[86195]: DEBUG oslo_db.sqlalchemy.engines [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86195) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 13 13:47:25 devstack cinder-volume[86195]: INFO oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] Starting 1 workers Jul 13 13:47:25 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] Started child 86412 {{(pid=86195) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 13 13:47:25 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] Full set of CONF: {{(pid=86195) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 13 13:47:25 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] ******************************************************************************** {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 13 13:47:25 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] Configuration options gathered from: {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 13 13:47:25 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 13 13:47:25 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 13 13:47:25 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] ================================================================================ {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 13 13:47:25 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] allow_availability_zone_fallback = False {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:25 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] allow_compression_on_image_upload = False {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:25 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] allowed_direct_url_schemes = [] {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:25 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] api_rate_limit = True {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:25 devstack cinder-volume[86412]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 13 13:47:25 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] auth_strategy = keystone {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:25 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] backend_availability_zone = None {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:25 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] backend_host = None {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:25 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] backend_name = None {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:25 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] backend_stats_polling_interval = 60 {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:25 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] backup_api_class = cinder.backup.api.API {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:25 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:25 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] backup_name_template = backup-%s {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:25 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] backup_use_same_host = False {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:25 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] backup_use_temp_snapshot = False {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:25 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] chap_password = **** {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:25 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] chap_username = {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:25 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:25 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] cinder_internal_tenant_project_id = f23f3258d3f24d7bae257d30c4583ef1 {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:25 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] cinder_internal_tenant_user_id = 25e9b69a76a441e6852258f8913f490b {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:25 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] cluster = None {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:25 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] compression_format = gzip {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:25 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] compute_api_class = cinder.compute.nova.API {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:25 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] config_dir = [] {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:25 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:25 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] config_source = [] {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:25 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:25 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] control_exchange = openstack {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:25 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] debug = True {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:25 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] default_availability_zone = None {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:25 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] default_group_type = None {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:25 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:25 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] default_volume_type = QuobyteHD {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:25 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] disk_geometry = None {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:25 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] driver_client_cert = None {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:25 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] driver_client_cert_key = None {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:25 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] driver_data_namespace = None {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:25 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] driver_ssl_cert_path = None {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:25 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] driver_ssl_cert_verify = False {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:25 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] driver_use_ssl = False {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:25 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] enable_new_services = True {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:25 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] enable_unsupported_driver = False {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:25 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] enabled_backends = ['QuobyteHD'] {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:25 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] enforce_multipath_for_image_xfer = False {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:25 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] filter_function = None {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:25 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] glance_api_insecure = False {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] glance_api_servers = ['http://192.168.122.10/image'] {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] glance_api_ssl_compression = False {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] glance_ca_certificates_file = None {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] glance_catalog_info = image:glance:publicURL {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] glance_certfile = None {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] glance_keyfile = None {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] glance_num_retries = 3 {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] glance_request_timeout = None {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] goodness_function = None {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] graceful_shutdown_timeout = 5 {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] group_api_class = cinder.group.api.API {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] host = devstack {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] image_compress_on_upload = True {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] image_conversion_address_space_limit = 1 {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] image_conversion_cpu_limit = 60 {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] image_conversion_disable = False {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] image_upload_use_cinder_backend = False {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] image_upload_use_internal_tenant = False {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] image_volume_cache_enabled = False {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] image_volume_cache_max_count = 0 {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] image_volume_cache_max_size_gb = 0 {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] init_host_max_objects_retrieval = 0 {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] instance_format = [instance: %(uuid)s] {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] iscsi_target_flags = {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] iscsi_write_cache = on {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] iser_helper = tgtadm {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] iser_ip_address = 192.168.122.10 {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] iser_port = 3260 {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] log_color = False {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] log_config_append = None {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] log_dir = None {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] log_file = None {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] log_options = True {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] log_rotate_interval = 1 {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] log_rotate_interval_type = days {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] log_rotation_type = none {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:26 devstack cinder-volume[86412]: INFO cinder.volume.manager [None req-a00e927c-ef5f-47f6-8c0a-1dc5156e6f4c None None] Starting volume driver QuobyteDriver (1.1.14) Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] max_age = 0 {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] max_logfile_count = 30 {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] max_logfile_size_mb = 200 {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:26 devstack cinder-volume[86412]: DEBUG cinder.volume.drivers.remotefs [None req-a00e927c-ef5f-47f6-8c0a-1dc5156e6f4c None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86412) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] max_over_subscription_ratio = 20.0 {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] message_reap_interval = 86400 {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] message_ttl = 2592000 {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] migration_create_volume_timeout_secs = 300 {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] monkey_patch = False {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] monkey_patch_modules = [] {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] my_ip = 192.168.122.10 {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] no_snapshot_gb_quota = False {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] num_iser_scan_tries = 3 {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] num_shell_tries = 3 {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] num_volume_device_scan_tries = 3 {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] nvmeof_conn_info_version = 1 {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] nvmet_ns_id = 10 {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] nvmet_port_id = 1 {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] osapi_max_limit = 1000 {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] osapi_volume_ext_list = [] {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] osapi_volume_listen = 0.0.0.0 {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] osapi_volume_listen_port = 8776 {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] osapi_volume_use_ssl = False {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] osapi_volume_workers = None {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] per_volume_size_limit = -1 {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] periodic_fuzzy_delay = 60 {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] periodic_interval = 60 {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] project_id_regex = [0-9a-f\-]+ {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] public_endpoint = None {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] publish_errors = False {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] quota_backup_gigabytes = 1000 {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] quota_backups = 10 {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] quota_gigabytes = 1000 {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] quota_groups = 10 {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] quota_snapshots = 10 {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] quota_volumes = 10 {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] rate_limit_burst = 0 {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] rate_limit_except_level = CRITICAL {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] rate_limit_interval = 0 {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] reinit_driver_count = 3 {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] replication_device = **** {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] report_discard_supported = False {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] report_interval = 120 {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] reservation_clean_interval = 86400 {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] reservation_expire = 86400 {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] reserved_image_namespaces = [] {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] reserved_percentage = 0 {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] rpc_response_timeout = 120 {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] run_external_periodic_tasks = True {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] scst_target_driver = iscsi {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] scst_target_iqn_name = None {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] service_down_time = 720 {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] shell_completion = None {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] snapshot_name_template = snapshot-%s {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] split_loggers = False {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] state_path = /opt/stack/data/cinder {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] storage_availability_zone = nova {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] storage_protocol = iSCSI {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] syslog_log_facility = LOG_USER {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] target_helper = lioadm {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] target_ip_address = 192.168.122.10 {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] target_port = 3260 {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] target_protocol = iscsi {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] target_secondary_ip_addresses = [] {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] trace_flags = None {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] transfer_api_class = cinder.transfer.api.API {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] transport_url = **** {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] until_refresh = 0 {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] use_chap_auth = False {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] use_default_quota_class = True {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] use_journal = False {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] use_json = False {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] use_multipath_for_image_xfer = False {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] use_stderr = False {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] use_syslog = False {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] verify_glance_signatures = enabled {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] volume_api_class = cinder.volume.api.API {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] volume_backend_name = None {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] volume_clear = zero {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] volume_clear_ionice = None {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] volume_clear_size = 0 {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] volume_copy_bps_limit = 0 {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] volume_dd_blocksize = 1M {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] volume_name_template = volume-%s {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] volume_service_inithost_offload = False {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] volume_usage_audit_period = month {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] zoning_mode = None {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] oslo_concurrency.disable_process_locking = False {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] keystone_authtoken.auth_section = None {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] keystone_authtoken.auth_type = password {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] keystone_authtoken.auth_version = None {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] keystone_authtoken.cache = None {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] keystone_authtoken.certfile = None {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] keystone_authtoken.delay_auth_decision = False {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] keystone_authtoken.http_connect_timeout = None {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] keystone_authtoken.include_service_catalog = True {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] keystone_authtoken.insecure = False {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] keystone_authtoken.interface = public {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] keystone_authtoken.keyfile = None {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] keystone_authtoken.memcache_password = {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] keystone_authtoken.memcache_username = {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] keystone_authtoken.region_name = None {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] keystone_authtoken.service_token_roles_required = True {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] keystone_authtoken.service_type = None {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] keystone_authtoken.token_cache_time = 300 {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.10/identity {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] cache.backend = dogpile.cache.null {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] cache.backend_argument = **** {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] cache.backend_expiration_time = None {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] cache.config_prefix = cache.oslo {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] cache.debug_cache_backend = False {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] cache.enable_retry_client = False {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] cache.enable_socket_keepalive = False {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] cache.enabled = False {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] cache.expiration_time = 600 {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] cache.hashclient_retry_attempts = 2 {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] cache.memcache_dead_retry = 300 {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] cache.memcache_pool_maxsize = 10 {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] cache.memcache_sasl_enabled = False {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] cache.password = **** {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] cache.proxies = [] {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] cache.redis_db = 0 {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] cache.redis_sentinel_service_name = mymaster {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] cache.redis_server = localhost:6379 {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] cache.retry_attempts = 2 {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] cache.retry_delay = 0.0 {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] cache.socket_keepalive_count = 1 {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] cache.socket_keepalive_idle = 1 {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] cache.socket_keepalive_interval = 1 {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] cache.socket_timeout = 1.0 {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] cache.tls_allowed_ciphers = None {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] cache.tls_cafile = None {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] cache.tls_certfile = None {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] cache.tls_enabled = False {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] cache.tls_keyfile = None {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] cache.username = None {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86412]: DEBUG cinder.volume.drivers.quobyte [None req-a00e927c-ef5f-47f6-8c0a-1dc5156e6f4c None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86412) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Jul 13 13:47:26 devstack cinder-volume[86412]: WARNING cinder.volume.drivers.quobyte [None req-a00e927c-ef5f-47f6-8c0a-1dc5156e6f4c None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jul 13 13:47:26 devstack cinder-volume[86412]: WARNING cinder.volume.drivers.quobyte [None req-a00e927c-ef5f-47f6-8c0a-1dc5156e6f4c None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jul 13 13:47:26 devstack cinder-volume[86412]: DEBUG oslo_concurrency.processutils [None req-a00e927c-ef5f-47f6-8c0a-1dc5156e6f4c None None] Running cmd (subprocess): mount.quobyte {{(pid=86412) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] coordination.backend_url = **** {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] database.asyncio_connection = **** {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] database.asyncio_slave_connection = **** {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] database.backend = sqlalchemy {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] database.connection = **** {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] database.connection_debug = 0 {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] database.connection_parameters = {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] database.connection_recycle_time = 3600 {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] database.connection_trace = False {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] database.db_inc_retry_interval = True {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] database.db_max_retries = 20 {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] database.db_max_retry_interval = 10 {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] database.db_retry_interval = 1 {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] database.max_overflow = 50 {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] database.max_pool_size = 5 {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] database.max_retries = 10 {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] database.mysql_wsrep_sync_wait = None {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] database.pool_timeout = None {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] database.retry_interval = 10 {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] database.slave_connection = **** {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] database.sqlite_synchronous = True {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] database.synchronous_reader = True {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] database.use_db_reconnect = False {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] profiler.connection_string = messaging:// {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] profiler.enabled = False {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] profiler.es_doc_type = notification {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] profiler.es_scroll_size = 10000 {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] profiler.es_scroll_time = 2m {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] profiler.filter_error_trace = False {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] profiler.hmac_keys = **** {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] profiler.sentinel_service_name = mymaster {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] profiler.socket_timeout = 0.1 {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] profiler.trace_requests = False {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] profiler.trace_sqlalchemy = False {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] profiler_jaeger.process_tags = {} {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] profiler_jaeger.service_name_prefix = None {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] profiler_otlp.service_name_prefix = None {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] oslo_policy.enforce_new_defaults = True {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] oslo_policy.enforce_scope = False {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] oslo_policy.policy_default_rule = default {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] oslo_policy.policy_file = policy.yaml {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] oslo_policy.remote_timeout = 60.0 {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] privsep_osbrick.group = None {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] privsep_osbrick.helper_command = None {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] privsep_osbrick.user = None {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] cinder_sys_admin.group = None {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] cinder_sys_admin.helper_command = None {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] cinder_sys_admin.user = None {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] service_user.auth_section = None {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] service_user.auth_type = password {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] service_user.cafile = None {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] service_user.certfile = None {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] service_user.collect_timing = False {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] service_user.insecure = False {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] service_user.keyfile = None {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] service_user.send_service_user_token = True {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] service_user.split_loggers = False {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] service_user.timeout = None {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] glance.auth_section = None {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] glance.auth_type = password {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] glance.certfile = None {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] glance.collect_timing = False {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] glance.insecure = False {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] glance.keyfile = None {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] glance.region_name = None {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] glance.split_loggers = False {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] glance.timeout = None {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] backend_defaults.backend_availability_zone = None {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] backend_defaults.chap_password = **** {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] backend_defaults.chap_username = {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] backend_defaults.disk_geometry = None {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] backend_defaults.driver_client_cert = None {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] backend_defaults.driver_client_cert_key = None {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] backend_defaults.driver_data_namespace = None {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] backend_defaults.driver_use_ssl = False {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] backend_defaults.enable_unsupported_driver = False {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] backend_defaults.extra_capabilities = {} {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] backend_defaults.filter_function = None {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] backend_defaults.goodness_function = None {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] backend_defaults.iscsi_target_flags = {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] backend_defaults.iscsi_write_cache = on {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] backend_defaults.iser_helper = tgtadm {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] backend_defaults.iser_ip_address = 192.168.122.10 {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] backend_defaults.iser_port = 3260 {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] backend_defaults.nas_host = {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] backend_defaults.nas_login = admin {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] backend_defaults.nas_mount_options = None {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] backend_defaults.nas_password = **** {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] backend_defaults.nas_private_key = {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] backend_defaults.nas_share_path = {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] backend_defaults.nas_ssh_port = 22 {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] backend_defaults.num_shell_tries = 3 {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] backend_defaults.nvmet_port_id = 1 {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] backend_defaults.quobyte_client_cfg = None {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] backend_defaults.quobyte_volume_url = None {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] backend_defaults.replication_device = **** {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] backend_defaults.report_discard_supported = False {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] backend_defaults.reserved_percentage = 0 {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] backend_defaults.scst_target_driver = iscsi {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] backend_defaults.scst_target_iqn_name = None {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] backend_defaults.storage_protocol = iSCSI {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] backend_defaults.target_helper = tgtadm {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] backend_defaults.target_ip_address = 192.168.122.10 {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] backend_defaults.target_port = 3260 {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] backend_defaults.target_protocol = iscsi {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] backend_defaults.trace_flags = None {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] backend_defaults.unique_fqdn_network = True {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] backend_defaults.use_chap_auth = False {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] backend_defaults.volume_backend_name = None {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] backend_defaults.volume_clear = zero {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] backend_defaults.volume_clear_ionice = None {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] backend_defaults.volume_clear_size = 0 {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] oslo_reports.file_event_handler = None {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] oslo_reports.log_dir = None {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] QuobyteHD.backend_availability_zone = None {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] QuobyteHD.backend_host = None {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] QuobyteHD.chap_password = **** {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] QuobyteHD.chap_username = None {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] QuobyteHD.chiscsi_conf = None {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] QuobyteHD.disk_geometry = None {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] QuobyteHD.driver_client_cert = None {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] QuobyteHD.driver_client_cert_key = None {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] QuobyteHD.driver_data_namespace = None {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] QuobyteHD.driver_use_ssl = None {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] QuobyteHD.extra_capabilities = None {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] QuobyteHD.filter_function = None {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] QuobyteHD.goodness_function = None {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] QuobyteHD.iscsi_target_flags = None {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] QuobyteHD.iscsi_write_cache = None {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] QuobyteHD.iser_helper = None {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] QuobyteHD.iser_ip_address = None {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] QuobyteHD.iser_port = None {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] QuobyteHD.iser_target_prefix = None {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] QuobyteHD.nas_host = None {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] QuobyteHD.nas_login = None {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] QuobyteHD.nas_mount_options = None {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] QuobyteHD.nas_password = **** {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] QuobyteHD.nas_private_key = None {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] QuobyteHD.nas_share_path = None {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] QuobyteHD.nas_ssh_port = None {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] QuobyteHD.num_shell_tries = None {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] QuobyteHD.nvmet_ns_id = None {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] QuobyteHD.nvmet_port_id = None {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] QuobyteHD.replication_device = **** {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] QuobyteHD.report_discard_supported = None {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] QuobyteHD.reserved_percentage = None {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] QuobyteHD.scst_target_driver = None {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] QuobyteHD.storage_protocol = None {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] QuobyteHD.target_helper = None {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] QuobyteHD.target_ip_address = None {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] QuobyteHD.target_port = None {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] QuobyteHD.target_prefix = None {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] QuobyteHD.target_protocol = None {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] QuobyteHD.trace_flags = None {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] QuobyteHD.unique_fqdn_network = None {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] QuobyteHD.use_chap_auth = None {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] QuobyteHD.volume_clear = None {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] QuobyteHD.volume_clear_ionice = None {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] QuobyteHD.volume_clear_size = None {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86412]: DEBUG oslo_concurrency.processutils [None req-a00e927c-ef5f-47f6-8c0a-1dc5156e6f4c None None] CMD "mount.quobyte" returned: 1 in 0.117s {{(pid=86412) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86412]: DEBUG oslo_concurrency.lockutils [None req-a00e927c-ef5f-47f6-8c0a-1dc5156e6f4c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86412) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] QuobyteHD.volumes_dir = None {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86412]: DEBUG oslo_concurrency.lockutils [None req-a00e927c-ef5f-47f6-8c0a-1dc5156e6f4c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86412) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86412]: DEBUG cinder.volume.drivers.quobyte [None req-a00e927c-ef5f-47f6-8c0a-1dc5156e6f4c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=86412) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86412]: INFO cinder.volume.drivers.quobyte [None req-a00e927c-ef5f-47f6-8c0a-1dc5156e6f4c None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 ... Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86412]: DEBUG oslo_concurrency.processutils [None req-a00e927c-ef5f-47f6-8c0a-1dc5156e6f4c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 -c /etc/quobyte/client-cinder.cfg {{(pid=86412) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] oslo_messaging_rabbit.ssl = False {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] oslo_messaging_rabbit.ssl_version = {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] oslo_messaging_notifications.driver = [] {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] oslo_messaging_notifications.retry = -1 {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] oslo_messaging_notifications.transport_url = **** {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] key_manager.fixed_key = **** {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] barbican.barbican_api_version = None {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] barbican.barbican_endpoint = None {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] barbican.barbican_endpoint_type = public {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] barbican.barbican_region_name = None {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] barbican.cafile = None {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] barbican.certfile = None {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] barbican.collect_timing = False {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] barbican.insecure = False {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] barbican.keyfile = None {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] barbican.number_of_retries = 60 {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] barbican.retry_delay = 1 {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] barbican.send_service_user_token = False {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] barbican.split_loggers = False {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] barbican.timeout = None {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] barbican.verify_ssl = True {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] barbican.verify_ssl_path = None {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] barbican_service_user.auth_section = None {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] barbican_service_user.auth_type = None {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] barbican_service_user.cafile = None {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] barbican_service_user.certfile = None {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] barbican_service_user.collect_timing = False {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] barbican_service_user.insecure = False {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] barbican_service_user.keyfile = None {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] barbican_service_user.split_loggers = False {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] barbican_service_user.timeout = None {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] vault.approle_role_id = **** {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] vault.approle_secret_id = **** {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] vault.auth_method = approle {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] vault.auth_path = None {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] vault.kv_mountpoint = secret {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] vault.kv_path = None {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] vault.kv_version = 2 {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] vault.namespace = None {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] vault.root_token_id = **** {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] vault.ssl_ca_crt_file = None {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] vault.timeout = 60.0 {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] vault.token_file = None {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] vault.token_role = None {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] vault.use_ssl = False {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:26 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] ******************************************************************************** {{(pid=86195) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 13 13:47:26 devstack sudo[86418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 -c /etc/quobyte/client-cinder.cfg Jul 13 13:47:26 devstack sudo[86418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:47:26 devstack sudo[86418]: pam_unix(sudo:session): session closed for user root Jul 13 13:47:26 devstack cinder-volume[86412]: DEBUG oslo_concurrency.processutils [None req-a00e927c-ef5f-47f6-8c0a-1dc5156e6f4c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.545s {{(pid=86412) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:47:26 devstack cinder-volume[86412]: INFO cinder.volume.drivers.quobyte [None req-a00e927c-ef5f-47f6-8c0a-1dc5156e6f4c None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 succeeded Jul 13 13:47:26 devstack cinder-volume[86412]: DEBUG cinder.volume.drivers.quobyte [None req-a00e927c-ef5f-47f6-8c0a-1dc5156e6f4c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=86412) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 13:47:26 devstack cinder-volume[86412]: DEBUG oslo_concurrency.lockutils [None req-a00e927c-ef5f-47f6-8c0a-1dc5156e6f4c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.562s {{(pid=86412) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:47:26 devstack cinder-volume[86412]: DEBUG oslo_concurrency.processutils [None req-a00e927c-ef5f-47f6-8c0a-1dc5156e6f4c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 {{(pid=86412) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:47:26 devstack sudo[86500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 Jul 13 13:47:26 devstack sudo[86500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:47:27 devstack sudo[86500]: pam_unix(sudo:session): session closed for user root Jul 13 13:47:27 devstack cinder-volume[86412]: DEBUG oslo_concurrency.processutils [None req-a00e927c-ef5f-47f6-8c0a-1dc5156e6f4c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78" returned: 0 in 0.333s {{(pid=86412) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:47:27 devstack cinder-volume[86412]: INFO cinder.volume.driver [None req-a00e927c-ef5f-47f6-8c0a-1dc5156e6f4c None None] Driver hasn't implemented _init_vendor_properties() Jul 13 13:47:27 devstack cinder-volume[86412]: DEBUG cinder.volume.driver [None req-a00e927c-ef5f-47f6-8c0a-1dc5156e6f4c None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7577095031738, 'free_capacity_gb': 1775.7577095031738, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86412) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 13 13:47:27 devstack cinder-volume[86412]: DEBUG oslo_db.sqlalchemy.engines [None req-a00e927c-ef5f-47f6-8c0a-1dc5156e6f4c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86412) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 13 13:47:27 devstack cinder-volume[86412]: DEBUG dbcounter [-] [86412] Writer thread running {{(pid=86412) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 13 13:47:27 devstack cinder-volume[86412]: DEBUG cinder.db.api [None req-a00e927c-ef5f-47f6-8c0a-1dc5156e6f4c None None] Building query based on filter {{(pid=86412) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 13 13:47:27 devstack cinder-volume[86412]: DEBUG cinder.image.image_utils [None req-a00e927c-ef5f-47f6-8c0a-1dc5156e6f4c None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86412) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 13 13:47:27 devstack cinder-volume[86412]: INFO cinder.keymgr.migration [None req-ac65f3da-5452-4696-a66f-c4eac3cbd43c None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 13 13:47:27 devstack cinder-volume[86412]: DEBUG oslo_concurrency.lockutils [None req-a00e927c-ef5f-47f6-8c0a-1dc5156e6f4c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86412) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:47:27 devstack cinder-volume[86412]: DEBUG oslo_concurrency.lockutils [None req-a00e927c-ef5f-47f6-8c0a-1dc5156e6f4c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86412) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:47:27 devstack cinder-volume[86412]: DEBUG cinder.volume.drivers.quobyte [None req-a00e927c-ef5f-47f6-8c0a-1dc5156e6f4c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=86412) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 13:47:27 devstack cinder-volume[86412]: DEBUG cinder.volume.drivers.quobyte [None req-a00e927c-ef5f-47f6-8c0a-1dc5156e6f4c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=86412) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 13:47:27 devstack cinder-volume[86412]: DEBUG oslo_concurrency.lockutils [None req-a00e927c-ef5f-47f6-8c0a-1dc5156e6f4c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86412) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:47:27 devstack cinder-volume[86412]: DEBUG oslo_concurrency.processutils [None req-a00e927c-ef5f-47f6-8c0a-1dc5156e6f4c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 {{(pid=86412) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:47:27 devstack sudo[86536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 Jul 13 13:47:27 devstack sudo[86536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:47:27 devstack sudo[86536]: pam_unix(sudo:session): session closed for user root Jul 13 13:47:27 devstack cinder-volume[86412]: DEBUG oslo_concurrency.processutils [None req-a00e927c-ef5f-47f6-8c0a-1dc5156e6f4c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78" returned: 0 in 0.315s {{(pid=86412) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:47:27 devstack cinder-volume[86412]: DEBUG cinder.manager [None req-a00e927c-ef5f-47f6-8c0a-1dc5156e6f4c None None] Notifying Schedulers of capabilities ... {{(pid=86412) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 13:47:27 devstack cinder-volume[86412]: INFO cinder.volume.manager [None req-a00e927c-ef5f-47f6-8c0a-1dc5156e6f4c None None] Driver initialization completed successfully. Jul 13 13:47:27 devstack cinder-volume[86412]: INFO cinder.manager [None req-a00e927c-ef5f-47f6-8c0a-1dc5156e6f4c None None] Initiating service 3 cleanup Jul 13 13:47:27 devstack cinder-volume[86412]: INFO cinder.manager [None req-a00e927c-ef5f-47f6-8c0a-1dc5156e6f4c None None] Service 3 cleanup completed. Jul 13 13:47:27 devstack cinder-volume[86412]: DEBUG cinder.service [None req-a00e927c-ef5f-47f6-8c0a-1dc5156e6f4c None None] Creating RPC server for service cinder-volume {{(pid=86412) start /opt/stack/cinder/cinder/service.py:231}} Jul 13 13:47:27 devstack cinder-volume[86412]: DEBUG cinder.service [None req-a00e927c-ef5f-47f6-8c0a-1dc5156e6f4c None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86412) start /opt/stack/cinder/cinder/service.py:237}} Jul 13 13:47:28 devstack cinder-volume[86412]: INFO cinder.volume.manager [None req-a00e927c-ef5f-47f6-8c0a-1dc5156e6f4c None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Jul 13 13:47:28 devstack cinder-volume[86412]: DEBUG oslo_concurrency.lockutils [None req-a00e927c-ef5f-47f6-8c0a-1dc5156e6f4c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86412) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:47:28 devstack cinder-volume[86412]: DEBUG oslo_concurrency.lockutils [None req-a00e927c-ef5f-47f6-8c0a-1dc5156e6f4c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86412) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:47:28 devstack cinder-volume[86412]: DEBUG cinder.volume.drivers.quobyte [None req-a00e927c-ef5f-47f6-8c0a-1dc5156e6f4c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=86412) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 13:47:28 devstack cinder-volume[86412]: DEBUG cinder.volume.drivers.quobyte [None req-a00e927c-ef5f-47f6-8c0a-1dc5156e6f4c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=86412) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 13:47:28 devstack cinder-volume[86412]: DEBUG oslo_concurrency.lockutils [None req-a00e927c-ef5f-47f6-8c0a-1dc5156e6f4c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86412) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:47:28 devstack cinder-volume[86412]: DEBUG oslo_concurrency.processutils [None req-a00e927c-ef5f-47f6-8c0a-1dc5156e6f4c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 {{(pid=86412) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:47:28 devstack sudo[86548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 Jul 13 13:47:28 devstack sudo[86548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:47:28 devstack sudo[86548]: pam_unix(sudo:session): session closed for user root Jul 13 13:47:28 devstack cinder-volume[86412]: DEBUG oslo_concurrency.processutils [None req-a00e927c-ef5f-47f6-8c0a-1dc5156e6f4c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78" returned: 0 in 0.377s {{(pid=86412) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:47:28 devstack cinder-volume[86412]: INFO cinder.volume.manager [None req-a00e927c-ef5f-47f6-8c0a-1dc5156e6f4c None None] Driver post RPC initialization completed successfully. Jul 13 13:47:31 devstack cinder-volume[86195]: INFO oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] Caught SIGTERM, stopping children Jul 13 13:47:31 devstack cinder-volume[86195]: DEBUG oslo_concurrency.lockutils [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] Acquiring lock "singleton_lock" {{(pid=86195) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 13 13:47:31 devstack cinder-volume[86195]: DEBUG oslo_concurrency.lockutils [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] Acquired lock "singleton_lock" {{(pid=86195) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 13 13:47:31 devstack cinder-volume[86195]: DEBUG oslo_concurrency.lockutils [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] Releasing lock "singleton_lock" {{(pid=86195) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 13 13:47:31 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] Stop services. {{(pid=86195) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jul 13 13:47:31 devstack cinder-volume[86195]: DEBUG oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] Killing children. {{(pid=86195) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jul 13 13:47:31 devstack cinder-volume[86195]: INFO oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] Waiting on 1 children to exit Jul 13 13:47:32 devstack cinder-volume[86412]: DEBUG oslo_concurrency.lockutils [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] Acquiring lock "singleton_lock" {{(pid=86412) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 13 13:47:32 devstack cinder-volume[86412]: DEBUG oslo_concurrency.lockutils [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] Acquired lock "singleton_lock" {{(pid=86412) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 13 13:47:32 devstack cinder-volume[86412]: DEBUG oslo_concurrency.lockutils [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] Releasing lock "singleton_lock" {{(pid=86412) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 13 13:47:32 devstack cinder-volume[86412]: WARNING amqp [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 13 13:47:32 devstack cinder-volume[86412]: WARNING amqp [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 13 13:47:32 devstack cinder-volume[86195]: INFO oslo_service.backend._eventlet.service [None req-7a0ac896-c061-44e2-a571-4d12ba0d0534 None None] Child 86412 exited with status 0 Jul 13 13:47:32 devstack cinder-volume[86766]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 13 13:47:32 devstack cinder-volume[86766]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 13 13:47:32 devstack cinder-volume[86766]: we strongly recommend against using it for new projects. Jul 13 13:47:32 devstack cinder-volume[86766]: If you are already using Eventlet, we recommend migrating to a different Jul 13 13:47:32 devstack cinder-volume[86766]: framework. For more detail see Jul 13 13:47:32 devstack cinder-volume[86766]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 13 13:47:32 devstack cinder-volume[86766]: import eventlet # noqa Jul 13 13:47:36 devstack cinder-volume[86766]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86766) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 13 13:47:36 devstack cinder-volume[86766]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86766) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 13 13:47:36 devstack cinder-volume[86766]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86766) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 13 13:47:37 devstack cinder-volume[86766]: INFO dbcounter [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] Registered counter for database cinder Jul 13 13:47:37 devstack cinder-volume[86766]: DEBUG oslo_db.sqlalchemy.engines [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86766) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG dbcounter [-] [86766] Writer thread running {{(pid=86766) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 13 13:47:38 devstack cinder-volume[86766]: INFO cinder.rpc [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 13 13:47:38 devstack cinder-volume[86766]: INFO cinder.rpc [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_db.sqlalchemy.engines [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86766) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 13 13:47:38 devstack cinder-volume[86766]: INFO cinder.volume.manager [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] Determined volume DB was empty at startup. Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG cinder.volume.manager [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86766) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 13 13:47:38 devstack cinder-volume[86766]: WARNING stevedore.named [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 13 13:47:38 devstack cinder-volume[86766]: WARNING castellan.key_manager [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 13 13:47:38 devstack cinder-volume[86766]: WARNING cinder.keymgr.conf_key_mgr [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 13 13:47:38 devstack cinder-volume[86766]: INFO cinder.volume.manager [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] Image-volume cache disabled for host devstack@QuobyteHD. Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_db.sqlalchemy.engines [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86766) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 13 13:47:38 devstack cinder-volume[86766]: INFO oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] Starting 1 workers Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] Started child 87098 {{(pid=86766) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] Full set of CONF: {{(pid=86766) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] ******************************************************************************** {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] Configuration options gathered from: {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] ================================================================================ {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] allow_availability_zone_fallback = False {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] allow_compression_on_image_upload = False {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] allowed_direct_url_schemes = [] {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] api_rate_limit = True {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] auth_strategy = keystone {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] backend_availability_zone = None {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] backend_host = None {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:38 devstack cinder-volume[87098]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] backend_name = None {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] backend_stats_polling_interval = 60 {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] backup_api_class = cinder.backup.api.API {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] backup_name_template = backup-%s {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] backup_use_same_host = False {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] backup_use_temp_snapshot = False {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] chap_password = **** {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] chap_username = {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] cinder_internal_tenant_project_id = f23f3258d3f24d7bae257d30c4583ef1 {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] cinder_internal_tenant_user_id = 25e9b69a76a441e6852258f8913f490b {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] cluster = None {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] compression_format = gzip {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] compute_api_class = cinder.compute.nova.API {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] config_dir = [] {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] config_source = [] {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] control_exchange = openstack {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] debug = True {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] default_availability_zone = None {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] default_group_type = None {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] default_volume_type = QuobyteHD {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] disk_geometry = None {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] driver_client_cert = None {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] driver_client_cert_key = None {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] driver_data_namespace = None {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] driver_ssl_cert_path = None {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] driver_ssl_cert_verify = False {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] driver_use_ssl = False {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] enable_new_services = True {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] enable_unsupported_driver = False {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] enabled_backends = ['QuobyteHD'] {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] enforce_multipath_for_image_xfer = False {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] filter_function = None {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] glance_api_insecure = False {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] glance_api_servers = ['http://192.168.122.10/image'] {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] glance_api_ssl_compression = False {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] glance_ca_certificates_file = None {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] glance_catalog_info = image:glance:publicURL {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] glance_certfile = None {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] glance_keyfile = None {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] glance_num_retries = 3 {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] glance_request_timeout = None {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] goodness_function = None {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] graceful_shutdown_timeout = 5 {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] group_api_class = cinder.group.api.API {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] host = devstack {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] image_compress_on_upload = True {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] image_conversion_address_space_limit = 1 {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] image_conversion_cpu_limit = 60 {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] image_conversion_disable = False {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] image_upload_use_cinder_backend = False {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] image_upload_use_internal_tenant = False {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] image_volume_cache_enabled = False {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] image_volume_cache_max_count = 0 {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] image_volume_cache_max_size_gb = 0 {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] init_host_max_objects_retrieval = 0 {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] instance_format = [instance: %(uuid)s] {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] iscsi_target_flags = {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] iscsi_write_cache = on {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] iser_helper = tgtadm {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] iser_ip_address = 192.168.122.10 {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] iser_port = 3260 {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] log_color = False {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] log_config_append = None {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] log_dir = None {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] log_file = None {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] log_options = True {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] log_rotate_interval = 1 {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] log_rotate_interval_type = days {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] log_rotation_type = none {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] max_age = 0 {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] max_logfile_count = 30 {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] max_logfile_size_mb = 200 {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:38 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-4f120210-777e-426a-a9ce-f6a30632feb2 None None] Starting volume driver QuobyteDriver (1.1.14) Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] max_over_subscription_ratio = 20.0 {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] message_reap_interval = 86400 {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] message_ttl = 2592000 {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] migration_create_volume_timeout_secs = 300 {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] monkey_patch = False {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:38 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-4f120210-777e-426a-a9ce-f6a30632feb2 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=87098) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] monkey_patch_modules = [] {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] my_ip = 192.168.122.10 {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] no_snapshot_gb_quota = False {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] num_iser_scan_tries = 3 {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] num_shell_tries = 3 {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] num_volume_device_scan_tries = 3 {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] nvmeof_conn_info_version = 1 {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] nvmet_ns_id = 10 {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] nvmet_port_id = 1 {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] osapi_max_limit = 1000 {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] osapi_volume_ext_list = [] {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] osapi_volume_listen = 0.0.0.0 {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] osapi_volume_listen_port = 8776 {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] osapi_volume_use_ssl = False {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] osapi_volume_workers = None {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] per_volume_size_limit = -1 {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] periodic_fuzzy_delay = 60 {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] periodic_interval = 60 {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] project_id_regex = [0-9a-f\-]+ {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] public_endpoint = None {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] publish_errors = False {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] quota_backup_gigabytes = 1000 {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] quota_backups = 10 {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] quota_gigabytes = 1000 {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] quota_groups = 10 {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] quota_snapshots = 10 {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] quota_volumes = 10 {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] rate_limit_burst = 0 {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] rate_limit_except_level = CRITICAL {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] rate_limit_interval = 0 {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] reinit_driver_count = 3 {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] replication_device = **** {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] report_discard_supported = False {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] report_interval = 120 {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] reservation_clean_interval = 86400 {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] reservation_expire = 86400 {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] reserved_image_namespaces = [] {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] reserved_percentage = 0 {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] rpc_response_timeout = 120 {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] run_external_periodic_tasks = True {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] scst_target_driver = iscsi {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] scst_target_iqn_name = None {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] service_down_time = 720 {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] shell_completion = None {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] snapshot_name_template = snapshot-%s {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] split_loggers = False {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] state_path = /opt/stack/data/cinder {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] storage_availability_zone = nova {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] storage_protocol = iSCSI {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] syslog_log_facility = LOG_USER {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] target_helper = lioadm {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] target_ip_address = 192.168.122.10 {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] target_port = 3260 {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] target_protocol = iscsi {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] target_secondary_ip_addresses = [] {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] trace_flags = None {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] transfer_api_class = cinder.transfer.api.API {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] transport_url = **** {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] until_refresh = 0 {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] use_chap_auth = False {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] use_default_quota_class = True {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] use_journal = False {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] use_json = False {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] use_multipath_for_image_xfer = False {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] use_stderr = False {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] use_syslog = False {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] verify_glance_signatures = enabled {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] volume_api_class = cinder.volume.api.API {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] volume_backend_name = None {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] volume_clear = zero {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] volume_clear_ionice = None {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] volume_clear_size = 0 {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] volume_copy_bps_limit = 0 {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] volume_dd_blocksize = 1M {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] volume_name_template = volume-%s {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] volume_service_inithost_offload = False {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] volume_usage_audit_period = month {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] zoning_mode = None {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] oslo_concurrency.disable_process_locking = False {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] keystone_authtoken.auth_section = None {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] keystone_authtoken.auth_type = password {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] keystone_authtoken.auth_version = None {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] keystone_authtoken.cache = None {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] keystone_authtoken.certfile = None {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] keystone_authtoken.delay_auth_decision = False {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] keystone_authtoken.http_connect_timeout = None {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] keystone_authtoken.include_service_catalog = True {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] keystone_authtoken.insecure = False {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] keystone_authtoken.interface = public {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] keystone_authtoken.keyfile = None {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] keystone_authtoken.memcache_password = {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] keystone_authtoken.memcache_username = {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] keystone_authtoken.region_name = None {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] keystone_authtoken.service_token_roles_required = True {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] keystone_authtoken.service_type = None {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] keystone_authtoken.token_cache_time = 300 {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.10/identity {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] cache.backend = dogpile.cache.null {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] cache.backend_argument = **** {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] cache.backend_expiration_time = None {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] cache.config_prefix = cache.oslo {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] cache.debug_cache_backend = False {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] cache.enable_retry_client = False {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] cache.enable_socket_keepalive = False {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] cache.enabled = False {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] cache.expiration_time = 600 {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] cache.hashclient_retry_attempts = 2 {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] cache.memcache_dead_retry = 300 {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] cache.memcache_pool_maxsize = 10 {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] cache.memcache_sasl_enabled = False {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] cache.password = **** {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] cache.proxies = [] {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] cache.redis_db = 0 {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] cache.redis_sentinel_service_name = mymaster {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] cache.redis_server = localhost:6379 {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] cache.retry_attempts = 2 {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] cache.retry_delay = 0.0 {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] cache.socket_keepalive_count = 1 {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] cache.socket_keepalive_idle = 1 {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] cache.socket_keepalive_interval = 1 {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] cache.socket_timeout = 1.0 {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] cache.tls_allowed_ciphers = None {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] cache.tls_cafile = None {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] cache.tls_certfile = None {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] cache.tls_enabled = False {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] cache.tls_keyfile = None {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] cache.username = None {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] coordination.backend_url = **** {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] database.asyncio_connection = **** {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] database.asyncio_slave_connection = **** {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] database.backend = sqlalchemy {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] database.connection = **** {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] database.connection_debug = 0 {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] database.connection_parameters = {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] database.connection_recycle_time = 3600 {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] database.connection_trace = False {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] database.db_inc_retry_interval = True {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] database.db_max_retries = 20 {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] database.db_max_retry_interval = 10 {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] database.db_retry_interval = 1 {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] database.max_overflow = 50 {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] database.max_pool_size = 5 {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] database.max_retries = 10 {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] database.mysql_wsrep_sync_wait = None {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] database.pool_timeout = None {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] database.retry_interval = 10 {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] database.slave_connection = **** {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] database.sqlite_synchronous = True {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] database.synchronous_reader = True {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] database.use_db_reconnect = False {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] profiler.connection_string = messaging:// {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] profiler.enabled = False {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] profiler.es_doc_type = notification {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] profiler.es_scroll_size = 10000 {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] profiler.es_scroll_time = 2m {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] profiler.filter_error_trace = False {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] profiler.hmac_keys = **** {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] profiler.sentinel_service_name = mymaster {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] profiler.socket_timeout = 0.1 {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] profiler.trace_requests = False {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] profiler.trace_sqlalchemy = False {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] profiler_jaeger.process_tags = {} {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] profiler_jaeger.service_name_prefix = None {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] profiler_otlp.service_name_prefix = None {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] oslo_policy.enforce_new_defaults = True {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] oslo_policy.enforce_scope = False {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] oslo_policy.policy_default_rule = default {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] oslo_policy.policy_file = policy.yaml {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] oslo_policy.remote_timeout = 60.0 {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] privsep_osbrick.group = None {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] privsep_osbrick.helper_command = None {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] privsep_osbrick.user = None {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] cinder_sys_admin.group = None {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] cinder_sys_admin.helper_command = None {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] cinder_sys_admin.user = None {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] service_user.auth_section = None {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] service_user.auth_type = password {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] service_user.cafile = None {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] service_user.certfile = None {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] service_user.collect_timing = False {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] service_user.insecure = False {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] service_user.keyfile = None {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] service_user.send_service_user_token = True {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] service_user.split_loggers = False {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] service_user.timeout = None {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] glance.auth_section = None {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] glance.auth_type = password {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] glance.certfile = None {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] glance.collect_timing = False {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] glance.insecure = False {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] glance.keyfile = None {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] glance.region_name = None {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] glance.split_loggers = False {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] glance.timeout = None {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] backend_defaults.backend_availability_zone = None {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] backend_defaults.chap_password = **** {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] backend_defaults.chap_username = {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] backend_defaults.disk_geometry = None {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] backend_defaults.driver_client_cert = None {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] backend_defaults.driver_client_cert_key = None {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] backend_defaults.driver_data_namespace = None {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] backend_defaults.driver_use_ssl = False {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] backend_defaults.enable_unsupported_driver = False {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] backend_defaults.extra_capabilities = {} {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] backend_defaults.filter_function = None {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] backend_defaults.goodness_function = None {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] backend_defaults.iscsi_target_flags = {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] backend_defaults.iscsi_write_cache = on {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] backend_defaults.iser_helper = tgtadm {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] backend_defaults.iser_ip_address = 192.168.122.10 {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] backend_defaults.iser_port = 3260 {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] backend_defaults.nas_host = {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] backend_defaults.nas_login = admin {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] backend_defaults.nas_mount_options = None {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] backend_defaults.nas_password = **** {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] backend_defaults.nas_private_key = {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] backend_defaults.nas_share_path = {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] backend_defaults.nas_ssh_port = 22 {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] backend_defaults.num_shell_tries = 3 {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] backend_defaults.nvmet_port_id = 1 {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] backend_defaults.quobyte_client_cfg = None {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] backend_defaults.quobyte_volume_url = None {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] backend_defaults.replication_device = **** {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] backend_defaults.report_discard_supported = False {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] backend_defaults.reserved_percentage = 0 {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] backend_defaults.scst_target_driver = iscsi {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] backend_defaults.scst_target_iqn_name = None {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] backend_defaults.storage_protocol = iSCSI {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] backend_defaults.target_helper = tgtadm {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] backend_defaults.target_ip_address = 192.168.122.10 {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] backend_defaults.target_port = 3260 {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] backend_defaults.target_protocol = iscsi {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] backend_defaults.trace_flags = None {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] backend_defaults.unique_fqdn_network = True {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] backend_defaults.use_chap_auth = False {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] backend_defaults.volume_backend_name = None {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] backend_defaults.volume_clear = zero {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] backend_defaults.volume_clear_ionice = None {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] backend_defaults.volume_clear_size = 0 {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] oslo_reports.file_event_handler = None {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] oslo_reports.log_dir = None {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] QuobyteHD.backend_availability_zone = None {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] QuobyteHD.backend_host = None {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] QuobyteHD.chap_password = **** {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] QuobyteHD.chap_username = None {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] QuobyteHD.chiscsi_conf = None {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] QuobyteHD.disk_geometry = None {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] QuobyteHD.driver_client_cert = None {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] QuobyteHD.driver_client_cert_key = None {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] QuobyteHD.driver_data_namespace = None {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] QuobyteHD.driver_use_ssl = None {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] QuobyteHD.extra_capabilities = None {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] QuobyteHD.filter_function = None {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] QuobyteHD.goodness_function = None {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] QuobyteHD.iscsi_target_flags = None {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] QuobyteHD.iscsi_write_cache = None {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] QuobyteHD.iser_helper = None {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] QuobyteHD.iser_ip_address = None {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] QuobyteHD.iser_port = None {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] QuobyteHD.iser_target_prefix = None {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] QuobyteHD.nas_host = None {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] QuobyteHD.nas_login = None {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] QuobyteHD.nas_mount_options = None {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] QuobyteHD.nas_password = **** {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] QuobyteHD.nas_private_key = None {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] QuobyteHD.nas_share_path = None {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] QuobyteHD.nas_ssh_port = None {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-4f120210-777e-426a-a9ce-f6a30632feb2 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=87098) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Jul 13 13:47:38 devstack cinder-volume[87098]: WARNING cinder.volume.drivers.quobyte [None req-4f120210-777e-426a-a9ce-f6a30632feb2 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jul 13 13:47:38 devstack cinder-volume[87098]: WARNING cinder.volume.drivers.quobyte [None req-4f120210-777e-426a-a9ce-f6a30632feb2 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] QuobyteHD.num_shell_tries = None {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] QuobyteHD.nvmet_ns_id = None {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] QuobyteHD.nvmet_port_id = None {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-4f120210-777e-426a-a9ce-f6a30632feb2 None None] Running cmd (subprocess): mount.quobyte {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:47:38 devstack quobyte-client[87103]: Reading configuration file: /etc/quobyte/client.cfg Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack quobyte-client[87103]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] QuobyteHD.replication_device = **** {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] QuobyteHD.report_discard_supported = None {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] QuobyteHD.reserved_percentage = None {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] QuobyteHD.scst_target_driver = None {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] QuobyteHD.storage_protocol = None {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] QuobyteHD.target_helper = None {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] QuobyteHD.target_ip_address = None {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] QuobyteHD.target_port = None {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] QuobyteHD.target_prefix = None {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] QuobyteHD.target_protocol = None {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] QuobyteHD.trace_flags = None {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] QuobyteHD.unique_fqdn_network = None {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] QuobyteHD.use_chap_auth = None {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] QuobyteHD.volume_clear = None {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] QuobyteHD.volume_clear_ionice = None {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] QuobyteHD.volume_clear_size = None {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] QuobyteHD.volumes_dir = None {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] oslo_messaging_rabbit.ssl = False {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] oslo_messaging_rabbit.ssl_version = {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] oslo_messaging_notifications.driver = [] {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] oslo_messaging_notifications.retry = -1 {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] oslo_messaging_notifications.transport_url = **** {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] key_manager.fixed_key = **** {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] barbican.barbican_api_version = None {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] barbican.barbican_endpoint = None {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] barbican.barbican_endpoint_type = public {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] barbican.barbican_region_name = None {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] barbican.cafile = None {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] barbican.certfile = None {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] barbican.collect_timing = False {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] barbican.insecure = False {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] barbican.keyfile = None {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] barbican.number_of_retries = 60 {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] barbican.retry_delay = 1 {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] barbican.send_service_user_token = False {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] barbican.split_loggers = False {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] barbican.timeout = None {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] barbican.verify_ssl = True {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] barbican.verify_ssl_path = None {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] barbican_service_user.auth_section = None {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] barbican_service_user.auth_type = None {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] barbican_service_user.cafile = None {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] barbican_service_user.certfile = None {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] barbican_service_user.collect_timing = False {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] barbican_service_user.insecure = False {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] barbican_service_user.keyfile = None {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] barbican_service_user.split_loggers = False {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] barbican_service_user.timeout = None {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] vault.approle_role_id = **** {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] vault.approle_secret_id = **** {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] vault.auth_method = approle {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] vault.auth_path = None {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] vault.kv_mountpoint = secret {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] vault.kv_path = None {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] vault.kv_version = 2 {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] vault.namespace = None {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] vault.root_token_id = **** {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] vault.ssl_ca_crt_file = None {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] vault.timeout = 60.0 {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] vault.token_file = None {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] vault.token_role = None {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-4f120210-777e-426a-a9ce-f6a30632feb2 None None] CMD "mount.quobyte" returned: 1 in 0.093s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:47:38 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-4f120210-777e-426a-a9ce-f6a30632feb2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:47:38 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-4f120210-777e-426a-a9ce-f6a30632feb2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:47:38 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-4f120210-777e-426a-a9ce-f6a30632feb2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] vault.use_ssl = False {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 13 13:47:38 devstack cinder-volume[86766]: DEBUG oslo_service.backend._eventlet.service [None req-9b4f33d2-eea8-4356-91fa-7b3e7754d645 None None] ******************************************************************************** {{(pid=86766) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 13 13:47:38 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-4f120210-777e-426a-a9ce-f6a30632feb2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 13:47:38 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-4f120210-777e-426a-a9ce-f6a30632feb2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:47:38 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-4f120210-777e-426a-a9ce-f6a30632feb2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:47:38 devstack sudo[87110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 Jul 13 13:47:38 devstack sudo[87110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:47:39 devstack sudo[87110]: pam_unix(sudo:session): session closed for user root Jul 13 13:47:39 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-4f120210-777e-426a-a9ce-f6a30632feb2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78" returned: 0 in 0.306s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:47:39 devstack cinder-volume[87098]: INFO cinder.volume.driver [None req-4f120210-777e-426a-a9ce-f6a30632feb2 None None] Driver hasn't implemented _init_vendor_properties() Jul 13 13:47:39 devstack cinder-volume[87098]: DEBUG cinder.volume.driver [None req-4f120210-777e-426a-a9ce-f6a30632feb2 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7577095031738, 'free_capacity_gb': 1775.7577095031738, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87098) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 13 13:47:39 devstack cinder-volume[87098]: DEBUG oslo_db.sqlalchemy.engines [None req-4f120210-777e-426a-a9ce-f6a30632feb2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87098) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 13 13:47:39 devstack cinder-volume[87098]: DEBUG dbcounter [-] [87098] Writer thread running {{(pid=87098) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 13 13:47:39 devstack cinder-volume[87098]: DEBUG cinder.db.api [None req-4f120210-777e-426a-a9ce-f6a30632feb2 None None] Building query based on filter {{(pid=87098) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 13 13:47:39 devstack cinder-volume[87098]: DEBUG cinder.image.image_utils [None req-4f120210-777e-426a-a9ce-f6a30632feb2 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=87098) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 13 13:47:39 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-4f120210-777e-426a-a9ce-f6a30632feb2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:47:39 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-4f120210-777e-426a-a9ce-f6a30632feb2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:47:39 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-4f120210-777e-426a-a9ce-f6a30632feb2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 13:47:39 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-4f120210-777e-426a-a9ce-f6a30632feb2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 13:47:39 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-4f120210-777e-426a-a9ce-f6a30632feb2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:47:39 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-4f120210-777e-426a-a9ce-f6a30632feb2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:47:39 devstack cinder-volume[87098]: INFO cinder.keymgr.migration [None req-d6939b1b-bf22-4017-9cdf-f5af124cd747 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 13 13:47:39 devstack sudo[87122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 Jul 13 13:47:39 devstack sudo[87122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:47:39 devstack sudo[87122]: pam_unix(sudo:session): session closed for user root Jul 13 13:47:39 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-4f120210-777e-426a-a9ce-f6a30632feb2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78" returned: 0 in 0.283s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:47:39 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-4f120210-777e-426a-a9ce-f6a30632feb2 None None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 13:47:39 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-4f120210-777e-426a-a9ce-f6a30632feb2 None None] Driver initialization completed successfully. Jul 13 13:47:39 devstack cinder-volume[87098]: INFO cinder.manager [None req-4f120210-777e-426a-a9ce-f6a30632feb2 None None] Initiating service 3 cleanup Jul 13 13:47:39 devstack cinder-volume[87098]: INFO cinder.manager [None req-4f120210-777e-426a-a9ce-f6a30632feb2 None None] Service 3 cleanup completed. Jul 13 13:47:39 devstack cinder-volume[87098]: DEBUG cinder.service [None req-4f120210-777e-426a-a9ce-f6a30632feb2 None None] Creating RPC server for service cinder-volume {{(pid=87098) start /opt/stack/cinder/cinder/service.py:231}} Jul 13 13:47:39 devstack cinder-volume[87098]: DEBUG cinder.service [None req-4f120210-777e-426a-a9ce-f6a30632feb2 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=87098) start /opt/stack/cinder/cinder/service.py:237}} Jul 13 13:47:39 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-4f120210-777e-426a-a9ce-f6a30632feb2 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Jul 13 13:47:39 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-4f120210-777e-426a-a9ce-f6a30632feb2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:47:39 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-4f120210-777e-426a-a9ce-f6a30632feb2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:47:39 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-4f120210-777e-426a-a9ce-f6a30632feb2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 13:47:39 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-4f120210-777e-426a-a9ce-f6a30632feb2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 13:47:39 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-4f120210-777e-426a-a9ce-f6a30632feb2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:47:39 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-4f120210-777e-426a-a9ce-f6a30632feb2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:47:39 devstack sudo[87133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 Jul 13 13:47:39 devstack sudo[87133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:47:39 devstack sudo[87133]: pam_unix(sudo:session): session closed for user root Jul 13 13:47:39 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-4f120210-777e-426a-a9ce-f6a30632feb2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78" returned: 0 in 0.269s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:47:39 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-4f120210-777e-426a-a9ce-f6a30632feb2 None None] Driver post RPC initialization completed successfully. Jul 13 13:47:48 devstack cinder-volume[86766]: DEBUG dbcounter [-] [86766] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=86766) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 13 13:47:49 devstack cinder-volume[87098]: DEBUG dbcounter [-] [87098] Writing DB stats cinder:SELECT=2 {{(pid=87098) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 13 13:47:49 devstack cinder-volume[87098]: DEBUG dbcounter [-] [87098] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=87098) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 13 13:48:29 devstack cinder-volume[87098]: DEBUG oslo_service.periodic_task [None req-727a1692-ea28-4a77-b327-0d94e8f01efb None None] Running periodic task VolumeManager._thread_info {{(pid=87098) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 13 13:48:29 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-727a1692-ea28-4a77-b327-0d94e8f01efb None None] thread count: 6 {{(pid=87098) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 13 13:48:29 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-727a1692-ea28-4a77-b327-0d94e8f01efb None None] thread info: [<_MainThread(MainThread, started 127988054597760)>, , , , , ] {{(pid=87098) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 13 13:48:39 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-2463a0ea-5c17-4e79-8213-9d287fda6137 tempest-TaggedAttachmentsTest-1735047278 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 13:48:39 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-2463a0ea-5c17-4e79-8213-9d287fda6137 tempest-TaggedAttachmentsTest-1735047278 None] Flow 'volume_create_manager' (61d2e954-06db-4f48-a7d4-794917e8521f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 13:48:39 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-2463a0ea-5c17-4e79-8213-9d287fda6137 tempest-TaggedAttachmentsTest-1735047278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef2f35da-ff10-48f8-b0a2-4d4cc9af1c02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:48:39 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-2463a0ea-5c17-4e79-8213-9d287fda6137 tempest-TaggedAttachmentsTest-1735047278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef2f35da-ff10-48f8-b0a2-4d4cc9af1c02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T11:48:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-2114944984',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=daac9ea7-4832-4a55-993c-de92f42b67a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c998ceb0c42447989cd3a6d9fc8263ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T11:48:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T11:48:39Z,use_quota=True,user_id='bb98b9e6457d404dad68e8762c4d3124',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1147de8b-623b-426c-a13d-7fc824a80f67),volume_type_id=1147de8b-623b-426c-a13d-7fc824a80f67)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:48:39 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-2463a0ea-5c17-4e79-8213-9d287fda6137 tempest-TaggedAttachmentsTest-1735047278 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dbcab25a-38ba-4890-88a8-ff36488fe224) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:48:39 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-2463a0ea-5c17-4e79-8213-9d287fda6137 tempest-TaggedAttachmentsTest-1735047278 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dbcab25a-38ba-4890-88a8-ff36488fe224) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:48:39 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-2463a0ea-5c17-4e79-8213-9d287fda6137 tempest-TaggedAttachmentsTest-1735047278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa7b3a75-9925-46b0-855c-edaadab3fbb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:48:39 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-2463a0ea-5c17-4e79-8213-9d287fda6137 tempest-TaggedAttachmentsTest-1735047278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa7b3a75-9925-46b0-855c-edaadab3fbb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'daac9ea7-4832-4a55-993c-de92f42b67a5', 'volume_name': 'volume-daac9ea7-4832-4a55-993c-de92f42b67a5', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:48:39 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-2463a0ea-5c17-4e79-8213-9d287fda6137 tempest-TaggedAttachmentsTest-1735047278 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01916d2e-fb35-40d0-9921-f703404f10ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:48:39 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-2463a0ea-5c17-4e79-8213-9d287fda6137 tempest-TaggedAttachmentsTest-1735047278 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01916d2e-fb35-40d0-9921-f703404f10ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:48:39 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-2463a0ea-5c17-4e79-8213-9d287fda6137 tempest-TaggedAttachmentsTest-1735047278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b3fe6ed-00ed-48eb-9575-509eacc1c976) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:48:39 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-2463a0ea-5c17-4e79-8213-9d287fda6137 tempest-TaggedAttachmentsTest-1735047278 None] Volume daac9ea7-4832-4a55-993c-de92f42b67a5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-daac9ea7-4832-4a55-993c-de92f42b67a5', 'volume_size': 1} Jul 13 13:48:39 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-2463a0ea-5c17-4e79-8213-9d287fda6137 tempest-TaggedAttachmentsTest-1735047278 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:48:39 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-2463a0ea-5c17-4e79-8213-9d287fda6137 tempest-TaggedAttachmentsTest-1735047278 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:48:39 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-2463a0ea-5c17-4e79-8213-9d287fda6137 tempest-TaggedAttachmentsTest-1735047278 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T11:48:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-2114944984',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=daac9ea7-4832-4a55-993c-de92f42b67a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c998ceb0c42447989cd3a6d9fc8263ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T11:48:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T11:48:39Z,use_quota=True,user_id='bb98b9e6457d404dad68e8762c4d3124',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1147de8b-623b-426c-a13d-7fc824a80f67),volume_type_id=1147de8b-623b-426c-a13d-7fc824a80f67)}" {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 13 13:48:39 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-2463a0ea-5c17-4e79-8213-9d287fda6137 tempest-TaggedAttachmentsTest-1735047278 None] Creating volume daac9ea7-4832-4a55-993c-de92f42b67a5 {{(pid=87098) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 13 13:48:39 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-2463a0ea-5c17-4e79-8213-9d287fda6137 tempest-TaggedAttachmentsTest-1735047278 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:48:39 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-2463a0ea-5c17-4e79-8213-9d287fda6137 tempest-TaggedAttachmentsTest-1735047278 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:48:39 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-2463a0ea-5c17-4e79-8213-9d287fda6137 tempest-TaggedAttachmentsTest-1735047278 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 13:48:39 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-2463a0ea-5c17-4e79-8213-9d287fda6137 tempest-TaggedAttachmentsTest-1735047278 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 13:48:39 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-2463a0ea-5c17-4e79-8213-9d287fda6137 tempest-TaggedAttachmentsTest-1735047278 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:48:39 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-2463a0ea-5c17-4e79-8213-9d287fda6137 tempest-TaggedAttachmentsTest-1735047278 None] Selected osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 13:48:39 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-2463a0ea-5c17-4e79-8213-9d287fda6137 tempest-TaggedAttachmentsTest-1735047278 None] casted to osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 Jul 13 13:48:39 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-2463a0ea-5c17-4e79-8213-9d287fda6137 tempest-TaggedAttachmentsTest-1735047278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-daac9ea7-4832-4a55-993c-de92f42b67a5 1073741824 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:48:39 devstack sudo[87357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-daac9ea7-4832-4a55-993c-de92f42b67a5 1073741824 Jul 13 13:48:39 devstack sudo[87357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:48:39 devstack sudo[87357]: pam_unix(sudo:session): session closed for user root Jul 13 13:48:39 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-2463a0ea-5c17-4e79-8213-9d287fda6137 tempest-TaggedAttachmentsTest-1735047278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-daac9ea7-4832-4a55-993c-de92f42b67a5 1073741824" returned: 0 in 0.603s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:48:39 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-2463a0ea-5c17-4e79-8213-9d287fda6137 tempest-TaggedAttachmentsTest-1735047278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-daac9ea7-4832-4a55-993c-de92f42b67a5 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:48:39 devstack sudo[87675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-daac9ea7-4832-4a55-993c-de92f42b67a5 Jul 13 13:48:39 devstack sudo[87675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:48:40 devstack sudo[87675]: pam_unix(sudo:session): session closed for user root Jul 13 13:48:40 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-2463a0ea-5c17-4e79-8213-9d287fda6137 tempest-TaggedAttachmentsTest-1735047278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-daac9ea7-4832-4a55-993c-de92f42b67a5" returned: 0 in 0.361s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:48:40 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-2463a0ea-5c17-4e79-8213-9d287fda6137 tempest-TaggedAttachmentsTest-1735047278 None] <== create_volume: return (1020ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'} {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 13 13:48:40 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-2463a0ea-5c17-4e79-8213-9d287fda6137 tempest-TaggedAttachmentsTest-1735047278 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.024s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:48:40 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-2463a0ea-5c17-4e79-8213-9d287fda6137 tempest-TaggedAttachmentsTest-1735047278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b3fe6ed-00ed-48eb-9575-509eacc1c976) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-daac9ea7-4832-4a55-993c-de92f42b67a5', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:48:40 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-2463a0ea-5c17-4e79-8213-9d287fda6137 tempest-TaggedAttachmentsTest-1735047278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ae906a8-6ab8-452b-a107-2bc9fdb17f63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:48:40 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-2463a0ea-5c17-4e79-8213-9d287fda6137 tempest-TaggedAttachmentsTest-1735047278 None] Volume volume-daac9ea7-4832-4a55-993c-de92f42b67a5 (daac9ea7-4832-4a55-993c-de92f42b67a5): created successfully Jul 13 13:48:40 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-2463a0ea-5c17-4e79-8213-9d287fda6137 tempest-TaggedAttachmentsTest-1735047278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ae906a8-6ab8-452b-a107-2bc9fdb17f63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:48:40 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-2463a0ea-5c17-4e79-8213-9d287fda6137 tempest-TaggedAttachmentsTest-1735047278 None] Flow 'volume_create_manager' (61d2e954-06db-4f48-a7d4-794917e8521f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 13:48:40 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-2463a0ea-5c17-4e79-8213-9d287fda6137 tempest-TaggedAttachmentsTest-1735047278 None] Created volume successfully. Jul 13 13:48:50 devstack cinder-volume[87098]: DEBUG dbcounter [-] [87098] Writing DB stats cinder:UPDATE=5,cinder:SELECT=2,cinder:INSERT=1 {{(pid=87098) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 13 13:48:50 devstack cinder-volume[87098]: DEBUG dbcounter [-] [87098] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1,cinder:DELETE=1 {{(pid=87098) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 13 13:49:08 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-e3176bfb-6503-4c30-b0ff-50b9f0542ee5 tempest-VolumesAdminNegativeTest-710152774 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 13:49:08 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-e3176bfb-6503-4c30-b0ff-50b9f0542ee5 tempest-VolumesAdminNegativeTest-710152774 None] Flow 'volume_create_manager' (96ce6f48-932f-46da-9fe2-2248f8c46dc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 13:49:08 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-e3176bfb-6503-4c30-b0ff-50b9f0542ee5 tempest-VolumesAdminNegativeTest-710152774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7bed3e7-4f6d-4938-bbc5-ccb5f057be88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:49:08 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-e3176bfb-6503-4c30-b0ff-50b9f0542ee5 tempest-VolumesAdminNegativeTest-710152774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7bed3e7-4f6d-4938-bbc5-ccb5f057be88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T11:49:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1872431512',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36bbdcba-ff64-40d6-908e-eb72a4a80843,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37f1708b71eb4780ba441d68ed29b885',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T11:49:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T11:49:08Z,use_quota=True,user_id='7c8fb50cae4740259e1031fe74d3d00b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1147de8b-623b-426c-a13d-7fc824a80f67),volume_type_id=1147de8b-623b-426c-a13d-7fc824a80f67)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:49:08 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-e3176bfb-6503-4c30-b0ff-50b9f0542ee5 tempest-VolumesAdminNegativeTest-710152774 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0819cef4-1e8c-4870-87e9-cd6c614f5fab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:49:08 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-e3176bfb-6503-4c30-b0ff-50b9f0542ee5 tempest-VolumesAdminNegativeTest-710152774 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0819cef4-1e8c-4870-87e9-cd6c614f5fab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:49:08 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-e3176bfb-6503-4c30-b0ff-50b9f0542ee5 tempest-VolumesAdminNegativeTest-710152774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f4031a4-6200-44db-92d3-86c96a3add74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:49:08 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-e3176bfb-6503-4c30-b0ff-50b9f0542ee5 tempest-VolumesAdminNegativeTest-710152774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f4031a4-6200-44db-92d3-86c96a3add74) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '36bbdcba-ff64-40d6-908e-eb72a4a80843', 'volume_name': 'volume-36bbdcba-ff64-40d6-908e-eb72a4a80843', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:49:08 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-e3176bfb-6503-4c30-b0ff-50b9f0542ee5 tempest-VolumesAdminNegativeTest-710152774 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6bbeeb9-d3e9-471d-a352-3b04229e0493) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:49:08 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-e3176bfb-6503-4c30-b0ff-50b9f0542ee5 tempest-VolumesAdminNegativeTest-710152774 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6bbeeb9-d3e9-471d-a352-3b04229e0493) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:49:08 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-e3176bfb-6503-4c30-b0ff-50b9f0542ee5 tempest-VolumesAdminNegativeTest-710152774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb33d9b4-26e6-449f-bd59-b85d3f254b54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:49:08 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-e3176bfb-6503-4c30-b0ff-50b9f0542ee5 tempest-VolumesAdminNegativeTest-710152774 None] Volume 36bbdcba-ff64-40d6-908e-eb72a4a80843: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-36bbdcba-ff64-40d6-908e-eb72a4a80843', 'volume_size': 1} Jul 13 13:49:08 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-e3176bfb-6503-4c30-b0ff-50b9f0542ee5 tempest-VolumesAdminNegativeTest-710152774 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:49:08 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-e3176bfb-6503-4c30-b0ff-50b9f0542ee5 tempest-VolumesAdminNegativeTest-710152774 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:49:08 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-e3176bfb-6503-4c30-b0ff-50b9f0542ee5 tempest-VolumesAdminNegativeTest-710152774 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T11:49:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1872431512',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36bbdcba-ff64-40d6-908e-eb72a4a80843,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37f1708b71eb4780ba441d68ed29b885',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T11:49:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T11:49:08Z,use_quota=True,user_id='7c8fb50cae4740259e1031fe74d3d00b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1147de8b-623b-426c-a13d-7fc824a80f67),volume_type_id=1147de8b-623b-426c-a13d-7fc824a80f67)}" {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 13 13:49:08 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-e3176bfb-6503-4c30-b0ff-50b9f0542ee5 tempest-VolumesAdminNegativeTest-710152774 None] Creating volume 36bbdcba-ff64-40d6-908e-eb72a4a80843 {{(pid=87098) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 13 13:49:08 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-e3176bfb-6503-4c30-b0ff-50b9f0542ee5 tempest-VolumesAdminNegativeTest-710152774 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:49:08 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-e3176bfb-6503-4c30-b0ff-50b9f0542ee5 tempest-VolumesAdminNegativeTest-710152774 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:49:08 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-e3176bfb-6503-4c30-b0ff-50b9f0542ee5 tempest-VolumesAdminNegativeTest-710152774 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 13:49:08 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-e3176bfb-6503-4c30-b0ff-50b9f0542ee5 tempest-VolumesAdminNegativeTest-710152774 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 13:49:08 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-e3176bfb-6503-4c30-b0ff-50b9f0542ee5 tempest-VolumesAdminNegativeTest-710152774 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:49:08 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-e3176bfb-6503-4c30-b0ff-50b9f0542ee5 tempest-VolumesAdminNegativeTest-710152774 None] Selected osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 13:49:08 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-e3176bfb-6503-4c30-b0ff-50b9f0542ee5 tempest-VolumesAdminNegativeTest-710152774 None] casted to osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 Jul 13 13:49:08 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-e3176bfb-6503-4c30-b0ff-50b9f0542ee5 tempest-VolumesAdminNegativeTest-710152774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-36bbdcba-ff64-40d6-908e-eb72a4a80843 1073741824 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:49:08 devstack sudo[88114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-36bbdcba-ff64-40d6-908e-eb72a4a80843 1073741824 Jul 13 13:49:08 devstack sudo[88114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:49:09 devstack sudo[88114]: pam_unix(sudo:session): session closed for user root Jul 13 13:49:09 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-e3176bfb-6503-4c30-b0ff-50b9f0542ee5 tempest-VolumesAdminNegativeTest-710152774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-36bbdcba-ff64-40d6-908e-eb72a4a80843 1073741824" returned: 0 in 0.998s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:49:09 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-e3176bfb-6503-4c30-b0ff-50b9f0542ee5 tempest-VolumesAdminNegativeTest-710152774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-36bbdcba-ff64-40d6-908e-eb72a4a80843 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:49:09 devstack sudo[88146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-36bbdcba-ff64-40d6-908e-eb72a4a80843 Jul 13 13:49:09 devstack sudo[88146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:49:10 devstack sudo[88146]: pam_unix(sudo:session): session closed for user root Jul 13 13:49:10 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-e3176bfb-6503-4c30-b0ff-50b9f0542ee5 tempest-VolumesAdminNegativeTest-710152774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-36bbdcba-ff64-40d6-908e-eb72a4a80843" returned: 0 in 0.484s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:49:10 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-e3176bfb-6503-4c30-b0ff-50b9f0542ee5 tempest-VolumesAdminNegativeTest-710152774 None] <== create_volume: return (1567ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'} {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 13 13:49:10 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-e3176bfb-6503-4c30-b0ff-50b9f0542ee5 tempest-VolumesAdminNegativeTest-710152774 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.572s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:49:10 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-e3176bfb-6503-4c30-b0ff-50b9f0542ee5 tempest-VolumesAdminNegativeTest-710152774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb33d9b4-26e6-449f-bd59-b85d3f254b54) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-36bbdcba-ff64-40d6-908e-eb72a4a80843', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:49:10 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-e3176bfb-6503-4c30-b0ff-50b9f0542ee5 tempest-VolumesAdminNegativeTest-710152774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea561a03-e77d-477a-b400-7f41915b53a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:49:10 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-e3176bfb-6503-4c30-b0ff-50b9f0542ee5 tempest-VolumesAdminNegativeTest-710152774 None] Volume volume-36bbdcba-ff64-40d6-908e-eb72a4a80843 (36bbdcba-ff64-40d6-908e-eb72a4a80843): created successfully Jul 13 13:49:10 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-e3176bfb-6503-4c30-b0ff-50b9f0542ee5 tempest-VolumesAdminNegativeTest-710152774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea561a03-e77d-477a-b400-7f41915b53a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:49:10 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-e3176bfb-6503-4c30-b0ff-50b9f0542ee5 tempest-VolumesAdminNegativeTest-710152774 None] Flow 'volume_create_manager' (96ce6f48-932f-46da-9fe2-2248f8c46dc6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 13:49:10 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-e3176bfb-6503-4c30-b0ff-50b9f0542ee5 tempest-VolumesAdminNegativeTest-710152774 None] Created volume successfully. Jul 13 13:49:11 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-2dcb24e5-4556-4da2-96be-53748682dcb4 tempest-VolumesAdminNegativeTest-710152774 None] Acquiring lock "cinder-36bbdcba-ff64-40d6-908e-eb72a4a80843-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 13:49:11 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-2dcb24e5-4556-4da2-96be-53748682dcb4 tempest-VolumesAdminNegativeTest-710152774 None] Lock "cinder-36bbdcba-ff64-40d6-908e-eb72a4a80843-delete_volume" acquired by "delete_volume" :: waited 0.070s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 13:49:11 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-2dcb24e5-4556-4da2-96be-53748682dcb4 tempest-VolumesAdminNegativeTest-710152774 None] Acquiring lock "cinder-quobyte-36bbdcba-ff64-40d6-908e-eb72a4a80843" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 13:49:11 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-2dcb24e5-4556-4da2-96be-53748682dcb4 tempest-VolumesAdminNegativeTest-710152774 None] Lock "cinder-quobyte-36bbdcba-ff64-40d6-908e-eb72a4a80843" acquired by "delete_volume" :: waited 0.033s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 13:49:11 devstack cinder-volume[87098]: INFO oslo.privsep.daemon [None req-2dcb24e5-4556-4da2-96be-53748682dcb4 tempest-VolumesAdminNegativeTest-710152774 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmp34clbg9n/privsep.sock'] Jul 13 13:49:11 devstack sudo[88150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmp34clbg9n/privsep.sock Jul 13 13:49:11 devstack sudo[88150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:49:13 devstack cinder-volume[87098]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning: Jul 13 13:49:13 devstack cinder-volume[87098]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 13 13:49:13 devstack cinder-volume[87098]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jul 13 13:49:13 devstack cinder-volume[87098]: WARNING oslo.privsep.daemon [-] privsep log: Jul 13 13:49:13 devstack cinder-volume[87098]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jul 13 13:49:13 devstack cinder-volume[87098]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jul 13 13:49:13 devstack cinder-volume[87098]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 13 13:49:13 devstack cinder-volume[87098]: WARNING oslo.privsep.daemon [-] privsep log: Jul 13 13:49:13 devstack cinder-volume[87098]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Jul 13 13:49:13 devstack sudo[88150]: pam_unix(sudo:session): session closed for user root Jul 13 13:49:13 devstack cinder-volume[87098]: INFO oslo.privsep.daemon [None req-2dcb24e5-4556-4da2-96be-53748682dcb4 tempest-VolumesAdminNegativeTest-710152774 None] Spawned new privsep daemon via rootwrap Jul 13 13:49:13 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [None req-2dcb24e5-4556-4da2-96be-53748682dcb4 tempest-VolumesAdminNegativeTest-710152774 None] Accepted privsep connection to /tmp/tmp34clbg9n/privsep.sock {{(pid=87098) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Jul 13 13:49:13 devstack cinder-volume[87098]: INFO oslo.privsep.daemon [-] privsep daemon starting Jul 13 13:49:13 devstack cinder-volume[87098]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Jul 13 13:49:13 devstack cinder-volume[87098]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Jul 13 13:49:13 devstack cinder-volume[87098]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 88154 Jul 13 13:49:13 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3fc139b-3c8f-46bc-8590-9a8b4a9dc65a]: (2,) {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 13:49:13 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[b203a825-3c39-4cdd-87a3-a674d848c32e]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 13:49:13 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-2dcb24e5-4556-4da2-96be-53748682dcb4 tempest-VolumesAdminNegativeTest-710152774 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-36bbdcba-ff64-40d6-908e-eb72a4a80843 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:49:14 devstack sudo[88158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-36bbdcba-ff64-40d6-908e-eb72a4a80843 Jul 13 13:49:14 devstack sudo[88158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:49:14 devstack sudo[88158]: pam_unix(sudo:session): session closed for user root Jul 13 13:49:14 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-2dcb24e5-4556-4da2-96be-53748682dcb4 tempest-VolumesAdminNegativeTest-710152774 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-36bbdcba-ff64-40d6-908e-eb72a4a80843" returned: 0 in 0.672s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:49:14 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-2dcb24e5-4556-4da2-96be-53748682dcb4 tempest-VolumesAdminNegativeTest-710152774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-36bbdcba-ff64-40d6-908e-eb72a4a80843 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:49:14 devstack sudo[88163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-36bbdcba-ff64-40d6-908e-eb72a4a80843 Jul 13 13:49:14 devstack sudo[88163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:49:14 devstack sudo[88163]: pam_unix(sudo:session): session closed for user root Jul 13 13:49:14 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-2dcb24e5-4556-4da2-96be-53748682dcb4 tempest-VolumesAdminNegativeTest-710152774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-36bbdcba-ff64-40d6-908e-eb72a4a80843" returned: 0 in 0.375s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:49:14 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-2dcb24e5-4556-4da2-96be-53748682dcb4 tempest-VolumesAdminNegativeTest-710152774 None] Lock "cinder-quobyte-36bbdcba-ff64-40d6-908e-eb72a4a80843" released by "delete_volume" :: held 3.420s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 13:49:15 devstack cinder-volume[87098]: WARNING cinder.quota [None req-2dcb24e5-4556-4da2-96be-53748682dcb4 tempest-VolumesAdminNegativeTest-710152774 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 13 13:49:15 devstack cinder-volume[87098]: WARNING cinder.quota [None req-2dcb24e5-4556-4da2-96be-53748682dcb4 tempest-VolumesAdminNegativeTest-710152774 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 13 13:49:15 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-2dcb24e5-4556-4da2-96be-53748682dcb4 tempest-VolumesAdminNegativeTest-710152774 None] Created reservations ['f0e347ad-8121-41ad-8f8a-3c52cfca1e35', 'ff1181b4-9530-4c57-9bbc-1bf2be50366d', '64e3762e-f4a4-4313-a355-1f3493226b8b', '39d09dd1-004d-4cc7-8477-77632fec706f'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 13:49:15 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-2dcb24e5-4556-4da2-96be-53748682dcb4 tempest-VolumesAdminNegativeTest-710152774 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:49:15 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-2dcb24e5-4556-4da2-96be-53748682dcb4 tempest-VolumesAdminNegativeTest-710152774 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:49:15 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-2dcb24e5-4556-4da2-96be-53748682dcb4 tempest-VolumesAdminNegativeTest-710152774 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 13:49:15 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-2dcb24e5-4556-4da2-96be-53748682dcb4 tempest-VolumesAdminNegativeTest-710152774 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 13:49:15 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-2dcb24e5-4556-4da2-96be-53748682dcb4 tempest-VolumesAdminNegativeTest-710152774 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:49:15 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-2dcb24e5-4556-4da2-96be-53748682dcb4 tempest-VolumesAdminNegativeTest-710152774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:49:15 devstack sudo[88166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 Jul 13 13:49:15 devstack sudo[88166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:49:15 devstack sudo[88166]: pam_unix(sudo:session): session closed for user root Jul 13 13:49:15 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-2dcb24e5-4556-4da2-96be-53748682dcb4 tempest-VolumesAdminNegativeTest-710152774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78" returned: 0 in 0.387s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:49:15 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-2dcb24e5-4556-4da2-96be-53748682dcb4 tempest-VolumesAdminNegativeTest-710152774 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 13:49:15 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-2dcb24e5-4556-4da2-96be-53748682dcb4 tempest-VolumesAdminNegativeTest-710152774 None] Deleted volume successfully. Jul 13 13:49:15 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-2dcb24e5-4556-4da2-96be-53748682dcb4 tempest-VolumesAdminNegativeTest-710152774 None] Lock "cinder-36bbdcba-ff64-40d6-908e-eb72a4a80843-delete_volume" released by "delete_volume" :: held 4.192s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 13:49:25 devstack cinder-volume[87098]: DEBUG dbcounter [-] [87098] Writing DB stats cinder:SELECT=8,cinder:UPDATE=10,cinder:DELETE=1,cinder:INSERT=2 {{(pid=87098) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 13 13:49:25 devstack cinder-volume[87098]: DEBUG dbcounter [-] [87098] Writing DB stats cinder:SELECT=6,cinder:UPDATE=12,cinder:INSERT=3,cinder:DELETE=1 {{(pid=87098) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 13 13:49:26 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-9d92460a-dc48-4022-aa28-f79f812c8be7 tempest-ServerActionsTestOtherA-1029806651 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 13:49:26 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-9d92460a-dc48-4022-aa28-f79f812c8be7 tempest-ServerActionsTestOtherA-1029806651 None] Flow 'volume_create_manager' (54eecb6e-2f45-44a1-90e2-481d46ba0dc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 13:49:26 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-9d92460a-dc48-4022-aa28-f79f812c8be7 tempest-ServerActionsTestOtherA-1029806651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b54d16d3-3f52-40c0-a38c-2c967b4e02c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:49:26 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-9d92460a-dc48-4022-aa28-f79f812c8be7 tempest-ServerActionsTestOtherA-1029806651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b54d16d3-3f52-40c0-a38c-2c967b4e02c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T11:49:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-508740898',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f69829c-8ad1-4f1a-b85f-71116dd67d6d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58fd7c1c6d5048c19df704e40e116e15',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T11:49:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T11:49:26Z,use_quota=True,user_id='985cddecd1a44e568f9a8c662bf0c27b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1147de8b-623b-426c-a13d-7fc824a80f67),volume_type_id=1147de8b-623b-426c-a13d-7fc824a80f67)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:49:26 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-9d92460a-dc48-4022-aa28-f79f812c8be7 tempest-ServerActionsTestOtherA-1029806651 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9693d1e-3053-4ec7-9ae7-626521e182ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:49:26 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-9d92460a-dc48-4022-aa28-f79f812c8be7 tempest-ServerActionsTestOtherA-1029806651 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9693d1e-3053-4ec7-9ae7-626521e182ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:49:26 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-9d92460a-dc48-4022-aa28-f79f812c8be7 tempest-ServerActionsTestOtherA-1029806651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34635e35-9b86-4e43-99a9-b7c142f9eb40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:49:26 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-9d92460a-dc48-4022-aa28-f79f812c8be7 tempest-ServerActionsTestOtherA-1029806651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34635e35-9b86-4e43-99a9-b7c142f9eb40) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0f69829c-8ad1-4f1a-b85f-71116dd67d6d', 'volume_name': 'volume-0f69829c-8ad1-4f1a-b85f-71116dd67d6d', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:49:26 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-9d92460a-dc48-4022-aa28-f79f812c8be7 tempest-ServerActionsTestOtherA-1029806651 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5296e25b-33cc-4e42-ab7d-6d08221c9187) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:49:26 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-9d92460a-dc48-4022-aa28-f79f812c8be7 tempest-ServerActionsTestOtherA-1029806651 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5296e25b-33cc-4e42-ab7d-6d08221c9187) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:49:26 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-9d92460a-dc48-4022-aa28-f79f812c8be7 tempest-ServerActionsTestOtherA-1029806651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81005c00-47c3-4f18-abec-6c28a026e305) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:49:26 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-9d92460a-dc48-4022-aa28-f79f812c8be7 tempest-ServerActionsTestOtherA-1029806651 None] Volume 0f69829c-8ad1-4f1a-b85f-71116dd67d6d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0f69829c-8ad1-4f1a-b85f-71116dd67d6d', 'volume_size': 1} Jul 13 13:49:26 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-9d92460a-dc48-4022-aa28-f79f812c8be7 tempest-ServerActionsTestOtherA-1029806651 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:49:26 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-9d92460a-dc48-4022-aa28-f79f812c8be7 tempest-ServerActionsTestOtherA-1029806651 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:49:26 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-9d92460a-dc48-4022-aa28-f79f812c8be7 tempest-ServerActionsTestOtherA-1029806651 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T11:49:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-508740898',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f69829c-8ad1-4f1a-b85f-71116dd67d6d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58fd7c1c6d5048c19df704e40e116e15',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T11:49:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T11:49:26Z,use_quota=True,user_id='985cddecd1a44e568f9a8c662bf0c27b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1147de8b-623b-426c-a13d-7fc824a80f67),volume_type_id=1147de8b-623b-426c-a13d-7fc824a80f67)}" {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 13 13:49:26 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-9d92460a-dc48-4022-aa28-f79f812c8be7 tempest-ServerActionsTestOtherA-1029806651 None] Creating volume 0f69829c-8ad1-4f1a-b85f-71116dd67d6d {{(pid=87098) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 13 13:49:26 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-9d92460a-dc48-4022-aa28-f79f812c8be7 tempest-ServerActionsTestOtherA-1029806651 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:49:26 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-9d92460a-dc48-4022-aa28-f79f812c8be7 tempest-ServerActionsTestOtherA-1029806651 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:49:26 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-9d92460a-dc48-4022-aa28-f79f812c8be7 tempest-ServerActionsTestOtherA-1029806651 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 13:49:26 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-9d92460a-dc48-4022-aa28-f79f812c8be7 tempest-ServerActionsTestOtherA-1029806651 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 13:49:26 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-9d92460a-dc48-4022-aa28-f79f812c8be7 tempest-ServerActionsTestOtherA-1029806651 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:49:26 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-9d92460a-dc48-4022-aa28-f79f812c8be7 tempest-ServerActionsTestOtherA-1029806651 None] Selected osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 13:49:26 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-9d92460a-dc48-4022-aa28-f79f812c8be7 tempest-ServerActionsTestOtherA-1029806651 None] casted to osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 Jul 13 13:49:26 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-9d92460a-dc48-4022-aa28-f79f812c8be7 tempest-ServerActionsTestOtherA-1029806651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-0f69829c-8ad1-4f1a-b85f-71116dd67d6d 1073741824 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:49:26 devstack sudo[88230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-0f69829c-8ad1-4f1a-b85f-71116dd67d6d 1073741824 Jul 13 13:49:26 devstack sudo[88230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:49:27 devstack sudo[88230]: pam_unix(sudo:session): session closed for user root Jul 13 13:49:27 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-9d92460a-dc48-4022-aa28-f79f812c8be7 tempest-ServerActionsTestOtherA-1029806651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-0f69829c-8ad1-4f1a-b85f-71116dd67d6d 1073741824" returned: 0 in 0.626s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:49:27 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-9d92460a-dc48-4022-aa28-f79f812c8be7 tempest-ServerActionsTestOtherA-1029806651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-0f69829c-8ad1-4f1a-b85f-71116dd67d6d {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:49:27 devstack sudo[88235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-0f69829c-8ad1-4f1a-b85f-71116dd67d6d Jul 13 13:49:27 devstack sudo[88235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:49:27 devstack sudo[88235]: pam_unix(sudo:session): session closed for user root Jul 13 13:49:27 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-9d92460a-dc48-4022-aa28-f79f812c8be7 tempest-ServerActionsTestOtherA-1029806651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-0f69829c-8ad1-4f1a-b85f-71116dd67d6d" returned: 0 in 0.287s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:49:27 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-9d92460a-dc48-4022-aa28-f79f812c8be7 tempest-ServerActionsTestOtherA-1029806651 None] <== create_volume: return (970ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'} {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 13 13:49:27 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-9d92460a-dc48-4022-aa28-f79f812c8be7 tempest-ServerActionsTestOtherA-1029806651 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.973s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:49:27 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-9d92460a-dc48-4022-aa28-f79f812c8be7 tempest-ServerActionsTestOtherA-1029806651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81005c00-47c3-4f18-abec-6c28a026e305) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0f69829c-8ad1-4f1a-b85f-71116dd67d6d', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:49:27 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-9d92460a-dc48-4022-aa28-f79f812c8be7 tempest-ServerActionsTestOtherA-1029806651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de74eeac-59d0-46aa-be14-7952999c2daf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:49:27 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-9d92460a-dc48-4022-aa28-f79f812c8be7 tempest-ServerActionsTestOtherA-1029806651 None] Volume volume-0f69829c-8ad1-4f1a-b85f-71116dd67d6d (0f69829c-8ad1-4f1a-b85f-71116dd67d6d): created successfully Jul 13 13:49:27 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-9d92460a-dc48-4022-aa28-f79f812c8be7 tempest-ServerActionsTestOtherA-1029806651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de74eeac-59d0-46aa-be14-7952999c2daf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:49:27 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-9d92460a-dc48-4022-aa28-f79f812c8be7 tempest-ServerActionsTestOtherA-1029806651 None] Flow 'volume_create_manager' (54eecb6e-2f45-44a1-90e2-481d46ba0dc5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 13:49:27 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-9d92460a-dc48-4022-aa28-f79f812c8be7 tempest-ServerActionsTestOtherA-1029806651 None] Created volume successfully. Jul 13 13:49:29 devstack cinder-volume[87098]: DEBUG oslo_service.periodic_task [None req-727a1692-ea28-4a77-b327-0d94e8f01efb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87098) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 13 13:49:29 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-727a1692-ea28-4a77-b327-0d94e8f01efb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:49:29 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-727a1692-ea28-4a77-b327-0d94e8f01efb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:49:29 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-727a1692-ea28-4a77-b327-0d94e8f01efb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 13:49:29 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-727a1692-ea28-4a77-b327-0d94e8f01efb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 13:49:29 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-727a1692-ea28-4a77-b327-0d94e8f01efb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:49:29 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-727a1692-ea28-4a77-b327-0d94e8f01efb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:49:29 devstack sudo[88239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 Jul 13 13:49:29 devstack sudo[88239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:49:29 devstack sudo[88239]: pam_unix(sudo:session): session closed for user root Jul 13 13:49:29 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-727a1692-ea28-4a77-b327-0d94e8f01efb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78" returned: 0 in 0.277s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:49:29 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-727a1692-ea28-4a77-b327-0d94e8f01efb None None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 13:49:29 devstack cinder-volume[87098]: DEBUG oslo_service.periodic_task [None req-727a1692-ea28-4a77-b327-0d94e8f01efb None None] Running periodic task VolumeManager._thread_info {{(pid=87098) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 13 13:49:29 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-727a1692-ea28-4a77-b327-0d94e8f01efb None None] thread count: 8 {{(pid=87098) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 13 13:49:29 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-727a1692-ea28-4a77-b327-0d94e8f01efb None None] thread info: [<_MainThread(MainThread, started 127988054597760)>, , , , , , , ] {{(pid=87098) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 13 13:49:37 devstack cinder-volume[87098]: DEBUG dbcounter [-] [87098] Writing DB stats cinder:SELECT=2,cinder:UPDATE=2,cinder:INSERT=1 {{(pid=87098) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 13 13:49:37 devstack cinder-volume[87098]: DEBUG dbcounter [-] [87098] Writing DB stats cinder:SELECT=2,cinder:UPDATE=4,cinder:DELETE=1 {{(pid=87098) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 13 13:49:50 devstack cinder-volume[87098]: DEBUG dbcounter [-] [87098] Writing DB stats cinder:SELECT=1 {{(pid=87098) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 13 13:49:50 devstack cinder-volume[87098]: DEBUG dbcounter [-] [87098] Writing DB stats cinder:UPDATE=1 {{(pid=87098) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 13 13:49:53 devstack cinder-volume[87098]: WARNING py.warnings [req-65c75204-6dc8-4aea-8d00-d1dbd19f3435 req-39bbd90c-551c-438c-a184-dd6bbf6804e4 tempest-TaggedAttachmentsTest-1735047278 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volume_attachment". Apply join condition(s) between each element to resolve. Jul 13 13:49:53 devstack cinder-volume[87098]: .first() Jul 13 13:49:53 devstack cinder-volume[87098]: Jul 13 13:49:53 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [req-65c75204-6dc8-4aea-8d00-d1dbd19f3435 req-39bbd90c-551c-438c-a184-dd6bbf6804e4 tempest-TaggedAttachmentsTest-1735047278 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:49:53 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [req-65c75204-6dc8-4aea-8d00-d1dbd19f3435 req-39bbd90c-551c-438c-a184-dd6bbf6804e4 tempest-TaggedAttachmentsTest-1735047278 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:49:53 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[369fd6f3-6f4a-4566-bf72-b29916a456e6]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 13:49:53 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [req-65c75204-6dc8-4aea-8d00-d1dbd19f3435 req-39bbd90c-551c-438c-a184-dd6bbf6804e4 tempest-TaggedAttachmentsTest-1735047278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-daac9ea7-4832-4a55-993c-de92f42b67a5 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:49:53 devstack sudo[88511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-daac9ea7-4832-4a55-993c-de92f42b67a5 Jul 13 13:49:53 devstack sudo[88511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:49:54 devstack sudo[88511]: pam_unix(sudo:session): session closed for user root Jul 13 13:49:54 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [req-65c75204-6dc8-4aea-8d00-d1dbd19f3435 req-39bbd90c-551c-438c-a184-dd6bbf6804e4 tempest-TaggedAttachmentsTest-1735047278 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-daac9ea7-4832-4a55-993c-de92f42b67a5" returned: 0 in 0.549s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:49:54 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [req-65c75204-6dc8-4aea-8d00-d1dbd19f3435 req-39bbd90c-551c-438c-a184-dd6bbf6804e4 tempest-TaggedAttachmentsTest-1735047278 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.578s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:49:54 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [req-65c75204-6dc8-4aea-8d00-d1dbd19f3435 req-39bbd90c-551c-438c-a184-dd6bbf6804e4 tempest-TaggedAttachmentsTest-1735047278 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654', 'name': 'volume-daac9ea7-4832-4a55-993c-de92f42b67a5', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd4504679-70c6-4ce2-b2b7-f8f37042005e', 'enforce_multipath': True} {{(pid=87098) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 13 13:49:54 devstack cinder-volume[87098]: INFO cinder.volume.manager [req-65c75204-6dc8-4aea-8d00-d1dbd19f3435 req-39bbd90c-551c-438c-a184-dd6bbf6804e4 tempest-TaggedAttachmentsTest-1735047278 None] attachment_update completed successfully. Jul 13 13:49:58 devstack cinder-volume[87098]: INFO cinder.volume.manager [req-1160b2a7-0cb3-40a0-8f1b-4ecf2a70ff37 req-d60f738a-e27f-4ecb-98d0-e0910e38e852 tempest-TaggedAttachmentsTest-1735047278 None] Terminate volume connection completed successfully. Jul 13 13:49:58 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [req-1160b2a7-0cb3-40a0-8f1b-4ecf2a70ff37 req-d60f738a-e27f-4ecb-98d0-e0910e38e852 tempest-TaggedAttachmentsTest-1735047278 None] Deleting attachment d4504679-70c6-4ce2-b2b7-f8f37042005e. {{(pid=87098) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 13 13:50:04 devstack cinder-volume[87098]: DEBUG dbcounter [-] [87098] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=87098) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 13 13:50:08 devstack cinder-volume[87098]: DEBUG dbcounter [-] [87098] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=87098) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 13 13:50:08 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-2ff0cd87-e381-4e4a-a158-a6f66ff7436f tempest-AttachVolumeNegativeTest-468633374 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 13:50:08 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-2ff0cd87-e381-4e4a-a158-a6f66ff7436f tempest-AttachVolumeNegativeTest-468633374 None] Flow 'volume_create_manager' (ea7c2b51-3b17-4f78-b85e-6136d4c23a2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 13:50:08 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-2ff0cd87-e381-4e4a-a158-a6f66ff7436f tempest-AttachVolumeNegativeTest-468633374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40af3382-5cb6-4c6d-8a43-f453ee433fa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:50:09 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-2ff0cd87-e381-4e4a-a158-a6f66ff7436f tempest-AttachVolumeNegativeTest-468633374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40af3382-5cb6-4c6d-8a43-f453ee433fa6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T11:50:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1190771875',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82a84106-434a-4410-9614-dc7ca7555937,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8794c1b399a24bc5b65aeed906ffb8f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T11:50:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T11:50:09Z,use_quota=True,user_id='6566c5149286424f948fd3e110a2ca17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1147de8b-623b-426c-a13d-7fc824a80f67),volume_type_id=1147de8b-623b-426c-a13d-7fc824a80f67)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:50:09 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-2ff0cd87-e381-4e4a-a158-a6f66ff7436f tempest-AttachVolumeNegativeTest-468633374 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1fe06a2-85aa-470f-82bc-d983f7b6a4e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:50:09 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-2ff0cd87-e381-4e4a-a158-a6f66ff7436f tempest-AttachVolumeNegativeTest-468633374 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1fe06a2-85aa-470f-82bc-d983f7b6a4e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:50:09 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-2ff0cd87-e381-4e4a-a158-a6f66ff7436f tempest-AttachVolumeNegativeTest-468633374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (947df768-c9fe-4f63-8348-1c4615660670) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:50:09 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-2ff0cd87-e381-4e4a-a158-a6f66ff7436f tempest-AttachVolumeNegativeTest-468633374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (947df768-c9fe-4f63-8348-1c4615660670) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '82a84106-434a-4410-9614-dc7ca7555937', 'volume_name': 'volume-82a84106-434a-4410-9614-dc7ca7555937', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:50:09 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-2ff0cd87-e381-4e4a-a158-a6f66ff7436f tempest-AttachVolumeNegativeTest-468633374 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac507c89-0d41-4b58-839e-e16a6439ae90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:50:09 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-2ff0cd87-e381-4e4a-a158-a6f66ff7436f tempest-AttachVolumeNegativeTest-468633374 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac507c89-0d41-4b58-839e-e16a6439ae90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:50:09 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-2ff0cd87-e381-4e4a-a158-a6f66ff7436f tempest-AttachVolumeNegativeTest-468633374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5d7d6c2-f1b8-45b7-bf1d-bdfb391f0b8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:50:09 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-2ff0cd87-e381-4e4a-a158-a6f66ff7436f tempest-AttachVolumeNegativeTest-468633374 None] Volume 82a84106-434a-4410-9614-dc7ca7555937: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-82a84106-434a-4410-9614-dc7ca7555937', 'volume_size': 1} Jul 13 13:50:09 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-2ff0cd87-e381-4e4a-a158-a6f66ff7436f tempest-AttachVolumeNegativeTest-468633374 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:50:09 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-2ff0cd87-e381-4e4a-a158-a6f66ff7436f tempest-AttachVolumeNegativeTest-468633374 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:50:09 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-2ff0cd87-e381-4e4a-a158-a6f66ff7436f tempest-AttachVolumeNegativeTest-468633374 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T11:50:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1190771875',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82a84106-434a-4410-9614-dc7ca7555937,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8794c1b399a24bc5b65aeed906ffb8f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T11:50:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T11:50:09Z,use_quota=True,user_id='6566c5149286424f948fd3e110a2ca17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1147de8b-623b-426c-a13d-7fc824a80f67),volume_type_id=1147de8b-623b-426c-a13d-7fc824a80f67)}" {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 13 13:50:09 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-2ff0cd87-e381-4e4a-a158-a6f66ff7436f tempest-AttachVolumeNegativeTest-468633374 None] Creating volume 82a84106-434a-4410-9614-dc7ca7555937 {{(pid=87098) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 13 13:50:09 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-2ff0cd87-e381-4e4a-a158-a6f66ff7436f tempest-AttachVolumeNegativeTest-468633374 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:50:09 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-2ff0cd87-e381-4e4a-a158-a6f66ff7436f tempest-AttachVolumeNegativeTest-468633374 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:50:09 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-2ff0cd87-e381-4e4a-a158-a6f66ff7436f tempest-AttachVolumeNegativeTest-468633374 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 13:50:09 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-2ff0cd87-e381-4e4a-a158-a6f66ff7436f tempest-AttachVolumeNegativeTest-468633374 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 13:50:09 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-2ff0cd87-e381-4e4a-a158-a6f66ff7436f tempest-AttachVolumeNegativeTest-468633374 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:50:09 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-2ff0cd87-e381-4e4a-a158-a6f66ff7436f tempest-AttachVolumeNegativeTest-468633374 None] Selected osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 13:50:09 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-2ff0cd87-e381-4e4a-a158-a6f66ff7436f tempest-AttachVolumeNegativeTest-468633374 None] casted to osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 Jul 13 13:50:09 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-2ff0cd87-e381-4e4a-a158-a6f66ff7436f tempest-AttachVolumeNegativeTest-468633374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-82a84106-434a-4410-9614-dc7ca7555937 1073741824 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:50:09 devstack sudo[89173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-82a84106-434a-4410-9614-dc7ca7555937 1073741824 Jul 13 13:50:09 devstack sudo[89173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:50:09 devstack sudo[89173]: pam_unix(sudo:session): session closed for user root Jul 13 13:50:09 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-2ff0cd87-e381-4e4a-a158-a6f66ff7436f tempest-AttachVolumeNegativeTest-468633374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-82a84106-434a-4410-9614-dc7ca7555937 1073741824" returned: 0 in 0.677s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:50:09 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-2ff0cd87-e381-4e4a-a158-a6f66ff7436f tempest-AttachVolumeNegativeTest-468633374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-82a84106-434a-4410-9614-dc7ca7555937 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:50:09 devstack sudo[89185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-82a84106-434a-4410-9614-dc7ca7555937 Jul 13 13:50:09 devstack sudo[89185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:50:10 devstack sudo[89185]: pam_unix(sudo:session): session closed for user root Jul 13 13:50:10 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-2ff0cd87-e381-4e4a-a158-a6f66ff7436f tempest-AttachVolumeNegativeTest-468633374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-82a84106-434a-4410-9614-dc7ca7555937" returned: 0 in 0.636s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:50:10 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-2ff0cd87-e381-4e4a-a158-a6f66ff7436f tempest-AttachVolumeNegativeTest-468633374 None] <== create_volume: return (1383ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'} {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 13 13:50:10 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-2ff0cd87-e381-4e4a-a158-a6f66ff7436f tempest-AttachVolumeNegativeTest-468633374 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.386s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:50:10 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-2ff0cd87-e381-4e4a-a158-a6f66ff7436f tempest-AttachVolumeNegativeTest-468633374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5d7d6c2-f1b8-45b7-bf1d-bdfb391f0b8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-82a84106-434a-4410-9614-dc7ca7555937', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:50:10 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-2ff0cd87-e381-4e4a-a158-a6f66ff7436f tempest-AttachVolumeNegativeTest-468633374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (132632c5-8ac4-472d-907d-c955f661bd23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:50:10 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-2ff0cd87-e381-4e4a-a158-a6f66ff7436f tempest-AttachVolumeNegativeTest-468633374 None] Volume volume-82a84106-434a-4410-9614-dc7ca7555937 (82a84106-434a-4410-9614-dc7ca7555937): created successfully Jul 13 13:50:10 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-2ff0cd87-e381-4e4a-a158-a6f66ff7436f tempest-AttachVolumeNegativeTest-468633374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (132632c5-8ac4-472d-907d-c955f661bd23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:50:10 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-2ff0cd87-e381-4e4a-a158-a6f66ff7436f tempest-AttachVolumeNegativeTest-468633374 None] Flow 'volume_create_manager' (ea7c2b51-3b17-4f78-b85e-6136d4c23a2f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 13:50:10 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-2ff0cd87-e381-4e4a-a158-a6f66ff7436f tempest-AttachVolumeNegativeTest-468633374 None] Created volume successfully. Jul 13 13:50:11 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-1ec84616-dee3-4ee1-bde9-aeb85f8ea5f1 tempest-TaggedAttachmentsTest-1735047278 None] Acquiring lock "cinder-daac9ea7-4832-4a55-993c-de92f42b67a5-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 13:50:11 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-1ec84616-dee3-4ee1-bde9-aeb85f8ea5f1 tempest-TaggedAttachmentsTest-1735047278 None] Lock "cinder-daac9ea7-4832-4a55-993c-de92f42b67a5-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 13:50:11 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-1ec84616-dee3-4ee1-bde9-aeb85f8ea5f1 tempest-TaggedAttachmentsTest-1735047278 None] Acquiring lock "cinder-quobyte-daac9ea7-4832-4a55-993c-de92f42b67a5" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 13:50:11 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-1ec84616-dee3-4ee1-bde9-aeb85f8ea5f1 tempest-TaggedAttachmentsTest-1735047278 None] Lock "cinder-quobyte-daac9ea7-4832-4a55-993c-de92f42b67a5" acquired by "delete_volume" :: waited 0.056s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 13:50:11 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [req-7937d436-4d4a-43fa-9304-b59c99b2d15e req-7b27b64c-4c53-4835-a958-99f2b675fa55 tempest-ServerActionsTestOtherA-1029806651 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:50:11 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [req-7937d436-4d4a-43fa-9304-b59c99b2d15e req-7b27b64c-4c53-4835-a958-99f2b675fa55 tempest-ServerActionsTestOtherA-1029806651 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:50:11 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[d539d1e6-65d0-41b0-9a88-fa8bc97eccc9]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 13:50:11 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-1ec84616-dee3-4ee1-bde9-aeb85f8ea5f1 tempest-TaggedAttachmentsTest-1735047278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-daac9ea7-4832-4a55-993c-de92f42b67a5 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:50:11 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[633ee4ac-12ba-4fff-90dc-b15a6a7fe851]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 13:50:11 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [req-7937d436-4d4a-43fa-9304-b59c99b2d15e req-7b27b64c-4c53-4835-a958-99f2b675fa55 tempest-ServerActionsTestOtherA-1029806651 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-0f69829c-8ad1-4f1a-b85f-71116dd67d6d {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:50:11 devstack sudo[89210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-daac9ea7-4832-4a55-993c-de92f42b67a5 Jul 13 13:50:11 devstack sudo[89210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:50:11 devstack sudo[89211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-0f69829c-8ad1-4f1a-b85f-71116dd67d6d Jul 13 13:50:11 devstack sudo[89211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:50:11 devstack sudo[89211]: pam_unix(sudo:session): session closed for user root Jul 13 13:50:11 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [req-7937d436-4d4a-43fa-9304-b59c99b2d15e req-7b27b64c-4c53-4835-a958-99f2b675fa55 tempest-ServerActionsTestOtherA-1029806651 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-0f69829c-8ad1-4f1a-b85f-71116dd67d6d" returned: 0 in 0.507s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:50:11 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [req-7937d436-4d4a-43fa-9304-b59c99b2d15e req-7b27b64c-4c53-4835-a958-99f2b675fa55 tempest-ServerActionsTestOtherA-1029806651 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.565s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:50:11 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [req-7937d436-4d4a-43fa-9304-b59c99b2d15e req-7b27b64c-4c53-4835-a958-99f2b675fa55 tempest-ServerActionsTestOtherA-1029806651 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654', 'name': 'volume-0f69829c-8ad1-4f1a-b85f-71116dd67d6d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '872dc098-dd18-4c73-81eb-9424304cc336', 'enforce_multipath': True} {{(pid=87098) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 13 13:50:12 devstack sudo[89210]: pam_unix(sudo:session): session closed for user root Jul 13 13:50:12 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-1ec84616-dee3-4ee1-bde9-aeb85f8ea5f1 tempest-TaggedAttachmentsTest-1735047278 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-daac9ea7-4832-4a55-993c-de92f42b67a5" returned: 0 in 0.651s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:50:12 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-1ec84616-dee3-4ee1-bde9-aeb85f8ea5f1 tempest-TaggedAttachmentsTest-1735047278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-daac9ea7-4832-4a55-993c-de92f42b67a5 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:50:12 devstack cinder-volume[87098]: INFO cinder.volume.manager [req-7937d436-4d4a-43fa-9304-b59c99b2d15e req-7b27b64c-4c53-4835-a958-99f2b675fa55 tempest-ServerActionsTestOtherA-1029806651 None] attachment_update completed successfully. Jul 13 13:50:12 devstack sudo[89221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-daac9ea7-4832-4a55-993c-de92f42b67a5 Jul 13 13:50:12 devstack sudo[89221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:50:12 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-e3e681ee-f0fb-4da8-a898-2431969b0802 tempest-DeleteServersTestJSON-1147269655 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 13:50:12 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-e3e681ee-f0fb-4da8-a898-2431969b0802 tempest-DeleteServersTestJSON-1147269655 None] Flow 'volume_create_manager' (a4be2203-2d20-44ec-92cb-a8989b15f8af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 13:50:12 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-e3e681ee-f0fb-4da8-a898-2431969b0802 tempest-DeleteServersTestJSON-1147269655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96a6a429-916b-4229-a72a-41f7d8a8ddef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:50:12 devstack sudo[89221]: pam_unix(sudo:session): session closed for user root Jul 13 13:50:12 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-e3e681ee-f0fb-4da8-a898-2431969b0802 tempest-DeleteServersTestJSON-1147269655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96a6a429-916b-4229-a72a-41f7d8a8ddef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T11:50:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-530881562',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c8ed443-557e-47e5-8be7-af61112793fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ba68d882fe143bf9214a9c5a94536db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T11:50:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T11:50:12Z,use_quota=True,user_id='9b1040ae8544404880943d9f4a33c9fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1147de8b-623b-426c-a13d-7fc824a80f67),volume_type_id=1147de8b-623b-426c-a13d-7fc824a80f67)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:50:12 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-e3e681ee-f0fb-4da8-a898-2431969b0802 tempest-DeleteServersTestJSON-1147269655 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2a7d367-c1b1-43e9-9a52-68e1a3e153e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:50:12 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-e3e681ee-f0fb-4da8-a898-2431969b0802 tempest-DeleteServersTestJSON-1147269655 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2a7d367-c1b1-43e9-9a52-68e1a3e153e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:50:12 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-e3e681ee-f0fb-4da8-a898-2431969b0802 tempest-DeleteServersTestJSON-1147269655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7cfb04be-bad3-4779-9c62-46eb7b047beb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:50:12 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-e3e681ee-f0fb-4da8-a898-2431969b0802 tempest-DeleteServersTestJSON-1147269655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7cfb04be-bad3-4779-9c62-46eb7b047beb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6c8ed443-557e-47e5-8be7-af61112793fb', 'volume_name': 'volume-6c8ed443-557e-47e5-8be7-af61112793fb', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:50:12 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-e3e681ee-f0fb-4da8-a898-2431969b0802 tempest-DeleteServersTestJSON-1147269655 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b392cf47-dbc7-4d8a-b4d9-feee20887036) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:50:12 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-e3e681ee-f0fb-4da8-a898-2431969b0802 tempest-DeleteServersTestJSON-1147269655 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b392cf47-dbc7-4d8a-b4d9-feee20887036) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:50:12 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-e3e681ee-f0fb-4da8-a898-2431969b0802 tempest-DeleteServersTestJSON-1147269655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85ef0028-bc3b-4776-8bfc-90eeaddb5bd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:50:12 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-e3e681ee-f0fb-4da8-a898-2431969b0802 tempest-DeleteServersTestJSON-1147269655 None] Volume 6c8ed443-557e-47e5-8be7-af61112793fb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6c8ed443-557e-47e5-8be7-af61112793fb', 'volume_size': 1} Jul 13 13:50:12 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-e3e681ee-f0fb-4da8-a898-2431969b0802 tempest-DeleteServersTestJSON-1147269655 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:50:12 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-e3e681ee-f0fb-4da8-a898-2431969b0802 tempest-DeleteServersTestJSON-1147269655 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:50:12 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-e3e681ee-f0fb-4da8-a898-2431969b0802 tempest-DeleteServersTestJSON-1147269655 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T11:50:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-530881562',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c8ed443-557e-47e5-8be7-af61112793fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ba68d882fe143bf9214a9c5a94536db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T11:50:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T11:50:12Z,use_quota=True,user_id='9b1040ae8544404880943d9f4a33c9fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1147de8b-623b-426c-a13d-7fc824a80f67),volume_type_id=1147de8b-623b-426c-a13d-7fc824a80f67)}" {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 13 13:50:12 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-e3e681ee-f0fb-4da8-a898-2431969b0802 tempest-DeleteServersTestJSON-1147269655 None] Creating volume 6c8ed443-557e-47e5-8be7-af61112793fb {{(pid=87098) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 13 13:50:12 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-e3e681ee-f0fb-4da8-a898-2431969b0802 tempest-DeleteServersTestJSON-1147269655 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:50:12 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-e3e681ee-f0fb-4da8-a898-2431969b0802 tempest-DeleteServersTestJSON-1147269655 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:50:12 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-e3e681ee-f0fb-4da8-a898-2431969b0802 tempest-DeleteServersTestJSON-1147269655 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 13:50:12 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-e3e681ee-f0fb-4da8-a898-2431969b0802 tempest-DeleteServersTestJSON-1147269655 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 13:50:12 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-e3e681ee-f0fb-4da8-a898-2431969b0802 tempest-DeleteServersTestJSON-1147269655 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:50:12 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-e3e681ee-f0fb-4da8-a898-2431969b0802 tempest-DeleteServersTestJSON-1147269655 None] Selected osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 13:50:12 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-e3e681ee-f0fb-4da8-a898-2431969b0802 tempest-DeleteServersTestJSON-1147269655 None] casted to osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 Jul 13 13:50:12 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-e3e681ee-f0fb-4da8-a898-2431969b0802 tempest-DeleteServersTestJSON-1147269655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-6c8ed443-557e-47e5-8be7-af61112793fb 1073741824 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:50:12 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-1ec84616-dee3-4ee1-bde9-aeb85f8ea5f1 tempest-TaggedAttachmentsTest-1735047278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-daac9ea7-4832-4a55-993c-de92f42b67a5" returned: 0 in 0.445s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:50:12 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-1ec84616-dee3-4ee1-bde9-aeb85f8ea5f1 tempest-TaggedAttachmentsTest-1735047278 None] Lock "cinder-quobyte-daac9ea7-4832-4a55-993c-de92f42b67a5" released by "delete_volume" :: held 1.183s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 13:50:12 devstack sudo[89272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-6c8ed443-557e-47e5-8be7-af61112793fb 1073741824 Jul 13 13:50:12 devstack sudo[89272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:50:12 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-1ec84616-dee3-4ee1-bde9-aeb85f8ea5f1 tempest-TaggedAttachmentsTest-1735047278 None] Created reservations ['a039adba-5820-4f51-905d-9f8b451f15b0', '799b7d64-2cca-4ca7-9629-be728e471cd7', '2a42d160-8903-4132-9165-78048ce5c70e', 'fcbb2518-904c-447a-9f9a-a0824f8cb80a'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 13:50:12 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-1ec84616-dee3-4ee1-bde9-aeb85f8ea5f1 tempest-TaggedAttachmentsTest-1735047278 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:50:12 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-1ec84616-dee3-4ee1-bde9-aeb85f8ea5f1 tempest-TaggedAttachmentsTest-1735047278 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:50:12 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-1ec84616-dee3-4ee1-bde9-aeb85f8ea5f1 tempest-TaggedAttachmentsTest-1735047278 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 13:50:12 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-1ec84616-dee3-4ee1-bde9-aeb85f8ea5f1 tempest-TaggedAttachmentsTest-1735047278 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 13:50:12 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-1ec84616-dee3-4ee1-bde9-aeb85f8ea5f1 tempest-TaggedAttachmentsTest-1735047278 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:50:12 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-1ec84616-dee3-4ee1-bde9-aeb85f8ea5f1 tempest-TaggedAttachmentsTest-1735047278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:50:12 devstack sudo[89294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 Jul 13 13:50:12 devstack sudo[89294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:50:13 devstack sudo[89294]: pam_unix(sudo:session): session closed for user root Jul 13 13:50:13 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-1ec84616-dee3-4ee1-bde9-aeb85f8ea5f1 tempest-TaggedAttachmentsTest-1735047278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78" returned: 0 in 0.501s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:50:13 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-1ec84616-dee3-4ee1-bde9-aeb85f8ea5f1 tempest-TaggedAttachmentsTest-1735047278 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 13:50:13 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-1ec84616-dee3-4ee1-bde9-aeb85f8ea5f1 tempest-TaggedAttachmentsTest-1735047278 None] Deleted volume successfully. Jul 13 13:50:13 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-1ec84616-dee3-4ee1-bde9-aeb85f8ea5f1 tempest-TaggedAttachmentsTest-1735047278 None] Lock "cinder-daac9ea7-4832-4a55-993c-de92f42b67a5-delete_volume" released by "delete_volume" :: held 2.113s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 13:50:13 devstack sudo[89272]: pam_unix(sudo:session): session closed for user root Jul 13 13:50:13 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-e3e681ee-f0fb-4da8-a898-2431969b0802 tempest-DeleteServersTestJSON-1147269655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-6c8ed443-557e-47e5-8be7-af61112793fb 1073741824" returned: 0 in 0.855s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:50:13 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [req-0782d908-b315-429e-8fd5-399b69ce4ae3 req-324acea0-663b-4d4a-8ca0-5259f1cae985 tempest-AttachVolumeNegativeTest-468633374 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:50:13 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-e3e681ee-f0fb-4da8-a898-2431969b0802 tempest-DeleteServersTestJSON-1147269655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-6c8ed443-557e-47e5-8be7-af61112793fb {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:50:13 devstack sudo[89624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-6c8ed443-557e-47e5-8be7-af61112793fb Jul 13 13:50:13 devstack sudo[89624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:50:13 devstack sudo[89624]: pam_unix(sudo:session): session closed for user root Jul 13 13:50:13 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-e3e681ee-f0fb-4da8-a898-2431969b0802 tempest-DeleteServersTestJSON-1147269655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-6c8ed443-557e-47e5-8be7-af61112793fb" returned: 0 in 0.282s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:50:13 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-e3e681ee-f0fb-4da8-a898-2431969b0802 tempest-DeleteServersTestJSON-1147269655 None] <== create_volume: return (1218ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'} {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 13 13:50:13 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-e3e681ee-f0fb-4da8-a898-2431969b0802 tempest-DeleteServersTestJSON-1147269655 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.221s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:50:13 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [req-0782d908-b315-429e-8fd5-399b69ce4ae3 req-324acea0-663b-4d4a-8ca0-5259f1cae985 tempest-AttachVolumeNegativeTest-468633374 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.293s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:50:13 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-e3e681ee-f0fb-4da8-a898-2431969b0802 tempest-DeleteServersTestJSON-1147269655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85ef0028-bc3b-4776-8bfc-90eeaddb5bd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6c8ed443-557e-47e5-8be7-af61112793fb', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:50:13 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-e3e681ee-f0fb-4da8-a898-2431969b0802 tempest-DeleteServersTestJSON-1147269655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3258a04e-079c-4ad7-a759-7d771a06e5b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:50:13 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed2ff56f-2a0b-4a9d-b4bd-adb0f1e96553]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 13:50:13 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [req-0782d908-b315-429e-8fd5-399b69ce4ae3 req-324acea0-663b-4d4a-8ca0-5259f1cae985 tempest-AttachVolumeNegativeTest-468633374 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-82a84106-434a-4410-9614-dc7ca7555937 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:50:13 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-e3e681ee-f0fb-4da8-a898-2431969b0802 tempest-DeleteServersTestJSON-1147269655 None] Volume volume-6c8ed443-557e-47e5-8be7-af61112793fb (6c8ed443-557e-47e5-8be7-af61112793fb): created successfully Jul 13 13:50:13 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-e3e681ee-f0fb-4da8-a898-2431969b0802 tempest-DeleteServersTestJSON-1147269655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3258a04e-079c-4ad7-a759-7d771a06e5b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:50:13 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-e3e681ee-f0fb-4da8-a898-2431969b0802 tempest-DeleteServersTestJSON-1147269655 None] Flow 'volume_create_manager' (a4be2203-2d20-44ec-92cb-a8989b15f8af) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 13:50:13 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-e3e681ee-f0fb-4da8-a898-2431969b0802 tempest-DeleteServersTestJSON-1147269655 None] Created volume successfully. Jul 13 13:50:13 devstack sudo[89627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-82a84106-434a-4410-9614-dc7ca7555937 Jul 13 13:50:13 devstack sudo[89627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:50:14 devstack sudo[89627]: pam_unix(sudo:session): session closed for user root Jul 13 13:50:14 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [req-0782d908-b315-429e-8fd5-399b69ce4ae3 req-324acea0-663b-4d4a-8ca0-5259f1cae985 tempest-AttachVolumeNegativeTest-468633374 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-82a84106-434a-4410-9614-dc7ca7555937" returned: 0 in 0.414s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:50:14 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [req-0782d908-b315-429e-8fd5-399b69ce4ae3 req-324acea0-663b-4d4a-8ca0-5259f1cae985 tempest-AttachVolumeNegativeTest-468633374 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.459s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:50:14 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [req-0782d908-b315-429e-8fd5-399b69ce4ae3 req-324acea0-663b-4d4a-8ca0-5259f1cae985 tempest-AttachVolumeNegativeTest-468633374 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654', 'name': 'volume-82a84106-434a-4410-9614-dc7ca7555937', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '69a459d8-1264-47e3-a3b2-9f73c411e341', 'enforce_multipath': True} {{(pid=87098) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 13 13:50:14 devstack cinder-volume[87098]: INFO cinder.volume.manager [req-0782d908-b315-429e-8fd5-399b69ce4ae3 req-324acea0-663b-4d4a-8ca0-5259f1cae985 tempest-AttachVolumeNegativeTest-468633374 None] attachment_update completed successfully. Jul 13 13:50:15 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [req-4c32d218-8343-465b-83cb-06e3c19b9a9c req-a21f27e2-aeb7-4d93-ad07-1d1792520b4c tempest-DeleteServersTestJSON-1147269655 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:50:15 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [req-4c32d218-8343-465b-83cb-06e3c19b9a9c req-a21f27e2-aeb7-4d93-ad07-1d1792520b4c tempest-DeleteServersTestJSON-1147269655 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:50:15 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[c40da1fb-6167-43e4-8185-471e9af358d0]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 13:50:15 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [req-4c32d218-8343-465b-83cb-06e3c19b9a9c req-a21f27e2-aeb7-4d93-ad07-1d1792520b4c tempest-DeleteServersTestJSON-1147269655 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-6c8ed443-557e-47e5-8be7-af61112793fb {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:50:15 devstack sudo[89649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-6c8ed443-557e-47e5-8be7-af61112793fb Jul 13 13:50:15 devstack sudo[89649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:50:16 devstack sudo[89649]: pam_unix(sudo:session): session closed for user root Jul 13 13:50:16 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [req-4c32d218-8343-465b-83cb-06e3c19b9a9c req-a21f27e2-aeb7-4d93-ad07-1d1792520b4c tempest-DeleteServersTestJSON-1147269655 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-6c8ed443-557e-47e5-8be7-af61112793fb" returned: 0 in 0.627s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:50:16 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [req-4c32d218-8343-465b-83cb-06e3c19b9a9c req-a21f27e2-aeb7-4d93-ad07-1d1792520b4c tempest-DeleteServersTestJSON-1147269655 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.665s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:50:16 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [req-4c32d218-8343-465b-83cb-06e3c19b9a9c req-a21f27e2-aeb7-4d93-ad07-1d1792520b4c tempest-DeleteServersTestJSON-1147269655 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654', 'name': 'volume-6c8ed443-557e-47e5-8be7-af61112793fb', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '031262b0-af87-447d-8cb0-834a87d6320c', 'enforce_multipath': True} {{(pid=87098) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 13 13:50:16 devstack cinder-volume[87098]: INFO cinder.volume.manager [req-4c32d218-8343-465b-83cb-06e3c19b9a9c req-a21f27e2-aeb7-4d93-ad07-1d1792520b4c tempest-DeleteServersTestJSON-1147269655 None] attachment_update completed successfully. Jul 13 13:50:17 devstack cinder-volume[87098]: INFO cinder.volume.manager [req-562def39-59a5-4116-9898-b6c1b6202094 req-c5902dc6-ead0-4cb6-9714-a8fdc6b5e572 tempest-ServerActionsTestOtherA-1029806651 None] Terminate volume connection completed successfully. Jul 13 13:50:17 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [req-562def39-59a5-4116-9898-b6c1b6202094 req-c5902dc6-ead0-4cb6-9714-a8fdc6b5e572 tempest-ServerActionsTestOtherA-1029806651 None] Deleting attachment 872dc098-dd18-4c73-81eb-9424304cc336. {{(pid=87098) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 13 13:50:19 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [req-562def39-59a5-4116-9898-b6c1b6202094 req-b561dc32-fe14-4d95-9511-f9f8914a78bc tempest-ServerActionsTestOtherA-1029806651 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:50:19 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [req-562def39-59a5-4116-9898-b6c1b6202094 req-b561dc32-fe14-4d95-9511-f9f8914a78bc tempest-ServerActionsTestOtherA-1029806651 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:50:19 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba47c10d-f91c-40bc-8481-3e94df7a68c0]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 13:50:19 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [req-562def39-59a5-4116-9898-b6c1b6202094 req-b561dc32-fe14-4d95-9511-f9f8914a78bc tempest-ServerActionsTestOtherA-1029806651 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-0f69829c-8ad1-4f1a-b85f-71116dd67d6d {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:50:19 devstack sudo[89728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-0f69829c-8ad1-4f1a-b85f-71116dd67d6d Jul 13 13:50:19 devstack sudo[89728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:50:20 devstack sudo[89728]: pam_unix(sudo:session): session closed for user root Jul 13 13:50:20 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [req-562def39-59a5-4116-9898-b6c1b6202094 req-b561dc32-fe14-4d95-9511-f9f8914a78bc tempest-ServerActionsTestOtherA-1029806651 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-0f69829c-8ad1-4f1a-b85f-71116dd67d6d" returned: 0 in 0.541s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:50:20 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [req-562def39-59a5-4116-9898-b6c1b6202094 req-b561dc32-fe14-4d95-9511-f9f8914a78bc tempest-ServerActionsTestOtherA-1029806651 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.569s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:50:20 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [req-562def39-59a5-4116-9898-b6c1b6202094 req-b561dc32-fe14-4d95-9511-f9f8914a78bc tempest-ServerActionsTestOtherA-1029806651 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654', 'name': 'volume-0f69829c-8ad1-4f1a-b85f-71116dd67d6d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5674d292-74e6-44a3-934b-ff40f165537a', 'enforce_multipath': True} {{(pid=87098) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 13 13:50:20 devstack cinder-volume[87098]: INFO cinder.volume.manager [req-562def39-59a5-4116-9898-b6c1b6202094 req-b561dc32-fe14-4d95-9511-f9f8914a78bc tempest-ServerActionsTestOtherA-1029806651 None] attachment_update completed successfully. Jul 13 13:50:21 devstack cinder-volume[87098]: INFO cinder.volume.manager [req-7f4939ba-d0ac-44aa-b8d3-8daf0ba50d13 req-8c6b44f8-66ea-4695-930c-5baa98b3c913 tempest-DeleteServersTestJSON-1147269655 None] Terminate volume connection completed successfully. Jul 13 13:50:21 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [req-7f4939ba-d0ac-44aa-b8d3-8daf0ba50d13 req-8c6b44f8-66ea-4695-930c-5baa98b3c913 tempest-DeleteServersTestJSON-1147269655 None] Deleting attachment 031262b0-af87-447d-8cb0-834a87d6320c. {{(pid=87098) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 13 13:50:23 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-14a35178-9ae2-46c0-8b95-dcd2de022378 tempest-DeleteServersTestJSON-1147269655 None] Acquiring lock "cinder-6c8ed443-557e-47e5-8be7-af61112793fb-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 13:50:23 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-14a35178-9ae2-46c0-8b95-dcd2de022378 tempest-DeleteServersTestJSON-1147269655 None] Lock "cinder-6c8ed443-557e-47e5-8be7-af61112793fb-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 13:50:23 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-14a35178-9ae2-46c0-8b95-dcd2de022378 tempest-DeleteServersTestJSON-1147269655 None] Acquiring lock "cinder-quobyte-6c8ed443-557e-47e5-8be7-af61112793fb" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 13:50:23 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-14a35178-9ae2-46c0-8b95-dcd2de022378 tempest-DeleteServersTestJSON-1147269655 None] Lock "cinder-quobyte-6c8ed443-557e-47e5-8be7-af61112793fb" acquired by "delete_volume" :: waited 0.039s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 13:50:23 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef3c2d4e-cca9-43d0-8f59-015e0edc9174]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 13:50:23 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-14a35178-9ae2-46c0-8b95-dcd2de022378 tempest-DeleteServersTestJSON-1147269655 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-6c8ed443-557e-47e5-8be7-af61112793fb {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:50:23 devstack sudo[89803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-6c8ed443-557e-47e5-8be7-af61112793fb Jul 13 13:50:23 devstack sudo[89803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:50:24 devstack sudo[89803]: pam_unix(sudo:session): session closed for user root Jul 13 13:50:24 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-14a35178-9ae2-46c0-8b95-dcd2de022378 tempest-DeleteServersTestJSON-1147269655 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-6c8ed443-557e-47e5-8be7-af61112793fb" returned: 0 in 0.622s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:50:24 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-14a35178-9ae2-46c0-8b95-dcd2de022378 tempest-DeleteServersTestJSON-1147269655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-6c8ed443-557e-47e5-8be7-af61112793fb {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:50:24 devstack sudo[89811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-6c8ed443-557e-47e5-8be7-af61112793fb Jul 13 13:50:24 devstack sudo[89811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:50:24 devstack sudo[89811]: pam_unix(sudo:session): session closed for user root Jul 13 13:50:24 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-14a35178-9ae2-46c0-8b95-dcd2de022378 tempest-DeleteServersTestJSON-1147269655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-6c8ed443-557e-47e5-8be7-af61112793fb" returned: 0 in 0.676s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:50:24 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-14a35178-9ae2-46c0-8b95-dcd2de022378 tempest-DeleteServersTestJSON-1147269655 None] Lock "cinder-quobyte-6c8ed443-557e-47e5-8be7-af61112793fb" released by "delete_volume" :: held 1.361s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 13:50:24 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-14a35178-9ae2-46c0-8b95-dcd2de022378 tempest-DeleteServersTestJSON-1147269655 None] Created reservations ['38aee16a-d58c-4424-954a-724ddc415348', '5028acce-7755-4871-99bd-1759143afe13', 'a205501d-0a12-40c1-80dc-6b61767317ab', '95ec915f-ea85-488b-95cc-d68748b2fe00'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 13:50:25 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-14a35178-9ae2-46c0-8b95-dcd2de022378 tempest-DeleteServersTestJSON-1147269655 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:50:25 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-14a35178-9ae2-46c0-8b95-dcd2de022378 tempest-DeleteServersTestJSON-1147269655 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:50:25 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-14a35178-9ae2-46c0-8b95-dcd2de022378 tempest-DeleteServersTestJSON-1147269655 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 13:50:25 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-14a35178-9ae2-46c0-8b95-dcd2de022378 tempest-DeleteServersTestJSON-1147269655 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 13:50:25 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-14a35178-9ae2-46c0-8b95-dcd2de022378 tempest-DeleteServersTestJSON-1147269655 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:50:25 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-14a35178-9ae2-46c0-8b95-dcd2de022378 tempest-DeleteServersTestJSON-1147269655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:50:25 devstack sudo[89815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 Jul 13 13:50:25 devstack sudo[89815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:50:25 devstack sudo[89815]: pam_unix(sudo:session): session closed for user root Jul 13 13:50:25 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-14a35178-9ae2-46c0-8b95-dcd2de022378 tempest-DeleteServersTestJSON-1147269655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78" returned: 0 in 0.393s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:50:25 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-14a35178-9ae2-46c0-8b95-dcd2de022378 tempest-DeleteServersTestJSON-1147269655 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 13:50:25 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-14a35178-9ae2-46c0-8b95-dcd2de022378 tempest-DeleteServersTestJSON-1147269655 None] Deleted volume successfully. Jul 13 13:50:25 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-14a35178-9ae2-46c0-8b95-dcd2de022378 tempest-DeleteServersTestJSON-1147269655 None] Lock "cinder-6c8ed443-557e-47e5-8be7-af61112793fb-delete_volume" released by "delete_volume" :: held 2.156s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 13:50:29 devstack cinder-volume[87098]: DEBUG oslo_service.periodic_task [None req-727a1692-ea28-4a77-b327-0d94e8f01efb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87098) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 13 13:50:29 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-727a1692-ea28-4a77-b327-0d94e8f01efb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:50:29 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-727a1692-ea28-4a77-b327-0d94e8f01efb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:50:29 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-727a1692-ea28-4a77-b327-0d94e8f01efb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 13:50:29 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-727a1692-ea28-4a77-b327-0d94e8f01efb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 13:50:29 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-727a1692-ea28-4a77-b327-0d94e8f01efb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:50:29 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-727a1692-ea28-4a77-b327-0d94e8f01efb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:50:29 devstack sudo[89838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 Jul 13 13:50:29 devstack sudo[89838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:50:29 devstack sudo[89838]: pam_unix(sudo:session): session closed for user root Jul 13 13:50:29 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-727a1692-ea28-4a77-b327-0d94e8f01efb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78" returned: 0 in 0.443s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:50:29 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-727a1692-ea28-4a77-b327-0d94e8f01efb None None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 13:50:35 devstack cinder-volume[87098]: DEBUG dbcounter [-] [87098] Writing DB stats cinder:SELECT=45,cinder:UPDATE=31,cinder:INSERT=5,cinder:DELETE=2 {{(pid=87098) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 13 13:50:35 devstack cinder-volume[87098]: DEBUG dbcounter [-] [87098] Writing DB stats cinder:SELECT=31,cinder:UPDATE=25,cinder:INSERT=5,cinder:DELETE=2 {{(pid=87098) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 13 13:50:38 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [req-9f4ad007-8b8d-4a30-8e55-9b8e7861edf4 req-fa868e2c-e28d-4351-98ba-9e83c40da9d6 tempest-VolumesGetTestJSON-1421670201 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 13:50:38 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [req-9f4ad007-8b8d-4a30-8e55-9b8e7861edf4 req-fa868e2c-e28d-4351-98ba-9e83c40da9d6 tempest-VolumesGetTestJSON-1421670201 None] Flow 'volume_create_manager' (4ffbf9b1-8b55-42f9-be8a-794d6a6b6d5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 13:50:38 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [req-9f4ad007-8b8d-4a30-8e55-9b8e7861edf4 req-fa868e2c-e28d-4351-98ba-9e83c40da9d6 tempest-VolumesGetTestJSON-1421670201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e02ce962-352b-4da7-a891-2d9251cc9f68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:50:38 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [req-9f4ad007-8b8d-4a30-8e55-9b8e7861edf4 req-fa868e2c-e28d-4351-98ba-9e83c40da9d6 tempest-VolumesGetTestJSON-1421670201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e02ce962-352b-4da7-a891-2d9251cc9f68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T11:50:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1574487281',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f723d97-92c0-432e-aca9-ad059c92f596,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='161ca0adc156490c80d5521d2966170d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T11:50:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T11:50:38Z,use_quota=True,user_id='82c9eeeeac3d4dae9538b38858931995',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1147de8b-623b-426c-a13d-7fc824a80f67),volume_type_id=1147de8b-623b-426c-a13d-7fc824a80f67)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:50:38 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [req-9f4ad007-8b8d-4a30-8e55-9b8e7861edf4 req-fa868e2c-e28d-4351-98ba-9e83c40da9d6 tempest-VolumesGetTestJSON-1421670201 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c69ae31a-902e-4cab-9b1f-aeeca47187e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:50:38 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [req-9f4ad007-8b8d-4a30-8e55-9b8e7861edf4 req-fa868e2c-e28d-4351-98ba-9e83c40da9d6 tempest-VolumesGetTestJSON-1421670201 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c69ae31a-902e-4cab-9b1f-aeeca47187e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:50:38 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [req-9f4ad007-8b8d-4a30-8e55-9b8e7861edf4 req-fa868e2c-e28d-4351-98ba-9e83c40da9d6 tempest-VolumesGetTestJSON-1421670201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6617a18c-5856-44d5-8e78-3aeab3fbfc87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:50:38 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [req-9f4ad007-8b8d-4a30-8e55-9b8e7861edf4 req-fa868e2c-e28d-4351-98ba-9e83c40da9d6 tempest-VolumesGetTestJSON-1421670201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6617a18c-5856-44d5-8e78-3aeab3fbfc87) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8f723d97-92c0-432e-aca9-ad059c92f596', 'volume_name': 'volume-8f723d97-92c0-432e-aca9-ad059c92f596', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:50:38 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [req-9f4ad007-8b8d-4a30-8e55-9b8e7861edf4 req-fa868e2c-e28d-4351-98ba-9e83c40da9d6 tempest-VolumesGetTestJSON-1421670201 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6a6a4ea-b951-4023-bf78-dc97606d7d78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:50:38 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [req-9f4ad007-8b8d-4a30-8e55-9b8e7861edf4 req-fa868e2c-e28d-4351-98ba-9e83c40da9d6 tempest-VolumesGetTestJSON-1421670201 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6a6a4ea-b951-4023-bf78-dc97606d7d78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:50:38 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [req-9f4ad007-8b8d-4a30-8e55-9b8e7861edf4 req-fa868e2c-e28d-4351-98ba-9e83c40da9d6 tempest-VolumesGetTestJSON-1421670201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cea81ab1-340d-4df9-9e4e-d2759ba72226) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:50:38 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [req-9f4ad007-8b8d-4a30-8e55-9b8e7861edf4 req-fa868e2c-e28d-4351-98ba-9e83c40da9d6 tempest-VolumesGetTestJSON-1421670201 None] Volume 8f723d97-92c0-432e-aca9-ad059c92f596: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8f723d97-92c0-432e-aca9-ad059c92f596', 'volume_size': 1} Jul 13 13:50:38 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [req-9f4ad007-8b8d-4a30-8e55-9b8e7861edf4 req-fa868e2c-e28d-4351-98ba-9e83c40da9d6 tempest-VolumesGetTestJSON-1421670201 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:50:38 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [req-9f4ad007-8b8d-4a30-8e55-9b8e7861edf4 req-fa868e2c-e28d-4351-98ba-9e83c40da9d6 tempest-VolumesGetTestJSON-1421670201 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:50:38 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [req-9f4ad007-8b8d-4a30-8e55-9b8e7861edf4 req-fa868e2c-e28d-4351-98ba-9e83c40da9d6 tempest-VolumesGetTestJSON-1421670201 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T11:50:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1574487281',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f723d97-92c0-432e-aca9-ad059c92f596,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='161ca0adc156490c80d5521d2966170d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T11:50:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T11:50:38Z,use_quota=True,user_id='82c9eeeeac3d4dae9538b38858931995',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1147de8b-623b-426c-a13d-7fc824a80f67),volume_type_id=1147de8b-623b-426c-a13d-7fc824a80f67)}" {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 13 13:50:38 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [req-9f4ad007-8b8d-4a30-8e55-9b8e7861edf4 req-fa868e2c-e28d-4351-98ba-9e83c40da9d6 tempest-VolumesGetTestJSON-1421670201 None] Creating volume 8f723d97-92c0-432e-aca9-ad059c92f596 {{(pid=87098) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 13 13:50:38 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [req-9f4ad007-8b8d-4a30-8e55-9b8e7861edf4 req-fa868e2c-e28d-4351-98ba-9e83c40da9d6 tempest-VolumesGetTestJSON-1421670201 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:50:38 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [req-9f4ad007-8b8d-4a30-8e55-9b8e7861edf4 req-fa868e2c-e28d-4351-98ba-9e83c40da9d6 tempest-VolumesGetTestJSON-1421670201 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:50:38 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [req-9f4ad007-8b8d-4a30-8e55-9b8e7861edf4 req-fa868e2c-e28d-4351-98ba-9e83c40da9d6 tempest-VolumesGetTestJSON-1421670201 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 13:50:38 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [req-9f4ad007-8b8d-4a30-8e55-9b8e7861edf4 req-fa868e2c-e28d-4351-98ba-9e83c40da9d6 tempest-VolumesGetTestJSON-1421670201 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 13:50:38 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [req-9f4ad007-8b8d-4a30-8e55-9b8e7861edf4 req-fa868e2c-e28d-4351-98ba-9e83c40da9d6 tempest-VolumesGetTestJSON-1421670201 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:50:38 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [req-9f4ad007-8b8d-4a30-8e55-9b8e7861edf4 req-fa868e2c-e28d-4351-98ba-9e83c40da9d6 tempest-VolumesGetTestJSON-1421670201 None] Selected osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 13:50:38 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [req-9f4ad007-8b8d-4a30-8e55-9b8e7861edf4 req-fa868e2c-e28d-4351-98ba-9e83c40da9d6 tempest-VolumesGetTestJSON-1421670201 None] casted to osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 Jul 13 13:50:38 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [req-9f4ad007-8b8d-4a30-8e55-9b8e7861edf4 req-fa868e2c-e28d-4351-98ba-9e83c40da9d6 tempest-VolumesGetTestJSON-1421670201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-8f723d97-92c0-432e-aca9-ad059c92f596 1073741824 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:50:38 devstack sudo[89940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-8f723d97-92c0-432e-aca9-ad059c92f596 1073741824 Jul 13 13:50:38 devstack sudo[89940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:50:39 devstack sudo[89940]: pam_unix(sudo:session): session closed for user root Jul 13 13:50:39 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [req-9f4ad007-8b8d-4a30-8e55-9b8e7861edf4 req-fa868e2c-e28d-4351-98ba-9e83c40da9d6 tempest-VolumesGetTestJSON-1421670201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-8f723d97-92c0-432e-aca9-ad059c92f596 1073741824" returned: 0 in 0.689s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:50:39 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [req-9f4ad007-8b8d-4a30-8e55-9b8e7861edf4 req-fa868e2c-e28d-4351-98ba-9e83c40da9d6 tempest-VolumesGetTestJSON-1421670201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-8f723d97-92c0-432e-aca9-ad059c92f596 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:50:39 devstack sudo[89948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-8f723d97-92c0-432e-aca9-ad059c92f596 Jul 13 13:50:39 devstack sudo[89948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:50:39 devstack sudo[89948]: pam_unix(sudo:session): session closed for user root Jul 13 13:50:39 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [req-9f4ad007-8b8d-4a30-8e55-9b8e7861edf4 req-fa868e2c-e28d-4351-98ba-9e83c40da9d6 tempest-VolumesGetTestJSON-1421670201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-8f723d97-92c0-432e-aca9-ad059c92f596" returned: 0 in 0.475s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:50:39 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [req-9f4ad007-8b8d-4a30-8e55-9b8e7861edf4 req-fa868e2c-e28d-4351-98ba-9e83c40da9d6 tempest-VolumesGetTestJSON-1421670201 None] <== create_volume: return (1230ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'} {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 13 13:50:39 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [req-9f4ad007-8b8d-4a30-8e55-9b8e7861edf4 req-fa868e2c-e28d-4351-98ba-9e83c40da9d6 tempest-VolumesGetTestJSON-1421670201 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.235s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:50:39 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [req-9f4ad007-8b8d-4a30-8e55-9b8e7861edf4 req-fa868e2c-e28d-4351-98ba-9e83c40da9d6 tempest-VolumesGetTestJSON-1421670201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cea81ab1-340d-4df9-9e4e-d2759ba72226) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8f723d97-92c0-432e-aca9-ad059c92f596', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:50:39 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [req-9f4ad007-8b8d-4a30-8e55-9b8e7861edf4 req-fa868e2c-e28d-4351-98ba-9e83c40da9d6 tempest-VolumesGetTestJSON-1421670201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b184e33-1243-4b72-aaf6-011ff2b28849) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:50:39 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [req-9f4ad007-8b8d-4a30-8e55-9b8e7861edf4 req-fa868e2c-e28d-4351-98ba-9e83c40da9d6 tempest-VolumesGetTestJSON-1421670201 None] Volume volume-8f723d97-92c0-432e-aca9-ad059c92f596 (8f723d97-92c0-432e-aca9-ad059c92f596): created successfully Jul 13 13:50:39 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [req-9f4ad007-8b8d-4a30-8e55-9b8e7861edf4 req-fa868e2c-e28d-4351-98ba-9e83c40da9d6 tempest-VolumesGetTestJSON-1421670201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b184e33-1243-4b72-aaf6-011ff2b28849) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:50:39 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [req-9f4ad007-8b8d-4a30-8e55-9b8e7861edf4 req-fa868e2c-e28d-4351-98ba-9e83c40da9d6 tempest-VolumesGetTestJSON-1421670201 None] Flow 'volume_create_manager' (4ffbf9b1-8b55-42f9-be8a-794d6a6b6d5e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 13:50:39 devstack cinder-volume[87098]: INFO cinder.volume.manager [req-9f4ad007-8b8d-4a30-8e55-9b8e7861edf4 req-fa868e2c-e28d-4351-98ba-9e83c40da9d6 tempest-VolumesGetTestJSON-1421670201 None] Created volume successfully. Jul 13 13:50:40 devstack cinder-volume[87098]: DEBUG cinder.coordination [req-1cf3a76c-50f3-4735-8a95-6187d9aa9c4a req-72f4cf7f-881f-4c34-89b1-4ff906e88cf6 tempest-VolumesGetTestJSON-1421670201 None] Acquiring lock "cinder-8f723d97-92c0-432e-aca9-ad059c92f596-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 13:50:40 devstack cinder-volume[87098]: DEBUG cinder.coordination [req-1cf3a76c-50f3-4735-8a95-6187d9aa9c4a req-72f4cf7f-881f-4c34-89b1-4ff906e88cf6 tempest-VolumesGetTestJSON-1421670201 None] Lock "cinder-8f723d97-92c0-432e-aca9-ad059c92f596-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 13:50:41 devstack cinder-volume[87098]: DEBUG cinder.coordination [req-1cf3a76c-50f3-4735-8a95-6187d9aa9c4a req-72f4cf7f-881f-4c34-89b1-4ff906e88cf6 tempest-VolumesGetTestJSON-1421670201 None] Acquiring lock "cinder-quobyte-8f723d97-92c0-432e-aca9-ad059c92f596" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 13:50:41 devstack cinder-volume[87098]: DEBUG cinder.coordination [req-1cf3a76c-50f3-4735-8a95-6187d9aa9c4a req-72f4cf7f-881f-4c34-89b1-4ff906e88cf6 tempest-VolumesGetTestJSON-1421670201 None] Lock "cinder-quobyte-8f723d97-92c0-432e-aca9-ad059c92f596" acquired by "delete_volume" :: waited 0.028s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 13:50:41 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbcbc6d0-f5f2-4aa2-a7f6-85a6914fe63b]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 13:50:41 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [req-1cf3a76c-50f3-4735-8a95-6187d9aa9c4a req-72f4cf7f-881f-4c34-89b1-4ff906e88cf6 tempest-VolumesGetTestJSON-1421670201 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-8f723d97-92c0-432e-aca9-ad059c92f596 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:50:41 devstack sudo[89978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-8f723d97-92c0-432e-aca9-ad059c92f596 Jul 13 13:50:41 devstack sudo[89978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:50:41 devstack sudo[89978]: pam_unix(sudo:session): session closed for user root Jul 13 13:50:41 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [req-1cf3a76c-50f3-4735-8a95-6187d9aa9c4a req-72f4cf7f-881f-4c34-89b1-4ff906e88cf6 tempest-VolumesGetTestJSON-1421670201 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-8f723d97-92c0-432e-aca9-ad059c92f596" returned: 0 in 0.442s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:50:41 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [req-1cf3a76c-50f3-4735-8a95-6187d9aa9c4a req-72f4cf7f-881f-4c34-89b1-4ff906e88cf6 tempest-VolumesGetTestJSON-1421670201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-8f723d97-92c0-432e-aca9-ad059c92f596 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:50:41 devstack sudo[89983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-8f723d97-92c0-432e-aca9-ad059c92f596 Jul 13 13:50:41 devstack sudo[89983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:50:41 devstack sudo[89983]: pam_unix(sudo:session): session closed for user root Jul 13 13:50:41 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [req-1cf3a76c-50f3-4735-8a95-6187d9aa9c4a req-72f4cf7f-881f-4c34-89b1-4ff906e88cf6 tempest-VolumesGetTestJSON-1421670201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-8f723d97-92c0-432e-aca9-ad059c92f596" returned: 0 in 0.272s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:50:41 devstack cinder-volume[87098]: DEBUG cinder.coordination [req-1cf3a76c-50f3-4735-8a95-6187d9aa9c4a req-72f4cf7f-881f-4c34-89b1-4ff906e88cf6 tempest-VolumesGetTestJSON-1421670201 None] Lock "cinder-quobyte-8f723d97-92c0-432e-aca9-ad059c92f596" released by "delete_volume" :: held 0.758s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 13:50:41 devstack cinder-volume[87098]: DEBUG cinder.quota [req-1cf3a76c-50f3-4735-8a95-6187d9aa9c4a req-72f4cf7f-881f-4c34-89b1-4ff906e88cf6 tempest-VolumesGetTestJSON-1421670201 None] Created reservations ['f1167aa1-2784-435e-b605-c7649e632220', '958b744c-65a5-491b-bfc9-73f98a2009e4', 'cba32c73-ad17-4a99-9541-f5d96e39ef06', '4d525d56-2679-46d2-8f48-5fbae55cd105'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 13:50:41 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [req-1cf3a76c-50f3-4735-8a95-6187d9aa9c4a req-72f4cf7f-881f-4c34-89b1-4ff906e88cf6 tempest-VolumesGetTestJSON-1421670201 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:50:41 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [req-1cf3a76c-50f3-4735-8a95-6187d9aa9c4a req-72f4cf7f-881f-4c34-89b1-4ff906e88cf6 tempest-VolumesGetTestJSON-1421670201 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:50:41 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [req-1cf3a76c-50f3-4735-8a95-6187d9aa9c4a req-72f4cf7f-881f-4c34-89b1-4ff906e88cf6 tempest-VolumesGetTestJSON-1421670201 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 13:50:41 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [req-1cf3a76c-50f3-4735-8a95-6187d9aa9c4a req-72f4cf7f-881f-4c34-89b1-4ff906e88cf6 tempest-VolumesGetTestJSON-1421670201 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 13:50:41 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [req-1cf3a76c-50f3-4735-8a95-6187d9aa9c4a req-72f4cf7f-881f-4c34-89b1-4ff906e88cf6 tempest-VolumesGetTestJSON-1421670201 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:50:41 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [req-1cf3a76c-50f3-4735-8a95-6187d9aa9c4a req-72f4cf7f-881f-4c34-89b1-4ff906e88cf6 tempest-VolumesGetTestJSON-1421670201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:50:41 devstack sudo[89986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 Jul 13 13:50:41 devstack sudo[89986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:50:42 devstack sudo[89986]: pam_unix(sudo:session): session closed for user root Jul 13 13:50:42 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [req-1cf3a76c-50f3-4735-8a95-6187d9aa9c4a req-72f4cf7f-881f-4c34-89b1-4ff906e88cf6 tempest-VolumesGetTestJSON-1421670201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78" returned: 0 in 0.280s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:50:42 devstack cinder-volume[87098]: DEBUG cinder.manager [req-1cf3a76c-50f3-4735-8a95-6187d9aa9c4a req-72f4cf7f-881f-4c34-89b1-4ff906e88cf6 tempest-VolumesGetTestJSON-1421670201 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 13:50:42 devstack cinder-volume[87098]: INFO cinder.volume.manager [req-1cf3a76c-50f3-4735-8a95-6187d9aa9c4a req-72f4cf7f-881f-4c34-89b1-4ff906e88cf6 tempest-VolumesGetTestJSON-1421670201 None] Deleted volume successfully. Jul 13 13:50:42 devstack cinder-volume[87098]: DEBUG cinder.coordination [req-1cf3a76c-50f3-4735-8a95-6187d9aa9c4a req-72f4cf7f-881f-4c34-89b1-4ff906e88cf6 tempest-VolumesGetTestJSON-1421670201 None] Lock "cinder-8f723d97-92c0-432e-aca9-ad059c92f596-delete_volume" released by "delete_volume" :: held 1.303s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 13:50:49 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-291cd4cc-fd65-4887-8a07-db0bfc5a7980 tempest-GroupSnapshotsTest-803384794 None] Group tempest-GroupSnapshotsTest-Group-494678834: creating Jul 13 13:50:49 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-291cd4cc-fd65-4887-8a07-db0bfc5a7980 tempest-GroupSnapshotsTest-803384794 None] Group tempest-GroupSnapshotsTest-Group-494678834: created successfully Jul 13 13:50:49 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-291cd4cc-fd65-4887-8a07-db0bfc5a7980 tempest-GroupSnapshotsTest-803384794 None] Create group completed successfully. Jul 13 13:50:50 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b2e2f12-0c70-4f24-acb2-e78d8ca0ccfd tempest-GroupSnapshotsTest-803384794 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 13:50:50 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-5b2e2f12-0c70-4f24-acb2-e78d8ca0ccfd tempest-GroupSnapshotsTest-803384794 None] Flow 'volume_create_manager' (0a391185-6b7d-43a6-8def-97da63d32d62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 13:50:50 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-5b2e2f12-0c70-4f24-acb2-e78d8ca0ccfd tempest-GroupSnapshotsTest-803384794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e593e1a1-d49e-47c6-ab30-e929dc679259) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:50:51 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-5b2e2f12-0c70-4f24-acb2-e78d8ca0ccfd tempest-GroupSnapshotsTest-803384794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e593e1a1-d49e-47c6-ab30-e929dc679259) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T11:50:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-391682480',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a88e817e-1345-4b54-b483-7d30bb9595d7,host='devstack@QuobyteHD#QuobyteHD',id=37602eab-5ea9-4ae6-9734-b7e248a22f81,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d230cd5df37249c2889f13684894daaf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T11:50:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T11:50:51Z,use_quota=True,user_id='2d6e7b464a7a4c6a8957aa2e2008eb6c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1576673-f4d4-46b1-bbb3-b8ca90239ad6),volume_type_id=c1576673-f4d4-46b1-bbb3-b8ca90239ad6)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:50:51 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-5b2e2f12-0c70-4f24-acb2-e78d8ca0ccfd tempest-GroupSnapshotsTest-803384794 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94202792-de3c-4b2d-bdca-dc54a44e7216) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:50:51 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-5b2e2f12-0c70-4f24-acb2-e78d8ca0ccfd tempest-GroupSnapshotsTest-803384794 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94202792-de3c-4b2d-bdca-dc54a44e7216) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:50:51 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-5b2e2f12-0c70-4f24-acb2-e78d8ca0ccfd tempest-GroupSnapshotsTest-803384794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1974b97e-48bd-4fbf-ac2f-292b2dcc4828) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:50:51 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-5b2e2f12-0c70-4f24-acb2-e78d8ca0ccfd tempest-GroupSnapshotsTest-803384794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1974b97e-48bd-4fbf-ac2f-292b2dcc4828) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '37602eab-5ea9-4ae6-9734-b7e248a22f81', 'volume_name': 'volume-37602eab-5ea9-4ae6-9734-b7e248a22f81', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:50:51 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-5b2e2f12-0c70-4f24-acb2-e78d8ca0ccfd tempest-GroupSnapshotsTest-803384794 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9aa82ed-148b-4fea-9034-620c2522dc87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:50:51 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-5b2e2f12-0c70-4f24-acb2-e78d8ca0ccfd tempest-GroupSnapshotsTest-803384794 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9aa82ed-148b-4fea-9034-620c2522dc87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:50:51 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-5b2e2f12-0c70-4f24-acb2-e78d8ca0ccfd tempest-GroupSnapshotsTest-803384794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2eb34557-d866-4594-a28b-71a54104b13e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:50:51 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-5b2e2f12-0c70-4f24-acb2-e78d8ca0ccfd tempest-GroupSnapshotsTest-803384794 None] Volume 37602eab-5ea9-4ae6-9734-b7e248a22f81: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-37602eab-5ea9-4ae6-9734-b7e248a22f81', 'volume_size': 1} Jul 13 13:50:51 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-5b2e2f12-0c70-4f24-acb2-e78d8ca0ccfd tempest-GroupSnapshotsTest-803384794 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:50:51 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-5b2e2f12-0c70-4f24-acb2-e78d8ca0ccfd tempest-GroupSnapshotsTest-803384794 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:50:51 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-5b2e2f12-0c70-4f24-acb2-e78d8ca0ccfd tempest-GroupSnapshotsTest-803384794 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=a88e817e-1345-4b54-b483-7d30bb9595d7,created_at=2026-07-13T11:50:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-391682480',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a88e817e-1345-4b54-b483-7d30bb9595d7,host='devstack@QuobyteHD#QuobyteHD',id=37602eab-5ea9-4ae6-9734-b7e248a22f81,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d230cd5df37249c2889f13684894daaf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T11:50:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T11:50:51Z,use_quota=True,user_id='2d6e7b464a7a4c6a8957aa2e2008eb6c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1576673-f4d4-46b1-bbb3-b8ca90239ad6),volume_type_id=c1576673-f4d4-46b1-bbb3-b8ca90239ad6)}" {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 13 13:50:51 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-5b2e2f12-0c70-4f24-acb2-e78d8ca0ccfd tempest-GroupSnapshotsTest-803384794 None] Creating volume 37602eab-5ea9-4ae6-9734-b7e248a22f81 {{(pid=87098) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 13 13:50:51 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-5b2e2f12-0c70-4f24-acb2-e78d8ca0ccfd tempest-GroupSnapshotsTest-803384794 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:50:51 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-5b2e2f12-0c70-4f24-acb2-e78d8ca0ccfd tempest-GroupSnapshotsTest-803384794 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:50:51 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-5b2e2f12-0c70-4f24-acb2-e78d8ca0ccfd tempest-GroupSnapshotsTest-803384794 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 13:50:51 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-5b2e2f12-0c70-4f24-acb2-e78d8ca0ccfd tempest-GroupSnapshotsTest-803384794 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 13:50:51 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-5b2e2f12-0c70-4f24-acb2-e78d8ca0ccfd tempest-GroupSnapshotsTest-803384794 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:50:51 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-5b2e2f12-0c70-4f24-acb2-e78d8ca0ccfd tempest-GroupSnapshotsTest-803384794 None] Selected osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 13:50:51 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-5b2e2f12-0c70-4f24-acb2-e78d8ca0ccfd tempest-GroupSnapshotsTest-803384794 None] casted to osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 Jul 13 13:50:51 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-5b2e2f12-0c70-4f24-acb2-e78d8ca0ccfd tempest-GroupSnapshotsTest-803384794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-37602eab-5ea9-4ae6-9734-b7e248a22f81 1073741824 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:50:51 devstack sudo[90025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-37602eab-5ea9-4ae6-9734-b7e248a22f81 1073741824 Jul 13 13:50:51 devstack sudo[90025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:50:51 devstack sudo[90025]: pam_unix(sudo:session): session closed for user root Jul 13 13:50:51 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-5b2e2f12-0c70-4f24-acb2-e78d8ca0ccfd tempest-GroupSnapshotsTest-803384794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-37602eab-5ea9-4ae6-9734-b7e248a22f81 1073741824" returned: 0 in 0.793s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:50:51 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-5b2e2f12-0c70-4f24-acb2-e78d8ca0ccfd tempest-GroupSnapshotsTest-803384794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-37602eab-5ea9-4ae6-9734-b7e248a22f81 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:50:51 devstack sudo[90038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-37602eab-5ea9-4ae6-9734-b7e248a22f81 Jul 13 13:50:51 devstack sudo[90038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:50:52 devstack cinder-volume[87098]: INFO cinder.volume.manager [req-5bf71acd-197a-4a5c-8af0-572c91a917f2 req-df78436c-2cd7-4971-9668-1011fd4ce70a tempest-ServerActionsTestOtherA-1029806651 None] Terminate volume connection completed successfully. Jul 13 13:50:52 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [req-5bf71acd-197a-4a5c-8af0-572c91a917f2 req-df78436c-2cd7-4971-9668-1011fd4ce70a tempest-ServerActionsTestOtherA-1029806651 None] Deleting attachment 5674d292-74e6-44a3-934b-ff40f165537a. {{(pid=87098) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 13 13:50:52 devstack sudo[90038]: pam_unix(sudo:session): session closed for user root Jul 13 13:50:52 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-5b2e2f12-0c70-4f24-acb2-e78d8ca0ccfd tempest-GroupSnapshotsTest-803384794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-37602eab-5ea9-4ae6-9734-b7e248a22f81" returned: 0 in 0.477s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:50:52 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-5b2e2f12-0c70-4f24-acb2-e78d8ca0ccfd tempest-GroupSnapshotsTest-803384794 None] <== create_volume: return (1323ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'} {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 13 13:50:52 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-5b2e2f12-0c70-4f24-acb2-e78d8ca0ccfd tempest-GroupSnapshotsTest-803384794 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.342s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:50:52 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-5b2e2f12-0c70-4f24-acb2-e78d8ca0ccfd tempest-GroupSnapshotsTest-803384794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2eb34557-d866-4594-a28b-71a54104b13e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-37602eab-5ea9-4ae6-9734-b7e248a22f81', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:50:52 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-5b2e2f12-0c70-4f24-acb2-e78d8ca0ccfd tempest-GroupSnapshotsTest-803384794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc51ec9c-9688-45c1-86da-f92b20816cff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:50:52 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-5b2e2f12-0c70-4f24-acb2-e78d8ca0ccfd tempest-GroupSnapshotsTest-803384794 None] Volume volume-37602eab-5ea9-4ae6-9734-b7e248a22f81 (37602eab-5ea9-4ae6-9734-b7e248a22f81): created successfully Jul 13 13:50:52 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-5b2e2f12-0c70-4f24-acb2-e78d8ca0ccfd tempest-GroupSnapshotsTest-803384794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc51ec9c-9688-45c1-86da-f92b20816cff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:50:52 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-5b2e2f12-0c70-4f24-acb2-e78d8ca0ccfd tempest-GroupSnapshotsTest-803384794 None] Flow 'volume_create_manager' (0a391185-6b7d-43a6-8def-97da63d32d62) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 13:50:52 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-5b2e2f12-0c70-4f24-acb2-e78d8ca0ccfd tempest-GroupSnapshotsTest-803384794 None] Created volume successfully. Jul 13 13:50:54 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-dfdd9335-640a-48ce-918f-80ff3b9af26c tempest-GroupSnapshotsTest-803384794 None] GroupSnapshot 65837490-4ec1-4357-bae5-e81b60eff750: creating. Jul 13 13:50:54 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-dfdd9335-640a-48ce-918f-80ff3b9af26c tempest-GroupSnapshotsTest-803384794 None] Group snapshot 65837490-4ec1-4357-bae5-e81b60eff750: creating. {{(pid=87098) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 13 13:50:54 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-dfdd9335-640a-48ce-918f-80ff3b9af26c tempest-GroupSnapshotsTest-803384794 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:50:54 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-dfdd9335-640a-48ce-918f-80ff3b9af26c tempest-GroupSnapshotsTest-803384794 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:50:54 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-dfdd9335-640a-48ce-918f-80ff3b9af26c tempest-GroupSnapshotsTest-803384794 None] Creating offline snapshot 9c2b236b-fb44-4f6b-ae1f-88cd35f28549 of volume 37602eab-5ea9-4ae6-9734-b7e248a22f81 {{(pid=87098) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 13 13:50:54 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[49428784-d1e5-49ba-b0db-c80d09edc220]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 13:50:54 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-dfdd9335-640a-48ce-918f-80ff3b9af26c tempest-GroupSnapshotsTest-803384794 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-37602eab-5ea9-4ae6-9734-b7e248a22f81 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:50:54 devstack sudo[90098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-37602eab-5ea9-4ae6-9734-b7e248a22f81 Jul 13 13:50:54 devstack sudo[90098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:50:55 devstack sudo[90098]: pam_unix(sudo:session): session closed for user root Jul 13 13:50:55 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-dfdd9335-640a-48ce-918f-80ff3b9af26c tempest-GroupSnapshotsTest-803384794 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-37602eab-5ea9-4ae6-9734-b7e248a22f81" returned: 0 in 0.542s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:50:55 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-dfdd9335-640a-48ce-918f-80ff3b9af26c tempest-GroupSnapshotsTest-803384794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-37602eab-5ea9-4ae6-9734-b7e248a22f81,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-37602eab-5ea9-4ae6-9734-b7e248a22f81.9c2b236b-fb44-4f6b-ae1f-88cd35f28549 1G {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:50:55 devstack sudo[90104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-37602eab-5ea9-4ae6-9734-b7e248a22f81,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-37602eab-5ea9-4ae6-9734-b7e248a22f81.9c2b236b-fb44-4f6b-ae1f-88cd35f28549 1G Jul 13 13:50:55 devstack sudo[90104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:50:55 devstack sudo[90104]: pam_unix(sudo:session): session closed for user root Jul 13 13:50:55 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-dfdd9335-640a-48ce-918f-80ff3b9af26c tempest-GroupSnapshotsTest-803384794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-37602eab-5ea9-4ae6-9734-b7e248a22f81,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-37602eab-5ea9-4ae6-9734-b7e248a22f81.9c2b236b-fb44-4f6b-ae1f-88cd35f28549 1G" returned: 0 in 0.637s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:50:55 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-dfdd9335-640a-48ce-918f-80ff3b9af26c tempest-GroupSnapshotsTest-803384794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-37602eab-5ea9-4ae6-9734-b7e248a22f81 -F qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-37602eab-5ea9-4ae6-9734-b7e248a22f81.9c2b236b-fb44-4f6b-ae1f-88cd35f28549 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:50:55 devstack sudo[90112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-37602eab-5ea9-4ae6-9734-b7e248a22f81 -F qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-37602eab-5ea9-4ae6-9734-b7e248a22f81.9c2b236b-fb44-4f6b-ae1f-88cd35f28549 Jul 13 13:50:55 devstack sudo[90112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:50:56 devstack sudo[90112]: pam_unix(sudo:session): session closed for user root Jul 13 13:50:56 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-dfdd9335-640a-48ce-918f-80ff3b9af26c tempest-GroupSnapshotsTest-803384794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-37602eab-5ea9-4ae6-9734-b7e248a22f81 -F qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-37602eab-5ea9-4ae6-9734-b7e248a22f81.9c2b236b-fb44-4f6b-ae1f-88cd35f28549" returned: 0 in 0.587s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:50:56 devstack cinder-volume[87098]: WARNING cinder.volume.drivers.remotefs [None req-dfdd9335-640a-48ce-918f-80ff3b9af26c tempest-GroupSnapshotsTest-803384794 None] /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-37602eab-5ea9-4ae6-9734-b7e248a22f81.9c2b236b-fb44-4f6b-ae1f-88cd35f28549 is being set with open permissions: ugo+rw: NotImplementedError Jul 13 13:50:56 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-dfdd9335-640a-48ce-918f-80ff3b9af26c tempest-GroupSnapshotsTest-803384794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-37602eab-5ea9-4ae6-9734-b7e248a22f81.9c2b236b-fb44-4f6b-ae1f-88cd35f28549 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:50:56 devstack sudo[90120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-37602eab-5ea9-4ae6-9734-b7e248a22f81.9c2b236b-fb44-4f6b-ae1f-88cd35f28549 Jul 13 13:50:56 devstack sudo[90120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:50:56 devstack sudo[90120]: pam_unix(sudo:session): session closed for user root Jul 13 13:50:56 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-dfdd9335-640a-48ce-918f-80ff3b9af26c tempest-GroupSnapshotsTest-803384794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-37602eab-5ea9-4ae6-9734-b7e248a22f81.9c2b236b-fb44-4f6b-ae1f-88cd35f28549" returned: 0 in 0.481s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:50:56 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-dfdd9335-640a-48ce-918f-80ff3b9af26c tempest-GroupSnapshotsTest-803384794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-37602eab-5ea9-4ae6-9734-b7e248a22f81.info {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:50:56 devstack sudo[90132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-37602eab-5ea9-4ae6-9734-b7e248a22f81.info Jul 13 13:50:56 devstack sudo[90132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:50:57 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-dfdd9335-640a-48ce-918f-80ff3b9af26c tempest-GroupSnapshotsTest-803384794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-37602eab-5ea9-4ae6-9734-b7e248a22f81.info" returned: 0 in 1.092s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:50:57 devstack cinder-volume[87098]: WARNING cinder.volume.drivers.remotefs [None req-dfdd9335-640a-48ce-918f-80ff3b9af26c tempest-GroupSnapshotsTest-803384794 None] /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-37602eab-5ea9-4ae6-9734-b7e248a22f81.info is being set with open permissions: ugo+rw: NotImplementedError Jul 13 13:50:57 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-dfdd9335-640a-48ce-918f-80ff3b9af26c tempest-GroupSnapshotsTest-803384794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-37602eab-5ea9-4ae6-9734-b7e248a22f81.info {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:50:57 devstack sudo[90132]: pam_unix(sudo:session): session closed for user root Jul 13 13:50:58 devstack sudo[90223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-37602eab-5ea9-4ae6-9734-b7e248a22f81.info Jul 13 13:50:58 devstack sudo[90223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:50:58 devstack sudo[90223]: pam_unix(sudo:session): session closed for user root Jul 13 13:50:58 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-dfdd9335-640a-48ce-918f-80ff3b9af26c tempest-GroupSnapshotsTest-803384794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-37602eab-5ea9-4ae6-9734-b7e248a22f81.info" returned: 0 in 1.001s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:50:58 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-dfdd9335-640a-48ce-918f-80ff3b9af26c tempest-GroupSnapshotsTest-803384794 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.506s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:50:59 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-dfdd9335-640a-48ce-918f-80ff3b9af26c tempest-GroupSnapshotsTest-803384794 None] group_snapshot 65837490-4ec1-4357-bae5-e81b60eff750: created successfully Jul 13 13:51:02 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-f9129c06-4abc-4f12-925f-3426a125a99c tempest-GroupSnapshotsTest-803384794 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:51:02 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-f9129c06-4abc-4f12-925f-3426a125a99c tempest-GroupSnapshotsTest-803384794 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:51:02 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-f9129c06-4abc-4f12-925f-3426a125a99c tempest-GroupSnapshotsTest-803384794 None] Acquiring lock "cinder-quobyte-9c2b236b-fb44-4f6b-ae1f-88cd35f28549-f7dff220-a63b-4295-be41-acad14bf1f3b" by "_create_volume_from_snapshot" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 13:51:02 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-f9129c06-4abc-4f12-925f-3426a125a99c tempest-GroupSnapshotsTest-803384794 None] Lock "cinder-quobyte-9c2b236b-fb44-4f6b-ae1f-88cd35f28549-f7dff220-a63b-4295-be41-acad14bf1f3b" acquired by "_create_volume_from_snapshot" :: waited 0.033s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 13:51:02 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-f9129c06-4abc-4f12-925f-3426a125a99c tempest-GroupSnapshotsTest-803384794 None] Creating volume f7dff220-a63b-4295-be41-acad14bf1f3b from snapshot 9c2b236b-fb44-4f6b-ae1f-88cd35f28549 {{(pid=87098) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 13 13:51:02 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-f9129c06-4abc-4f12-925f-3426a125a99c tempest-GroupSnapshotsTest-803384794 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:51:02 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-f9129c06-4abc-4f12-925f-3426a125a99c tempest-GroupSnapshotsTest-803384794 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:51:02 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-f9129c06-4abc-4f12-925f-3426a125a99c tempest-GroupSnapshotsTest-803384794 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 13:51:02 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-f9129c06-4abc-4f12-925f-3426a125a99c tempest-GroupSnapshotsTest-803384794 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 13:51:02 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-f9129c06-4abc-4f12-925f-3426a125a99c tempest-GroupSnapshotsTest-803384794 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:51:02 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-f9129c06-4abc-4f12-925f-3426a125a99c tempest-GroupSnapshotsTest-803384794 None] Selected osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 13:51:02 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-f9129c06-4abc-4f12-925f-3426a125a99c tempest-GroupSnapshotsTest-803384794 None] Acquiring lock "cinder-quobyte-f7dff220-a63b-4295-be41-acad14bf1f3b" by "_copy_volume_from_snapshot" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 13:51:02 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-f9129c06-4abc-4f12-925f-3426a125a99c tempest-GroupSnapshotsTest-803384794 None] Lock "cinder-quobyte-f7dff220-a63b-4295-be41-acad14bf1f3b" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 13:51:02 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-f9129c06-4abc-4f12-925f-3426a125a99c tempest-GroupSnapshotsTest-803384794 None] snapshot: 9c2b236b-fb44-4f6b-ae1f-88cd35f28549, volume: f7dff220-a63b-4295-be41-acad14bf1f3b, {{(pid=87098) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 13 13:51:02 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-f9129c06-4abc-4f12-925f-3426a125a99c tempest-GroupSnapshotsTest-803384794 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:51:02 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-f9129c06-4abc-4f12-925f-3426a125a99c tempest-GroupSnapshotsTest-803384794 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:51:02 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-f9129c06-4abc-4f12-925f-3426a125a99c tempest-GroupSnapshotsTest-803384794 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 13:51:02 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-f9129c06-4abc-4f12-925f-3426a125a99c tempest-GroupSnapshotsTest-803384794 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 13:51:02 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-f9129c06-4abc-4f12-925f-3426a125a99c tempest-GroupSnapshotsTest-803384794 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:51:02 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[63374e93-e3d0-4603-bb7e-35a93867dec6]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 13:51:02 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-f9129c06-4abc-4f12-925f-3426a125a99c tempest-GroupSnapshotsTest-803384794 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-37602eab-5ea9-4ae6-9734-b7e248a22f81.9c2b236b-fb44-4f6b-ae1f-88cd35f28549 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:51:02 devstack sudo[90306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-37602eab-5ea9-4ae6-9734-b7e248a22f81.9c2b236b-fb44-4f6b-ae1f-88cd35f28549 Jul 13 13:51:02 devstack sudo[90306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:51:03 devstack sudo[90306]: pam_unix(sudo:session): session closed for user root Jul 13 13:51:03 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-f9129c06-4abc-4f12-925f-3426a125a99c tempest-GroupSnapshotsTest-803384794 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-37602eab-5ea9-4ae6-9734-b7e248a22f81.9c2b236b-fb44-4f6b-ae1f-88cd35f28549" returned: 0 in 0.789s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:51:03 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-f9129c06-4abc-4f12-925f-3426a125a99c tempest-GroupSnapshotsTest-803384794 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-37602eab-5ea9-4ae6-9734-b7e248a22f81(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87098) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 13 13:51:03 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-f9129c06-4abc-4f12-925f-3426a125a99c tempest-GroupSnapshotsTest-803384794 None] will copy from snapshot at /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-37602eab-5ea9-4ae6-9734-b7e248a22f81 {{(pid=87098) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 13 13:51:03 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-f9129c06-4abc-4f12-925f-3426a125a99c tempest-GroupSnapshotsTest-803384794 None] Creating direct copy from snapshot {{(pid=87098) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 13 13:51:03 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae674855-b130-4beb-844b-aa8287fc4192]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 13:51:03 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-f9129c06-4abc-4f12-925f-3426a125a99c tempest-GroupSnapshotsTest-803384794 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-37602eab-5ea9-4ae6-9734-b7e248a22f81 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:51:03 devstack sudo[90313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-37602eab-5ea9-4ae6-9734-b7e248a22f81 Jul 13 13:51:03 devstack sudo[90313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:51:04 devstack sudo[90313]: pam_unix(sudo:session): session closed for user root Jul 13 13:51:04 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-f9129c06-4abc-4f12-925f-3426a125a99c tempest-GroupSnapshotsTest-803384794 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-37602eab-5ea9-4ae6-9734-b7e248a22f81" returned: 0 in 0.848s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:51:04 devstack cinder-volume[87098]: DEBUG cinder.utils [None req-f9129c06-4abc-4f12-925f-3426a125a99c tempest-GroupSnapshotsTest-803384794 None] Path /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-f7dff220-a63b-4295-be41-acad14bf1f3b not found in is_blk_device check {{(pid=87098) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 13 13:51:04 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-f9129c06-4abc-4f12-925f-3426a125a99c tempest-GroupSnapshotsTest-803384794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-37602eab-5ea9-4ae6-9734-b7e248a22f81 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-f7dff220-a63b-4295-be41-acad14bf1f3b {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:51:04 devstack sudo[90320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-37602eab-5ea9-4ae6-9734-b7e248a22f81 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-f7dff220-a63b-4295-be41-acad14bf1f3b Jul 13 13:51:04 devstack sudo[90320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:51:04 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-2fe23159-4c6b-43a8-bdfe-9aa8bf1b2cb4 tempest-ServerActionsTestOtherA-1029806651 None] Acquiring lock "cinder-0f69829c-8ad1-4f1a-b85f-71116dd67d6d-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 13:51:04 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-2fe23159-4c6b-43a8-bdfe-9aa8bf1b2cb4 tempest-ServerActionsTestOtherA-1029806651 None] Lock "cinder-0f69829c-8ad1-4f1a-b85f-71116dd67d6d-delete_volume" acquired by "delete_volume" :: waited 0.069s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 13:51:04 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-2fe23159-4c6b-43a8-bdfe-9aa8bf1b2cb4 tempest-ServerActionsTestOtherA-1029806651 None] Acquiring lock "cinder-quobyte-0f69829c-8ad1-4f1a-b85f-71116dd67d6d" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 13:51:04 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-2fe23159-4c6b-43a8-bdfe-9aa8bf1b2cb4 tempest-ServerActionsTestOtherA-1029806651 None] Lock "cinder-quobyte-0f69829c-8ad1-4f1a-b85f-71116dd67d6d" acquired by "delete_volume" :: waited 0.028s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 13:51:04 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[f748df7a-db0e-49ad-9f0d-7db6d0c51fe6]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 13:51:04 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-2fe23159-4c6b-43a8-bdfe-9aa8bf1b2cb4 tempest-ServerActionsTestOtherA-1029806651 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-0f69829c-8ad1-4f1a-b85f-71116dd67d6d {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:51:05 devstack sudo[90326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-0f69829c-8ad1-4f1a-b85f-71116dd67d6d Jul 13 13:51:05 devstack sudo[90326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:51:06 devstack sudo[90326]: pam_unix(sudo:session): session closed for user root Jul 13 13:51:06 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-2fe23159-4c6b-43a8-bdfe-9aa8bf1b2cb4 tempest-ServerActionsTestOtherA-1029806651 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-0f69829c-8ad1-4f1a-b85f-71116dd67d6d" returned: 0 in 2.003s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:51:06 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-2fe23159-4c6b-43a8-bdfe-9aa8bf1b2cb4 tempest-ServerActionsTestOtherA-1029806651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-0f69829c-8ad1-4f1a-b85f-71116dd67d6d {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:51:07 devstack sudo[90352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-0f69829c-8ad1-4f1a-b85f-71116dd67d6d Jul 13 13:51:07 devstack sudo[90352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:51:07 devstack sudo[90352]: pam_unix(sudo:session): session closed for user root Jul 13 13:51:07 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-2fe23159-4c6b-43a8-bdfe-9aa8bf1b2cb4 tempest-ServerActionsTestOtherA-1029806651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-0f69829c-8ad1-4f1a-b85f-71116dd67d6d" returned: 0 in 1.016s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:51:08 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-2fe23159-4c6b-43a8-bdfe-9aa8bf1b2cb4 tempest-ServerActionsTestOtherA-1029806651 None] Lock "cinder-quobyte-0f69829c-8ad1-4f1a-b85f-71116dd67d6d" released by "delete_volume" :: held 3.161s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 13:51:08 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-2fe23159-4c6b-43a8-bdfe-9aa8bf1b2cb4 tempest-ServerActionsTestOtherA-1029806651 None] Created reservations ['fd3fce0d-9610-43e7-890a-c5265bf804b9', 'e26b5b6e-64ba-4e1f-8ee4-aa105febec15', '3c949933-5005-4cfe-bf61-5cdf7c8bde7a', '37f7b8b3-ba53-4172-8551-ca88ca8bf33e'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 13:51:08 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-2fe23159-4c6b-43a8-bdfe-9aa8bf1b2cb4 tempest-ServerActionsTestOtherA-1029806651 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:51:08 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-2fe23159-4c6b-43a8-bdfe-9aa8bf1b2cb4 tempest-ServerActionsTestOtherA-1029806651 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:51:08 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-2fe23159-4c6b-43a8-bdfe-9aa8bf1b2cb4 tempest-ServerActionsTestOtherA-1029806651 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 13:51:08 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-2fe23159-4c6b-43a8-bdfe-9aa8bf1b2cb4 tempest-ServerActionsTestOtherA-1029806651 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 13:51:08 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-2fe23159-4c6b-43a8-bdfe-9aa8bf1b2cb4 tempest-ServerActionsTestOtherA-1029806651 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.042s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:51:08 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-2fe23159-4c6b-43a8-bdfe-9aa8bf1b2cb4 tempest-ServerActionsTestOtherA-1029806651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:51:09 devstack sudo[90356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 Jul 13 13:51:09 devstack sudo[90356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:51:09 devstack sudo[90356]: pam_unix(sudo:session): session closed for user root Jul 13 13:51:09 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-2fe23159-4c6b-43a8-bdfe-9aa8bf1b2cb4 tempest-ServerActionsTestOtherA-1029806651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78" returned: 0 in 0.927s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:51:09 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-2fe23159-4c6b-43a8-bdfe-9aa8bf1b2cb4 tempest-ServerActionsTestOtherA-1029806651 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 13:51:09 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-2fe23159-4c6b-43a8-bdfe-9aa8bf1b2cb4 tempest-ServerActionsTestOtherA-1029806651 None] Deleted volume successfully. Jul 13 13:51:09 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-2fe23159-4c6b-43a8-bdfe-9aa8bf1b2cb4 tempest-ServerActionsTestOtherA-1029806651 None] Lock "cinder-0f69829c-8ad1-4f1a-b85f-71116dd67d6d-delete_volume" released by "delete_volume" :: held 5.193s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 13:51:12 devstack cinder-volume[87098]: INFO cinder.volume.manager [req-cee531be-036f-4d1b-8762-6cc8d8b03a3f req-245d2cfd-fd46-42fa-b923-7ec47ef89450 tempest-AttachVolumeNegativeTest-468633374 None] Terminate volume connection completed successfully. Jul 13 13:51:12 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [req-cee531be-036f-4d1b-8762-6cc8d8b03a3f req-245d2cfd-fd46-42fa-b923-7ec47ef89450 tempest-AttachVolumeNegativeTest-468633374 None] Deleting attachment 69a459d8-1264-47e3-a3b2-9f73c411e341. {{(pid=87098) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 13 13:51:14 devstack sudo[90320]: pam_unix(sudo:session): session closed for user root Jul 13 13:51:14 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-f9129c06-4abc-4f12-925f-3426a125a99c tempest-GroupSnapshotsTest-803384794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-37602eab-5ea9-4ae6-9734-b7e248a22f81 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-f7dff220-a63b-4295-be41-acad14bf1f3b" returned: 0 in 10.644s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:51:14 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0530887-e906-46df-8279-7bb2cb5efaf8]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 13:51:14 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-f9129c06-4abc-4f12-925f-3426a125a99c tempest-GroupSnapshotsTest-803384794 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-37602eab-5ea9-4ae6-9734-b7e248a22f81 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:51:15 devstack sudo[90424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-37602eab-5ea9-4ae6-9734-b7e248a22f81 Jul 13 13:51:15 devstack sudo[90424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:51:16 devstack sudo[90424]: pam_unix(sudo:session): session closed for user root Jul 13 13:51:16 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-f9129c06-4abc-4f12-925f-3426a125a99c tempest-GroupSnapshotsTest-803384794 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-37602eab-5ea9-4ae6-9734-b7e248a22f81" returned: 0 in 1.323s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:51:16 devstack cinder-volume[87098]: DEBUG cinder.image.image_utils [None req-f9129c06-4abc-4f12-925f-3426a125a99c tempest-GroupSnapshotsTest-803384794 None] Image conversion details: src /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-37602eab-5ea9-4ae6-9734-b7e248a22f81, size 1024.00 MB, duration 10.65 sec, destination /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-f7dff220-a63b-4295-be41-acad14bf1f3b {{(pid=87098) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 13 13:51:16 devstack cinder-volume[87098]: INFO cinder.image.image_utils [None req-f9129c06-4abc-4f12-925f-3426a125a99c tempest-GroupSnapshotsTest-803384794 None] Converted 1024.00 MB image at 96.18 MB/s Jul 13 13:51:16 devstack cinder-volume[87098]: WARNING cinder.volume.drivers.remotefs [None req-f9129c06-4abc-4f12-925f-3426a125a99c tempest-GroupSnapshotsTest-803384794 None] /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-f7dff220-a63b-4295-be41-acad14bf1f3b is being set with open permissions: ugo+rw: NotImplementedError Jul 13 13:51:16 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-f9129c06-4abc-4f12-925f-3426a125a99c tempest-GroupSnapshotsTest-803384794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-f7dff220-a63b-4295-be41-acad14bf1f3b {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:51:16 devstack sudo[90471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-f7dff220-a63b-4295-be41-acad14bf1f3b Jul 13 13:51:16 devstack sudo[90471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:51:16 devstack sudo[90471]: pam_unix(sudo:session): session closed for user root Jul 13 13:51:16 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-f9129c06-4abc-4f12-925f-3426a125a99c tempest-GroupSnapshotsTest-803384794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-f7dff220-a63b-4295-be41-acad14bf1f3b" returned: 0 in 0.634s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:51:16 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-f9129c06-4abc-4f12-925f-3426a125a99c tempest-GroupSnapshotsTest-803384794 None] Lock "cinder-quobyte-f7dff220-a63b-4295-be41-acad14bf1f3b" released by "_copy_volume_from_snapshot" :: held 14.472s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 13:51:16 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-f9129c06-4abc-4f12-925f-3426a125a99c tempest-GroupSnapshotsTest-803384794 None] Lock "cinder-quobyte-9c2b236b-fb44-4f6b-ae1f-88cd35f28549-f7dff220-a63b-4295-be41-acad14bf1f3b" released by "_create_volume_from_snapshot" :: held 14.530s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 13:51:16 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-f9129c06-4abc-4f12-925f-3426a125a99c tempest-GroupSnapshotsTest-803384794 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 14.564s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:51:17 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-f9129c06-4abc-4f12-925f-3426a125a99c tempest-GroupSnapshotsTest-803384794 None] Create group from source-snapshot-65837490-4ec1-4357-bae5-e81b60eff750 completed successfully. Jul 13 13:51:18 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-a31a7e85-d200-44dc-a272-647ae6f24f68 tempest-ServerRescueNegativeTestJSON-2052165915 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 13:51:18 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-a31a7e85-d200-44dc-a272-647ae6f24f68 tempest-ServerRescueNegativeTestJSON-2052165915 None] Flow 'volume_create_manager' (2537e9d3-9cfc-4ee7-ae75-e3b213bb803c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 13:51:18 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-a31a7e85-d200-44dc-a272-647ae6f24f68 tempest-ServerRescueNegativeTestJSON-2052165915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f92a32f-e342-4e14-b7fd-51688c920c1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:51:18 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-a31a7e85-d200-44dc-a272-647ae6f24f68 tempest-ServerRescueNegativeTestJSON-2052165915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f92a32f-e342-4e14-b7fd-51688c920c1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T11:51:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-2107457480',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06d539cc-569f-479e-bf41-3d0a0b1670e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d8e65f52d70486098b07d2c23ce2dca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T11:51:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T11:51:18Z,use_quota=True,user_id='af60c1c0b0f94ecc9cb148ff02fe32f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1147de8b-623b-426c-a13d-7fc824a80f67),volume_type_id=1147de8b-623b-426c-a13d-7fc824a80f67)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:51:18 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-a31a7e85-d200-44dc-a272-647ae6f24f68 tempest-ServerRescueNegativeTestJSON-2052165915 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f265476-9384-4e22-bc1e-94c892abde92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:51:18 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-a31a7e85-d200-44dc-a272-647ae6f24f68 tempest-ServerRescueNegativeTestJSON-2052165915 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f265476-9384-4e22-bc1e-94c892abde92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:51:18 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-a31a7e85-d200-44dc-a272-647ae6f24f68 tempest-ServerRescueNegativeTestJSON-2052165915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6d91bac-358a-4ef6-9121-b9ec531c92e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:51:18 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-a31a7e85-d200-44dc-a272-647ae6f24f68 tempest-ServerRescueNegativeTestJSON-2052165915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6d91bac-358a-4ef6-9121-b9ec531c92e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '06d539cc-569f-479e-bf41-3d0a0b1670e3', 'volume_name': 'volume-06d539cc-569f-479e-bf41-3d0a0b1670e3', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:51:18 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-a31a7e85-d200-44dc-a272-647ae6f24f68 tempest-ServerRescueNegativeTestJSON-2052165915 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (527cdefe-c695-4a9b-bfc8-2943de590d48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:51:18 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-a31a7e85-d200-44dc-a272-647ae6f24f68 tempest-ServerRescueNegativeTestJSON-2052165915 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (527cdefe-c695-4a9b-bfc8-2943de590d48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:51:18 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-a31a7e85-d200-44dc-a272-647ae6f24f68 tempest-ServerRescueNegativeTestJSON-2052165915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a9ec2f8-04f6-4b6d-aee6-57e0856621e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:51:18 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-a31a7e85-d200-44dc-a272-647ae6f24f68 tempest-ServerRescueNegativeTestJSON-2052165915 None] Volume 06d539cc-569f-479e-bf41-3d0a0b1670e3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-06d539cc-569f-479e-bf41-3d0a0b1670e3', 'volume_size': 1} Jul 13 13:51:18 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-a31a7e85-d200-44dc-a272-647ae6f24f68 tempest-ServerRescueNegativeTestJSON-2052165915 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:51:18 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-a31a7e85-d200-44dc-a272-647ae6f24f68 tempest-ServerRescueNegativeTestJSON-2052165915 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:51:18 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-a31a7e85-d200-44dc-a272-647ae6f24f68 tempest-ServerRescueNegativeTestJSON-2052165915 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T11:51:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-2107457480',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06d539cc-569f-479e-bf41-3d0a0b1670e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d8e65f52d70486098b07d2c23ce2dca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T11:51:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T11:51:18Z,use_quota=True,user_id='af60c1c0b0f94ecc9cb148ff02fe32f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1147de8b-623b-426c-a13d-7fc824a80f67),volume_type_id=1147de8b-623b-426c-a13d-7fc824a80f67)}" {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 13 13:51:18 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-a31a7e85-d200-44dc-a272-647ae6f24f68 tempest-ServerRescueNegativeTestJSON-2052165915 None] Creating volume 06d539cc-569f-479e-bf41-3d0a0b1670e3 {{(pid=87098) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 13 13:51:18 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-a31a7e85-d200-44dc-a272-647ae6f24f68 tempest-ServerRescueNegativeTestJSON-2052165915 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:51:18 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-a31a7e85-d200-44dc-a272-647ae6f24f68 tempest-ServerRescueNegativeTestJSON-2052165915 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:51:18 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-a31a7e85-d200-44dc-a272-647ae6f24f68 tempest-ServerRescueNegativeTestJSON-2052165915 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 13:51:18 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-a31a7e85-d200-44dc-a272-647ae6f24f68 tempest-ServerRescueNegativeTestJSON-2052165915 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 13:51:18 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-a31a7e85-d200-44dc-a272-647ae6f24f68 tempest-ServerRescueNegativeTestJSON-2052165915 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:51:18 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-a31a7e85-d200-44dc-a272-647ae6f24f68 tempest-ServerRescueNegativeTestJSON-2052165915 None] Selected osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 13:51:18 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-a31a7e85-d200-44dc-a272-647ae6f24f68 tempest-ServerRescueNegativeTestJSON-2052165915 None] casted to osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 Jul 13 13:51:18 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-a31a7e85-d200-44dc-a272-647ae6f24f68 tempest-ServerRescueNegativeTestJSON-2052165915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-06d539cc-569f-479e-bf41-3d0a0b1670e3 1073741824 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:51:18 devstack sudo[90488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-06d539cc-569f-479e-bf41-3d0a0b1670e3 1073741824 Jul 13 13:51:18 devstack sudo[90488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:51:19 devstack sudo[90488]: pam_unix(sudo:session): session closed for user root Jul 13 13:51:19 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-a31a7e85-d200-44dc-a272-647ae6f24f68 tempest-ServerRescueNegativeTestJSON-2052165915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-06d539cc-569f-479e-bf41-3d0a0b1670e3 1073741824" returned: 0 in 0.698s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:51:19 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-a31a7e85-d200-44dc-a272-647ae6f24f68 tempest-ServerRescueNegativeTestJSON-2052165915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-06d539cc-569f-479e-bf41-3d0a0b1670e3 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:51:19 devstack sudo[90495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-06d539cc-569f-479e-bf41-3d0a0b1670e3 Jul 13 13:51:19 devstack sudo[90495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:51:19 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-e9bba370-1d9d-45e4-b035-306155843ef1 tempest-GroupSnapshotsTest-803384794 None] Acquiring lock "cinder-quobyte-f7dff220-a63b-4295-be41-acad14bf1f3b" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 13:51:19 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-e9bba370-1d9d-45e4-b035-306155843ef1 tempest-GroupSnapshotsTest-803384794 None] Lock "cinder-quobyte-f7dff220-a63b-4295-be41-acad14bf1f3b" acquired by "delete_volume" :: waited 0.073s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 13:51:19 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[73d892d7-0aec-4496-bdf0-b5eca743b0d0]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 13:51:19 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-e9bba370-1d9d-45e4-b035-306155843ef1 tempest-GroupSnapshotsTest-803384794 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-f7dff220-a63b-4295-be41-acad14bf1f3b {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:51:19 devstack sudo[90495]: pam_unix(sudo:session): session closed for user root Jul 13 13:51:19 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-a31a7e85-d200-44dc-a272-647ae6f24f68 tempest-ServerRescueNegativeTestJSON-2052165915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-06d539cc-569f-479e-bf41-3d0a0b1670e3" returned: 0 in 0.501s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:51:19 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-a31a7e85-d200-44dc-a272-647ae6f24f68 tempest-ServerRescueNegativeTestJSON-2052165915 None] <== create_volume: return (1283ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'} {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 13 13:51:19 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-a31a7e85-d200-44dc-a272-647ae6f24f68 tempest-ServerRescueNegativeTestJSON-2052165915 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.285s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:51:19 devstack sudo[90498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-f7dff220-a63b-4295-be41-acad14bf1f3b Jul 13 13:51:19 devstack sudo[90498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:51:19 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-a31a7e85-d200-44dc-a272-647ae6f24f68 tempest-ServerRescueNegativeTestJSON-2052165915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a9ec2f8-04f6-4b6d-aee6-57e0856621e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-06d539cc-569f-479e-bf41-3d0a0b1670e3', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:51:19 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-a31a7e85-d200-44dc-a272-647ae6f24f68 tempest-ServerRescueNegativeTestJSON-2052165915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (807fe584-10a7-40b1-bc76-212005caa2c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:51:19 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-a31a7e85-d200-44dc-a272-647ae6f24f68 tempest-ServerRescueNegativeTestJSON-2052165915 None] Volume volume-06d539cc-569f-479e-bf41-3d0a0b1670e3 (06d539cc-569f-479e-bf41-3d0a0b1670e3): created successfully Jul 13 13:51:19 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-a31a7e85-d200-44dc-a272-647ae6f24f68 tempest-ServerRescueNegativeTestJSON-2052165915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (807fe584-10a7-40b1-bc76-212005caa2c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:51:19 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-a31a7e85-d200-44dc-a272-647ae6f24f68 tempest-ServerRescueNegativeTestJSON-2052165915 None] Flow 'volume_create_manager' (2537e9d3-9cfc-4ee7-ae75-e3b213bb803c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 13:51:19 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-a31a7e85-d200-44dc-a272-647ae6f24f68 tempest-ServerRescueNegativeTestJSON-2052165915 None] Created volume successfully. Jul 13 13:51:20 devstack sudo[90498]: pam_unix(sudo:session): session closed for user root Jul 13 13:51:20 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-e9bba370-1d9d-45e4-b035-306155843ef1 tempest-GroupSnapshotsTest-803384794 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-f7dff220-a63b-4295-be41-acad14bf1f3b" returned: 0 in 0.469s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:51:20 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-e9bba370-1d9d-45e4-b035-306155843ef1 tempest-GroupSnapshotsTest-803384794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-f7dff220-a63b-4295-be41-acad14bf1f3b {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:51:20 devstack sudo[90504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-f7dff220-a63b-4295-be41-acad14bf1f3b Jul 13 13:51:20 devstack sudo[90504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:51:20 devstack sudo[90504]: pam_unix(sudo:session): session closed for user root Jul 13 13:51:20 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-e9bba370-1d9d-45e4-b035-306155843ef1 tempest-GroupSnapshotsTest-803384794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-f7dff220-a63b-4295-be41-acad14bf1f3b" returned: 0 in 0.469s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:51:20 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-e9bba370-1d9d-45e4-b035-306155843ef1 tempest-GroupSnapshotsTest-803384794 None] Lock "cinder-quobyte-f7dff220-a63b-4295-be41-acad14bf1f3b" released by "delete_volume" :: held 1.057s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 13:51:20 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-e9bba370-1d9d-45e4-b035-306155843ef1 tempest-GroupSnapshotsTest-803384794 None] Created reservations ['12b5e2f2-1988-460e-9213-fd057f304354'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 13:51:21 devstack cinder-volume[87098]: WARNING cinder.quota [None req-e9bba370-1d9d-45e4-b035-306155843ef1 tempest-GroupSnapshotsTest-803384794 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1584874140 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1584874140, it is now deprecated. Please use the default quota class for default quota. Jul 13 13:51:21 devstack cinder-volume[87098]: WARNING cinder.quota [None req-e9bba370-1d9d-45e4-b035-306155843ef1 tempest-GroupSnapshotsTest-803384794 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1584874140 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1584874140, it is now deprecated. Please use the default quota class for default quota. Jul 13 13:51:21 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-e9bba370-1d9d-45e4-b035-306155843ef1 tempest-GroupSnapshotsTest-803384794 None] Created reservations ['6e3a3aed-62ee-4aeb-8ada-dfc733c11daa', '337e6e96-572a-4d90-84cf-fab1cb0bf9f5', 'd1af7649-20be-40fc-97ef-d347a120fa4b', '604aec66-16e5-4dd3-885a-90c2305fa6ce'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 13:51:21 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-e9bba370-1d9d-45e4-b035-306155843ef1 tempest-GroupSnapshotsTest-803384794 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:51:21 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-e9bba370-1d9d-45e4-b035-306155843ef1 tempest-GroupSnapshotsTest-803384794 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:51:21 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-e9bba370-1d9d-45e4-b035-306155843ef1 tempest-GroupSnapshotsTest-803384794 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 13:51:21 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-e9bba370-1d9d-45e4-b035-306155843ef1 tempest-GroupSnapshotsTest-803384794 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 13:51:21 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-e9bba370-1d9d-45e4-b035-306155843ef1 tempest-GroupSnapshotsTest-803384794 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:51:21 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-e9bba370-1d9d-45e4-b035-306155843ef1 tempest-GroupSnapshotsTest-803384794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:51:21 devstack sudo[90509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 Jul 13 13:51:21 devstack sudo[90509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:51:21 devstack sudo[90509]: pam_unix(sudo:session): session closed for user root Jul 13 13:51:21 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-e9bba370-1d9d-45e4-b035-306155843ef1 tempest-GroupSnapshotsTest-803384794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78" returned: 0 in 0.369s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:51:21 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-e9bba370-1d9d-45e4-b035-306155843ef1 tempest-GroupSnapshotsTest-803384794 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 13:51:21 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-e9bba370-1d9d-45e4-b035-306155843ef1 tempest-GroupSnapshotsTest-803384794 None] Delete group completed successfully. Jul 13 13:51:22 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-a68b0feb-b889-4237-90a7-94425a4fd253 tempest-GroupSnapshotsTest-803384794 None] group_snapshot 65837490-4ec1-4357-bae5-e81b60eff750: deleting Jul 13 13:51:22 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-a68b0feb-b889-4237-90a7-94425a4fd253 tempest-GroupSnapshotsTest-803384794 None] group_snapshot 65837490-4ec1-4357-bae5-e81b60eff750: deleting {{(pid=87098) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 13 13:51:22 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-a68b0feb-b889-4237-90a7-94425a4fd253 tempest-GroupSnapshotsTest-803384794 None] Acquiring lock "cinder-quobyte-37602eab-5ea9-4ae6-9734-b7e248a22f81" by "delete_snapshot" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 13:51:22 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-a68b0feb-b889-4237-90a7-94425a4fd253 tempest-GroupSnapshotsTest-803384794 None] Lock "cinder-quobyte-37602eab-5ea9-4ae6-9734-b7e248a22f81" acquired by "delete_snapshot" :: waited 0.040s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 13:51:22 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-a68b0feb-b889-4237-90a7-94425a4fd253 tempest-GroupSnapshotsTest-803384794 None] Acquiring lock "cinder-quobyte-9c2b236b-fb44-4f6b-ae1f-88cd35f28549" by "_delete_snapshot" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 13:51:22 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-a68b0feb-b889-4237-90a7-94425a4fd253 tempest-GroupSnapshotsTest-803384794 None] Lock "cinder-quobyte-9c2b236b-fb44-4f6b-ae1f-88cd35f28549" acquired by "_delete_snapshot" :: waited 0.046s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 13:51:22 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-a68b0feb-b889-4237-90a7-94425a4fd253 tempest-GroupSnapshotsTest-803384794 None] Deleting offline snapshot 9c2b236b-fb44-4f6b-ae1f-88cd35f28549 of volume 37602eab-5ea9-4ae6-9734-b7e248a22f81 {{(pid=87098) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 13 13:51:22 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-a68b0feb-b889-4237-90a7-94425a4fd253 tempest-GroupSnapshotsTest-803384794 None] snapshot_file for this snap is: volume-37602eab-5ea9-4ae6-9734-b7e248a22f81.9c2b236b-fb44-4f6b-ae1f-88cd35f28549 {{(pid=87098) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 13 13:51:22 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[07ce69c2-2eb4-44d1-8a38-d51197080c16]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 13:51:22 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-a68b0feb-b889-4237-90a7-94425a4fd253 tempest-GroupSnapshotsTest-803384794 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-37602eab-5ea9-4ae6-9734-b7e248a22f81.9c2b236b-fb44-4f6b-ae1f-88cd35f28549 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:51:23 devstack sudo[90513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-37602eab-5ea9-4ae6-9734-b7e248a22f81.9c2b236b-fb44-4f6b-ae1f-88cd35f28549 Jul 13 13:51:23 devstack sudo[90513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:51:23 devstack sudo[90513]: pam_unix(sudo:session): session closed for user root Jul 13 13:51:23 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-a68b0feb-b889-4237-90a7-94425a4fd253 tempest-GroupSnapshotsTest-803384794 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-37602eab-5ea9-4ae6-9734-b7e248a22f81.9c2b236b-fb44-4f6b-ae1f-88cd35f28549" returned: 0 in 0.714s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:51:23 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-a68b0feb-b889-4237-90a7-94425a4fd253 tempest-GroupSnapshotsTest-803384794 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-37602eab-5ea9-4ae6-9734-b7e248a22f81(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87098) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 13 13:51:23 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[02f8d86c-2bc4-4f1e-bcb6-2fe05548c0a5]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 13:51:23 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-a68b0feb-b889-4237-90a7-94425a4fd253 tempest-GroupSnapshotsTest-803384794 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-37602eab-5ea9-4ae6-9734-b7e248a22f81 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:51:23 devstack sudo[90518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-37602eab-5ea9-4ae6-9734-b7e248a22f81 Jul 13 13:51:23 devstack sudo[90518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:51:24 devstack sudo[90518]: pam_unix(sudo:session): session closed for user root Jul 13 13:51:24 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-a68b0feb-b889-4237-90a7-94425a4fd253 tempest-GroupSnapshotsTest-803384794 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-37602eab-5ea9-4ae6-9734-b7e248a22f81" returned: 0 in 0.547s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:51:24 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-a68b0feb-b889-4237-90a7-94425a4fd253 tempest-GroupSnapshotsTest-803384794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-37602eab-5ea9-4ae6-9734-b7e248a22f81.9c2b236b-fb44-4f6b-ae1f-88cd35f28549 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:51:24 devstack sudo[90523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-37602eab-5ea9-4ae6-9734-b7e248a22f81.9c2b236b-fb44-4f6b-ae1f-88cd35f28549 Jul 13 13:51:24 devstack sudo[90523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:51:24 devstack sudo[90523]: pam_unix(sudo:session): session closed for user root Jul 13 13:51:24 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-a68b0feb-b889-4237-90a7-94425a4fd253 tempest-GroupSnapshotsTest-803384794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-37602eab-5ea9-4ae6-9734-b7e248a22f81.9c2b236b-fb44-4f6b-ae1f-88cd35f28549" returned: 0 in 0.685s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:51:24 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-a68b0feb-b889-4237-90a7-94425a4fd253 tempest-GroupSnapshotsTest-803384794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-37602eab-5ea9-4ae6-9734-b7e248a22f81.9c2b236b-fb44-4f6b-ae1f-88cd35f28549 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:51:24 devstack sudo[90530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-37602eab-5ea9-4ae6-9734-b7e248a22f81.9c2b236b-fb44-4f6b-ae1f-88cd35f28549 Jul 13 13:51:24 devstack sudo[90530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:51:25 devstack sudo[90530]: pam_unix(sudo:session): session closed for user root Jul 13 13:51:25 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-a68b0feb-b889-4237-90a7-94425a4fd253 tempest-GroupSnapshotsTest-803384794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-37602eab-5ea9-4ae6-9734-b7e248a22f81.9c2b236b-fb44-4f6b-ae1f-88cd35f28549" returned: 0 in 0.647s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:51:25 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-a68b0feb-b889-4237-90a7-94425a4fd253 tempest-GroupSnapshotsTest-803384794 None] Lock "cinder-quobyte-9c2b236b-fb44-4f6b-ae1f-88cd35f28549" released by "_delete_snapshot" :: held 2.797s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 13:51:25 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-a68b0feb-b889-4237-90a7-94425a4fd253 tempest-GroupSnapshotsTest-803384794 None] Lock "cinder-quobyte-37602eab-5ea9-4ae6-9734-b7e248a22f81" released by "delete_snapshot" :: held 2.858s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 13:51:25 devstack cinder-volume[87098]: WARNING cinder.quota [None req-a68b0feb-b889-4237-90a7-94425a4fd253 tempest-GroupSnapshotsTest-803384794 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1584874140 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1584874140, it is now deprecated. Please use the default quota class for default quota. Jul 13 13:51:25 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-a68b0feb-b889-4237-90a7-94425a4fd253 tempest-GroupSnapshotsTest-803384794 None] Created reservations ['7151de11-f877-4ae0-b0e2-ebe66fcab948', 'd1626899-5727-4a1b-829f-ef5352dae5ca', '670b1f7c-e88f-4452-ba6d-f5071698f655', '99be5f04-f990-4beb-98de-d44a96e8c901'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 13:51:25 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-a68b0feb-b889-4237-90a7-94425a4fd253 tempest-GroupSnapshotsTest-803384794 None] group_snapshot 65837490-4ec1-4357-bae5-e81b60eff750: deleted successfully Jul 13 13:51:27 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-94aaf74e-f306-44a5-8aef-384540662b5c tempest-GroupSnapshotsTest-803384794 None] Acquiring lock "cinder-quobyte-37602eab-5ea9-4ae6-9734-b7e248a22f81" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 13:51:27 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-94aaf74e-f306-44a5-8aef-384540662b5c tempest-GroupSnapshotsTest-803384794 None] Lock "cinder-quobyte-37602eab-5ea9-4ae6-9734-b7e248a22f81" acquired by "delete_volume" :: waited 0.047s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 13:51:27 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d036cf8-8aaa-4fb7-9570-69cea8449dd7]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 13:51:27 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-94aaf74e-f306-44a5-8aef-384540662b5c tempest-GroupSnapshotsTest-803384794 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-37602eab-5ea9-4ae6-9734-b7e248a22f81 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:51:27 devstack sudo[90578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-37602eab-5ea9-4ae6-9734-b7e248a22f81 Jul 13 13:51:27 devstack sudo[90578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:51:28 devstack sudo[90578]: pam_unix(sudo:session): session closed for user root Jul 13 13:51:28 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-94aaf74e-f306-44a5-8aef-384540662b5c tempest-GroupSnapshotsTest-803384794 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-37602eab-5ea9-4ae6-9734-b7e248a22f81" returned: 0 in 0.867s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:51:28 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-94aaf74e-f306-44a5-8aef-384540662b5c tempest-GroupSnapshotsTest-803384794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-37602eab-5ea9-4ae6-9734-b7e248a22f81 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:51:28 devstack sudo[90586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-37602eab-5ea9-4ae6-9734-b7e248a22f81 Jul 13 13:51:28 devstack sudo[90586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:51:28 devstack sudo[90586]: pam_unix(sudo:session): session closed for user root Jul 13 13:51:28 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-94aaf74e-f306-44a5-8aef-384540662b5c tempest-GroupSnapshotsTest-803384794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-37602eab-5ea9-4ae6-9734-b7e248a22f81" returned: 0 in 0.659s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:51:28 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-94aaf74e-f306-44a5-8aef-384540662b5c tempest-GroupSnapshotsTest-803384794 None] Lock "cinder-quobyte-37602eab-5ea9-4ae6-9734-b7e248a22f81" released by "delete_volume" :: held 1.694s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 13:51:28 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-94aaf74e-f306-44a5-8aef-384540662b5c tempest-GroupSnapshotsTest-803384794 None] Created reservations ['163c6589-a798-4014-a03c-639ac907ef79'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 13:51:29 devstack cinder-volume[87098]: DEBUG oslo_service.periodic_task [None req-727a1692-ea28-4a77-b327-0d94e8f01efb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87098) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 13 13:51:29 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-727a1692-ea28-4a77-b327-0d94e8f01efb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:51:29 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-727a1692-ea28-4a77-b327-0d94e8f01efb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:51:29 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-727a1692-ea28-4a77-b327-0d94e8f01efb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 13:51:29 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-727a1692-ea28-4a77-b327-0d94e8f01efb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 13:51:29 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-727a1692-ea28-4a77-b327-0d94e8f01efb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:51:29 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-727a1692-ea28-4a77-b327-0d94e8f01efb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:51:29 devstack cinder-volume[87098]: WARNING cinder.db.api [None req-94aaf74e-f306-44a5-8aef-384540662b5c tempest-GroupSnapshotsTest-803384794 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1584874140'] Jul 13 13:51:29 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-94aaf74e-f306-44a5-8aef-384540662b5c tempest-GroupSnapshotsTest-803384794 None] Created reservations ['73c3ac5c-678d-4397-8ca2-a6f8cebbc694', 'ad03ecfc-9b35-4d84-8c60-b16f6efc4496', 'd7208a7f-a5fe-4212-88a5-bc3a05c897cf', '30c3f2c0-4be7-44ad-ab67-986fc8724d41'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 13:51:29 devstack sudo[90626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 Jul 13 13:51:29 devstack sudo[90626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:51:29 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-94aaf74e-f306-44a5-8aef-384540662b5c tempest-GroupSnapshotsTest-803384794 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:51:29 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-94aaf74e-f306-44a5-8aef-384540662b5c tempest-GroupSnapshotsTest-803384794 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:51:29 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-94aaf74e-f306-44a5-8aef-384540662b5c tempest-GroupSnapshotsTest-803384794 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 13:51:29 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-94aaf74e-f306-44a5-8aef-384540662b5c tempest-GroupSnapshotsTest-803384794 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 13:51:29 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-94aaf74e-f306-44a5-8aef-384540662b5c tempest-GroupSnapshotsTest-803384794 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.041s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:51:29 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-94aaf74e-f306-44a5-8aef-384540662b5c tempest-GroupSnapshotsTest-803384794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:51:29 devstack sudo[90631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 Jul 13 13:51:29 devstack sudo[90631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:51:29 devstack sudo[90626]: pam_unix(sudo:session): session closed for user root Jul 13 13:51:29 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-727a1692-ea28-4a77-b327-0d94e8f01efb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78" returned: 0 in 0.642s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:51:29 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-727a1692-ea28-4a77-b327-0d94e8f01efb None None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 13:51:29 devstack cinder-volume[87098]: DEBUG oslo_service.periodic_task [None req-727a1692-ea28-4a77-b327-0d94e8f01efb None None] Running periodic task VolumeManager._thread_info {{(pid=87098) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 13 13:51:29 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-727a1692-ea28-4a77-b327-0d94e8f01efb None None] thread count: 8 {{(pid=87098) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 13 13:51:29 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-727a1692-ea28-4a77-b327-0d94e8f01efb None None] thread info: [<_MainThread(MainThread, started 127988054597760)>, , , , , , , ] {{(pid=87098) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 13 13:51:29 devstack sudo[90631]: pam_unix(sudo:session): session closed for user root Jul 13 13:51:29 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-94aaf74e-f306-44a5-8aef-384540662b5c tempest-GroupSnapshotsTest-803384794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78" returned: 0 in 0.475s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:51:29 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-94aaf74e-f306-44a5-8aef-384540662b5c tempest-GroupSnapshotsTest-803384794 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 13:51:29 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-94aaf74e-f306-44a5-8aef-384540662b5c tempest-GroupSnapshotsTest-803384794 None] Delete group completed successfully. Jul 13 13:51:31 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-74099099-be9e-46c3-befb-ab9b056c29c8 tempest-GroupSnapshotsTest-803384794 None] Group tempest-GroupSnapshotsTest-Group-1787967108: creating Jul 13 13:51:31 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-74099099-be9e-46c3-befb-ab9b056c29c8 tempest-GroupSnapshotsTest-803384794 None] Group tempest-GroupSnapshotsTest-Group-1787967108: created successfully Jul 13 13:51:31 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-74099099-be9e-46c3-befb-ab9b056c29c8 tempest-GroupSnapshotsTest-803384794 None] Create group completed successfully. Jul 13 13:51:33 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-f0b4361d-c75e-4d0e-9dab-ea00c01bb70b tempest-GroupSnapshotsTest-803384794 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 13:51:33 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-f0b4361d-c75e-4d0e-9dab-ea00c01bb70b tempest-GroupSnapshotsTest-803384794 None] Flow 'volume_create_manager' (a7cba6d0-6b39-4ed2-869c-714d7ee2e9e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 13:51:33 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-f0b4361d-c75e-4d0e-9dab-ea00c01bb70b tempest-GroupSnapshotsTest-803384794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44aa6bce-3146-4caa-bb08-abd578ad1fb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:51:33 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-f0b4361d-c75e-4d0e-9dab-ea00c01bb70b tempest-GroupSnapshotsTest-803384794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44aa6bce-3146-4caa-bb08-abd578ad1fb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T11:51:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1775863560',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=79fff0d3-5bdc-4f31-8f25-00922bbb96c5,host='devstack@QuobyteHD#QuobyteHD',id=55de4e95-4f8b-40a4-bbb8-9334dcdbae04,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d230cd5df37249c2889f13684894daaf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T11:51:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T11:51:33Z,use_quota=True,user_id='2d6e7b464a7a4c6a8957aa2e2008eb6c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b7d5e36-a19e-4fcb-8c60-d308a577fe06),volume_type_id=9b7d5e36-a19e-4fcb-8c60-d308a577fe06)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:51:33 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-f0b4361d-c75e-4d0e-9dab-ea00c01bb70b tempest-GroupSnapshotsTest-803384794 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e54fab76-f5a9-40bf-8cd5-59fd3904bf41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:51:33 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-f0b4361d-c75e-4d0e-9dab-ea00c01bb70b tempest-GroupSnapshotsTest-803384794 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e54fab76-f5a9-40bf-8cd5-59fd3904bf41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:51:33 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-f0b4361d-c75e-4d0e-9dab-ea00c01bb70b tempest-GroupSnapshotsTest-803384794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee9a0933-c257-44de-8370-be0f68b54cfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:51:33 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-f0b4361d-c75e-4d0e-9dab-ea00c01bb70b tempest-GroupSnapshotsTest-803384794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee9a0933-c257-44de-8370-be0f68b54cfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '55de4e95-4f8b-40a4-bbb8-9334dcdbae04', 'volume_name': 'volume-55de4e95-4f8b-40a4-bbb8-9334dcdbae04', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:51:33 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-f0b4361d-c75e-4d0e-9dab-ea00c01bb70b tempest-GroupSnapshotsTest-803384794 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2d169fd-67f8-4c51-82f8-7b2e44fb7bd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:51:33 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-f0b4361d-c75e-4d0e-9dab-ea00c01bb70b tempest-GroupSnapshotsTest-803384794 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2d169fd-67f8-4c51-82f8-7b2e44fb7bd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:51:33 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-f0b4361d-c75e-4d0e-9dab-ea00c01bb70b tempest-GroupSnapshotsTest-803384794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8006587d-1e02-494d-9e10-f41442536f4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:51:33 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-f0b4361d-c75e-4d0e-9dab-ea00c01bb70b tempest-GroupSnapshotsTest-803384794 None] Volume 55de4e95-4f8b-40a4-bbb8-9334dcdbae04: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-55de4e95-4f8b-40a4-bbb8-9334dcdbae04', 'volume_size': 1} Jul 13 13:51:33 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-f0b4361d-c75e-4d0e-9dab-ea00c01bb70b tempest-GroupSnapshotsTest-803384794 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:51:33 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-f0b4361d-c75e-4d0e-9dab-ea00c01bb70b tempest-GroupSnapshotsTest-803384794 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:51:33 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-f0b4361d-c75e-4d0e-9dab-ea00c01bb70b tempest-GroupSnapshotsTest-803384794 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=79fff0d3-5bdc-4f31-8f25-00922bbb96c5,created_at=2026-07-13T11:51:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1775863560',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=79fff0d3-5bdc-4f31-8f25-00922bbb96c5,host='devstack@QuobyteHD#QuobyteHD',id=55de4e95-4f8b-40a4-bbb8-9334dcdbae04,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d230cd5df37249c2889f13684894daaf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T11:51:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T11:51:33Z,use_quota=True,user_id='2d6e7b464a7a4c6a8957aa2e2008eb6c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b7d5e36-a19e-4fcb-8c60-d308a577fe06),volume_type_id=9b7d5e36-a19e-4fcb-8c60-d308a577fe06)}" {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 13 13:51:33 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-f0b4361d-c75e-4d0e-9dab-ea00c01bb70b tempest-GroupSnapshotsTest-803384794 None] Creating volume 55de4e95-4f8b-40a4-bbb8-9334dcdbae04 {{(pid=87098) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 13 13:51:33 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-f0b4361d-c75e-4d0e-9dab-ea00c01bb70b tempest-GroupSnapshotsTest-803384794 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:51:33 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-f0b4361d-c75e-4d0e-9dab-ea00c01bb70b tempest-GroupSnapshotsTest-803384794 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:51:33 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-f0b4361d-c75e-4d0e-9dab-ea00c01bb70b tempest-GroupSnapshotsTest-803384794 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 13:51:33 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-f0b4361d-c75e-4d0e-9dab-ea00c01bb70b tempest-GroupSnapshotsTest-803384794 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 13:51:33 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-f0b4361d-c75e-4d0e-9dab-ea00c01bb70b tempest-GroupSnapshotsTest-803384794 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:51:33 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-f0b4361d-c75e-4d0e-9dab-ea00c01bb70b tempest-GroupSnapshotsTest-803384794 None] Selected osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 13:51:33 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-f0b4361d-c75e-4d0e-9dab-ea00c01bb70b tempest-GroupSnapshotsTest-803384794 None] casted to osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 Jul 13 13:51:33 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-f0b4361d-c75e-4d0e-9dab-ea00c01bb70b tempest-GroupSnapshotsTest-803384794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-55de4e95-4f8b-40a4-bbb8-9334dcdbae04 1073741824 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:51:33 devstack sudo[90651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-55de4e95-4f8b-40a4-bbb8-9334dcdbae04 1073741824 Jul 13 13:51:33 devstack sudo[90651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:51:33 devstack sudo[90651]: pam_unix(sudo:session): session closed for user root Jul 13 13:51:33 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-f0b4361d-c75e-4d0e-9dab-ea00c01bb70b tempest-GroupSnapshotsTest-803384794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-55de4e95-4f8b-40a4-bbb8-9334dcdbae04 1073741824" returned: 0 in 0.696s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:51:34 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-f0b4361d-c75e-4d0e-9dab-ea00c01bb70b tempest-GroupSnapshotsTest-803384794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-55de4e95-4f8b-40a4-bbb8-9334dcdbae04 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:51:34 devstack sudo[90665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-55de4e95-4f8b-40a4-bbb8-9334dcdbae04 Jul 13 13:51:34 devstack sudo[90665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:51:34 devstack sudo[90665]: pam_unix(sudo:session): session closed for user root Jul 13 13:51:34 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-f0b4361d-c75e-4d0e-9dab-ea00c01bb70b tempest-GroupSnapshotsTest-803384794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-55de4e95-4f8b-40a4-bbb8-9334dcdbae04" returned: 0 in 0.536s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:51:34 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-f0b4361d-c75e-4d0e-9dab-ea00c01bb70b tempest-GroupSnapshotsTest-803384794 None] <== create_volume: return (1296ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'} {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 13 13:51:34 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-f0b4361d-c75e-4d0e-9dab-ea00c01bb70b tempest-GroupSnapshotsTest-803384794 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.299s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:51:34 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-f0b4361d-c75e-4d0e-9dab-ea00c01bb70b tempest-GroupSnapshotsTest-803384794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8006587d-1e02-494d-9e10-f41442536f4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-55de4e95-4f8b-40a4-bbb8-9334dcdbae04', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:51:34 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-f0b4361d-c75e-4d0e-9dab-ea00c01bb70b tempest-GroupSnapshotsTest-803384794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (600ce2db-979c-4abf-8b5f-1e0a7f0833fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:51:34 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-f0b4361d-c75e-4d0e-9dab-ea00c01bb70b tempest-GroupSnapshotsTest-803384794 None] Volume volume-55de4e95-4f8b-40a4-bbb8-9334dcdbae04 (55de4e95-4f8b-40a4-bbb8-9334dcdbae04): created successfully Jul 13 13:51:34 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-f0b4361d-c75e-4d0e-9dab-ea00c01bb70b tempest-GroupSnapshotsTest-803384794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (600ce2db-979c-4abf-8b5f-1e0a7f0833fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:51:34 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-f0b4361d-c75e-4d0e-9dab-ea00c01bb70b tempest-GroupSnapshotsTest-803384794 None] Flow 'volume_create_manager' (a7cba6d0-6b39-4ed2-869c-714d7ee2e9e4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 13:51:34 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-f0b4361d-c75e-4d0e-9dab-ea00c01bb70b tempest-GroupSnapshotsTest-803384794 None] Created volume successfully. Jul 13 13:51:37 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-cf4bff4e-3d26-4009-b914-b2d4c90d6e03 tempest-ServerRescueNegativeTestJSON-2052165915 None] Acquiring lock "cinder-06d539cc-569f-479e-bf41-3d0a0b1670e3-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 13:51:37 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-cf4bff4e-3d26-4009-b914-b2d4c90d6e03 tempest-ServerRescueNegativeTestJSON-2052165915 None] Lock "cinder-06d539cc-569f-479e-bf41-3d0a0b1670e3-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 13:51:37 devstack cinder-volume[87098]: DEBUG dbcounter [-] [87098] Writing DB stats cinder:SELECT=58,cinder:UPDATE=60,cinder:INSERT=13,cinder:DELETE=2 {{(pid=87098) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 13 13:51:37 devstack cinder-volume[87098]: DEBUG dbcounter [-] [87098] Writing DB stats cinder:UPDATE=62,cinder:SELECT=57,cinder:INSERT=14,cinder:DELETE=4 {{(pid=87098) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 13 13:51:37 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-cf4bff4e-3d26-4009-b914-b2d4c90d6e03 tempest-ServerRescueNegativeTestJSON-2052165915 None] Acquiring lock "cinder-quobyte-06d539cc-569f-479e-bf41-3d0a0b1670e3" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 13:51:37 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-cf4bff4e-3d26-4009-b914-b2d4c90d6e03 tempest-ServerRescueNegativeTestJSON-2052165915 None] Lock "cinder-quobyte-06d539cc-569f-479e-bf41-3d0a0b1670e3" acquired by "delete_volume" :: waited 0.112s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 13:51:37 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[8945e8f0-5a65-42e8-95eb-8ded69b285dc]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 13:51:37 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-cf4bff4e-3d26-4009-b914-b2d4c90d6e03 tempest-ServerRescueNegativeTestJSON-2052165915 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-06d539cc-569f-479e-bf41-3d0a0b1670e3 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:51:38 devstack sudo[90763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-06d539cc-569f-479e-bf41-3d0a0b1670e3 Jul 13 13:51:38 devstack sudo[90763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:51:38 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-76cb395c-41f9-462c-953d-7d8b5daa0dd6 tempest-GroupSnapshotsTest-803384794 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 13:51:38 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-76cb395c-41f9-462c-953d-7d8b5daa0dd6 tempest-GroupSnapshotsTest-803384794 None] Flow 'volume_create_manager' (b2dd5f60-759f-4b1f-9fd7-43434f26a9ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 13:51:38 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-76cb395c-41f9-462c-953d-7d8b5daa0dd6 tempest-GroupSnapshotsTest-803384794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae5892dd-b10f-4b24-9218-815fb21c5074) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:51:38 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-76cb395c-41f9-462c-953d-7d8b5daa0dd6 tempest-GroupSnapshotsTest-803384794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae5892dd-b10f-4b24-9218-815fb21c5074) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T11:51:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-917988191',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=79fff0d3-5bdc-4f31-8f25-00922bbb96c5,host='devstack@QuobyteHD#QuobyteHD',id=08fc2087-8cf3-40a4-bb9c-d746181f1fc4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d230cd5df37249c2889f13684894daaf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T11:51:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T11:51:38Z,use_quota=True,user_id='2d6e7b464a7a4c6a8957aa2e2008eb6c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b7d5e36-a19e-4fcb-8c60-d308a577fe06),volume_type_id=9b7d5e36-a19e-4fcb-8c60-d308a577fe06)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:51:38 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-76cb395c-41f9-462c-953d-7d8b5daa0dd6 tempest-GroupSnapshotsTest-803384794 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6b4ac50-e04f-41a4-b638-f8c28c630049) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:51:38 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-76cb395c-41f9-462c-953d-7d8b5daa0dd6 tempest-GroupSnapshotsTest-803384794 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6b4ac50-e04f-41a4-b638-f8c28c630049) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:51:38 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-76cb395c-41f9-462c-953d-7d8b5daa0dd6 tempest-GroupSnapshotsTest-803384794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c31a1b0-d14f-4c5f-a86d-f07180327472) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:51:38 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-76cb395c-41f9-462c-953d-7d8b5daa0dd6 tempest-GroupSnapshotsTest-803384794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c31a1b0-d14f-4c5f-a86d-f07180327472) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '08fc2087-8cf3-40a4-bb9c-d746181f1fc4', 'volume_name': 'volume-08fc2087-8cf3-40a4-bb9c-d746181f1fc4', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:51:38 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-76cb395c-41f9-462c-953d-7d8b5daa0dd6 tempest-GroupSnapshotsTest-803384794 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf2b5fc7-98f7-4b99-9f60-7da84a5a74a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:51:38 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-76cb395c-41f9-462c-953d-7d8b5daa0dd6 tempest-GroupSnapshotsTest-803384794 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf2b5fc7-98f7-4b99-9f60-7da84a5a74a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:51:38 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-76cb395c-41f9-462c-953d-7d8b5daa0dd6 tempest-GroupSnapshotsTest-803384794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a45c0e3d-cfaf-48a5-94c6-96dd10ad5cbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:51:38 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-76cb395c-41f9-462c-953d-7d8b5daa0dd6 tempest-GroupSnapshotsTest-803384794 None] Volume 08fc2087-8cf3-40a4-bb9c-d746181f1fc4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-08fc2087-8cf3-40a4-bb9c-d746181f1fc4', 'volume_size': 1} Jul 13 13:51:38 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-76cb395c-41f9-462c-953d-7d8b5daa0dd6 tempest-GroupSnapshotsTest-803384794 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:51:38 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-76cb395c-41f9-462c-953d-7d8b5daa0dd6 tempest-GroupSnapshotsTest-803384794 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:51:38 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-76cb395c-41f9-462c-953d-7d8b5daa0dd6 tempest-GroupSnapshotsTest-803384794 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=79fff0d3-5bdc-4f31-8f25-00922bbb96c5,created_at=2026-07-13T11:51:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-917988191',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=79fff0d3-5bdc-4f31-8f25-00922bbb96c5,host='devstack@QuobyteHD#QuobyteHD',id=08fc2087-8cf3-40a4-bb9c-d746181f1fc4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d230cd5df37249c2889f13684894daaf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T11:51:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T11:51:38Z,use_quota=True,user_id='2d6e7b464a7a4c6a8957aa2e2008eb6c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b7d5e36-a19e-4fcb-8c60-d308a577fe06),volume_type_id=9b7d5e36-a19e-4fcb-8c60-d308a577fe06)}" {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 13 13:51:38 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-76cb395c-41f9-462c-953d-7d8b5daa0dd6 tempest-GroupSnapshotsTest-803384794 None] Creating volume 08fc2087-8cf3-40a4-bb9c-d746181f1fc4 {{(pid=87098) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 13 13:51:38 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-76cb395c-41f9-462c-953d-7d8b5daa0dd6 tempest-GroupSnapshotsTest-803384794 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:51:38 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-76cb395c-41f9-462c-953d-7d8b5daa0dd6 tempest-GroupSnapshotsTest-803384794 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:51:38 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-76cb395c-41f9-462c-953d-7d8b5daa0dd6 tempest-GroupSnapshotsTest-803384794 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 13:51:38 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-76cb395c-41f9-462c-953d-7d8b5daa0dd6 tempest-GroupSnapshotsTest-803384794 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 13:51:38 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-76cb395c-41f9-462c-953d-7d8b5daa0dd6 tempest-GroupSnapshotsTest-803384794 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:51:38 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-76cb395c-41f9-462c-953d-7d8b5daa0dd6 tempest-GroupSnapshotsTest-803384794 None] Selected osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 13:51:38 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-76cb395c-41f9-462c-953d-7d8b5daa0dd6 tempest-GroupSnapshotsTest-803384794 None] casted to osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 Jul 13 13:51:38 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-76cb395c-41f9-462c-953d-7d8b5daa0dd6 tempest-GroupSnapshotsTest-803384794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-08fc2087-8cf3-40a4-bb9c-d746181f1fc4 1073741824 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:51:38 devstack sudo[90765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-08fc2087-8cf3-40a4-bb9c-d746181f1fc4 1073741824 Jul 13 13:51:38 devstack sudo[90765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:51:38 devstack sudo[90763]: pam_unix(sudo:session): session closed for user root Jul 13 13:51:38 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-cf4bff4e-3d26-4009-b914-b2d4c90d6e03 tempest-ServerRescueNegativeTestJSON-2052165915 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-06d539cc-569f-479e-bf41-3d0a0b1670e3" returned: 0 in 1.121s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:51:38 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-cf4bff4e-3d26-4009-b914-b2d4c90d6e03 tempest-ServerRescueNegativeTestJSON-2052165915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-06d539cc-569f-479e-bf41-3d0a0b1670e3 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:51:38 devstack sudo[90770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-06d539cc-569f-479e-bf41-3d0a0b1670e3 Jul 13 13:51:38 devstack sudo[90770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:51:39 devstack sudo[90770]: pam_unix(sudo:session): session closed for user root Jul 13 13:51:39 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-cf4bff4e-3d26-4009-b914-b2d4c90d6e03 tempest-ServerRescueNegativeTestJSON-2052165915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-06d539cc-569f-479e-bf41-3d0a0b1670e3" returned: 0 in 0.671s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:51:39 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-cf4bff4e-3d26-4009-b914-b2d4c90d6e03 tempest-ServerRescueNegativeTestJSON-2052165915 None] Lock "cinder-quobyte-06d539cc-569f-479e-bf41-3d0a0b1670e3" released by "delete_volume" :: held 1.991s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 13:51:39 devstack sudo[90765]: pam_unix(sudo:session): session closed for user root Jul 13 13:51:39 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-76cb395c-41f9-462c-953d-7d8b5daa0dd6 tempest-GroupSnapshotsTest-803384794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-08fc2087-8cf3-40a4-bb9c-d746181f1fc4 1073741824" returned: 0 in 1.157s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:51:39 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-cf4bff4e-3d26-4009-b914-b2d4c90d6e03 tempest-ServerRescueNegativeTestJSON-2052165915 None] Created reservations ['5cfc75e8-7fcb-47e5-91bc-bf131f9a01aa', '3f15e8f8-eabc-4002-a52e-5208dfec9912', 'f25a6579-1e3f-4851-9ec8-019b996d7ced', '8f2477f1-d15f-4292-b188-05ce7875fed8'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 13:51:39 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-76cb395c-41f9-462c-953d-7d8b5daa0dd6 tempest-GroupSnapshotsTest-803384794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-08fc2087-8cf3-40a4-bb9c-d746181f1fc4 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:51:39 devstack sudo[90776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-08fc2087-8cf3-40a4-bb9c-d746181f1fc4 Jul 13 13:51:39 devstack sudo[90776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:51:40 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-cf4bff4e-3d26-4009-b914-b2d4c90d6e03 tempest-ServerRescueNegativeTestJSON-2052165915 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:51:40 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-cf4bff4e-3d26-4009-b914-b2d4c90d6e03 tempest-ServerRescueNegativeTestJSON-2052165915 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:51:40 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-cf4bff4e-3d26-4009-b914-b2d4c90d6e03 tempest-ServerRescueNegativeTestJSON-2052165915 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 13:51:40 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-cf4bff4e-3d26-4009-b914-b2d4c90d6e03 tempest-ServerRescueNegativeTestJSON-2052165915 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 13:51:40 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-cf4bff4e-3d26-4009-b914-b2d4c90d6e03 tempest-ServerRescueNegativeTestJSON-2052165915 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:51:40 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-cf4bff4e-3d26-4009-b914-b2d4c90d6e03 tempest-ServerRescueNegativeTestJSON-2052165915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:51:40 devstack sudo[90778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 Jul 13 13:51:40 devstack sudo[90778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:51:40 devstack sudo[90776]: pam_unix(sudo:session): session closed for user root Jul 13 13:51:40 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-76cb395c-41f9-462c-953d-7d8b5daa0dd6 tempest-GroupSnapshotsTest-803384794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-08fc2087-8cf3-40a4-bb9c-d746181f1fc4" returned: 0 in 0.869s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:51:40 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-76cb395c-41f9-462c-953d-7d8b5daa0dd6 tempest-GroupSnapshotsTest-803384794 None] <== create_volume: return (2165ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'} {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 13 13:51:40 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-76cb395c-41f9-462c-953d-7d8b5daa0dd6 tempest-GroupSnapshotsTest-803384794 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.170s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:51:40 devstack sudo[90778]: pam_unix(sudo:session): session closed for user root Jul 13 13:51:40 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-76cb395c-41f9-462c-953d-7d8b5daa0dd6 tempest-GroupSnapshotsTest-803384794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a45c0e3d-cfaf-48a5-94c6-96dd10ad5cbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-08fc2087-8cf3-40a4-bb9c-d746181f1fc4', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:51:40 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-76cb395c-41f9-462c-953d-7d8b5daa0dd6 tempest-GroupSnapshotsTest-803384794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de343ea7-6aa9-4db7-8e04-50c0af177da1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:51:40 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-cf4bff4e-3d26-4009-b914-b2d4c90d6e03 tempest-ServerRescueNegativeTestJSON-2052165915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78" returned: 0 in 0.617s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:51:40 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-cf4bff4e-3d26-4009-b914-b2d4c90d6e03 tempest-ServerRescueNegativeTestJSON-2052165915 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 13:51:40 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-cf4bff4e-3d26-4009-b914-b2d4c90d6e03 tempest-ServerRescueNegativeTestJSON-2052165915 None] Deleted volume successfully. Jul 13 13:51:40 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-76cb395c-41f9-462c-953d-7d8b5daa0dd6 tempest-GroupSnapshotsTest-803384794 None] Volume volume-08fc2087-8cf3-40a4-bb9c-d746181f1fc4 (08fc2087-8cf3-40a4-bb9c-d746181f1fc4): created successfully Jul 13 13:51:40 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-76cb395c-41f9-462c-953d-7d8b5daa0dd6 tempest-GroupSnapshotsTest-803384794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de343ea7-6aa9-4db7-8e04-50c0af177da1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:51:40 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-76cb395c-41f9-462c-953d-7d8b5daa0dd6 tempest-GroupSnapshotsTest-803384794 None] Flow 'volume_create_manager' (b2dd5f60-759f-4b1f-9fd7-43434f26a9ad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 13:51:40 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-76cb395c-41f9-462c-953d-7d8b5daa0dd6 tempest-GroupSnapshotsTest-803384794 None] Created volume successfully. Jul 13 13:51:40 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-cf4bff4e-3d26-4009-b914-b2d4c90d6e03 tempest-ServerRescueNegativeTestJSON-2052165915 None] Lock "cinder-06d539cc-569f-479e-bf41-3d0a0b1670e3-delete_volume" released by "delete_volume" :: held 3.642s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 13:51:41 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-731f6e05-2a12-46fb-9ff6-e653bb115371 tempest-GroupSnapshotsTest-803384794 None] Update group completed successfully. Jul 13 13:51:43 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-d78056b6-9a46-4a93-b061-8480af7867d3 tempest-GroupSnapshotsTest-803384794 None] Update group completed successfully. Jul 13 13:51:44 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-0653bd70-6fce-45d9-a43e-ce8d8be1c269 tempest-GroupSnapshotsTest-803384794 None] Update group completed successfully. Jul 13 13:51:46 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-010954ab-52ea-482f-b48f-42a740684296 tempest-GroupSnapshotsTest-803384794 None] Update group completed successfully. Jul 13 13:51:48 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-9064d98f-9311-45b5-a1ec-101efbe565bc tempest-GroupSnapshotsTest-803384794 None] GroupSnapshot 1b625f03-a3d0-4160-8216-79a4e1b49bc8: creating. Jul 13 13:51:48 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-9064d98f-9311-45b5-a1ec-101efbe565bc tempest-GroupSnapshotsTest-803384794 None] Group snapshot 1b625f03-a3d0-4160-8216-79a4e1b49bc8: creating. {{(pid=87098) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 13 13:51:48 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-9064d98f-9311-45b5-a1ec-101efbe565bc tempest-GroupSnapshotsTest-803384794 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:51:48 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-9064d98f-9311-45b5-a1ec-101efbe565bc tempest-GroupSnapshotsTest-803384794 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:51:48 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-9064d98f-9311-45b5-a1ec-101efbe565bc tempest-GroupSnapshotsTest-803384794 None] Creating offline snapshot 1a581473-1c63-4331-86ff-77628ee028aa of volume 55de4e95-4f8b-40a4-bbb8-9334dcdbae04 {{(pid=87098) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 13 13:51:48 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[63629c30-519d-4cb5-80ba-c667fd15ada9]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 13:51:48 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-9064d98f-9311-45b5-a1ec-101efbe565bc tempest-GroupSnapshotsTest-803384794 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-55de4e95-4f8b-40a4-bbb8-9334dcdbae04 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:51:48 devstack sudo[90864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-55de4e95-4f8b-40a4-bbb8-9334dcdbae04 Jul 13 13:51:48 devstack sudo[90864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:51:49 devstack sudo[90864]: pam_unix(sudo:session): session closed for user root Jul 13 13:51:49 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-9064d98f-9311-45b5-a1ec-101efbe565bc tempest-GroupSnapshotsTest-803384794 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-55de4e95-4f8b-40a4-bbb8-9334dcdbae04" returned: 0 in 0.695s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:51:49 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-9064d98f-9311-45b5-a1ec-101efbe565bc tempest-GroupSnapshotsTest-803384794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-55de4e95-4f8b-40a4-bbb8-9334dcdbae04,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-55de4e95-4f8b-40a4-bbb8-9334dcdbae04.1a581473-1c63-4331-86ff-77628ee028aa 1G {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:51:49 devstack sudo[90870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-55de4e95-4f8b-40a4-bbb8-9334dcdbae04,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-55de4e95-4f8b-40a4-bbb8-9334dcdbae04.1a581473-1c63-4331-86ff-77628ee028aa 1G Jul 13 13:51:49 devstack sudo[90870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:51:49 devstack sudo[90870]: pam_unix(sudo:session): session closed for user root Jul 13 13:51:49 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-9064d98f-9311-45b5-a1ec-101efbe565bc tempest-GroupSnapshotsTest-803384794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-55de4e95-4f8b-40a4-bbb8-9334dcdbae04,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-55de4e95-4f8b-40a4-bbb8-9334dcdbae04.1a581473-1c63-4331-86ff-77628ee028aa 1G" returned: 0 in 0.857s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:51:49 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-9064d98f-9311-45b5-a1ec-101efbe565bc tempest-GroupSnapshotsTest-803384794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-55de4e95-4f8b-40a4-bbb8-9334dcdbae04 -F qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-55de4e95-4f8b-40a4-bbb8-9334dcdbae04.1a581473-1c63-4331-86ff-77628ee028aa {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:51:49 devstack sudo[90877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-55de4e95-4f8b-40a4-bbb8-9334dcdbae04 -F qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-55de4e95-4f8b-40a4-bbb8-9334dcdbae04.1a581473-1c63-4331-86ff-77628ee028aa Jul 13 13:51:49 devstack sudo[90877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:51:50 devstack sudo[90877]: pam_unix(sudo:session): session closed for user root Jul 13 13:51:50 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-9064d98f-9311-45b5-a1ec-101efbe565bc tempest-GroupSnapshotsTest-803384794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-55de4e95-4f8b-40a4-bbb8-9334dcdbae04 -F qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-55de4e95-4f8b-40a4-bbb8-9334dcdbae04.1a581473-1c63-4331-86ff-77628ee028aa" returned: 0 in 0.399s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:51:50 devstack cinder-volume[87098]: WARNING cinder.volume.drivers.remotefs [None req-9064d98f-9311-45b5-a1ec-101efbe565bc tempest-GroupSnapshotsTest-803384794 None] /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-55de4e95-4f8b-40a4-bbb8-9334dcdbae04.1a581473-1c63-4331-86ff-77628ee028aa is being set with open permissions: ugo+rw: NotImplementedError Jul 13 13:51:50 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-9064d98f-9311-45b5-a1ec-101efbe565bc tempest-GroupSnapshotsTest-803384794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-55de4e95-4f8b-40a4-bbb8-9334dcdbae04.1a581473-1c63-4331-86ff-77628ee028aa {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:51:50 devstack sudo[90883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-55de4e95-4f8b-40a4-bbb8-9334dcdbae04.1a581473-1c63-4331-86ff-77628ee028aa Jul 13 13:51:50 devstack sudo[90883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:51:50 devstack sudo[90883]: pam_unix(sudo:session): session closed for user root Jul 13 13:51:50 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-9064d98f-9311-45b5-a1ec-101efbe565bc tempest-GroupSnapshotsTest-803384794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-55de4e95-4f8b-40a4-bbb8-9334dcdbae04.1a581473-1c63-4331-86ff-77628ee028aa" returned: 0 in 0.460s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:51:50 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-9064d98f-9311-45b5-a1ec-101efbe565bc tempest-GroupSnapshotsTest-803384794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-55de4e95-4f8b-40a4-bbb8-9334dcdbae04.info {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:51:50 devstack sudo[90888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-55de4e95-4f8b-40a4-bbb8-9334dcdbae04.info Jul 13 13:51:50 devstack sudo[90888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:51:51 devstack sudo[90888]: pam_unix(sudo:session): session closed for user root Jul 13 13:51:51 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-9064d98f-9311-45b5-a1ec-101efbe565bc tempest-GroupSnapshotsTest-803384794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-55de4e95-4f8b-40a4-bbb8-9334dcdbae04.info" returned: 0 in 0.430s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:51:51 devstack cinder-volume[87098]: WARNING cinder.volume.drivers.remotefs [None req-9064d98f-9311-45b5-a1ec-101efbe565bc tempest-GroupSnapshotsTest-803384794 None] /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-55de4e95-4f8b-40a4-bbb8-9334dcdbae04.info is being set with open permissions: ugo+rw: NotImplementedError Jul 13 13:51:51 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-9064d98f-9311-45b5-a1ec-101efbe565bc tempest-GroupSnapshotsTest-803384794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-55de4e95-4f8b-40a4-bbb8-9334dcdbae04.info {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:51:51 devstack sudo[90891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-55de4e95-4f8b-40a4-bbb8-9334dcdbae04.info Jul 13 13:51:51 devstack sudo[90891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:51:51 devstack sudo[90891]: pam_unix(sudo:session): session closed for user root Jul 13 13:51:51 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-9064d98f-9311-45b5-a1ec-101efbe565bc tempest-GroupSnapshotsTest-803384794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-55de4e95-4f8b-40a4-bbb8-9334dcdbae04.info" returned: 0 in 0.379s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:51:51 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-9064d98f-9311-45b5-a1ec-101efbe565bc tempest-GroupSnapshotsTest-803384794 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.380s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:51:51 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-9064d98f-9311-45b5-a1ec-101efbe565bc tempest-GroupSnapshotsTest-803384794 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:51:51 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-9064d98f-9311-45b5-a1ec-101efbe565bc tempest-GroupSnapshotsTest-803384794 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:51:51 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-9064d98f-9311-45b5-a1ec-101efbe565bc tempest-GroupSnapshotsTest-803384794 None] Creating offline snapshot 2b769c2f-9f55-4c56-a7f0-f062a3800bb2 of volume 08fc2087-8cf3-40a4-bb9c-d746181f1fc4 {{(pid=87098) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 13 13:51:51 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea08be15-2a7b-4f84-aa9f-d3bab64423f0]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 13:51:51 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-9064d98f-9311-45b5-a1ec-101efbe565bc tempest-GroupSnapshotsTest-803384794 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-08fc2087-8cf3-40a4-bb9c-d746181f1fc4 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:51:51 devstack sudo[90921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-08fc2087-8cf3-40a4-bb9c-d746181f1fc4 Jul 13 13:51:51 devstack sudo[90921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:51:52 devstack sudo[90921]: pam_unix(sudo:session): session closed for user root Jul 13 13:51:52 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-9064d98f-9311-45b5-a1ec-101efbe565bc tempest-GroupSnapshotsTest-803384794 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-08fc2087-8cf3-40a4-bb9c-d746181f1fc4" returned: 0 in 0.549s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:51:52 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-9064d98f-9311-45b5-a1ec-101efbe565bc tempest-GroupSnapshotsTest-803384794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-08fc2087-8cf3-40a4-bb9c-d746181f1fc4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-08fc2087-8cf3-40a4-bb9c-d746181f1fc4.2b769c2f-9f55-4c56-a7f0-f062a3800bb2 1G {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:51:52 devstack sudo[90926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-08fc2087-8cf3-40a4-bb9c-d746181f1fc4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-08fc2087-8cf3-40a4-bb9c-d746181f1fc4.2b769c2f-9f55-4c56-a7f0-f062a3800bb2 1G Jul 13 13:51:52 devstack sudo[90926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:51:52 devstack sudo[90926]: pam_unix(sudo:session): session closed for user root Jul 13 13:51:52 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-9064d98f-9311-45b5-a1ec-101efbe565bc tempest-GroupSnapshotsTest-803384794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-08fc2087-8cf3-40a4-bb9c-d746181f1fc4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-08fc2087-8cf3-40a4-bb9c-d746181f1fc4.2b769c2f-9f55-4c56-a7f0-f062a3800bb2 1G" returned: 0 in 0.513s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:51:52 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-9064d98f-9311-45b5-a1ec-101efbe565bc tempest-GroupSnapshotsTest-803384794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-08fc2087-8cf3-40a4-bb9c-d746181f1fc4 -F qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-08fc2087-8cf3-40a4-bb9c-d746181f1fc4.2b769c2f-9f55-4c56-a7f0-f062a3800bb2 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:51:52 devstack sudo[90932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-08fc2087-8cf3-40a4-bb9c-d746181f1fc4 -F qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-08fc2087-8cf3-40a4-bb9c-d746181f1fc4.2b769c2f-9f55-4c56-a7f0-f062a3800bb2 Jul 13 13:51:52 devstack sudo[90932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:51:53 devstack sudo[90932]: pam_unix(sudo:session): session closed for user root Jul 13 13:51:53 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-9064d98f-9311-45b5-a1ec-101efbe565bc tempest-GroupSnapshotsTest-803384794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-08fc2087-8cf3-40a4-bb9c-d746181f1fc4 -F qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-08fc2087-8cf3-40a4-bb9c-d746181f1fc4.2b769c2f-9f55-4c56-a7f0-f062a3800bb2" returned: 0 in 0.352s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:51:53 devstack cinder-volume[87098]: WARNING cinder.volume.drivers.remotefs [None req-9064d98f-9311-45b5-a1ec-101efbe565bc tempest-GroupSnapshotsTest-803384794 None] /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-08fc2087-8cf3-40a4-bb9c-d746181f1fc4.2b769c2f-9f55-4c56-a7f0-f062a3800bb2 is being set with open permissions: ugo+rw: NotImplementedError Jul 13 13:51:53 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-9064d98f-9311-45b5-a1ec-101efbe565bc tempest-GroupSnapshotsTest-803384794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-08fc2087-8cf3-40a4-bb9c-d746181f1fc4.2b769c2f-9f55-4c56-a7f0-f062a3800bb2 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:51:53 devstack sudo[90938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-08fc2087-8cf3-40a4-bb9c-d746181f1fc4.2b769c2f-9f55-4c56-a7f0-f062a3800bb2 Jul 13 13:51:53 devstack sudo[90938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:51:53 devstack sudo[90938]: pam_unix(sudo:session): session closed for user root Jul 13 13:51:53 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-9064d98f-9311-45b5-a1ec-101efbe565bc tempest-GroupSnapshotsTest-803384794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-08fc2087-8cf3-40a4-bb9c-d746181f1fc4.2b769c2f-9f55-4c56-a7f0-f062a3800bb2" returned: 0 in 0.287s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:51:53 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-9064d98f-9311-45b5-a1ec-101efbe565bc tempest-GroupSnapshotsTest-803384794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-08fc2087-8cf3-40a4-bb9c-d746181f1fc4.info {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:51:53 devstack sudo[90942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-08fc2087-8cf3-40a4-bb9c-d746181f1fc4.info Jul 13 13:51:53 devstack sudo[90942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:51:53 devstack sudo[90942]: pam_unix(sudo:session): session closed for user root Jul 13 13:51:53 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-9064d98f-9311-45b5-a1ec-101efbe565bc tempest-GroupSnapshotsTest-803384794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-08fc2087-8cf3-40a4-bb9c-d746181f1fc4.info" returned: 0 in 0.300s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:51:53 devstack cinder-volume[87098]: WARNING cinder.volume.drivers.remotefs [None req-9064d98f-9311-45b5-a1ec-101efbe565bc tempest-GroupSnapshotsTest-803384794 None] /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-08fc2087-8cf3-40a4-bb9c-d746181f1fc4.info is being set with open permissions: ugo+rw: NotImplementedError Jul 13 13:51:53 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-9064d98f-9311-45b5-a1ec-101efbe565bc tempest-GroupSnapshotsTest-803384794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-08fc2087-8cf3-40a4-bb9c-d746181f1fc4.info {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:51:53 devstack sudo[90945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-08fc2087-8cf3-40a4-bb9c-d746181f1fc4.info Jul 13 13:51:53 devstack sudo[90945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:51:54 devstack sudo[90945]: pam_unix(sudo:session): session closed for user root Jul 13 13:51:54 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-9064d98f-9311-45b5-a1ec-101efbe565bc tempest-GroupSnapshotsTest-803384794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-08fc2087-8cf3-40a4-bb9c-d746181f1fc4.info" returned: 0 in 0.274s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:51:54 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-9064d98f-9311-45b5-a1ec-101efbe565bc tempest-GroupSnapshotsTest-803384794 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.401s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:51:54 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-9064d98f-9311-45b5-a1ec-101efbe565bc tempest-GroupSnapshotsTest-803384794 None] group_snapshot 1b625f03-a3d0-4160-8216-79a4e1b49bc8: created successfully Jul 13 13:51:54 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-ef8aad27-fd25-47d3-968a-c19b429f5f18 tempest-GroupSnapshotsTest-803384794 None] group_snapshot 1b625f03-a3d0-4160-8216-79a4e1b49bc8: deleting Jul 13 13:51:55 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-ef8aad27-fd25-47d3-968a-c19b429f5f18 tempest-GroupSnapshotsTest-803384794 None] group_snapshot 1b625f03-a3d0-4160-8216-79a4e1b49bc8: deleting {{(pid=87098) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 13 13:51:55 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-ef8aad27-fd25-47d3-968a-c19b429f5f18 tempest-GroupSnapshotsTest-803384794 None] Acquiring lock "cinder-quobyte-55de4e95-4f8b-40a4-bbb8-9334dcdbae04" by "delete_snapshot" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 13:51:55 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-ef8aad27-fd25-47d3-968a-c19b429f5f18 tempest-GroupSnapshotsTest-803384794 None] Lock "cinder-quobyte-55de4e95-4f8b-40a4-bbb8-9334dcdbae04" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 13:51:55 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-ef8aad27-fd25-47d3-968a-c19b429f5f18 tempest-GroupSnapshotsTest-803384794 None] Acquiring lock "cinder-quobyte-1a581473-1c63-4331-86ff-77628ee028aa" by "_delete_snapshot" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 13:51:55 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-ef8aad27-fd25-47d3-968a-c19b429f5f18 tempest-GroupSnapshotsTest-803384794 None] Lock "cinder-quobyte-1a581473-1c63-4331-86ff-77628ee028aa" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 13:51:55 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-ef8aad27-fd25-47d3-968a-c19b429f5f18 tempest-GroupSnapshotsTest-803384794 None] Deleting offline snapshot 1a581473-1c63-4331-86ff-77628ee028aa of volume 55de4e95-4f8b-40a4-bbb8-9334dcdbae04 {{(pid=87098) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 13 13:51:55 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-ef8aad27-fd25-47d3-968a-c19b429f5f18 tempest-GroupSnapshotsTest-803384794 None] snapshot_file for this snap is: volume-55de4e95-4f8b-40a4-bbb8-9334dcdbae04.1a581473-1c63-4331-86ff-77628ee028aa {{(pid=87098) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 13 13:51:55 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad9684ab-66d5-4b1f-80f3-241ec1b44a01]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 13:51:55 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-ef8aad27-fd25-47d3-968a-c19b429f5f18 tempest-GroupSnapshotsTest-803384794 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-55de4e95-4f8b-40a4-bbb8-9334dcdbae04.1a581473-1c63-4331-86ff-77628ee028aa {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:51:55 devstack sudo[90948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-55de4e95-4f8b-40a4-bbb8-9334dcdbae04.1a581473-1c63-4331-86ff-77628ee028aa Jul 13 13:51:55 devstack sudo[90948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:51:55 devstack sudo[90948]: pam_unix(sudo:session): session closed for user root Jul 13 13:51:55 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-ef8aad27-fd25-47d3-968a-c19b429f5f18 tempest-GroupSnapshotsTest-803384794 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-55de4e95-4f8b-40a4-bbb8-9334dcdbae04.1a581473-1c63-4331-86ff-77628ee028aa" returned: 0 in 0.459s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:51:55 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-ef8aad27-fd25-47d3-968a-c19b429f5f18 tempest-GroupSnapshotsTest-803384794 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-55de4e95-4f8b-40a4-bbb8-9334dcdbae04(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87098) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 13 13:51:55 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff63672b-4fb7-47c2-a278-691a3a6982a4]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 13:51:55 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-ef8aad27-fd25-47d3-968a-c19b429f5f18 tempest-GroupSnapshotsTest-803384794 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-55de4e95-4f8b-40a4-bbb8-9334dcdbae04 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:51:55 devstack sudo[90953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-55de4e95-4f8b-40a4-bbb8-9334dcdbae04 Jul 13 13:51:55 devstack sudo[90953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:51:56 devstack sudo[90953]: pam_unix(sudo:session): session closed for user root Jul 13 13:51:56 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-ef8aad27-fd25-47d3-968a-c19b429f5f18 tempest-GroupSnapshotsTest-803384794 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-55de4e95-4f8b-40a4-bbb8-9334dcdbae04" returned: 0 in 0.417s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:51:56 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-ef8aad27-fd25-47d3-968a-c19b429f5f18 tempest-GroupSnapshotsTest-803384794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-55de4e95-4f8b-40a4-bbb8-9334dcdbae04.1a581473-1c63-4331-86ff-77628ee028aa {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:51:56 devstack sudo[90960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-55de4e95-4f8b-40a4-bbb8-9334dcdbae04.1a581473-1c63-4331-86ff-77628ee028aa Jul 13 13:51:56 devstack sudo[90960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:51:56 devstack sudo[90960]: pam_unix(sudo:session): session closed for user root Jul 13 13:51:56 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-ef8aad27-fd25-47d3-968a-c19b429f5f18 tempest-GroupSnapshotsTest-803384794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-55de4e95-4f8b-40a4-bbb8-9334dcdbae04.1a581473-1c63-4331-86ff-77628ee028aa" returned: 0 in 0.441s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:51:56 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-ef8aad27-fd25-47d3-968a-c19b429f5f18 tempest-GroupSnapshotsTest-803384794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-55de4e95-4f8b-40a4-bbb8-9334dcdbae04.1a581473-1c63-4331-86ff-77628ee028aa {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:51:56 devstack sudo[90969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-55de4e95-4f8b-40a4-bbb8-9334dcdbae04.1a581473-1c63-4331-86ff-77628ee028aa Jul 13 13:51:56 devstack sudo[90969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:51:56 devstack sudo[90969]: pam_unix(sudo:session): session closed for user root Jul 13 13:51:56 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-ef8aad27-fd25-47d3-968a-c19b429f5f18 tempest-GroupSnapshotsTest-803384794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-55de4e95-4f8b-40a4-bbb8-9334dcdbae04.1a581473-1c63-4331-86ff-77628ee028aa" returned: 0 in 0.296s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:51:56 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-ef8aad27-fd25-47d3-968a-c19b429f5f18 tempest-GroupSnapshotsTest-803384794 None] Lock "cinder-quobyte-1a581473-1c63-4331-86ff-77628ee028aa" released by "_delete_snapshot" :: held 1.756s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 13:51:56 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-ef8aad27-fd25-47d3-968a-c19b429f5f18 tempest-GroupSnapshotsTest-803384794 None] Lock "cinder-quobyte-55de4e95-4f8b-40a4-bbb8-9334dcdbae04" released by "delete_snapshot" :: held 1.790s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 13:51:56 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-ef8aad27-fd25-47d3-968a-c19b429f5f18 tempest-GroupSnapshotsTest-803384794 None] Acquiring lock "cinder-quobyte-08fc2087-8cf3-40a4-bb9c-d746181f1fc4" by "delete_snapshot" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 13:51:56 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-ef8aad27-fd25-47d3-968a-c19b429f5f18 tempest-GroupSnapshotsTest-803384794 None] Lock "cinder-quobyte-08fc2087-8cf3-40a4-bb9c-d746181f1fc4" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 13:51:56 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-ef8aad27-fd25-47d3-968a-c19b429f5f18 tempest-GroupSnapshotsTest-803384794 None] Acquiring lock "cinder-quobyte-2b769c2f-9f55-4c56-a7f0-f062a3800bb2" by "_delete_snapshot" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 13:51:56 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-ef8aad27-fd25-47d3-968a-c19b429f5f18 tempest-GroupSnapshotsTest-803384794 None] Lock "cinder-quobyte-2b769c2f-9f55-4c56-a7f0-f062a3800bb2" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 13:51:56 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-ef8aad27-fd25-47d3-968a-c19b429f5f18 tempest-GroupSnapshotsTest-803384794 None] Deleting offline snapshot 2b769c2f-9f55-4c56-a7f0-f062a3800bb2 of volume 08fc2087-8cf3-40a4-bb9c-d746181f1fc4 {{(pid=87098) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 13 13:51:56 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-ef8aad27-fd25-47d3-968a-c19b429f5f18 tempest-GroupSnapshotsTest-803384794 None] snapshot_file for this snap is: volume-08fc2087-8cf3-40a4-bb9c-d746181f1fc4.2b769c2f-9f55-4c56-a7f0-f062a3800bb2 {{(pid=87098) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 13 13:51:56 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce876cd8-f6a8-46d9-a364-d074ffeeba7a]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 13:51:56 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-ef8aad27-fd25-47d3-968a-c19b429f5f18 tempest-GroupSnapshotsTest-803384794 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-08fc2087-8cf3-40a4-bb9c-d746181f1fc4.2b769c2f-9f55-4c56-a7f0-f062a3800bb2 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:51:57 devstack sudo[90973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-08fc2087-8cf3-40a4-bb9c-d746181f1fc4.2b769c2f-9f55-4c56-a7f0-f062a3800bb2 Jul 13 13:51:57 devstack sudo[90973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:51:57 devstack sudo[90973]: pam_unix(sudo:session): session closed for user root Jul 13 13:51:57 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-ef8aad27-fd25-47d3-968a-c19b429f5f18 tempest-GroupSnapshotsTest-803384794 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-08fc2087-8cf3-40a4-bb9c-d746181f1fc4.2b769c2f-9f55-4c56-a7f0-f062a3800bb2" returned: 0 in 0.439s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:51:57 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-ef8aad27-fd25-47d3-968a-c19b429f5f18 tempest-GroupSnapshotsTest-803384794 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-08fc2087-8cf3-40a4-bb9c-d746181f1fc4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87098) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 13 13:51:57 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[63fa2cb9-1514-4155-bf54-d32789067f74]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 13:51:57 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-ef8aad27-fd25-47d3-968a-c19b429f5f18 tempest-GroupSnapshotsTest-803384794 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-08fc2087-8cf3-40a4-bb9c-d746181f1fc4 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:51:57 devstack sudo[90979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-08fc2087-8cf3-40a4-bb9c-d746181f1fc4 Jul 13 13:51:57 devstack sudo[90979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:51:58 devstack sudo[90979]: pam_unix(sudo:session): session closed for user root Jul 13 13:51:58 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-ef8aad27-fd25-47d3-968a-c19b429f5f18 tempest-GroupSnapshotsTest-803384794 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-08fc2087-8cf3-40a4-bb9c-d746181f1fc4" returned: 0 in 0.592s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:51:58 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-ef8aad27-fd25-47d3-968a-c19b429f5f18 tempest-GroupSnapshotsTest-803384794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-08fc2087-8cf3-40a4-bb9c-d746181f1fc4.2b769c2f-9f55-4c56-a7f0-f062a3800bb2 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:51:58 devstack sudo[90985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-08fc2087-8cf3-40a4-bb9c-d746181f1fc4.2b769c2f-9f55-4c56-a7f0-f062a3800bb2 Jul 13 13:51:58 devstack sudo[90985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:51:58 devstack sudo[90985]: pam_unix(sudo:session): session closed for user root Jul 13 13:51:58 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-ef8aad27-fd25-47d3-968a-c19b429f5f18 tempest-GroupSnapshotsTest-803384794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-08fc2087-8cf3-40a4-bb9c-d746181f1fc4.2b769c2f-9f55-4c56-a7f0-f062a3800bb2" returned: 0 in 0.453s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:51:58 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-ef8aad27-fd25-47d3-968a-c19b429f5f18 tempest-GroupSnapshotsTest-803384794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-08fc2087-8cf3-40a4-bb9c-d746181f1fc4.2b769c2f-9f55-4c56-a7f0-f062a3800bb2 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:51:58 devstack sudo[91000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-08fc2087-8cf3-40a4-bb9c-d746181f1fc4.2b769c2f-9f55-4c56-a7f0-f062a3800bb2 Jul 13 13:51:58 devstack sudo[91000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:51:58 devstack sudo[91000]: pam_unix(sudo:session): session closed for user root Jul 13 13:51:58 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-ef8aad27-fd25-47d3-968a-c19b429f5f18 tempest-GroupSnapshotsTest-803384794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-08fc2087-8cf3-40a4-bb9c-d746181f1fc4.2b769c2f-9f55-4c56-a7f0-f062a3800bb2" returned: 0 in 0.439s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:51:59 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-ef8aad27-fd25-47d3-968a-c19b429f5f18 tempest-GroupSnapshotsTest-803384794 None] Lock "cinder-quobyte-2b769c2f-9f55-4c56-a7f0-f062a3800bb2" released by "_delete_snapshot" :: held 2.109s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 13:51:59 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-ef8aad27-fd25-47d3-968a-c19b429f5f18 tempest-GroupSnapshotsTest-803384794 None] Lock "cinder-quobyte-08fc2087-8cf3-40a4-bb9c-d746181f1fc4" released by "delete_snapshot" :: held 2.147s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 13:51:59 devstack cinder-volume[87098]: WARNING cinder.quota [None req-ef8aad27-fd25-47d3-968a-c19b429f5f18 tempest-GroupSnapshotsTest-803384794 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1459092446 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1459092446, it is now deprecated. Please use the default quota class for default quota. Jul 13 13:51:59 devstack cinder-volume[87098]: WARNING cinder.quota [None req-ef8aad27-fd25-47d3-968a-c19b429f5f18 tempest-GroupSnapshotsTest-803384794 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1459092446 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1459092446, it is now deprecated. Please use the default quota class for default quota. Jul 13 13:51:59 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-ef8aad27-fd25-47d3-968a-c19b429f5f18 tempest-GroupSnapshotsTest-803384794 None] Created reservations ['aea4ae9b-a3f7-4d18-848b-baa204e86ddf', 'bf13ea2c-fe4d-4d7f-9eee-1b4e682d0b2f', '41cee7e2-44e1-4dbb-ad1f-8665537515e7', '514e83dc-fe30-4883-a21a-f36c90ad8694'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 13:51:59 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-ef8aad27-fd25-47d3-968a-c19b429f5f18 tempest-GroupSnapshotsTest-803384794 None] Created reservations ['f66c7d55-998a-462c-8c13-47fba5ccb454', '727ceba9-fbc5-46ce-9ee8-fd29b83d2c8f', 'cdb1f045-f008-4982-9de1-adbac5b5556e', '11fe2153-d750-43b4-996f-3380f190e01c'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 13:51:59 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-ef8aad27-fd25-47d3-968a-c19b429f5f18 tempest-GroupSnapshotsTest-803384794 None] group_snapshot 1b625f03-a3d0-4160-8216-79a4e1b49bc8: deleted successfully Jul 13 13:52:00 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-e85c9b04-fbc0-4f30-a0f8-f76f76a7e04b tempest-GroupSnapshotsTest-803384794 None] Acquiring lock "cinder-quobyte-08fc2087-8cf3-40a4-bb9c-d746181f1fc4" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 13:52:00 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-e85c9b04-fbc0-4f30-a0f8-f76f76a7e04b tempest-GroupSnapshotsTest-803384794 None] Lock "cinder-quobyte-08fc2087-8cf3-40a4-bb9c-d746181f1fc4" acquired by "delete_volume" :: waited 0.041s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 13:52:00 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c08530f-6ad5-4e53-897f-7bc80cce526c]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 13:52:00 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-e85c9b04-fbc0-4f30-a0f8-f76f76a7e04b tempest-GroupSnapshotsTest-803384794 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-08fc2087-8cf3-40a4-bb9c-d746181f1fc4 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:52:00 devstack sudo[91048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-08fc2087-8cf3-40a4-bb9c-d746181f1fc4 Jul 13 13:52:00 devstack sudo[91048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:52:01 devstack sudo[91048]: pam_unix(sudo:session): session closed for user root Jul 13 13:52:01 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-e85c9b04-fbc0-4f30-a0f8-f76f76a7e04b tempest-GroupSnapshotsTest-803384794 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-08fc2087-8cf3-40a4-bb9c-d746181f1fc4" returned: 0 in 0.432s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:52:01 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-e85c9b04-fbc0-4f30-a0f8-f76f76a7e04b tempest-GroupSnapshotsTest-803384794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-08fc2087-8cf3-40a4-bb9c-d746181f1fc4 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:52:01 devstack sudo[91054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-08fc2087-8cf3-40a4-bb9c-d746181f1fc4 Jul 13 13:52:01 devstack sudo[91054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:52:01 devstack sudo[91054]: pam_unix(sudo:session): session closed for user root Jul 13 13:52:01 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-e85c9b04-fbc0-4f30-a0f8-f76f76a7e04b tempest-GroupSnapshotsTest-803384794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-08fc2087-8cf3-40a4-bb9c-d746181f1fc4" returned: 0 in 0.336s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:52:01 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-e85c9b04-fbc0-4f30-a0f8-f76f76a7e04b tempest-GroupSnapshotsTest-803384794 None] Lock "cinder-quobyte-08fc2087-8cf3-40a4-bb9c-d746181f1fc4" released by "delete_volume" :: held 0.959s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 13:52:01 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-e85c9b04-fbc0-4f30-a0f8-f76f76a7e04b tempest-GroupSnapshotsTest-803384794 None] Acquiring lock "cinder-quobyte-55de4e95-4f8b-40a4-bbb8-9334dcdbae04" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 13:52:01 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-e85c9b04-fbc0-4f30-a0f8-f76f76a7e04b tempest-GroupSnapshotsTest-803384794 None] Lock "cinder-quobyte-55de4e95-4f8b-40a4-bbb8-9334dcdbae04" acquired by "delete_volume" :: waited 0.023s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 13:52:01 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9bbebfa-0559-4e88-8465-8b7b58175676]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 13:52:01 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-e85c9b04-fbc0-4f30-a0f8-f76f76a7e04b tempest-GroupSnapshotsTest-803384794 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-55de4e95-4f8b-40a4-bbb8-9334dcdbae04 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:52:01 devstack sudo[91072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-55de4e95-4f8b-40a4-bbb8-9334dcdbae04 Jul 13 13:52:01 devstack sudo[91072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:52:02 devstack sudo[91072]: pam_unix(sudo:session): session closed for user root Jul 13 13:52:02 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-e85c9b04-fbc0-4f30-a0f8-f76f76a7e04b tempest-GroupSnapshotsTest-803384794 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-55de4e95-4f8b-40a4-bbb8-9334dcdbae04" returned: 0 in 0.620s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:52:02 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-e85c9b04-fbc0-4f30-a0f8-f76f76a7e04b tempest-GroupSnapshotsTest-803384794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-55de4e95-4f8b-40a4-bbb8-9334dcdbae04 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:52:02 devstack sudo[91122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-55de4e95-4f8b-40a4-bbb8-9334dcdbae04 Jul 13 13:52:02 devstack sudo[91122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:52:02 devstack sudo[91122]: pam_unix(sudo:session): session closed for user root Jul 13 13:52:02 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-e85c9b04-fbc0-4f30-a0f8-f76f76a7e04b tempest-GroupSnapshotsTest-803384794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-55de4e95-4f8b-40a4-bbb8-9334dcdbae04" returned: 0 in 0.475s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:52:02 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-e85c9b04-fbc0-4f30-a0f8-f76f76a7e04b tempest-GroupSnapshotsTest-803384794 None] Lock "cinder-quobyte-55de4e95-4f8b-40a4-bbb8-9334dcdbae04" released by "delete_volume" :: held 1.197s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 13:52:02 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-e85c9b04-fbc0-4f30-a0f8-f76f76a7e04b tempest-GroupSnapshotsTest-803384794 None] Created reservations ['84e9bbdf-6472-4a23-af9b-d5497f9235b2'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 13:52:02 devstack cinder-volume[87098]: WARNING cinder.quota [None req-e85c9b04-fbc0-4f30-a0f8-f76f76a7e04b tempest-GroupSnapshotsTest-803384794 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1459092446 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1459092446, it is now deprecated. Please use the default quota class for default quota. Jul 13 13:52:02 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-e85c9b04-fbc0-4f30-a0f8-f76f76a7e04b tempest-GroupSnapshotsTest-803384794 None] Created reservations ['ec199413-b3e4-42af-9b87-748bc60e7465', 'e975adb6-6d7d-4ed0-97e7-975e087ae001', 'f60918d2-2a2a-4b31-8cbb-fcdde806e1f8', '6e7277d8-702c-4278-a5ac-f71795e8132f'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 13:52:03 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-e85c9b04-fbc0-4f30-a0f8-f76f76a7e04b tempest-GroupSnapshotsTest-803384794 None] Created reservations ['a62cf656-574c-4823-ba3e-ca427f748c7c', '7a42e1f5-7b57-4215-93b6-1e5cb2df7c6a', '63b0ff02-47b1-409c-b329-171e69cde66c', 'ca775cd0-de62-49b7-aa3e-097522ac7cdc'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 13:52:03 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-e85c9b04-fbc0-4f30-a0f8-f76f76a7e04b tempest-GroupSnapshotsTest-803384794 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:52:03 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-e85c9b04-fbc0-4f30-a0f8-f76f76a7e04b tempest-GroupSnapshotsTest-803384794 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:52:03 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-e85c9b04-fbc0-4f30-a0f8-f76f76a7e04b tempest-GroupSnapshotsTest-803384794 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 13:52:03 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-e85c9b04-fbc0-4f30-a0f8-f76f76a7e04b tempest-GroupSnapshotsTest-803384794 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 13:52:03 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-e85c9b04-fbc0-4f30-a0f8-f76f76a7e04b tempest-GroupSnapshotsTest-803384794 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:52:03 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-e85c9b04-fbc0-4f30-a0f8-f76f76a7e04b tempest-GroupSnapshotsTest-803384794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:52:03 devstack sudo[91137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 Jul 13 13:52:03 devstack sudo[91137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:52:04 devstack sudo[91137]: pam_unix(sudo:session): session closed for user root Jul 13 13:52:04 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-e85c9b04-fbc0-4f30-a0f8-f76f76a7e04b tempest-GroupSnapshotsTest-803384794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78" returned: 0 in 0.549s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:52:04 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-e85c9b04-fbc0-4f30-a0f8-f76f76a7e04b tempest-GroupSnapshotsTest-803384794 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 13:52:04 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-e85c9b04-fbc0-4f30-a0f8-f76f76a7e04b tempest-GroupSnapshotsTest-803384794 None] Delete group completed successfully. Jul 13 13:52:04 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-219f4a62-acc0-40d4-93fa-69d9bfa8621b tempest-AttachVolumeNegativeTest-468633374 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 13:52:04 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-219f4a62-acc0-40d4-93fa-69d9bfa8621b tempest-AttachVolumeNegativeTest-468633374 None] Flow 'volume_create_manager' (7d2321f6-3d39-4cc1-9d20-2a1764b9d10e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 13:52:04 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-219f4a62-acc0-40d4-93fa-69d9bfa8621b tempest-AttachVolumeNegativeTest-468633374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e5b9901-3b19-4bc1-9ad7-73fd5c8c33f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:52:04 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-219f4a62-acc0-40d4-93fa-69d9bfa8621b tempest-AttachVolumeNegativeTest-468633374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e5b9901-3b19-4bc1-9ad7-73fd5c8c33f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T11:52:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-177533316',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=304c6dea-b15e-46bc-90db-d48156d2081c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8794c1b399a24bc5b65aeed906ffb8f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T11:52:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T11:52:04Z,use_quota=True,user_id='6566c5149286424f948fd3e110a2ca17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1147de8b-623b-426c-a13d-7fc824a80f67),volume_type_id=1147de8b-623b-426c-a13d-7fc824a80f67)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:52:04 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-219f4a62-acc0-40d4-93fa-69d9bfa8621b tempest-AttachVolumeNegativeTest-468633374 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01e1ee5c-5562-4cb6-98c9-bafaea21d753) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:52:04 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-219f4a62-acc0-40d4-93fa-69d9bfa8621b tempest-AttachVolumeNegativeTest-468633374 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01e1ee5c-5562-4cb6-98c9-bafaea21d753) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:52:04 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-219f4a62-acc0-40d4-93fa-69d9bfa8621b tempest-AttachVolumeNegativeTest-468633374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f83c6ff-c452-469c-9d01-28b23fe72580) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:52:04 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-219f4a62-acc0-40d4-93fa-69d9bfa8621b tempest-AttachVolumeNegativeTest-468633374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f83c6ff-c452-469c-9d01-28b23fe72580) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '304c6dea-b15e-46bc-90db-d48156d2081c', 'volume_name': 'volume-304c6dea-b15e-46bc-90db-d48156d2081c', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:52:04 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-219f4a62-acc0-40d4-93fa-69d9bfa8621b tempest-AttachVolumeNegativeTest-468633374 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2561f3a3-9a38-41a9-adf7-0196837bef71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:52:04 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-219f4a62-acc0-40d4-93fa-69d9bfa8621b tempest-AttachVolumeNegativeTest-468633374 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2561f3a3-9a38-41a9-adf7-0196837bef71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:52:04 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-219f4a62-acc0-40d4-93fa-69d9bfa8621b tempest-AttachVolumeNegativeTest-468633374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (604c694c-fad3-4eff-ac2a-7d27133d2174) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:52:04 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-219f4a62-acc0-40d4-93fa-69d9bfa8621b tempest-AttachVolumeNegativeTest-468633374 None] Volume 304c6dea-b15e-46bc-90db-d48156d2081c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-304c6dea-b15e-46bc-90db-d48156d2081c', 'volume_size': 1} Jul 13 13:52:04 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-219f4a62-acc0-40d4-93fa-69d9bfa8621b tempest-AttachVolumeNegativeTest-468633374 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:52:04 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-219f4a62-acc0-40d4-93fa-69d9bfa8621b tempest-AttachVolumeNegativeTest-468633374 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:52:04 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-219f4a62-acc0-40d4-93fa-69d9bfa8621b tempest-AttachVolumeNegativeTest-468633374 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T11:52:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-177533316',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=304c6dea-b15e-46bc-90db-d48156d2081c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8794c1b399a24bc5b65aeed906ffb8f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T11:52:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T11:52:04Z,use_quota=True,user_id='6566c5149286424f948fd3e110a2ca17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1147de8b-623b-426c-a13d-7fc824a80f67),volume_type_id=1147de8b-623b-426c-a13d-7fc824a80f67)}" {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 13 13:52:04 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-219f4a62-acc0-40d4-93fa-69d9bfa8621b tempest-AttachVolumeNegativeTest-468633374 None] Creating volume 304c6dea-b15e-46bc-90db-d48156d2081c {{(pid=87098) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 13 13:52:04 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-219f4a62-acc0-40d4-93fa-69d9bfa8621b tempest-AttachVolumeNegativeTest-468633374 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:52:04 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-219f4a62-acc0-40d4-93fa-69d9bfa8621b tempest-AttachVolumeNegativeTest-468633374 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:52:04 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-219f4a62-acc0-40d4-93fa-69d9bfa8621b tempest-AttachVolumeNegativeTest-468633374 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 13:52:04 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-219f4a62-acc0-40d4-93fa-69d9bfa8621b tempest-AttachVolumeNegativeTest-468633374 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 13:52:04 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-219f4a62-acc0-40d4-93fa-69d9bfa8621b tempest-AttachVolumeNegativeTest-468633374 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:52:04 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-219f4a62-acc0-40d4-93fa-69d9bfa8621b tempest-AttachVolumeNegativeTest-468633374 None] Selected osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 13:52:04 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-219f4a62-acc0-40d4-93fa-69d9bfa8621b tempest-AttachVolumeNegativeTest-468633374 None] casted to osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 Jul 13 13:52:04 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-219f4a62-acc0-40d4-93fa-69d9bfa8621b tempest-AttachVolumeNegativeTest-468633374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-304c6dea-b15e-46bc-90db-d48156d2081c 1073741824 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:52:04 devstack sudo[91140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-304c6dea-b15e-46bc-90db-d48156d2081c 1073741824 Jul 13 13:52:04 devstack sudo[91140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:52:04 devstack sudo[91140]: pam_unix(sudo:session): session closed for user root Jul 13 13:52:04 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-219f4a62-acc0-40d4-93fa-69d9bfa8621b tempest-AttachVolumeNegativeTest-468633374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-304c6dea-b15e-46bc-90db-d48156d2081c 1073741824" returned: 0 in 0.692s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:52:05 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-219f4a62-acc0-40d4-93fa-69d9bfa8621b tempest-AttachVolumeNegativeTest-468633374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-304c6dea-b15e-46bc-90db-d48156d2081c {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:52:05 devstack sudo[91147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-304c6dea-b15e-46bc-90db-d48156d2081c Jul 13 13:52:05 devstack sudo[91147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:52:05 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-f916676f-b92b-4b20-9e99-39b2524892e5 tempest-GroupSnapshotsTest-803384794 None] Group tempest-GroupSnapshotsTest-Group-387923654: creating Jul 13 13:52:05 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-f916676f-b92b-4b20-9e99-39b2524892e5 tempest-GroupSnapshotsTest-803384794 None] Group tempest-GroupSnapshotsTest-Group-387923654: created successfully Jul 13 13:52:05 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-f916676f-b92b-4b20-9e99-39b2524892e5 tempest-GroupSnapshotsTest-803384794 None] Create group completed successfully. Jul 13 13:52:05 devstack sudo[91147]: pam_unix(sudo:session): session closed for user root Jul 13 13:52:05 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-219f4a62-acc0-40d4-93fa-69d9bfa8621b tempest-AttachVolumeNegativeTest-468633374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-304c6dea-b15e-46bc-90db-d48156d2081c" returned: 0 in 0.386s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:52:05 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-219f4a62-acc0-40d4-93fa-69d9bfa8621b tempest-AttachVolumeNegativeTest-468633374 None] <== create_volume: return (1191ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'} {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 13 13:52:05 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-219f4a62-acc0-40d4-93fa-69d9bfa8621b tempest-AttachVolumeNegativeTest-468633374 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.196s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:52:05 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-219f4a62-acc0-40d4-93fa-69d9bfa8621b tempest-AttachVolumeNegativeTest-468633374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (604c694c-fad3-4eff-ac2a-7d27133d2174) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-304c6dea-b15e-46bc-90db-d48156d2081c', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:52:05 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-219f4a62-acc0-40d4-93fa-69d9bfa8621b tempest-AttachVolumeNegativeTest-468633374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e96af1a9-24bf-49ab-b8a1-2e3a24aa215b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:52:05 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-219f4a62-acc0-40d4-93fa-69d9bfa8621b tempest-AttachVolumeNegativeTest-468633374 None] Volume volume-304c6dea-b15e-46bc-90db-d48156d2081c (304c6dea-b15e-46bc-90db-d48156d2081c): created successfully Jul 13 13:52:05 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-219f4a62-acc0-40d4-93fa-69d9bfa8621b tempest-AttachVolumeNegativeTest-468633374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e96af1a9-24bf-49ab-b8a1-2e3a24aa215b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:52:05 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-219f4a62-acc0-40d4-93fa-69d9bfa8621b tempest-AttachVolumeNegativeTest-468633374 None] Flow 'volume_create_manager' (7d2321f6-3d39-4cc1-9d20-2a1764b9d10e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 13:52:05 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-219f4a62-acc0-40d4-93fa-69d9bfa8621b tempest-AttachVolumeNegativeTest-468633374 None] Created volume successfully. Jul 13 13:52:07 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-d505a228-b026-445a-bc4a-9ecb8aadbd6f tempest-GroupSnapshotsTest-803384794 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 13:52:07 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-d505a228-b026-445a-bc4a-9ecb8aadbd6f tempest-GroupSnapshotsTest-803384794 None] Flow 'volume_create_manager' (1f747456-3dca-4498-b85a-9448f105a223) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 13:52:07 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-d505a228-b026-445a-bc4a-9ecb8aadbd6f tempest-GroupSnapshotsTest-803384794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd94d35b-dca8-4ba4-98cd-04c280fcb325) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:52:07 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-d505a228-b026-445a-bc4a-9ecb8aadbd6f tempest-GroupSnapshotsTest-803384794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd94d35b-dca8-4ba4-98cd-04c280fcb325) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T11:52:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-706270840',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b261271a-81aa-4bc8-9c6a-0acc21b6ceef,host='devstack@QuobyteHD#QuobyteHD',id=f843074a-f819-43da-81b2-4d27c2494d6b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d230cd5df37249c2889f13684894daaf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T11:52:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T11:52:07Z,use_quota=True,user_id='2d6e7b464a7a4c6a8957aa2e2008eb6c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7d112b7-f2ad-47c6-a522-f79b3b5bfb43),volume_type_id=b7d112b7-f2ad-47c6-a522-f79b3b5bfb43)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:52:07 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-d505a228-b026-445a-bc4a-9ecb8aadbd6f tempest-GroupSnapshotsTest-803384794 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c1a7798-b0cf-476a-ac1a-ef726bc91123) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:52:07 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-d505a228-b026-445a-bc4a-9ecb8aadbd6f tempest-GroupSnapshotsTest-803384794 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c1a7798-b0cf-476a-ac1a-ef726bc91123) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:52:07 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-d505a228-b026-445a-bc4a-9ecb8aadbd6f tempest-GroupSnapshotsTest-803384794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6f8c1d4-e11b-406e-8399-582d16c609f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:52:07 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-d505a228-b026-445a-bc4a-9ecb8aadbd6f tempest-GroupSnapshotsTest-803384794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6f8c1d4-e11b-406e-8399-582d16c609f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f843074a-f819-43da-81b2-4d27c2494d6b', 'volume_name': 'volume-f843074a-f819-43da-81b2-4d27c2494d6b', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:52:07 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-d505a228-b026-445a-bc4a-9ecb8aadbd6f tempest-GroupSnapshotsTest-803384794 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cec1ed30-c010-4838-b4ca-dbd852476e95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:52:07 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-d505a228-b026-445a-bc4a-9ecb8aadbd6f tempest-GroupSnapshotsTest-803384794 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cec1ed30-c010-4838-b4ca-dbd852476e95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:52:07 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-d505a228-b026-445a-bc4a-9ecb8aadbd6f tempest-GroupSnapshotsTest-803384794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1024626b-6cc7-4f7c-b193-5a6051f5d9d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:52:07 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-d505a228-b026-445a-bc4a-9ecb8aadbd6f tempest-GroupSnapshotsTest-803384794 None] Volume f843074a-f819-43da-81b2-4d27c2494d6b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f843074a-f819-43da-81b2-4d27c2494d6b', 'volume_size': 1} Jul 13 13:52:07 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-d505a228-b026-445a-bc4a-9ecb8aadbd6f tempest-GroupSnapshotsTest-803384794 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:52:07 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-d505a228-b026-445a-bc4a-9ecb8aadbd6f tempest-GroupSnapshotsTest-803384794 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:52:07 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-d505a228-b026-445a-bc4a-9ecb8aadbd6f tempest-GroupSnapshotsTest-803384794 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=b261271a-81aa-4bc8-9c6a-0acc21b6ceef,created_at=2026-07-13T11:52:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-706270840',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b261271a-81aa-4bc8-9c6a-0acc21b6ceef,host='devstack@QuobyteHD#QuobyteHD',id=f843074a-f819-43da-81b2-4d27c2494d6b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d230cd5df37249c2889f13684894daaf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T11:52:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T11:52:07Z,use_quota=True,user_id='2d6e7b464a7a4c6a8957aa2e2008eb6c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7d112b7-f2ad-47c6-a522-f79b3b5bfb43),volume_type_id=b7d112b7-f2ad-47c6-a522-f79b3b5bfb43)}" {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 13 13:52:07 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-d505a228-b026-445a-bc4a-9ecb8aadbd6f tempest-GroupSnapshotsTest-803384794 None] Creating volume f843074a-f819-43da-81b2-4d27c2494d6b {{(pid=87098) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 13 13:52:07 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-d505a228-b026-445a-bc4a-9ecb8aadbd6f tempest-GroupSnapshotsTest-803384794 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:52:07 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-d505a228-b026-445a-bc4a-9ecb8aadbd6f tempest-GroupSnapshotsTest-803384794 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:52:07 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-d505a228-b026-445a-bc4a-9ecb8aadbd6f tempest-GroupSnapshotsTest-803384794 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 13:52:07 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-d505a228-b026-445a-bc4a-9ecb8aadbd6f tempest-GroupSnapshotsTest-803384794 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 13:52:07 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-d505a228-b026-445a-bc4a-9ecb8aadbd6f tempest-GroupSnapshotsTest-803384794 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:52:07 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-d505a228-b026-445a-bc4a-9ecb8aadbd6f tempest-GroupSnapshotsTest-803384794 None] Selected osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 13:52:07 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-d505a228-b026-445a-bc4a-9ecb8aadbd6f tempest-GroupSnapshotsTest-803384794 None] casted to osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 Jul 13 13:52:07 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-d505a228-b026-445a-bc4a-9ecb8aadbd6f tempest-GroupSnapshotsTest-803384794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-f843074a-f819-43da-81b2-4d27c2494d6b 1073741824 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:52:07 devstack sudo[91168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-f843074a-f819-43da-81b2-4d27c2494d6b 1073741824 Jul 13 13:52:07 devstack sudo[91168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:52:07 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [req-e7e5fbae-ff5e-4c48-9501-170f8c5c413f req-f68bf4ea-a7d4-44d9-97f6-f611a25b3724 tempest-AttachVolumeNegativeTest-468633374 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:52:08 devstack sudo[91168]: pam_unix(sudo:session): session closed for user root Jul 13 13:52:08 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-d505a228-b026-445a-bc4a-9ecb8aadbd6f tempest-GroupSnapshotsTest-803384794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-f843074a-f819-43da-81b2-4d27c2494d6b 1073741824" returned: 0 in 0.647s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:52:08 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-d505a228-b026-445a-bc4a-9ecb8aadbd6f tempest-GroupSnapshotsTest-803384794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-f843074a-f819-43da-81b2-4d27c2494d6b {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:52:08 devstack sudo[91174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-f843074a-f819-43da-81b2-4d27c2494d6b Jul 13 13:52:08 devstack sudo[91174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:52:08 devstack sudo[91174]: pam_unix(sudo:session): session closed for user root Jul 13 13:52:08 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-d505a228-b026-445a-bc4a-9ecb8aadbd6f tempest-GroupSnapshotsTest-803384794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-f843074a-f819-43da-81b2-4d27c2494d6b" returned: 0 in 0.464s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:52:08 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-d505a228-b026-445a-bc4a-9ecb8aadbd6f tempest-GroupSnapshotsTest-803384794 None] <== create_volume: return (1196ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'} {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 13 13:52:08 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-d505a228-b026-445a-bc4a-9ecb8aadbd6f tempest-GroupSnapshotsTest-803384794 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.199s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:52:08 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [req-e7e5fbae-ff5e-4c48-9501-170f8c5c413f req-f68bf4ea-a7d4-44d9-97f6-f611a25b3724 tempest-AttachVolumeNegativeTest-468633374 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.020s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:52:08 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-d505a228-b026-445a-bc4a-9ecb8aadbd6f tempest-GroupSnapshotsTest-803384794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1024626b-6cc7-4f7c-b193-5a6051f5d9d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f843074a-f819-43da-81b2-4d27c2494d6b', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:52:08 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-d505a228-b026-445a-bc4a-9ecb8aadbd6f tempest-GroupSnapshotsTest-803384794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37c5add1-7c67-42d0-8ec4-7ea7bd8f2f6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:52:08 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[11dd8735-6192-4d40-8437-52212e3d75d2]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 13:52:08 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [req-e7e5fbae-ff5e-4c48-9501-170f8c5c413f req-f68bf4ea-a7d4-44d9-97f6-f611a25b3724 tempest-AttachVolumeNegativeTest-468633374 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-304c6dea-b15e-46bc-90db-d48156d2081c {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:52:08 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-d505a228-b026-445a-bc4a-9ecb8aadbd6f tempest-GroupSnapshotsTest-803384794 None] Volume volume-f843074a-f819-43da-81b2-4d27c2494d6b (f843074a-f819-43da-81b2-4d27c2494d6b): created successfully Jul 13 13:52:08 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-d505a228-b026-445a-bc4a-9ecb8aadbd6f tempest-GroupSnapshotsTest-803384794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37c5add1-7c67-42d0-8ec4-7ea7bd8f2f6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:52:08 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-d505a228-b026-445a-bc4a-9ecb8aadbd6f tempest-GroupSnapshotsTest-803384794 None] Flow 'volume_create_manager' (1f747456-3dca-4498-b85a-9448f105a223) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 13:52:08 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-d505a228-b026-445a-bc4a-9ecb8aadbd6f tempest-GroupSnapshotsTest-803384794 None] Created volume successfully. Jul 13 13:52:09 devstack sudo[91177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-304c6dea-b15e-46bc-90db-d48156d2081c Jul 13 13:52:09 devstack sudo[91177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:52:09 devstack sudo[91177]: pam_unix(sudo:session): session closed for user root Jul 13 13:52:09 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [req-e7e5fbae-ff5e-4c48-9501-170f8c5c413f req-f68bf4ea-a7d4-44d9-97f6-f611a25b3724 tempest-AttachVolumeNegativeTest-468633374 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-304c6dea-b15e-46bc-90db-d48156d2081c" returned: 0 in 0.572s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:52:09 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [req-e7e5fbae-ff5e-4c48-9501-170f8c5c413f req-f68bf4ea-a7d4-44d9-97f6-f611a25b3724 tempest-AttachVolumeNegativeTest-468633374 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.620s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:52:09 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [req-e7e5fbae-ff5e-4c48-9501-170f8c5c413f req-f68bf4ea-a7d4-44d9-97f6-f611a25b3724 tempest-AttachVolumeNegativeTest-468633374 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654', 'name': 'volume-304c6dea-b15e-46bc-90db-d48156d2081c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3961fbf1-65e0-4223-ac0b-0768821d86f2', 'enforce_multipath': True} {{(pid=87098) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 13 13:52:09 devstack cinder-volume[87098]: INFO cinder.volume.manager [req-e7e5fbae-ff5e-4c48-9501-170f8c5c413f req-f68bf4ea-a7d4-44d9-97f6-f611a25b3724 tempest-AttachVolumeNegativeTest-468633374 None] attachment_update completed successfully. Jul 13 13:52:10 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-ce8ab87f-832c-4508-bb54-1e238b7faf49 tempest-GroupSnapshotsTest-803384794 None] GroupSnapshot 3eb0675d-cab9-4940-9188-5313d91fb7a1: creating. Jul 13 13:52:10 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-ce8ab87f-832c-4508-bb54-1e238b7faf49 tempest-GroupSnapshotsTest-803384794 None] Group snapshot 3eb0675d-cab9-4940-9188-5313d91fb7a1: creating. {{(pid=87098) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 13 13:52:10 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-ce8ab87f-832c-4508-bb54-1e238b7faf49 tempest-GroupSnapshotsTest-803384794 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:52:10 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-ce8ab87f-832c-4508-bb54-1e238b7faf49 tempest-GroupSnapshotsTest-803384794 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:52:10 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-ce8ab87f-832c-4508-bb54-1e238b7faf49 tempest-GroupSnapshotsTest-803384794 None] Creating offline snapshot f6c13149-7994-40f0-bb9c-06dba1c28047 of volume f843074a-f819-43da-81b2-4d27c2494d6b {{(pid=87098) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 13 13:52:10 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b38b895-b446-4635-9c74-64674a900548]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 13:52:10 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-ce8ab87f-832c-4508-bb54-1e238b7faf49 tempest-GroupSnapshotsTest-803384794 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-f843074a-f819-43da-81b2-4d27c2494d6b {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:52:11 devstack sudo[91565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-f843074a-f819-43da-81b2-4d27c2494d6b Jul 13 13:52:11 devstack sudo[91565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:52:11 devstack sudo[91565]: pam_unix(sudo:session): session closed for user root Jul 13 13:52:11 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-ce8ab87f-832c-4508-bb54-1e238b7faf49 tempest-GroupSnapshotsTest-803384794 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-f843074a-f819-43da-81b2-4d27c2494d6b" returned: 0 in 0.470s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:52:11 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-ce8ab87f-832c-4508-bb54-1e238b7faf49 tempest-GroupSnapshotsTest-803384794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-f843074a-f819-43da-81b2-4d27c2494d6b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-f843074a-f819-43da-81b2-4d27c2494d6b.f6c13149-7994-40f0-bb9c-06dba1c28047 1G {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:52:11 devstack sudo[91571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-f843074a-f819-43da-81b2-4d27c2494d6b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-f843074a-f819-43da-81b2-4d27c2494d6b.f6c13149-7994-40f0-bb9c-06dba1c28047 1G Jul 13 13:52:11 devstack sudo[91571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:52:12 devstack sudo[91571]: pam_unix(sudo:session): session closed for user root Jul 13 13:52:12 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-ce8ab87f-832c-4508-bb54-1e238b7faf49 tempest-GroupSnapshotsTest-803384794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-f843074a-f819-43da-81b2-4d27c2494d6b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-f843074a-f819-43da-81b2-4d27c2494d6b.f6c13149-7994-40f0-bb9c-06dba1c28047 1G" returned: 0 in 0.817s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:52:12 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-ce8ab87f-832c-4508-bb54-1e238b7faf49 tempest-GroupSnapshotsTest-803384794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f843074a-f819-43da-81b2-4d27c2494d6b -F qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-f843074a-f819-43da-81b2-4d27c2494d6b.f6c13149-7994-40f0-bb9c-06dba1c28047 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:52:12 devstack sudo[91577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f843074a-f819-43da-81b2-4d27c2494d6b -F qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-f843074a-f819-43da-81b2-4d27c2494d6b.f6c13149-7994-40f0-bb9c-06dba1c28047 Jul 13 13:52:12 devstack sudo[91577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:52:12 devstack sudo[91577]: pam_unix(sudo:session): session closed for user root Jul 13 13:52:12 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-ce8ab87f-832c-4508-bb54-1e238b7faf49 tempest-GroupSnapshotsTest-803384794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f843074a-f819-43da-81b2-4d27c2494d6b -F qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-f843074a-f819-43da-81b2-4d27c2494d6b.f6c13149-7994-40f0-bb9c-06dba1c28047" returned: 0 in 0.769s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:52:12 devstack cinder-volume[87098]: WARNING cinder.volume.drivers.remotefs [None req-ce8ab87f-832c-4508-bb54-1e238b7faf49 tempest-GroupSnapshotsTest-803384794 None] /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-f843074a-f819-43da-81b2-4d27c2494d6b.f6c13149-7994-40f0-bb9c-06dba1c28047 is being set with open permissions: ugo+rw: NotImplementedError Jul 13 13:52:12 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-ce8ab87f-832c-4508-bb54-1e238b7faf49 tempest-GroupSnapshotsTest-803384794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-f843074a-f819-43da-81b2-4d27c2494d6b.f6c13149-7994-40f0-bb9c-06dba1c28047 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:52:12 devstack cinder-volume[87098]: INFO cinder.volume.manager [req-6704ded9-19ca-4f53-b3c5-ba4d293204d5 req-0a709428-356d-4cfc-be3c-d3d52569db5b tempest-AttachVolumeNegativeTest-468633374 None] Terminate volume connection completed successfully. Jul 13 13:52:12 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [req-6704ded9-19ca-4f53-b3c5-ba4d293204d5 req-0a709428-356d-4cfc-be3c-d3d52569db5b tempest-AttachVolumeNegativeTest-468633374 None] Deleting attachment 3961fbf1-65e0-4223-ac0b-0768821d86f2. {{(pid=87098) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 13 13:52:12 devstack sudo[91609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-f843074a-f819-43da-81b2-4d27c2494d6b.f6c13149-7994-40f0-bb9c-06dba1c28047 Jul 13 13:52:12 devstack sudo[91609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:52:13 devstack sudo[91609]: pam_unix(sudo:session): session closed for user root Jul 13 13:52:13 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-ce8ab87f-832c-4508-bb54-1e238b7faf49 tempest-GroupSnapshotsTest-803384794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-f843074a-f819-43da-81b2-4d27c2494d6b.f6c13149-7994-40f0-bb9c-06dba1c28047" returned: 0 in 0.413s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:52:13 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-ce8ab87f-832c-4508-bb54-1e238b7faf49 tempest-GroupSnapshotsTest-803384794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-f843074a-f819-43da-81b2-4d27c2494d6b.info {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:52:13 devstack sudo[91612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-f843074a-f819-43da-81b2-4d27c2494d6b.info Jul 13 13:52:13 devstack sudo[91612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:52:13 devstack sudo[91612]: pam_unix(sudo:session): session closed for user root Jul 13 13:52:13 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-ce8ab87f-832c-4508-bb54-1e238b7faf49 tempest-GroupSnapshotsTest-803384794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-f843074a-f819-43da-81b2-4d27c2494d6b.info" returned: 0 in 0.511s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:52:13 devstack cinder-volume[87098]: WARNING cinder.volume.drivers.remotefs [None req-ce8ab87f-832c-4508-bb54-1e238b7faf49 tempest-GroupSnapshotsTest-803384794 None] /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-f843074a-f819-43da-81b2-4d27c2494d6b.info is being set with open permissions: ugo+rw: NotImplementedError Jul 13 13:52:13 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-ce8ab87f-832c-4508-bb54-1e238b7faf49 tempest-GroupSnapshotsTest-803384794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-f843074a-f819-43da-81b2-4d27c2494d6b.info {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:52:13 devstack sudo[91615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-f843074a-f819-43da-81b2-4d27c2494d6b.info Jul 13 13:52:13 devstack sudo[91615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:52:14 devstack sudo[91615]: pam_unix(sudo:session): session closed for user root Jul 13 13:52:14 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-ce8ab87f-832c-4508-bb54-1e238b7faf49 tempest-GroupSnapshotsTest-803384794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-f843074a-f819-43da-81b2-4d27c2494d6b.info" returned: 0 in 0.505s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:52:14 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-ce8ab87f-832c-4508-bb54-1e238b7faf49 tempest-GroupSnapshotsTest-803384794 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.597s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:52:14 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-ce8ab87f-832c-4508-bb54-1e238b7faf49 tempest-GroupSnapshotsTest-803384794 None] group_snapshot 3eb0675d-cab9-4940-9188-5313d91fb7a1: created successfully Jul 13 13:52:15 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-2521800c-bb3b-4f1b-8691-36d87b447338 tempest-GroupSnapshotsTest-803384794 None] group_snapshot 3eb0675d-cab9-4940-9188-5313d91fb7a1: deleting Jul 13 13:52:15 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-2521800c-bb3b-4f1b-8691-36d87b447338 tempest-GroupSnapshotsTest-803384794 None] group_snapshot 3eb0675d-cab9-4940-9188-5313d91fb7a1: deleting {{(pid=87098) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 13 13:52:15 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-2521800c-bb3b-4f1b-8691-36d87b447338 tempest-GroupSnapshotsTest-803384794 None] Acquiring lock "cinder-quobyte-f843074a-f819-43da-81b2-4d27c2494d6b" by "delete_snapshot" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 13:52:15 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-2521800c-bb3b-4f1b-8691-36d87b447338 tempest-GroupSnapshotsTest-803384794 None] Lock "cinder-quobyte-f843074a-f819-43da-81b2-4d27c2494d6b" acquired by "delete_snapshot" :: waited 0.055s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 13:52:15 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-2521800c-bb3b-4f1b-8691-36d87b447338 tempest-GroupSnapshotsTest-803384794 None] Acquiring lock "cinder-quobyte-f6c13149-7994-40f0-bb9c-06dba1c28047" by "_delete_snapshot" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 13:52:15 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-2521800c-bb3b-4f1b-8691-36d87b447338 tempest-GroupSnapshotsTest-803384794 None] Lock "cinder-quobyte-f6c13149-7994-40f0-bb9c-06dba1c28047" acquired by "_delete_snapshot" :: waited 0.049s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 13:52:15 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-2521800c-bb3b-4f1b-8691-36d87b447338 tempest-GroupSnapshotsTest-803384794 None] Deleting offline snapshot f6c13149-7994-40f0-bb9c-06dba1c28047 of volume f843074a-f819-43da-81b2-4d27c2494d6b {{(pid=87098) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 13 13:52:15 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-2521800c-bb3b-4f1b-8691-36d87b447338 tempest-GroupSnapshotsTest-803384794 None] snapshot_file for this snap is: volume-f843074a-f819-43da-81b2-4d27c2494d6b.f6c13149-7994-40f0-bb9c-06dba1c28047 {{(pid=87098) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 13 13:52:15 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[746b2316-2ce8-465e-98db-c33ef39a822f]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 13:52:15 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-2521800c-bb3b-4f1b-8691-36d87b447338 tempest-GroupSnapshotsTest-803384794 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-f843074a-f819-43da-81b2-4d27c2494d6b.f6c13149-7994-40f0-bb9c-06dba1c28047 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:52:15 devstack sudo[91648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-f843074a-f819-43da-81b2-4d27c2494d6b.f6c13149-7994-40f0-bb9c-06dba1c28047 Jul 13 13:52:15 devstack sudo[91648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:52:16 devstack sudo[91648]: pam_unix(sudo:session): session closed for user root Jul 13 13:52:16 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-2521800c-bb3b-4f1b-8691-36d87b447338 tempest-GroupSnapshotsTest-803384794 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-f843074a-f819-43da-81b2-4d27c2494d6b.f6c13149-7994-40f0-bb9c-06dba1c28047" returned: 0 in 0.649s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:52:16 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-2521800c-bb3b-4f1b-8691-36d87b447338 tempest-GroupSnapshotsTest-803384794 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f843074a-f819-43da-81b2-4d27c2494d6b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87098) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 13 13:52:16 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[60e3ccd5-6b6b-4c36-9e6a-61878ce502dc]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 13:52:16 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-2521800c-bb3b-4f1b-8691-36d87b447338 tempest-GroupSnapshotsTest-803384794 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-f843074a-f819-43da-81b2-4d27c2494d6b {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:52:16 devstack sudo[91661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-f843074a-f819-43da-81b2-4d27c2494d6b Jul 13 13:52:16 devstack sudo[91661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:52:16 devstack sudo[91661]: pam_unix(sudo:session): session closed for user root Jul 13 13:52:16 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-2521800c-bb3b-4f1b-8691-36d87b447338 tempest-GroupSnapshotsTest-803384794 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-f843074a-f819-43da-81b2-4d27c2494d6b" returned: 0 in 0.521s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:52:16 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-2521800c-bb3b-4f1b-8691-36d87b447338 tempest-GroupSnapshotsTest-803384794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-f843074a-f819-43da-81b2-4d27c2494d6b.f6c13149-7994-40f0-bb9c-06dba1c28047 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:52:16 devstack sudo[91672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-f843074a-f819-43da-81b2-4d27c2494d6b.f6c13149-7994-40f0-bb9c-06dba1c28047 Jul 13 13:52:16 devstack sudo[91672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:52:17 devstack sudo[91672]: pam_unix(sudo:session): session closed for user root Jul 13 13:52:17 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-2521800c-bb3b-4f1b-8691-36d87b447338 tempest-GroupSnapshotsTest-803384794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-f843074a-f819-43da-81b2-4d27c2494d6b.f6c13149-7994-40f0-bb9c-06dba1c28047" returned: 0 in 0.427s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:52:17 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-2521800c-bb3b-4f1b-8691-36d87b447338 tempest-GroupSnapshotsTest-803384794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-f843074a-f819-43da-81b2-4d27c2494d6b.f6c13149-7994-40f0-bb9c-06dba1c28047 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:52:17 devstack sudo[91678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-f843074a-f819-43da-81b2-4d27c2494d6b.f6c13149-7994-40f0-bb9c-06dba1c28047 Jul 13 13:52:17 devstack sudo[91678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:52:17 devstack sudo[91678]: pam_unix(sudo:session): session closed for user root Jul 13 13:52:17 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-2521800c-bb3b-4f1b-8691-36d87b447338 tempest-GroupSnapshotsTest-803384794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-f843074a-f819-43da-81b2-4d27c2494d6b.f6c13149-7994-40f0-bb9c-06dba1c28047" returned: 0 in 0.290s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:52:17 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-2521800c-bb3b-4f1b-8691-36d87b447338 tempest-GroupSnapshotsTest-803384794 None] Lock "cinder-quobyte-f6c13149-7994-40f0-bb9c-06dba1c28047" released by "_delete_snapshot" :: held 2.065s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 13:52:17 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-2521800c-bb3b-4f1b-8691-36d87b447338 tempest-GroupSnapshotsTest-803384794 None] Lock "cinder-quobyte-f843074a-f819-43da-81b2-4d27c2494d6b" released by "delete_snapshot" :: held 2.125s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 13:52:17 devstack cinder-volume[87098]: WARNING cinder.quota [None req-2521800c-bb3b-4f1b-8691-36d87b447338 tempest-GroupSnapshotsTest-803384794 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1163623005 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1163623005, it is now deprecated. Please use the default quota class for default quota. Jul 13 13:52:17 devstack cinder-volume[87098]: WARNING cinder.quota [None req-2521800c-bb3b-4f1b-8691-36d87b447338 tempest-GroupSnapshotsTest-803384794 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1163623005 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1163623005, it is now deprecated. Please use the default quota class for default quota. Jul 13 13:52:17 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-2521800c-bb3b-4f1b-8691-36d87b447338 tempest-GroupSnapshotsTest-803384794 None] Created reservations ['d17bc078-a5a5-4ec0-93ec-ae3af0fa6d67', '1a1466e0-0797-4a2c-979d-454241e5587e', 'c631006a-a2a7-46bd-b3ab-53b8f506362f', '4a3fe070-9fd8-4785-90de-c6326cf62406'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 13:52:17 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-2521800c-bb3b-4f1b-8691-36d87b447338 tempest-GroupSnapshotsTest-803384794 None] group_snapshot 3eb0675d-cab9-4940-9188-5313d91fb7a1: deleted successfully Jul 13 13:52:18 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-9c401350-5169-4b7e-a981-75d2d2b153c0 tempest-GroupSnapshotsTest-803384794 None] Acquiring lock "cinder-quobyte-f843074a-f819-43da-81b2-4d27c2494d6b" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 13:52:18 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-9c401350-5169-4b7e-a981-75d2d2b153c0 tempest-GroupSnapshotsTest-803384794 None] Lock "cinder-quobyte-f843074a-f819-43da-81b2-4d27c2494d6b" acquired by "delete_volume" :: waited 0.019s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 13:52:18 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[09b66452-dee3-4c3b-a3dd-0c9543700a80]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 13:52:18 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-9c401350-5169-4b7e-a981-75d2d2b153c0 tempest-GroupSnapshotsTest-803384794 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-f843074a-f819-43da-81b2-4d27c2494d6b {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:52:18 devstack sudo[91690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-f843074a-f819-43da-81b2-4d27c2494d6b Jul 13 13:52:18 devstack sudo[91690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:52:19 devstack sudo[91690]: pam_unix(sudo:session): session closed for user root Jul 13 13:52:19 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-9c401350-5169-4b7e-a981-75d2d2b153c0 tempest-GroupSnapshotsTest-803384794 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-f843074a-f819-43da-81b2-4d27c2494d6b" returned: 0 in 0.535s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:52:19 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-9c401350-5169-4b7e-a981-75d2d2b153c0 tempest-GroupSnapshotsTest-803384794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-f843074a-f819-43da-81b2-4d27c2494d6b {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:52:19 devstack sudo[91707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-f843074a-f819-43da-81b2-4d27c2494d6b Jul 13 13:52:19 devstack sudo[91707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:52:19 devstack sudo[91707]: pam_unix(sudo:session): session closed for user root Jul 13 13:52:19 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-9c401350-5169-4b7e-a981-75d2d2b153c0 tempest-GroupSnapshotsTest-803384794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-f843074a-f819-43da-81b2-4d27c2494d6b" returned: 0 in 0.335s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:52:19 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-9c401350-5169-4b7e-a981-75d2d2b153c0 tempest-GroupSnapshotsTest-803384794 None] Lock "cinder-quobyte-f843074a-f819-43da-81b2-4d27c2494d6b" released by "delete_volume" :: held 0.962s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 13:52:19 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-9c401350-5169-4b7e-a981-75d2d2b153c0 tempest-GroupSnapshotsTest-803384794 None] Created reservations ['2d2910d0-38a1-457a-973d-3cd9a71653b8'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 13:52:19 devstack cinder-volume[87098]: WARNING cinder.quota [None req-9c401350-5169-4b7e-a981-75d2d2b153c0 tempest-GroupSnapshotsTest-803384794 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1163623005 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1163623005, it is now deprecated. Please use the default quota class for default quota. Jul 13 13:52:19 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-9c401350-5169-4b7e-a981-75d2d2b153c0 tempest-GroupSnapshotsTest-803384794 None] Created reservations ['ff41f715-fb89-4c3e-a80f-b30f52cdf94a', '5c389a89-d404-4f07-90fe-ab995224f2f2', '2148a2c5-b7dc-484b-81c6-f838312b6816', 'd947d44e-e31e-467d-9380-c586f85883c0'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 13:52:19 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-9c401350-5169-4b7e-a981-75d2d2b153c0 tempest-GroupSnapshotsTest-803384794 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:52:19 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-9c401350-5169-4b7e-a981-75d2d2b153c0 tempest-GroupSnapshotsTest-803384794 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:52:19 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-9c401350-5169-4b7e-a981-75d2d2b153c0 tempest-GroupSnapshotsTest-803384794 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 13:52:19 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-9c401350-5169-4b7e-a981-75d2d2b153c0 tempest-GroupSnapshotsTest-803384794 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 13:52:19 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-9c401350-5169-4b7e-a981-75d2d2b153c0 tempest-GroupSnapshotsTest-803384794 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:52:19 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-9c401350-5169-4b7e-a981-75d2d2b153c0 tempest-GroupSnapshotsTest-803384794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:52:19 devstack sudo[91715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 Jul 13 13:52:19 devstack sudo[91715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:52:19 devstack sudo[91715]: pam_unix(sudo:session): session closed for user root Jul 13 13:52:19 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-9c401350-5169-4b7e-a981-75d2d2b153c0 tempest-GroupSnapshotsTest-803384794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78" returned: 0 in 0.298s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:52:19 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-9c401350-5169-4b7e-a981-75d2d2b153c0 tempest-GroupSnapshotsTest-803384794 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 13:52:19 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-9c401350-5169-4b7e-a981-75d2d2b153c0 tempest-GroupSnapshotsTest-803384794 None] Delete group completed successfully. Jul 13 13:52:28 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-42dcf2c8-79bf-4c50-a486-bacbc6d6aa6d tempest-AttachVolumeShelveTestJSON-1995934202 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 13:52:28 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-42dcf2c8-79bf-4c50-a486-bacbc6d6aa6d tempest-AttachVolumeShelveTestJSON-1995934202 None] Flow 'volume_create_manager' (af07283c-4589-4fbd-8875-dc659f3168e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 13:52:28 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-42dcf2c8-79bf-4c50-a486-bacbc6d6aa6d tempest-AttachVolumeShelveTestJSON-1995934202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa1ab741-4885-4c02-8dad-986a933cdebc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:52:28 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-42dcf2c8-79bf-4c50-a486-bacbc6d6aa6d tempest-AttachVolumeShelveTestJSON-1995934202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa1ab741-4885-4c02-8dad-986a933cdebc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T11:52:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-948621024',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e08e8da-b20c-48db-a2fa-475a66c73eeb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7060be2acbbb43d89e97566aeb306603',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T11:52:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T11:52:28Z,use_quota=True,user_id='b2ccbcfed05641a88fb6af9e8931bf76',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1147de8b-623b-426c-a13d-7fc824a80f67),volume_type_id=1147de8b-623b-426c-a13d-7fc824a80f67)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:52:28 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-42dcf2c8-79bf-4c50-a486-bacbc6d6aa6d tempest-AttachVolumeShelveTestJSON-1995934202 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff46f224-8cf8-4a6c-b8ff-94b261c24be8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:52:28 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-42dcf2c8-79bf-4c50-a486-bacbc6d6aa6d tempest-AttachVolumeShelveTestJSON-1995934202 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff46f224-8cf8-4a6c-b8ff-94b261c24be8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:52:28 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-42dcf2c8-79bf-4c50-a486-bacbc6d6aa6d tempest-AttachVolumeShelveTestJSON-1995934202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b49131d4-59d7-4859-99e0-01ff966012ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:52:28 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-42dcf2c8-79bf-4c50-a486-bacbc6d6aa6d tempest-AttachVolumeShelveTestJSON-1995934202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b49131d4-59d7-4859-99e0-01ff966012ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1e08e8da-b20c-48db-a2fa-475a66c73eeb', 'volume_name': 'volume-1e08e8da-b20c-48db-a2fa-475a66c73eeb', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:52:28 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-42dcf2c8-79bf-4c50-a486-bacbc6d6aa6d tempest-AttachVolumeShelveTestJSON-1995934202 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35b2a6fb-65c7-44c0-bc5d-cae6b6a4561b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:52:28 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-42dcf2c8-79bf-4c50-a486-bacbc6d6aa6d tempest-AttachVolumeShelveTestJSON-1995934202 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35b2a6fb-65c7-44c0-bc5d-cae6b6a4561b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:52:28 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-42dcf2c8-79bf-4c50-a486-bacbc6d6aa6d tempest-AttachVolumeShelveTestJSON-1995934202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b879f095-d06d-4bcd-b505-9f7b26a8fa4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:52:28 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-42dcf2c8-79bf-4c50-a486-bacbc6d6aa6d tempest-AttachVolumeShelveTestJSON-1995934202 None] Volume 1e08e8da-b20c-48db-a2fa-475a66c73eeb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1e08e8da-b20c-48db-a2fa-475a66c73eeb', 'volume_size': 1} Jul 13 13:52:28 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-42dcf2c8-79bf-4c50-a486-bacbc6d6aa6d tempest-AttachVolumeShelveTestJSON-1995934202 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:52:28 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-42dcf2c8-79bf-4c50-a486-bacbc6d6aa6d tempest-AttachVolumeShelveTestJSON-1995934202 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:52:28 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-42dcf2c8-79bf-4c50-a486-bacbc6d6aa6d tempest-AttachVolumeShelveTestJSON-1995934202 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T11:52:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-948621024',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e08e8da-b20c-48db-a2fa-475a66c73eeb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7060be2acbbb43d89e97566aeb306603',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T11:52:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T11:52:28Z,use_quota=True,user_id='b2ccbcfed05641a88fb6af9e8931bf76',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1147de8b-623b-426c-a13d-7fc824a80f67),volume_type_id=1147de8b-623b-426c-a13d-7fc824a80f67)}" {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 13 13:52:28 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-42dcf2c8-79bf-4c50-a486-bacbc6d6aa6d tempest-AttachVolumeShelveTestJSON-1995934202 None] Creating volume 1e08e8da-b20c-48db-a2fa-475a66c73eeb {{(pid=87098) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 13 13:52:28 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-42dcf2c8-79bf-4c50-a486-bacbc6d6aa6d tempest-AttachVolumeShelveTestJSON-1995934202 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:52:28 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-42dcf2c8-79bf-4c50-a486-bacbc6d6aa6d tempest-AttachVolumeShelveTestJSON-1995934202 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:52:28 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-42dcf2c8-79bf-4c50-a486-bacbc6d6aa6d tempest-AttachVolumeShelveTestJSON-1995934202 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 13:52:28 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-42dcf2c8-79bf-4c50-a486-bacbc6d6aa6d tempest-AttachVolumeShelveTestJSON-1995934202 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 13:52:28 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-42dcf2c8-79bf-4c50-a486-bacbc6d6aa6d tempest-AttachVolumeShelveTestJSON-1995934202 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:52:28 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-42dcf2c8-79bf-4c50-a486-bacbc6d6aa6d tempest-AttachVolumeShelveTestJSON-1995934202 None] Selected osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 13:52:28 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-42dcf2c8-79bf-4c50-a486-bacbc6d6aa6d tempest-AttachVolumeShelveTestJSON-1995934202 None] casted to osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 Jul 13 13:52:28 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-42dcf2c8-79bf-4c50-a486-bacbc6d6aa6d tempest-AttachVolumeShelveTestJSON-1995934202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-1e08e8da-b20c-48db-a2fa-475a66c73eeb 1073741824 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:52:28 devstack sudo[91813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-1e08e8da-b20c-48db-a2fa-475a66c73eeb 1073741824 Jul 13 13:52:28 devstack sudo[91813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:52:29 devstack cinder-volume[87098]: DEBUG oslo_service.periodic_task [None req-727a1692-ea28-4a77-b327-0d94e8f01efb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87098) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 13 13:52:29 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-727a1692-ea28-4a77-b327-0d94e8f01efb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:52:29 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-727a1692-ea28-4a77-b327-0d94e8f01efb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:52:29 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-727a1692-ea28-4a77-b327-0d94e8f01efb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 13:52:29 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-727a1692-ea28-4a77-b327-0d94e8f01efb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 13:52:29 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-727a1692-ea28-4a77-b327-0d94e8f01efb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:52:29 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-727a1692-ea28-4a77-b327-0d94e8f01efb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:52:29 devstack sudo[91813]: pam_unix(sudo:session): session closed for user root Jul 13 13:52:29 devstack sudo[91822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 Jul 13 13:52:29 devstack sudo[91822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:52:29 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-42dcf2c8-79bf-4c50-a486-bacbc6d6aa6d tempest-AttachVolumeShelveTestJSON-1995934202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-1e08e8da-b20c-48db-a2fa-475a66c73eeb 1073741824" returned: 0 in 0.812s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:52:29 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-42dcf2c8-79bf-4c50-a486-bacbc6d6aa6d tempest-AttachVolumeShelveTestJSON-1995934202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-1e08e8da-b20c-48db-a2fa-475a66c73eeb {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:52:29 devstack sudo[91824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-1e08e8da-b20c-48db-a2fa-475a66c73eeb Jul 13 13:52:29 devstack sudo[91824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:52:29 devstack sudo[91822]: pam_unix(sudo:session): session closed for user root Jul 13 13:52:29 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-727a1692-ea28-4a77-b327-0d94e8f01efb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78" returned: 0 in 0.464s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:52:29 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-727a1692-ea28-4a77-b327-0d94e8f01efb None None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 13:52:29 devstack cinder-volume[87098]: DEBUG oslo_service.periodic_task [None req-727a1692-ea28-4a77-b327-0d94e8f01efb None None] Running periodic task VolumeManager._thread_info {{(pid=87098) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 13 13:52:29 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-727a1692-ea28-4a77-b327-0d94e8f01efb None None] thread count: 8 {{(pid=87098) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 13 13:52:29 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-727a1692-ea28-4a77-b327-0d94e8f01efb None None] thread info: [<_MainThread(MainThread, started 127988054597760)>, , , , , , , ] {{(pid=87098) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 13 13:52:29 devstack sudo[91824]: pam_unix(sudo:session): session closed for user root Jul 13 13:52:29 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-42dcf2c8-79bf-4c50-a486-bacbc6d6aa6d tempest-AttachVolumeShelveTestJSON-1995934202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-1e08e8da-b20c-48db-a2fa-475a66c73eeb" returned: 0 in 0.544s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:52:29 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-42dcf2c8-79bf-4c50-a486-bacbc6d6aa6d tempest-AttachVolumeShelveTestJSON-1995934202 None] <== create_volume: return (1429ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'} {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 13 13:52:29 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-42dcf2c8-79bf-4c50-a486-bacbc6d6aa6d tempest-AttachVolumeShelveTestJSON-1995934202 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.432s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:52:29 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-42dcf2c8-79bf-4c50-a486-bacbc6d6aa6d tempest-AttachVolumeShelveTestJSON-1995934202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b879f095-d06d-4bcd-b505-9f7b26a8fa4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1e08e8da-b20c-48db-a2fa-475a66c73eeb', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:52:29 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-42dcf2c8-79bf-4c50-a486-bacbc6d6aa6d tempest-AttachVolumeShelveTestJSON-1995934202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ff010da-72a7-4520-ac61-e3e7d55a9368) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:52:29 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-42dcf2c8-79bf-4c50-a486-bacbc6d6aa6d tempest-AttachVolumeShelveTestJSON-1995934202 None] Volume volume-1e08e8da-b20c-48db-a2fa-475a66c73eeb (1e08e8da-b20c-48db-a2fa-475a66c73eeb): created successfully Jul 13 13:52:29 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-42dcf2c8-79bf-4c50-a486-bacbc6d6aa6d tempest-AttachVolumeShelveTestJSON-1995934202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ff010da-72a7-4520-ac61-e3e7d55a9368) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:52:29 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-42dcf2c8-79bf-4c50-a486-bacbc6d6aa6d tempest-AttachVolumeShelveTestJSON-1995934202 None] Flow 'volume_create_manager' (af07283c-4589-4fbd-8875-dc659f3168e3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 13:52:29 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-42dcf2c8-79bf-4c50-a486-bacbc6d6aa6d tempest-AttachVolumeShelveTestJSON-1995934202 None] Created volume successfully. Jul 13 13:52:39 devstack cinder-volume[87098]: DEBUG dbcounter [-] [87098] Writing DB stats cinder:SELECT=91,cinder:UPDATE=74,cinder:INSERT=17,cinder:DELETE=2 {{(pid=87098) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 13 13:52:39 devstack cinder-volume[87098]: DEBUG dbcounter [-] [87098] Writing DB stats cinder:UPDATE=86,cinder:SELECT=75,cinder:INSERT=20,cinder:DELETE=3 {{(pid=87098) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 13 13:52:42 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-4baecc80-c266-4163-adfa-ff81038898c4 tempest-GroupsV320Test-1845255500 None] Group tempest-GroupsV320Test-Group-764532138: creating Jul 13 13:52:42 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-4baecc80-c266-4163-adfa-ff81038898c4 tempest-GroupsV320Test-1845255500 None] Group tempest-GroupsV320Test-Group-764532138: created successfully Jul 13 13:52:42 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-4baecc80-c266-4163-adfa-ff81038898c4 tempest-GroupsV320Test-1845255500 None] Create group completed successfully. Jul 13 13:52:44 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-24ddf2a8-684b-46f5-8bbe-d7f2a78f59c5 tempest-GroupsV320Test-1845255500 None] Created reservations ['19b6713f-8600-4231-ae79-f94601fb00f1'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 13:52:45 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-24ddf2a8-684b-46f5-8bbe-d7f2a78f59c5 tempest-GroupsV320Test-1845255500 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:52:45 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-24ddf2a8-684b-46f5-8bbe-d7f2a78f59c5 tempest-GroupsV320Test-1845255500 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:52:45 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-24ddf2a8-684b-46f5-8bbe-d7f2a78f59c5 tempest-GroupsV320Test-1845255500 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 13:52:45 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-24ddf2a8-684b-46f5-8bbe-d7f2a78f59c5 tempest-GroupsV320Test-1845255500 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 13:52:45 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-24ddf2a8-684b-46f5-8bbe-d7f2a78f59c5 tempest-GroupsV320Test-1845255500 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:52:45 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-24ddf2a8-684b-46f5-8bbe-d7f2a78f59c5 tempest-GroupsV320Test-1845255500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:52:45 devstack sudo[92032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 Jul 13 13:52:45 devstack sudo[92032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:52:45 devstack sudo[92032]: pam_unix(sudo:session): session closed for user root Jul 13 13:52:45 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-24ddf2a8-684b-46f5-8bbe-d7f2a78f59c5 tempest-GroupsV320Test-1845255500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78" returned: 0 in 0.611s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:52:45 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-24ddf2a8-684b-46f5-8bbe-d7f2a78f59c5 tempest-GroupsV320Test-1845255500 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 13:52:45 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-24ddf2a8-684b-46f5-8bbe-d7f2a78f59c5 tempest-GroupsV320Test-1845255500 None] Delete group completed successfully. Jul 13 13:52:49 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-d55d9fdb-bd31-491e-b205-650e8a659f22 tempest-ServersNegativeTestJSON-437316841 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 13:52:49 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-d55d9fdb-bd31-491e-b205-650e8a659f22 tempest-ServersNegativeTestJSON-437316841 None] Flow 'volume_create_manager' (c0257d2a-a2f4-40ba-ac1e-8cd258d3b86f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 13:52:49 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-d55d9fdb-bd31-491e-b205-650e8a659f22 tempest-ServersNegativeTestJSON-437316841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5480825b-6707-46f7-a155-412f40d2520d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:52:49 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-d55d9fdb-bd31-491e-b205-650e8a659f22 tempest-ServersNegativeTestJSON-437316841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5480825b-6707-46f7-a155-412f40d2520d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T11:52:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1751917953',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=361b8e58-48ba-423d-9280-2bd4e7316b85,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e9fe4e8e8b724856b8e665870e90bd10',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T11:52:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T11:52:50Z,use_quota=True,user_id='2121a631d4264de0b497b8425138aafa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1147de8b-623b-426c-a13d-7fc824a80f67),volume_type_id=1147de8b-623b-426c-a13d-7fc824a80f67)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:52:49 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-d55d9fdb-bd31-491e-b205-650e8a659f22 tempest-ServersNegativeTestJSON-437316841 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6d0a1d3-8180-4111-8a8b-61cd427e9a8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:52:49 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-d55d9fdb-bd31-491e-b205-650e8a659f22 tempest-ServersNegativeTestJSON-437316841 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6d0a1d3-8180-4111-8a8b-61cd427e9a8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:52:49 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-d55d9fdb-bd31-491e-b205-650e8a659f22 tempest-ServersNegativeTestJSON-437316841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32ebf5f8-87e8-4029-b0b5-085fc33fb095) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:52:49 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-d55d9fdb-bd31-491e-b205-650e8a659f22 tempest-ServersNegativeTestJSON-437316841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32ebf5f8-87e8-4029-b0b5-085fc33fb095) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '361b8e58-48ba-423d-9280-2bd4e7316b85', 'volume_name': 'volume-361b8e58-48ba-423d-9280-2bd4e7316b85', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:52:49 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-d55d9fdb-bd31-491e-b205-650e8a659f22 tempest-ServersNegativeTestJSON-437316841 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f32f3bb6-f2a2-4350-b8b2-83e950da6c9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:52:49 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-d55d9fdb-bd31-491e-b205-650e8a659f22 tempest-ServersNegativeTestJSON-437316841 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f32f3bb6-f2a2-4350-b8b2-83e950da6c9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:52:49 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-d55d9fdb-bd31-491e-b205-650e8a659f22 tempest-ServersNegativeTestJSON-437316841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c995c443-204a-4b60-9aab-41bf1010775e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:52:49 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-d55d9fdb-bd31-491e-b205-650e8a659f22 tempest-ServersNegativeTestJSON-437316841 None] Volume 361b8e58-48ba-423d-9280-2bd4e7316b85: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-361b8e58-48ba-423d-9280-2bd4e7316b85', 'volume_size': 1} Jul 13 13:52:49 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-d55d9fdb-bd31-491e-b205-650e8a659f22 tempest-ServersNegativeTestJSON-437316841 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:52:49 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-d55d9fdb-bd31-491e-b205-650e8a659f22 tempest-ServersNegativeTestJSON-437316841 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:52:49 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-d55d9fdb-bd31-491e-b205-650e8a659f22 tempest-ServersNegativeTestJSON-437316841 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T11:52:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1751917953',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=361b8e58-48ba-423d-9280-2bd4e7316b85,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e9fe4e8e8b724856b8e665870e90bd10',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T11:52:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T11:52:50Z,use_quota=True,user_id='2121a631d4264de0b497b8425138aafa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1147de8b-623b-426c-a13d-7fc824a80f67),volume_type_id=1147de8b-623b-426c-a13d-7fc824a80f67)}" {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 13 13:52:49 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-d55d9fdb-bd31-491e-b205-650e8a659f22 tempest-ServersNegativeTestJSON-437316841 None] Creating volume 361b8e58-48ba-423d-9280-2bd4e7316b85 {{(pid=87098) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 13 13:52:49 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-d55d9fdb-bd31-491e-b205-650e8a659f22 tempest-ServersNegativeTestJSON-437316841 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:52:49 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-d55d9fdb-bd31-491e-b205-650e8a659f22 tempest-ServersNegativeTestJSON-437316841 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:52:49 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-d55d9fdb-bd31-491e-b205-650e8a659f22 tempest-ServersNegativeTestJSON-437316841 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 13:52:49 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-d55d9fdb-bd31-491e-b205-650e8a659f22 tempest-ServersNegativeTestJSON-437316841 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 13:52:49 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-d55d9fdb-bd31-491e-b205-650e8a659f22 tempest-ServersNegativeTestJSON-437316841 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:52:49 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-d55d9fdb-bd31-491e-b205-650e8a659f22 tempest-ServersNegativeTestJSON-437316841 None] Selected osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 13:52:49 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-d55d9fdb-bd31-491e-b205-650e8a659f22 tempest-ServersNegativeTestJSON-437316841 None] casted to osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 Jul 13 13:52:49 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-d55d9fdb-bd31-491e-b205-650e8a659f22 tempest-ServersNegativeTestJSON-437316841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-361b8e58-48ba-423d-9280-2bd4e7316b85 1073741824 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:52:49 devstack sudo[92113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-361b8e58-48ba-423d-9280-2bd4e7316b85 1073741824 Jul 13 13:52:49 devstack sudo[92113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:52:50 devstack sudo[92113]: pam_unix(sudo:session): session closed for user root Jul 13 13:52:50 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-d55d9fdb-bd31-491e-b205-650e8a659f22 tempest-ServersNegativeTestJSON-437316841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-361b8e58-48ba-423d-9280-2bd4e7316b85 1073741824" returned: 0 in 0.487s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:52:50 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-d55d9fdb-bd31-491e-b205-650e8a659f22 tempest-ServersNegativeTestJSON-437316841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-361b8e58-48ba-423d-9280-2bd4e7316b85 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:52:50 devstack sudo[92118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-361b8e58-48ba-423d-9280-2bd4e7316b85 Jul 13 13:52:50 devstack sudo[92118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:52:50 devstack sudo[92118]: pam_unix(sudo:session): session closed for user root Jul 13 13:52:50 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-d55d9fdb-bd31-491e-b205-650e8a659f22 tempest-ServersNegativeTestJSON-437316841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-361b8e58-48ba-423d-9280-2bd4e7316b85" returned: 0 in 0.295s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:52:50 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-d55d9fdb-bd31-491e-b205-650e8a659f22 tempest-ServersNegativeTestJSON-437316841 None] <== create_volume: return (838ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'} {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 13 13:52:50 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-d55d9fdb-bd31-491e-b205-650e8a659f22 tempest-ServersNegativeTestJSON-437316841 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.841s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:52:50 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-d55d9fdb-bd31-491e-b205-650e8a659f22 tempest-ServersNegativeTestJSON-437316841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c995c443-204a-4b60-9aab-41bf1010775e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-361b8e58-48ba-423d-9280-2bd4e7316b85', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:52:50 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-d55d9fdb-bd31-491e-b205-650e8a659f22 tempest-ServersNegativeTestJSON-437316841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e01989f7-867f-42f1-980b-2052c1b65078) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:52:50 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-d55d9fdb-bd31-491e-b205-650e8a659f22 tempest-ServersNegativeTestJSON-437316841 None] Volume volume-361b8e58-48ba-423d-9280-2bd4e7316b85 (361b8e58-48ba-423d-9280-2bd4e7316b85): created successfully Jul 13 13:52:50 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-d55d9fdb-bd31-491e-b205-650e8a659f22 tempest-ServersNegativeTestJSON-437316841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e01989f7-867f-42f1-980b-2052c1b65078) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:52:50 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-d55d9fdb-bd31-491e-b205-650e8a659f22 tempest-ServersNegativeTestJSON-437316841 None] Flow 'volume_create_manager' (c0257d2a-a2f4-40ba-ac1e-8cd258d3b86f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 13:52:50 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-d55d9fdb-bd31-491e-b205-650e8a659f22 tempest-ServersNegativeTestJSON-437316841 None] Created volume successfully. Jul 13 13:52:51 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [req-7b5891a8-ab82-46df-beeb-0e3d73083eee req-252948dd-656d-43ab-bd3d-82693a012344 tempest-AttachVolumeShelveTestJSON-1995934202 None] No connector for attachment d7a48588-6aca-4525-8fce-f42d71092182; skipping storage backend terminate_connection call. {{(pid=87098) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Jul 13 13:52:51 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [req-7b5891a8-ab82-46df-beeb-0e3d73083eee req-252948dd-656d-43ab-bd3d-82693a012344 tempest-AttachVolumeShelveTestJSON-1995934202 None] Deleting attachment d7a48588-6aca-4525-8fce-f42d71092182. {{(pid=87098) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 13 13:52:53 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-02b717d7-60de-45c4-a281-a99bcaba2068 tempest-ServersNegativeTestJSON-437316841 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 13:52:53 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-02b717d7-60de-45c4-a281-a99bcaba2068 tempest-ServersNegativeTestJSON-437316841 None] Flow 'volume_create_manager' (e79dc2c2-35c3-4022-9a40-4c8af15ba910) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 13:52:53 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-02b717d7-60de-45c4-a281-a99bcaba2068 tempest-ServersNegativeTestJSON-437316841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5818933-eb86-4caa-bb6d-ee1650b06106) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:52:53 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-02b717d7-60de-45c4-a281-a99bcaba2068 tempest-ServersNegativeTestJSON-437316841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5818933-eb86-4caa-bb6d-ee1650b06106) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T11:52:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1907975612',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d099c83-0de8-4b26-8de7-fbf2f933c28e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e9fe4e8e8b724856b8e665870e90bd10',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T11:52:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T11:52:53Z,use_quota=True,user_id='2121a631d4264de0b497b8425138aafa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1147de8b-623b-426c-a13d-7fc824a80f67),volume_type_id=1147de8b-623b-426c-a13d-7fc824a80f67)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:52:53 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-02b717d7-60de-45c4-a281-a99bcaba2068 tempest-ServersNegativeTestJSON-437316841 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43ba0595-840e-418a-8b9a-8cb69c0d66ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:52:53 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-02b717d7-60de-45c4-a281-a99bcaba2068 tempest-ServersNegativeTestJSON-437316841 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43ba0595-840e-418a-8b9a-8cb69c0d66ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:52:53 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-02b717d7-60de-45c4-a281-a99bcaba2068 tempest-ServersNegativeTestJSON-437316841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77ea9d5c-5a7a-499e-b8d9-49b50083ce9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:52:53 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-02b717d7-60de-45c4-a281-a99bcaba2068 tempest-ServersNegativeTestJSON-437316841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77ea9d5c-5a7a-499e-b8d9-49b50083ce9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2d099c83-0de8-4b26-8de7-fbf2f933c28e', 'volume_name': 'volume-2d099c83-0de8-4b26-8de7-fbf2f933c28e', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:52:53 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-02b717d7-60de-45c4-a281-a99bcaba2068 tempest-ServersNegativeTestJSON-437316841 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da143714-97af-40bc-a363-17a07cec0719) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:52:53 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-02b717d7-60de-45c4-a281-a99bcaba2068 tempest-ServersNegativeTestJSON-437316841 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da143714-97af-40bc-a363-17a07cec0719) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:52:53 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-02b717d7-60de-45c4-a281-a99bcaba2068 tempest-ServersNegativeTestJSON-437316841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29b11915-813a-4f11-9b49-37f6d46a512a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:52:53 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-02b717d7-60de-45c4-a281-a99bcaba2068 tempest-ServersNegativeTestJSON-437316841 None] Volume 2d099c83-0de8-4b26-8de7-fbf2f933c28e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2d099c83-0de8-4b26-8de7-fbf2f933c28e', 'volume_size': 1} Jul 13 13:52:53 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-02b717d7-60de-45c4-a281-a99bcaba2068 tempest-ServersNegativeTestJSON-437316841 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:52:53 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-02b717d7-60de-45c4-a281-a99bcaba2068 tempest-ServersNegativeTestJSON-437316841 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:52:53 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-02b717d7-60de-45c4-a281-a99bcaba2068 tempest-ServersNegativeTestJSON-437316841 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T11:52:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1907975612',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d099c83-0de8-4b26-8de7-fbf2f933c28e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e9fe4e8e8b724856b8e665870e90bd10',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T11:52:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T11:52:53Z,use_quota=True,user_id='2121a631d4264de0b497b8425138aafa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1147de8b-623b-426c-a13d-7fc824a80f67),volume_type_id=1147de8b-623b-426c-a13d-7fc824a80f67)}" {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 13 13:52:53 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-02b717d7-60de-45c4-a281-a99bcaba2068 tempest-ServersNegativeTestJSON-437316841 None] Creating volume 2d099c83-0de8-4b26-8de7-fbf2f933c28e {{(pid=87098) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 13 13:52:53 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-02b717d7-60de-45c4-a281-a99bcaba2068 tempest-ServersNegativeTestJSON-437316841 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:52:53 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-02b717d7-60de-45c4-a281-a99bcaba2068 tempest-ServersNegativeTestJSON-437316841 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:52:53 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-02b717d7-60de-45c4-a281-a99bcaba2068 tempest-ServersNegativeTestJSON-437316841 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 13:52:53 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-02b717d7-60de-45c4-a281-a99bcaba2068 tempest-ServersNegativeTestJSON-437316841 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 13:52:53 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-02b717d7-60de-45c4-a281-a99bcaba2068 tempest-ServersNegativeTestJSON-437316841 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:52:53 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-02b717d7-60de-45c4-a281-a99bcaba2068 tempest-ServersNegativeTestJSON-437316841 None] Selected osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 13:52:53 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-02b717d7-60de-45c4-a281-a99bcaba2068 tempest-ServersNegativeTestJSON-437316841 None] casted to osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 Jul 13 13:52:53 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-02b717d7-60de-45c4-a281-a99bcaba2068 tempest-ServersNegativeTestJSON-437316841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-2d099c83-0de8-4b26-8de7-fbf2f933c28e 1073741824 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:52:53 devstack sudo[92126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-2d099c83-0de8-4b26-8de7-fbf2f933c28e 1073741824 Jul 13 13:52:53 devstack sudo[92126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:52:54 devstack sudo[92126]: pam_unix(sudo:session): session closed for user root Jul 13 13:52:54 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-02b717d7-60de-45c4-a281-a99bcaba2068 tempest-ServersNegativeTestJSON-437316841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-2d099c83-0de8-4b26-8de7-fbf2f933c28e 1073741824" returned: 0 in 0.476s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:52:54 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-02b717d7-60de-45c4-a281-a99bcaba2068 tempest-ServersNegativeTestJSON-437316841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-2d099c83-0de8-4b26-8de7-fbf2f933c28e {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:52:54 devstack sudo[92132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-2d099c83-0de8-4b26-8de7-fbf2f933c28e Jul 13 13:52:54 devstack sudo[92132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:52:54 devstack sudo[92132]: pam_unix(sudo:session): session closed for user root Jul 13 13:52:54 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-02b717d7-60de-45c4-a281-a99bcaba2068 tempest-ServersNegativeTestJSON-437316841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-2d099c83-0de8-4b26-8de7-fbf2f933c28e" returned: 0 in 0.283s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:52:54 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-02b717d7-60de-45c4-a281-a99bcaba2068 tempest-ServersNegativeTestJSON-437316841 None] <== create_volume: return (806ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'} {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 13 13:52:54 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-02b717d7-60de-45c4-a281-a99bcaba2068 tempest-ServersNegativeTestJSON-437316841 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.809s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:52:54 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-02b717d7-60de-45c4-a281-a99bcaba2068 tempest-ServersNegativeTestJSON-437316841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29b11915-813a-4f11-9b49-37f6d46a512a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2d099c83-0de8-4b26-8de7-fbf2f933c28e', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:52:54 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-02b717d7-60de-45c4-a281-a99bcaba2068 tempest-ServersNegativeTestJSON-437316841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21ba74fd-50f5-4d15-a2f4-d095d4595673) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:52:54 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-02b717d7-60de-45c4-a281-a99bcaba2068 tempest-ServersNegativeTestJSON-437316841 None] Volume volume-2d099c83-0de8-4b26-8de7-fbf2f933c28e (2d099c83-0de8-4b26-8de7-fbf2f933c28e): created successfully Jul 13 13:52:54 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-02b717d7-60de-45c4-a281-a99bcaba2068 tempest-ServersNegativeTestJSON-437316841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21ba74fd-50f5-4d15-a2f4-d095d4595673) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:52:54 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-02b717d7-60de-45c4-a281-a99bcaba2068 tempest-ServersNegativeTestJSON-437316841 None] Flow 'volume_create_manager' (e79dc2c2-35c3-4022-9a40-4c8af15ba910) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 13:52:54 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-02b717d7-60de-45c4-a281-a99bcaba2068 tempest-ServersNegativeTestJSON-437316841 None] Created volume successfully. Jul 13 13:52:56 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-b30caf27-4e42-44e5-927c-f3e47447f859 tempest-ServersNegativeTestJSON-437316841 None] Acquiring lock "cinder-2d099c83-0de8-4b26-8de7-fbf2f933c28e-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 13:52:56 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-b30caf27-4e42-44e5-927c-f3e47447f859 tempest-ServersNegativeTestJSON-437316841 None] Lock "cinder-2d099c83-0de8-4b26-8de7-fbf2f933c28e-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 13:52:56 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-b30caf27-4e42-44e5-927c-f3e47447f859 tempest-ServersNegativeTestJSON-437316841 None] Acquiring lock "cinder-quobyte-2d099c83-0de8-4b26-8de7-fbf2f933c28e" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 13:52:56 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-b30caf27-4e42-44e5-927c-f3e47447f859 tempest-ServersNegativeTestJSON-437316841 None] Lock "cinder-quobyte-2d099c83-0de8-4b26-8de7-fbf2f933c28e" acquired by "delete_volume" :: waited 0.035s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 13:52:56 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[44b5c974-2474-44ed-b63f-5baa3af43a38]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 13:52:56 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-b30caf27-4e42-44e5-927c-f3e47447f859 tempest-ServersNegativeTestJSON-437316841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-2d099c83-0de8-4b26-8de7-fbf2f933c28e {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:52:56 devstack sudo[92138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-2d099c83-0de8-4b26-8de7-fbf2f933c28e Jul 13 13:52:56 devstack sudo[92138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:52:57 devstack sudo[92138]: pam_unix(sudo:session): session closed for user root Jul 13 13:52:57 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-b30caf27-4e42-44e5-927c-f3e47447f859 tempest-ServersNegativeTestJSON-437316841 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-2d099c83-0de8-4b26-8de7-fbf2f933c28e" returned: 0 in 0.661s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:52:57 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-b30caf27-4e42-44e5-927c-f3e47447f859 tempest-ServersNegativeTestJSON-437316841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-2d099c83-0de8-4b26-8de7-fbf2f933c28e {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:52:57 devstack sudo[92144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-2d099c83-0de8-4b26-8de7-fbf2f933c28e Jul 13 13:52:57 devstack sudo[92144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:52:57 devstack sudo[92144]: pam_unix(sudo:session): session closed for user root Jul 13 13:52:57 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-b30caf27-4e42-44e5-927c-f3e47447f859 tempest-ServersNegativeTestJSON-437316841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-2d099c83-0de8-4b26-8de7-fbf2f933c28e" returned: 0 in 0.408s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:52:57 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-b30caf27-4e42-44e5-927c-f3e47447f859 tempest-ServersNegativeTestJSON-437316841 None] Lock "cinder-quobyte-2d099c83-0de8-4b26-8de7-fbf2f933c28e" released by "delete_volume" :: held 1.161s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 13:52:57 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-b30caf27-4e42-44e5-927c-f3e47447f859 tempest-ServersNegativeTestJSON-437316841 None] Created reservations ['7c0851d0-b573-4b7a-a34c-ff3ca2a15cdc', '25eb6b0f-1973-4766-8292-8a6cd8359025', 'caec9481-c132-4acc-b1ff-16feb2c34bf6', 'b675f4a5-02f6-4186-b0a3-e9f077258786'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 13:52:57 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-b30caf27-4e42-44e5-927c-f3e47447f859 tempest-ServersNegativeTestJSON-437316841 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:52:57 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-b30caf27-4e42-44e5-927c-f3e47447f859 tempest-ServersNegativeTestJSON-437316841 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:52:57 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-b30caf27-4e42-44e5-927c-f3e47447f859 tempest-ServersNegativeTestJSON-437316841 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 13:52:57 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-b30caf27-4e42-44e5-927c-f3e47447f859 tempest-ServersNegativeTestJSON-437316841 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 13:52:57 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-b30caf27-4e42-44e5-927c-f3e47447f859 tempest-ServersNegativeTestJSON-437316841 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:52:57 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-b30caf27-4e42-44e5-927c-f3e47447f859 tempest-ServersNegativeTestJSON-437316841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:52:57 devstack sudo[92158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 Jul 13 13:52:57 devstack sudo[92158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:52:58 devstack sudo[92158]: pam_unix(sudo:session): session closed for user root Jul 13 13:52:58 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-b30caf27-4e42-44e5-927c-f3e47447f859 tempest-ServersNegativeTestJSON-437316841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78" returned: 0 in 0.319s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:52:58 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-b30caf27-4e42-44e5-927c-f3e47447f859 tempest-ServersNegativeTestJSON-437316841 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 13:52:58 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-b30caf27-4e42-44e5-927c-f3e47447f859 tempest-ServersNegativeTestJSON-437316841 None] Deleted volume successfully. Jul 13 13:52:58 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-b30caf27-4e42-44e5-927c-f3e47447f859 tempest-ServersNegativeTestJSON-437316841 None] Lock "cinder-2d099c83-0de8-4b26-8de7-fbf2f933c28e-delete_volume" released by "delete_volume" :: held 1.834s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 13:52:58 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-31dd823e-0afb-4cc4-a9b2-8c534b09243d tempest-ServersNegativeTestJSON-437316841 None] Acquiring lock "cinder-361b8e58-48ba-423d-9280-2bd4e7316b85-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 13:52:58 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-31dd823e-0afb-4cc4-a9b2-8c534b09243d tempest-ServersNegativeTestJSON-437316841 None] Lock "cinder-361b8e58-48ba-423d-9280-2bd4e7316b85-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 13:52:58 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-31dd823e-0afb-4cc4-a9b2-8c534b09243d tempest-ServersNegativeTestJSON-437316841 None] Acquiring lock "cinder-quobyte-361b8e58-48ba-423d-9280-2bd4e7316b85" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 13:52:58 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-31dd823e-0afb-4cc4-a9b2-8c534b09243d tempest-ServersNegativeTestJSON-437316841 None] Lock "cinder-quobyte-361b8e58-48ba-423d-9280-2bd4e7316b85" acquired by "delete_volume" :: waited 0.030s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 13:52:58 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[db9ca465-27ba-4cd8-b305-6b5e0dac163d]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 13:52:58 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-31dd823e-0afb-4cc4-a9b2-8c534b09243d tempest-ServersNegativeTestJSON-437316841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-361b8e58-48ba-423d-9280-2bd4e7316b85 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:52:59 devstack sudo[92181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-361b8e58-48ba-423d-9280-2bd4e7316b85 Jul 13 13:52:59 devstack sudo[92181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:52:59 devstack sudo[92181]: pam_unix(sudo:session): session closed for user root Jul 13 13:52:59 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-31dd823e-0afb-4cc4-a9b2-8c534b09243d tempest-ServersNegativeTestJSON-437316841 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-361b8e58-48ba-423d-9280-2bd4e7316b85" returned: 0 in 0.443s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:52:59 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-31dd823e-0afb-4cc4-a9b2-8c534b09243d tempest-ServersNegativeTestJSON-437316841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-361b8e58-48ba-423d-9280-2bd4e7316b85 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:52:59 devstack sudo[92190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-361b8e58-48ba-423d-9280-2bd4e7316b85 Jul 13 13:52:59 devstack sudo[92190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:52:59 devstack sudo[92190]: pam_unix(sudo:session): session closed for user root Jul 13 13:52:59 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-31dd823e-0afb-4cc4-a9b2-8c534b09243d tempest-ServersNegativeTestJSON-437316841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-361b8e58-48ba-423d-9280-2bd4e7316b85" returned: 0 in 0.311s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:52:59 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-31dd823e-0afb-4cc4-a9b2-8c534b09243d tempest-ServersNegativeTestJSON-437316841 None] Lock "cinder-quobyte-361b8e58-48ba-423d-9280-2bd4e7316b85" released by "delete_volume" :: held 0.832s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 13:52:59 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-31dd823e-0afb-4cc4-a9b2-8c534b09243d tempest-ServersNegativeTestJSON-437316841 None] Created reservations ['45d8221a-9468-465b-ba25-e42d42cedf43', 'e1a3e256-ac8a-468a-bc71-e55afdd445c5', '483645be-baf3-4121-985e-0af4f382ac75', '03d65065-3fd7-49fa-823f-973bae79fb14'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 13:52:59 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-31dd823e-0afb-4cc4-a9b2-8c534b09243d tempest-ServersNegativeTestJSON-437316841 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:52:59 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-31dd823e-0afb-4cc4-a9b2-8c534b09243d tempest-ServersNegativeTestJSON-437316841 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:52:59 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-31dd823e-0afb-4cc4-a9b2-8c534b09243d tempest-ServersNegativeTestJSON-437316841 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 13:52:59 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-31dd823e-0afb-4cc4-a9b2-8c534b09243d tempest-ServersNegativeTestJSON-437316841 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 13:52:59 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-31dd823e-0afb-4cc4-a9b2-8c534b09243d tempest-ServersNegativeTestJSON-437316841 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:52:59 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-31dd823e-0afb-4cc4-a9b2-8c534b09243d tempest-ServersNegativeTestJSON-437316841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:52:59 devstack sudo[92195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 Jul 13 13:52:59 devstack sudo[92195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:53:00 devstack sudo[92195]: pam_unix(sudo:session): session closed for user root Jul 13 13:53:00 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-31dd823e-0afb-4cc4-a9b2-8c534b09243d tempest-ServersNegativeTestJSON-437316841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78" returned: 0 in 0.528s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:53:00 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-31dd823e-0afb-4cc4-a9b2-8c534b09243d tempest-ServersNegativeTestJSON-437316841 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 13:53:00 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-31dd823e-0afb-4cc4-a9b2-8c534b09243d tempest-ServersNegativeTestJSON-437316841 None] Deleted volume successfully. Jul 13 13:53:00 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-31dd823e-0afb-4cc4-a9b2-8c534b09243d tempest-ServersNegativeTestJSON-437316841 None] Lock "cinder-361b8e58-48ba-423d-9280-2bd4e7316b85-delete_volume" released by "delete_volume" :: held 1.702s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 13:53:00 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-606dcff4-ccdf-4df5-b086-35a78d449bb1 tempest-AttachVolumeNegativeTest-468633374 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 13:53:00 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-606dcff4-ccdf-4df5-b086-35a78d449bb1 tempest-AttachVolumeNegativeTest-468633374 None] Flow 'volume_create_manager' (4484820b-aba8-4042-af78-611693c00faa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 13:53:00 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-606dcff4-ccdf-4df5-b086-35a78d449bb1 tempest-AttachVolumeNegativeTest-468633374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8f3a1ea-585c-475c-9324-ac3cffd614e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:53:00 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-606dcff4-ccdf-4df5-b086-35a78d449bb1 tempest-AttachVolumeNegativeTest-468633374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8f3a1ea-585c-475c-9324-ac3cffd614e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T11:53:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-458946351',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41633fab-c379-4452-a7ae-4c357ee37b2d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8794c1b399a24bc5b65aeed906ffb8f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T11:53:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T11:53:01Z,use_quota=True,user_id='6566c5149286424f948fd3e110a2ca17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1147de8b-623b-426c-a13d-7fc824a80f67),volume_type_id=1147de8b-623b-426c-a13d-7fc824a80f67)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:53:00 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-606dcff4-ccdf-4df5-b086-35a78d449bb1 tempest-AttachVolumeNegativeTest-468633374 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1af944e3-9618-4a19-804f-379e42c227ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:53:00 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-606dcff4-ccdf-4df5-b086-35a78d449bb1 tempest-AttachVolumeNegativeTest-468633374 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1af944e3-9618-4a19-804f-379e42c227ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:53:00 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-606dcff4-ccdf-4df5-b086-35a78d449bb1 tempest-AttachVolumeNegativeTest-468633374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d76338bb-9b2f-44cd-8f64-ec32b37ab3ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:53:00 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-606dcff4-ccdf-4df5-b086-35a78d449bb1 tempest-AttachVolumeNegativeTest-468633374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d76338bb-9b2f-44cd-8f64-ec32b37ab3ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '41633fab-c379-4452-a7ae-4c357ee37b2d', 'volume_name': 'volume-41633fab-c379-4452-a7ae-4c357ee37b2d', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:53:00 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-606dcff4-ccdf-4df5-b086-35a78d449bb1 tempest-AttachVolumeNegativeTest-468633374 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a51c974-325e-4735-857a-872d9f096aaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:53:00 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-606dcff4-ccdf-4df5-b086-35a78d449bb1 tempest-AttachVolumeNegativeTest-468633374 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a51c974-325e-4735-857a-872d9f096aaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:53:00 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-606dcff4-ccdf-4df5-b086-35a78d449bb1 tempest-AttachVolumeNegativeTest-468633374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5edba0f7-f0f4-4eb2-86a4-f75890f159e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:53:00 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-606dcff4-ccdf-4df5-b086-35a78d449bb1 tempest-AttachVolumeNegativeTest-468633374 None] Volume 41633fab-c379-4452-a7ae-4c357ee37b2d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-41633fab-c379-4452-a7ae-4c357ee37b2d', 'volume_size': 1} Jul 13 13:53:00 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-606dcff4-ccdf-4df5-b086-35a78d449bb1 tempest-AttachVolumeNegativeTest-468633374 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:53:00 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-606dcff4-ccdf-4df5-b086-35a78d449bb1 tempest-AttachVolumeNegativeTest-468633374 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:53:00 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-606dcff4-ccdf-4df5-b086-35a78d449bb1 tempest-AttachVolumeNegativeTest-468633374 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T11:53:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-458946351',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41633fab-c379-4452-a7ae-4c357ee37b2d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8794c1b399a24bc5b65aeed906ffb8f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T11:53:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T11:53:01Z,use_quota=True,user_id='6566c5149286424f948fd3e110a2ca17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1147de8b-623b-426c-a13d-7fc824a80f67),volume_type_id=1147de8b-623b-426c-a13d-7fc824a80f67)}" {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 13 13:53:00 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-606dcff4-ccdf-4df5-b086-35a78d449bb1 tempest-AttachVolumeNegativeTest-468633374 None] Creating volume 41633fab-c379-4452-a7ae-4c357ee37b2d {{(pid=87098) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 13 13:53:00 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-606dcff4-ccdf-4df5-b086-35a78d449bb1 tempest-AttachVolumeNegativeTest-468633374 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:53:00 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-606dcff4-ccdf-4df5-b086-35a78d449bb1 tempest-AttachVolumeNegativeTest-468633374 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:53:00 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-606dcff4-ccdf-4df5-b086-35a78d449bb1 tempest-AttachVolumeNegativeTest-468633374 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 13:53:00 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-606dcff4-ccdf-4df5-b086-35a78d449bb1 tempest-AttachVolumeNegativeTest-468633374 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 13:53:00 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-606dcff4-ccdf-4df5-b086-35a78d449bb1 tempest-AttachVolumeNegativeTest-468633374 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:53:00 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-606dcff4-ccdf-4df5-b086-35a78d449bb1 tempest-AttachVolumeNegativeTest-468633374 None] Selected osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 13:53:00 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-606dcff4-ccdf-4df5-b086-35a78d449bb1 tempest-AttachVolumeNegativeTest-468633374 None] casted to osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 Jul 13 13:53:00 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-606dcff4-ccdf-4df5-b086-35a78d449bb1 tempest-AttachVolumeNegativeTest-468633374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-41633fab-c379-4452-a7ae-4c357ee37b2d 1073741824 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:53:00 devstack sudo[92239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-41633fab-c379-4452-a7ae-4c357ee37b2d 1073741824 Jul 13 13:53:00 devstack sudo[92239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:53:01 devstack sudo[92239]: pam_unix(sudo:session): session closed for user root Jul 13 13:53:01 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-606dcff4-ccdf-4df5-b086-35a78d449bb1 tempest-AttachVolumeNegativeTest-468633374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-41633fab-c379-4452-a7ae-4c357ee37b2d 1073741824" returned: 0 in 0.832s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:53:01 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-606dcff4-ccdf-4df5-b086-35a78d449bb1 tempest-AttachVolumeNegativeTest-468633374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-41633fab-c379-4452-a7ae-4c357ee37b2d {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:53:01 devstack sudo[92262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-41633fab-c379-4452-a7ae-4c357ee37b2d Jul 13 13:53:01 devstack sudo[92262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:53:02 devstack sudo[92262]: pam_unix(sudo:session): session closed for user root Jul 13 13:53:02 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-606dcff4-ccdf-4df5-b086-35a78d449bb1 tempest-AttachVolumeNegativeTest-468633374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-41633fab-c379-4452-a7ae-4c357ee37b2d" returned: 0 in 0.524s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:53:02 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-606dcff4-ccdf-4df5-b086-35a78d449bb1 tempest-AttachVolumeNegativeTest-468633374 None] <== create_volume: return (1469ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'} {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 13 13:53:02 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-606dcff4-ccdf-4df5-b086-35a78d449bb1 tempest-AttachVolumeNegativeTest-468633374 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.474s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:53:02 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-606dcff4-ccdf-4df5-b086-35a78d449bb1 tempest-AttachVolumeNegativeTest-468633374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5edba0f7-f0f4-4eb2-86a4-f75890f159e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-41633fab-c379-4452-a7ae-4c357ee37b2d', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:53:02 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-606dcff4-ccdf-4df5-b086-35a78d449bb1 tempest-AttachVolumeNegativeTest-468633374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42ed5136-9d3c-49cc-9870-3d819dd6d6bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:53:02 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-606dcff4-ccdf-4df5-b086-35a78d449bb1 tempest-AttachVolumeNegativeTest-468633374 None] Volume volume-41633fab-c379-4452-a7ae-4c357ee37b2d (41633fab-c379-4452-a7ae-4c357ee37b2d): created successfully Jul 13 13:53:02 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-606dcff4-ccdf-4df5-b086-35a78d449bb1 tempest-AttachVolumeNegativeTest-468633374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42ed5136-9d3c-49cc-9870-3d819dd6d6bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:53:02 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-606dcff4-ccdf-4df5-b086-35a78d449bb1 tempest-AttachVolumeNegativeTest-468633374 None] Flow 'volume_create_manager' (4484820b-aba8-4042-af78-611693c00faa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 13:53:02 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-606dcff4-ccdf-4df5-b086-35a78d449bb1 tempest-AttachVolumeNegativeTest-468633374 None] Created volume successfully. Jul 13 13:53:04 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [req-1dd585ed-941e-4205-bd46-fcc2ec573905 req-aaeff0e5-03dc-4939-87f8-89a672dfc526 tempest-AttachVolumeNegativeTest-468633374 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:53:04 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [req-1dd585ed-941e-4205-bd46-fcc2ec573905 req-aaeff0e5-03dc-4939-87f8-89a672dfc526 tempest-AttachVolumeNegativeTest-468633374 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:53:04 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[d996d5c0-5303-4792-a56c-77fe9d5bc01d]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 13:53:04 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [req-1dd585ed-941e-4205-bd46-fcc2ec573905 req-aaeff0e5-03dc-4939-87f8-89a672dfc526 tempest-AttachVolumeNegativeTest-468633374 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-41633fab-c379-4452-a7ae-4c357ee37b2d {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:53:04 devstack sudo[92349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-41633fab-c379-4452-a7ae-4c357ee37b2d Jul 13 13:53:04 devstack sudo[92349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:53:05 devstack sudo[92349]: pam_unix(sudo:session): session closed for user root Jul 13 13:53:05 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [req-1dd585ed-941e-4205-bd46-fcc2ec573905 req-aaeff0e5-03dc-4939-87f8-89a672dfc526 tempest-AttachVolumeNegativeTest-468633374 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-41633fab-c379-4452-a7ae-4c357ee37b2d" returned: 0 in 0.667s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:53:05 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [req-1dd585ed-941e-4205-bd46-fcc2ec573905 req-aaeff0e5-03dc-4939-87f8-89a672dfc526 tempest-AttachVolumeNegativeTest-468633374 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.717s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:53:05 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [req-1dd585ed-941e-4205-bd46-fcc2ec573905 req-aaeff0e5-03dc-4939-87f8-89a672dfc526 tempest-AttachVolumeNegativeTest-468633374 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654', 'name': 'volume-41633fab-c379-4452-a7ae-4c357ee37b2d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2611018d-dae1-4d49-b577-36bb90f99c6a', 'enforce_multipath': True} {{(pid=87098) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 13 13:53:05 devstack cinder-volume[87098]: INFO cinder.volume.manager [req-1dd585ed-941e-4205-bd46-fcc2ec573905 req-aaeff0e5-03dc-4939-87f8-89a672dfc526 tempest-AttachVolumeNegativeTest-468633374 None] attachment_update completed successfully. Jul 13 13:53:06 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c3a932d-9b49-4cf2-9c78-28fded131c29 tempest-VolumeSnapshotQuotasNegativeTestJSON-1374858560 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 13:53:06 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-2c3a932d-9b49-4cf2-9c78-28fded131c29 tempest-VolumeSnapshotQuotasNegativeTestJSON-1374858560 None] Flow 'volume_create_manager' (f6d4bcca-6abf-4de7-94f1-e74e4b733363) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 13:53:06 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-2c3a932d-9b49-4cf2-9c78-28fded131c29 tempest-VolumeSnapshotQuotasNegativeTestJSON-1374858560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (feb35389-8609-4db9-988e-dc98b782a271) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:53:06 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-2c3a932d-9b49-4cf2-9c78-28fded131c29 tempest-VolumeSnapshotQuotasNegativeTestJSON-1374858560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (feb35389-8609-4db9-988e-dc98b782a271) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T11:53:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-222771718',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=003ce600-63d7-41b7-8e9c-c16df098e723,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36aa4ea2aa29413eb976dd5bc0549bc7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T11:53:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T11:53:06Z,use_quota=True,user_id='82d41ba19a2441b292035bd795b2f73a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1147de8b-623b-426c-a13d-7fc824a80f67),volume_type_id=1147de8b-623b-426c-a13d-7fc824a80f67)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:53:06 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-2c3a932d-9b49-4cf2-9c78-28fded131c29 tempest-VolumeSnapshotQuotasNegativeTestJSON-1374858560 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b70e768-9b61-4f48-876c-c87e6fd6e55b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:53:06 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-2c3a932d-9b49-4cf2-9c78-28fded131c29 tempest-VolumeSnapshotQuotasNegativeTestJSON-1374858560 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b70e768-9b61-4f48-876c-c87e6fd6e55b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:53:06 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-2c3a932d-9b49-4cf2-9c78-28fded131c29 tempest-VolumeSnapshotQuotasNegativeTestJSON-1374858560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20a5fed8-0a4c-45ef-98b3-076eb3e27a1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:53:06 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-2c3a932d-9b49-4cf2-9c78-28fded131c29 tempest-VolumeSnapshotQuotasNegativeTestJSON-1374858560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20a5fed8-0a4c-45ef-98b3-076eb3e27a1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '003ce600-63d7-41b7-8e9c-c16df098e723', 'volume_name': 'volume-003ce600-63d7-41b7-8e9c-c16df098e723', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:53:06 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-2c3a932d-9b49-4cf2-9c78-28fded131c29 tempest-VolumeSnapshotQuotasNegativeTestJSON-1374858560 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (796b0110-16ba-41c9-a43d-0a0f45f6b19b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:53:06 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-2c3a932d-9b49-4cf2-9c78-28fded131c29 tempest-VolumeSnapshotQuotasNegativeTestJSON-1374858560 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (796b0110-16ba-41c9-a43d-0a0f45f6b19b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:53:06 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-2c3a932d-9b49-4cf2-9c78-28fded131c29 tempest-VolumeSnapshotQuotasNegativeTestJSON-1374858560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b580626c-9d21-467a-8b86-111aa638696c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:53:06 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-2c3a932d-9b49-4cf2-9c78-28fded131c29 tempest-VolumeSnapshotQuotasNegativeTestJSON-1374858560 None] Volume 003ce600-63d7-41b7-8e9c-c16df098e723: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-003ce600-63d7-41b7-8e9c-c16df098e723', 'volume_size': 1} Jul 13 13:53:06 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-2c3a932d-9b49-4cf2-9c78-28fded131c29 tempest-VolumeSnapshotQuotasNegativeTestJSON-1374858560 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:53:06 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-2c3a932d-9b49-4cf2-9c78-28fded131c29 tempest-VolumeSnapshotQuotasNegativeTestJSON-1374858560 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:53:06 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-2c3a932d-9b49-4cf2-9c78-28fded131c29 tempest-VolumeSnapshotQuotasNegativeTestJSON-1374858560 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T11:53:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-222771718',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=003ce600-63d7-41b7-8e9c-c16df098e723,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36aa4ea2aa29413eb976dd5bc0549bc7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T11:53:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T11:53:06Z,use_quota=True,user_id='82d41ba19a2441b292035bd795b2f73a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1147de8b-623b-426c-a13d-7fc824a80f67),volume_type_id=1147de8b-623b-426c-a13d-7fc824a80f67)}" {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 13 13:53:06 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-2c3a932d-9b49-4cf2-9c78-28fded131c29 tempest-VolumeSnapshotQuotasNegativeTestJSON-1374858560 None] Creating volume 003ce600-63d7-41b7-8e9c-c16df098e723 {{(pid=87098) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 13 13:53:06 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-2c3a932d-9b49-4cf2-9c78-28fded131c29 tempest-VolumeSnapshotQuotasNegativeTestJSON-1374858560 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:53:06 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-2c3a932d-9b49-4cf2-9c78-28fded131c29 tempest-VolumeSnapshotQuotasNegativeTestJSON-1374858560 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:53:06 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-2c3a932d-9b49-4cf2-9c78-28fded131c29 tempest-VolumeSnapshotQuotasNegativeTestJSON-1374858560 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 13:53:06 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-2c3a932d-9b49-4cf2-9c78-28fded131c29 tempest-VolumeSnapshotQuotasNegativeTestJSON-1374858560 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 13:53:06 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-2c3a932d-9b49-4cf2-9c78-28fded131c29 tempest-VolumeSnapshotQuotasNegativeTestJSON-1374858560 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:53:06 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-2c3a932d-9b49-4cf2-9c78-28fded131c29 tempest-VolumeSnapshotQuotasNegativeTestJSON-1374858560 None] Selected osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 13:53:06 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-2c3a932d-9b49-4cf2-9c78-28fded131c29 tempest-VolumeSnapshotQuotasNegativeTestJSON-1374858560 None] casted to osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 Jul 13 13:53:06 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-2c3a932d-9b49-4cf2-9c78-28fded131c29 tempest-VolumeSnapshotQuotasNegativeTestJSON-1374858560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-003ce600-63d7-41b7-8e9c-c16df098e723 1073741824 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:53:06 devstack sudo[92738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-003ce600-63d7-41b7-8e9c-c16df098e723 1073741824 Jul 13 13:53:06 devstack sudo[92738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:53:07 devstack sudo[92738]: pam_unix(sudo:session): session closed for user root Jul 13 13:53:07 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-2c3a932d-9b49-4cf2-9c78-28fded131c29 tempest-VolumeSnapshotQuotasNegativeTestJSON-1374858560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-003ce600-63d7-41b7-8e9c-c16df098e723 1073741824" returned: 0 in 0.564s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:53:07 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-2c3a932d-9b49-4cf2-9c78-28fded131c29 tempest-VolumeSnapshotQuotasNegativeTestJSON-1374858560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-003ce600-63d7-41b7-8e9c-c16df098e723 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:53:07 devstack sudo[92746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-003ce600-63d7-41b7-8e9c-c16df098e723 Jul 13 13:53:07 devstack sudo[92746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:53:07 devstack sudo[92746]: pam_unix(sudo:session): session closed for user root Jul 13 13:53:07 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-2c3a932d-9b49-4cf2-9c78-28fded131c29 tempest-VolumeSnapshotQuotasNegativeTestJSON-1374858560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-003ce600-63d7-41b7-8e9c-c16df098e723" returned: 0 in 0.431s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:53:07 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-2c3a932d-9b49-4cf2-9c78-28fded131c29 tempest-VolumeSnapshotQuotasNegativeTestJSON-1374858560 None] <== create_volume: return (1050ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'} {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 13 13:53:07 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-2c3a932d-9b49-4cf2-9c78-28fded131c29 tempest-VolumeSnapshotQuotasNegativeTestJSON-1374858560 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.056s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:53:07 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-2c3a932d-9b49-4cf2-9c78-28fded131c29 tempest-VolumeSnapshotQuotasNegativeTestJSON-1374858560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b580626c-9d21-467a-8b86-111aa638696c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-003ce600-63d7-41b7-8e9c-c16df098e723', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:53:07 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-2c3a932d-9b49-4cf2-9c78-28fded131c29 tempest-VolumeSnapshotQuotasNegativeTestJSON-1374858560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89a075e0-640d-4ccb-9bf5-e4533beaa27d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:53:07 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-2c3a932d-9b49-4cf2-9c78-28fded131c29 tempest-VolumeSnapshotQuotasNegativeTestJSON-1374858560 None] Volume volume-003ce600-63d7-41b7-8e9c-c16df098e723 (003ce600-63d7-41b7-8e9c-c16df098e723): created successfully Jul 13 13:53:07 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-2c3a932d-9b49-4cf2-9c78-28fded131c29 tempest-VolumeSnapshotQuotasNegativeTestJSON-1374858560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89a075e0-640d-4ccb-9bf5-e4533beaa27d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:53:07 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-2c3a932d-9b49-4cf2-9c78-28fded131c29 tempest-VolumeSnapshotQuotasNegativeTestJSON-1374858560 None] Flow 'volume_create_manager' (f6d4bcca-6abf-4de7-94f1-e74e4b733363) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 13:53:07 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-2c3a932d-9b49-4cf2-9c78-28fded131c29 tempest-VolumeSnapshotQuotasNegativeTestJSON-1374858560 None] Created volume successfully. Jul 13 13:53:08 devstack cinder-volume[87098]: INFO cinder.volume.manager [req-5b8738ab-122e-4773-8ca0-61cb337ca7d7 req-0a58d671-f69f-43a3-a5ee-97f321aeb32f tempest-AttachVolumeNegativeTest-468633374 None] Terminate volume connection completed successfully. Jul 13 13:53:08 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [req-5b8738ab-122e-4773-8ca0-61cb337ca7d7 req-0a58d671-f69f-43a3-a5ee-97f321aeb32f tempest-AttachVolumeNegativeTest-468633374 None] Deleting attachment 2611018d-dae1-4d49-b577-36bb90f99c6a. {{(pid=87098) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 13 13:53:08 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-46486edb-f0bb-4cdd-aadc-41b733079460 tempest-VolumeSnapshotQuotasNegativeTestJSON-1374858560 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:53:08 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-46486edb-f0bb-4cdd-aadc-41b733079460 tempest-VolumeSnapshotQuotasNegativeTestJSON-1374858560 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:53:08 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-46486edb-f0bb-4cdd-aadc-41b733079460 tempest-VolumeSnapshotQuotasNegativeTestJSON-1374858560 None] Creating offline snapshot 3f0e8e71-94ef-4205-8f04-b09e3205f8e6 of volume 003ce600-63d7-41b7-8e9c-c16df098e723 {{(pid=87098) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 13 13:53:09 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ac2f4cd-1b0e-496a-bd94-5e0e6c444550]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 13:53:09 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-46486edb-f0bb-4cdd-aadc-41b733079460 tempest-VolumeSnapshotQuotasNegativeTestJSON-1374858560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-003ce600-63d7-41b7-8e9c-c16df098e723 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:53:09 devstack sudo[92777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-003ce600-63d7-41b7-8e9c-c16df098e723 Jul 13 13:53:09 devstack sudo[92777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:53:09 devstack sudo[92777]: pam_unix(sudo:session): session closed for user root Jul 13 13:53:09 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-46486edb-f0bb-4cdd-aadc-41b733079460 tempest-VolumeSnapshotQuotasNegativeTestJSON-1374858560 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-003ce600-63d7-41b7-8e9c-c16df098e723" returned: 0 in 0.522s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:53:09 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-46486edb-f0bb-4cdd-aadc-41b733079460 tempest-VolumeSnapshotQuotasNegativeTestJSON-1374858560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-003ce600-63d7-41b7-8e9c-c16df098e723,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-003ce600-63d7-41b7-8e9c-c16df098e723.3f0e8e71-94ef-4205-8f04-b09e3205f8e6 1G {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:53:09 devstack sudo[92783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-003ce600-63d7-41b7-8e9c-c16df098e723,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-003ce600-63d7-41b7-8e9c-c16df098e723.3f0e8e71-94ef-4205-8f04-b09e3205f8e6 1G Jul 13 13:53:09 devstack sudo[92783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:53:10 devstack sudo[92783]: pam_unix(sudo:session): session closed for user root Jul 13 13:53:10 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-46486edb-f0bb-4cdd-aadc-41b733079460 tempest-VolumeSnapshotQuotasNegativeTestJSON-1374858560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-003ce600-63d7-41b7-8e9c-c16df098e723,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-003ce600-63d7-41b7-8e9c-c16df098e723.3f0e8e71-94ef-4205-8f04-b09e3205f8e6 1G" returned: 0 in 0.834s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:53:10 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-46486edb-f0bb-4cdd-aadc-41b733079460 tempest-VolumeSnapshotQuotasNegativeTestJSON-1374858560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-003ce600-63d7-41b7-8e9c-c16df098e723 -F qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-003ce600-63d7-41b7-8e9c-c16df098e723.3f0e8e71-94ef-4205-8f04-b09e3205f8e6 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:53:10 devstack sudo[92808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-003ce600-63d7-41b7-8e9c-c16df098e723 -F qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-003ce600-63d7-41b7-8e9c-c16df098e723.3f0e8e71-94ef-4205-8f04-b09e3205f8e6 Jul 13 13:53:10 devstack sudo[92808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:53:10 devstack sudo[92808]: pam_unix(sudo:session): session closed for user root Jul 13 13:53:10 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-46486edb-f0bb-4cdd-aadc-41b733079460 tempest-VolumeSnapshotQuotasNegativeTestJSON-1374858560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-003ce600-63d7-41b7-8e9c-c16df098e723 -F qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-003ce600-63d7-41b7-8e9c-c16df098e723.3f0e8e71-94ef-4205-8f04-b09e3205f8e6" returned: 0 in 0.565s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:53:10 devstack cinder-volume[87098]: WARNING cinder.volume.drivers.remotefs [None req-46486edb-f0bb-4cdd-aadc-41b733079460 tempest-VolumeSnapshotQuotasNegativeTestJSON-1374858560 None] /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-003ce600-63d7-41b7-8e9c-c16df098e723.3f0e8e71-94ef-4205-8f04-b09e3205f8e6 is being set with open permissions: ugo+rw Jul 13 13:53:10 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-46486edb-f0bb-4cdd-aadc-41b733079460 tempest-VolumeSnapshotQuotasNegativeTestJSON-1374858560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-003ce600-63d7-41b7-8e9c-c16df098e723.3f0e8e71-94ef-4205-8f04-b09e3205f8e6 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:53:11 devstack sudo[92813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-003ce600-63d7-41b7-8e9c-c16df098e723.3f0e8e71-94ef-4205-8f04-b09e3205f8e6 Jul 13 13:53:11 devstack sudo[92813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:53:11 devstack sudo[92813]: pam_unix(sudo:session): session closed for user root Jul 13 13:53:11 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-46486edb-f0bb-4cdd-aadc-41b733079460 tempest-VolumeSnapshotQuotasNegativeTestJSON-1374858560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-003ce600-63d7-41b7-8e9c-c16df098e723.3f0e8e71-94ef-4205-8f04-b09e3205f8e6" returned: 0 in 0.432s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:53:11 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-46486edb-f0bb-4cdd-aadc-41b733079460 tempest-VolumeSnapshotQuotasNegativeTestJSON-1374858560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-003ce600-63d7-41b7-8e9c-c16df098e723.info {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:53:11 devstack sudo[92817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-003ce600-63d7-41b7-8e9c-c16df098e723.info Jul 13 13:53:11 devstack sudo[92817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:53:11 devstack sudo[92817]: pam_unix(sudo:session): session closed for user root Jul 13 13:53:11 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-46486edb-f0bb-4cdd-aadc-41b733079460 tempest-VolumeSnapshotQuotasNegativeTestJSON-1374858560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-003ce600-63d7-41b7-8e9c-c16df098e723.info" returned: 0 in 0.444s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:53:11 devstack cinder-volume[87098]: WARNING cinder.volume.drivers.remotefs [None req-46486edb-f0bb-4cdd-aadc-41b733079460 tempest-VolumeSnapshotQuotasNegativeTestJSON-1374858560 None] /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-003ce600-63d7-41b7-8e9c-c16df098e723.info is being set with open permissions: ugo+rw Jul 13 13:53:11 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-46486edb-f0bb-4cdd-aadc-41b733079460 tempest-VolumeSnapshotQuotasNegativeTestJSON-1374858560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-003ce600-63d7-41b7-8e9c-c16df098e723.info {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:53:11 devstack sudo[92821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-003ce600-63d7-41b7-8e9c-c16df098e723.info Jul 13 13:53:11 devstack sudo[92821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:53:12 devstack sudo[92821]: pam_unix(sudo:session): session closed for user root Jul 13 13:53:12 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-46486edb-f0bb-4cdd-aadc-41b733079460 tempest-VolumeSnapshotQuotasNegativeTestJSON-1374858560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-003ce600-63d7-41b7-8e9c-c16df098e723.info" returned: 0 in 0.442s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:53:12 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-46486edb-f0bb-4cdd-aadc-41b733079460 tempest-VolumeSnapshotQuotasNegativeTestJSON-1374858560 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.444s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:53:12 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-46486edb-f0bb-4cdd-aadc-41b733079460 tempest-VolumeSnapshotQuotasNegativeTestJSON-1374858560 None] Create snapshot completed successfully Jul 13 13:53:13 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-143227fc-d9e3-4e8f-846a-abbacab5f979 tempest-VolumeSnapshotQuotasNegativeTestJSON-1374858560 None] Acquiring lock "cinder-3f0e8e71-94ef-4205-8f04-b09e3205f8e6-delete_snapshot" by "delete_snapshot" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 13:53:13 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-143227fc-d9e3-4e8f-846a-abbacab5f979 tempest-VolumeSnapshotQuotasNegativeTestJSON-1374858560 None] Lock "cinder-3f0e8e71-94ef-4205-8f04-b09e3205f8e6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.044s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 13:53:13 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-143227fc-d9e3-4e8f-846a-abbacab5f979 tempest-VolumeSnapshotQuotasNegativeTestJSON-1374858560 None] Acquiring lock "cinder-quobyte-003ce600-63d7-41b7-8e9c-c16df098e723" by "delete_snapshot" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 13:53:13 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-143227fc-d9e3-4e8f-846a-abbacab5f979 tempest-VolumeSnapshotQuotasNegativeTestJSON-1374858560 None] Lock "cinder-quobyte-003ce600-63d7-41b7-8e9c-c16df098e723" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 13:53:13 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-143227fc-d9e3-4e8f-846a-abbacab5f979 tempest-VolumeSnapshotQuotasNegativeTestJSON-1374858560 None] Acquiring lock "cinder-quobyte-3f0e8e71-94ef-4205-8f04-b09e3205f8e6" by "_delete_snapshot" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 13:53:13 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-143227fc-d9e3-4e8f-846a-abbacab5f979 tempest-VolumeSnapshotQuotasNegativeTestJSON-1374858560 None] Lock "cinder-quobyte-3f0e8e71-94ef-4205-8f04-b09e3205f8e6" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 13:53:13 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-143227fc-d9e3-4e8f-846a-abbacab5f979 tempest-VolumeSnapshotQuotasNegativeTestJSON-1374858560 None] Deleting offline snapshot 3f0e8e71-94ef-4205-8f04-b09e3205f8e6 of volume 003ce600-63d7-41b7-8e9c-c16df098e723 {{(pid=87098) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 13 13:53:13 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-143227fc-d9e3-4e8f-846a-abbacab5f979 tempest-VolumeSnapshotQuotasNegativeTestJSON-1374858560 None] snapshot_file for this snap is: volume-003ce600-63d7-41b7-8e9c-c16df098e723.3f0e8e71-94ef-4205-8f04-b09e3205f8e6 {{(pid=87098) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 13 13:53:14 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d598598-34b9-43ed-9cb2-d1ae4e0fe595]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 13:53:14 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-143227fc-d9e3-4e8f-846a-abbacab5f979 tempest-VolumeSnapshotQuotasNegativeTestJSON-1374858560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-003ce600-63d7-41b7-8e9c-c16df098e723.3f0e8e71-94ef-4205-8f04-b09e3205f8e6 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:53:14 devstack sudo[92825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-003ce600-63d7-41b7-8e9c-c16df098e723.3f0e8e71-94ef-4205-8f04-b09e3205f8e6 Jul 13 13:53:14 devstack sudo[92825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:53:14 devstack sudo[92825]: pam_unix(sudo:session): session closed for user root Jul 13 13:53:14 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-143227fc-d9e3-4e8f-846a-abbacab5f979 tempest-VolumeSnapshotQuotasNegativeTestJSON-1374858560 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-003ce600-63d7-41b7-8e9c-c16df098e723.3f0e8e71-94ef-4205-8f04-b09e3205f8e6" returned: 0 in 0.593s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:53:14 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-143227fc-d9e3-4e8f-846a-abbacab5f979 tempest-VolumeSnapshotQuotasNegativeTestJSON-1374858560 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-003ce600-63d7-41b7-8e9c-c16df098e723(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87098) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 13 13:53:14 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ba0e124-6018-4e6e-a576-f67821139b48]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 13:53:14 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-143227fc-d9e3-4e8f-846a-abbacab5f979 tempest-VolumeSnapshotQuotasNegativeTestJSON-1374858560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-003ce600-63d7-41b7-8e9c-c16df098e723 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:53:14 devstack sudo[92831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-003ce600-63d7-41b7-8e9c-c16df098e723 Jul 13 13:53:14 devstack sudo[92831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:53:15 devstack sudo[92831]: pam_unix(sudo:session): session closed for user root Jul 13 13:53:15 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-143227fc-d9e3-4e8f-846a-abbacab5f979 tempest-VolumeSnapshotQuotasNegativeTestJSON-1374858560 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-003ce600-63d7-41b7-8e9c-c16df098e723" returned: 0 in 0.435s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:53:15 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-143227fc-d9e3-4e8f-846a-abbacab5f979 tempest-VolumeSnapshotQuotasNegativeTestJSON-1374858560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-003ce600-63d7-41b7-8e9c-c16df098e723.3f0e8e71-94ef-4205-8f04-b09e3205f8e6 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:53:15 devstack sudo[92836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-003ce600-63d7-41b7-8e9c-c16df098e723.3f0e8e71-94ef-4205-8f04-b09e3205f8e6 Jul 13 13:53:15 devstack sudo[92836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:53:15 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-4f0e2fc5-e704-49d0-acbf-8ca0a6ba5034 tempest-AttachVolumeNegativeTest-468633374 None] Acquiring lock "cinder-41633fab-c379-4452-a7ae-4c357ee37b2d-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 13:53:15 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-4f0e2fc5-e704-49d0-acbf-8ca0a6ba5034 tempest-AttachVolumeNegativeTest-468633374 None] Lock "cinder-41633fab-c379-4452-a7ae-4c357ee37b2d-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 13:53:15 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-4f0e2fc5-e704-49d0-acbf-8ca0a6ba5034 tempest-AttachVolumeNegativeTest-468633374 None] Acquiring lock "cinder-quobyte-41633fab-c379-4452-a7ae-4c357ee37b2d" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 13:53:15 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-4f0e2fc5-e704-49d0-acbf-8ca0a6ba5034 tempest-AttachVolumeNegativeTest-468633374 None] Lock "cinder-quobyte-41633fab-c379-4452-a7ae-4c357ee37b2d" acquired by "delete_volume" :: waited 0.027s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 13:53:15 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[38c64de6-20db-4648-9bcf-6b95e0cd39d3]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 13:53:15 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-4f0e2fc5-e704-49d0-acbf-8ca0a6ba5034 tempest-AttachVolumeNegativeTest-468633374 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-41633fab-c379-4452-a7ae-4c357ee37b2d {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:53:15 devstack sudo[92838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-41633fab-c379-4452-a7ae-4c357ee37b2d Jul 13 13:53:15 devstack sudo[92838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:53:15 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [req-0b7f32cb-bf78-416b-a6f7-a70cecc162b5 req-cfb56076-08f2-4a74-8b69-7f97a0916c54 tempest-VolumesSnapshotsTestJSON-746625746 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 13:53:15 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [req-0b7f32cb-bf78-416b-a6f7-a70cecc162b5 req-cfb56076-08f2-4a74-8b69-7f97a0916c54 tempest-VolumesSnapshotsTestJSON-746625746 None] Flow 'volume_create_manager' (40dafec6-e72c-44dd-9ee4-2fd16d9ef1f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 13:53:15 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [req-0b7f32cb-bf78-416b-a6f7-a70cecc162b5 req-cfb56076-08f2-4a74-8b69-7f97a0916c54 tempest-VolumesSnapshotsTestJSON-746625746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d8f187e-210b-4d7e-8dcd-4b1957161f4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:53:15 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [req-0b7f32cb-bf78-416b-a6f7-a70cecc162b5 req-cfb56076-08f2-4a74-8b69-7f97a0916c54 tempest-VolumesSnapshotsTestJSON-746625746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d8f187e-210b-4d7e-8dcd-4b1957161f4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T11:53:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1193709603',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83413aaa-97c9-4379-bfe4-fde65b4500d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2284621a54ca4d6ca709fb8e37fd208b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T11:53:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T11:53:15Z,use_quota=True,user_id='0bb57454c24d4ec1ae4cd5c07692bdfa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1147de8b-623b-426c-a13d-7fc824a80f67),volume_type_id=1147de8b-623b-426c-a13d-7fc824a80f67)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:53:15 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [req-0b7f32cb-bf78-416b-a6f7-a70cecc162b5 req-cfb56076-08f2-4a74-8b69-7f97a0916c54 tempest-VolumesSnapshotsTestJSON-746625746 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3b9a4e3-0c9b-4fb9-bcc7-2020350511f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:53:15 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [req-0b7f32cb-bf78-416b-a6f7-a70cecc162b5 req-cfb56076-08f2-4a74-8b69-7f97a0916c54 tempest-VolumesSnapshotsTestJSON-746625746 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3b9a4e3-0c9b-4fb9-bcc7-2020350511f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:53:15 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [req-0b7f32cb-bf78-416b-a6f7-a70cecc162b5 req-cfb56076-08f2-4a74-8b69-7f97a0916c54 tempest-VolumesSnapshotsTestJSON-746625746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f689524f-4752-4458-8d1e-a6ff58dbc9e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:53:15 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [req-0b7f32cb-bf78-416b-a6f7-a70cecc162b5 req-cfb56076-08f2-4a74-8b69-7f97a0916c54 tempest-VolumesSnapshotsTestJSON-746625746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f689524f-4752-4458-8d1e-a6ff58dbc9e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '83413aaa-97c9-4379-bfe4-fde65b4500d9', 'volume_name': 'volume-83413aaa-97c9-4379-bfe4-fde65b4500d9', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:53:15 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [req-0b7f32cb-bf78-416b-a6f7-a70cecc162b5 req-cfb56076-08f2-4a74-8b69-7f97a0916c54 tempest-VolumesSnapshotsTestJSON-746625746 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (973e1f9d-b30d-44ac-ad56-51dbeac2b49d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:53:15 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [req-0b7f32cb-bf78-416b-a6f7-a70cecc162b5 req-cfb56076-08f2-4a74-8b69-7f97a0916c54 tempest-VolumesSnapshotsTestJSON-746625746 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (973e1f9d-b30d-44ac-ad56-51dbeac2b49d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:53:15 devstack sudo[92836]: pam_unix(sudo:session): session closed for user root Jul 13 13:53:15 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [req-0b7f32cb-bf78-416b-a6f7-a70cecc162b5 req-cfb56076-08f2-4a74-8b69-7f97a0916c54 tempest-VolumesSnapshotsTestJSON-746625746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25088eec-a235-4360-8789-a500254322a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:53:15 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [req-0b7f32cb-bf78-416b-a6f7-a70cecc162b5 req-cfb56076-08f2-4a74-8b69-7f97a0916c54 tempest-VolumesSnapshotsTestJSON-746625746 None] Volume 83413aaa-97c9-4379-bfe4-fde65b4500d9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-83413aaa-97c9-4379-bfe4-fde65b4500d9', 'volume_size': 1} Jul 13 13:53:15 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [req-0b7f32cb-bf78-416b-a6f7-a70cecc162b5 req-cfb56076-08f2-4a74-8b69-7f97a0916c54 tempest-VolumesSnapshotsTestJSON-746625746 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:53:15 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [req-0b7f32cb-bf78-416b-a6f7-a70cecc162b5 req-cfb56076-08f2-4a74-8b69-7f97a0916c54 tempest-VolumesSnapshotsTestJSON-746625746 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:53:15 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [req-0b7f32cb-bf78-416b-a6f7-a70cecc162b5 req-cfb56076-08f2-4a74-8b69-7f97a0916c54 tempest-VolumesSnapshotsTestJSON-746625746 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T11:53:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1193709603',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83413aaa-97c9-4379-bfe4-fde65b4500d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2284621a54ca4d6ca709fb8e37fd208b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T11:53:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T11:53:15Z,use_quota=True,user_id='0bb57454c24d4ec1ae4cd5c07692bdfa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1147de8b-623b-426c-a13d-7fc824a80f67),volume_type_id=1147de8b-623b-426c-a13d-7fc824a80f67)}" {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 13 13:53:15 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [req-0b7f32cb-bf78-416b-a6f7-a70cecc162b5 req-cfb56076-08f2-4a74-8b69-7f97a0916c54 tempest-VolumesSnapshotsTestJSON-746625746 None] Creating volume 83413aaa-97c9-4379-bfe4-fde65b4500d9 {{(pid=87098) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 13 13:53:15 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [req-0b7f32cb-bf78-416b-a6f7-a70cecc162b5 req-cfb56076-08f2-4a74-8b69-7f97a0916c54 tempest-VolumesSnapshotsTestJSON-746625746 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:53:15 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [req-0b7f32cb-bf78-416b-a6f7-a70cecc162b5 req-cfb56076-08f2-4a74-8b69-7f97a0916c54 tempest-VolumesSnapshotsTestJSON-746625746 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:53:15 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [req-0b7f32cb-bf78-416b-a6f7-a70cecc162b5 req-cfb56076-08f2-4a74-8b69-7f97a0916c54 tempest-VolumesSnapshotsTestJSON-746625746 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 13:53:15 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [req-0b7f32cb-bf78-416b-a6f7-a70cecc162b5 req-cfb56076-08f2-4a74-8b69-7f97a0916c54 tempest-VolumesSnapshotsTestJSON-746625746 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 13:53:15 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [req-0b7f32cb-bf78-416b-a6f7-a70cecc162b5 req-cfb56076-08f2-4a74-8b69-7f97a0916c54 tempest-VolumesSnapshotsTestJSON-746625746 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:53:15 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [req-0b7f32cb-bf78-416b-a6f7-a70cecc162b5 req-cfb56076-08f2-4a74-8b69-7f97a0916c54 tempest-VolumesSnapshotsTestJSON-746625746 None] Selected osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 13:53:15 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [req-0b7f32cb-bf78-416b-a6f7-a70cecc162b5 req-cfb56076-08f2-4a74-8b69-7f97a0916c54 tempest-VolumesSnapshotsTestJSON-746625746 None] casted to osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 Jul 13 13:53:15 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [req-0b7f32cb-bf78-416b-a6f7-a70cecc162b5 req-cfb56076-08f2-4a74-8b69-7f97a0916c54 tempest-VolumesSnapshotsTestJSON-746625746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-83413aaa-97c9-4379-bfe4-fde65b4500d9 1073741824 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:53:15 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-143227fc-d9e3-4e8f-846a-abbacab5f979 tempest-VolumeSnapshotQuotasNegativeTestJSON-1374858560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-003ce600-63d7-41b7-8e9c-c16df098e723.3f0e8e71-94ef-4205-8f04-b09e3205f8e6" returned: 0 in 0.621s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:53:15 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-143227fc-d9e3-4e8f-846a-abbacab5f979 tempest-VolumeSnapshotQuotasNegativeTestJSON-1374858560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-003ce600-63d7-41b7-8e9c-c16df098e723.3f0e8e71-94ef-4205-8f04-b09e3205f8e6 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:53:15 devstack sudo[92845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-83413aaa-97c9-4379-bfe4-fde65b4500d9 1073741824 Jul 13 13:53:15 devstack sudo[92845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:53:15 devstack sudo[92848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-003ce600-63d7-41b7-8e9c-c16df098e723.3f0e8e71-94ef-4205-8f04-b09e3205f8e6 Jul 13 13:53:15 devstack sudo[92848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:53:15 devstack sudo[92838]: pam_unix(sudo:session): session closed for user root Jul 13 13:53:15 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-4f0e2fc5-e704-49d0-acbf-8ca0a6ba5034 tempest-AttachVolumeNegativeTest-468633374 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-41633fab-c379-4452-a7ae-4c357ee37b2d" returned: 0 in 0.569s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:53:15 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-4f0e2fc5-e704-49d0-acbf-8ca0a6ba5034 tempest-AttachVolumeNegativeTest-468633374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-41633fab-c379-4452-a7ae-4c357ee37b2d {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:53:15 devstack sudo[92852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-41633fab-c379-4452-a7ae-4c357ee37b2d Jul 13 13:53:15 devstack sudo[92852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:53:15 devstack sudo[92848]: pam_unix(sudo:session): session closed for user root Jul 13 13:53:15 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-143227fc-d9e3-4e8f-846a-abbacab5f979 tempest-VolumeSnapshotQuotasNegativeTestJSON-1374858560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-003ce600-63d7-41b7-8e9c-c16df098e723.3f0e8e71-94ef-4205-8f04-b09e3205f8e6" returned: 0 in 0.294s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:53:16 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-143227fc-d9e3-4e8f-846a-abbacab5f979 tempest-VolumeSnapshotQuotasNegativeTestJSON-1374858560 None] Lock "cinder-quobyte-3f0e8e71-94ef-4205-8f04-b09e3205f8e6" released by "_delete_snapshot" :: held 2.105s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 13:53:16 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-143227fc-d9e3-4e8f-846a-abbacab5f979 tempest-VolumeSnapshotQuotasNegativeTestJSON-1374858560 None] Lock "cinder-quobyte-003ce600-63d7-41b7-8e9c-c16df098e723" released by "delete_snapshot" :: held 2.141s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 13:53:16 devstack cinder-volume[87098]: WARNING cinder.quota [None req-143227fc-d9e3-4e8f-846a-abbacab5f979 tempest-VolumeSnapshotQuotasNegativeTestJSON-1374858560 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 13 13:53:16 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-143227fc-d9e3-4e8f-846a-abbacab5f979 tempest-VolumeSnapshotQuotasNegativeTestJSON-1374858560 None] Created reservations ['f761ac06-bd57-4e6e-82c7-7a9acd59af6b', '46eaf76f-97e7-470c-8823-13cc7b17183c', '374d4cf9-0e55-4535-8bf3-08d800be3c96', '381788ac-1b69-47bb-81ad-13d12617caef'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 13:53:16 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-143227fc-d9e3-4e8f-846a-abbacab5f979 tempest-VolumeSnapshotQuotasNegativeTestJSON-1374858560 None] Delete snapshot completed successfully. Jul 13 13:53:16 devstack sudo[92852]: pam_unix(sudo:session): session closed for user root Jul 13 13:53:16 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-4f0e2fc5-e704-49d0-acbf-8ca0a6ba5034 tempest-AttachVolumeNegativeTest-468633374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-41633fab-c379-4452-a7ae-4c357ee37b2d" returned: 0 in 0.388s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:53:16 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-143227fc-d9e3-4e8f-846a-abbacab5f979 tempest-VolumeSnapshotQuotasNegativeTestJSON-1374858560 None] Lock "cinder-3f0e8e71-94ef-4205-8f04-b09e3205f8e6-delete_snapshot" released by "delete_snapshot" :: held 2.346s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 13:53:16 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-4f0e2fc5-e704-49d0-acbf-8ca0a6ba5034 tempest-AttachVolumeNegativeTest-468633374 None] Lock "cinder-quobyte-41633fab-c379-4452-a7ae-4c357ee37b2d" released by "delete_volume" :: held 1.033s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 13:53:16 devstack sudo[92845]: pam_unix(sudo:session): session closed for user root Jul 13 13:53:16 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [req-0b7f32cb-bf78-416b-a6f7-a70cecc162b5 req-cfb56076-08f2-4a74-8b69-7f97a0916c54 tempest-VolumesSnapshotsTestJSON-746625746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-83413aaa-97c9-4379-bfe4-fde65b4500d9 1073741824" returned: 0 in 0.600s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:53:16 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-4f0e2fc5-e704-49d0-acbf-8ca0a6ba5034 tempest-AttachVolumeNegativeTest-468633374 None] Created reservations ['44d9be71-4a31-470e-9ffa-8152f8f7ea2e', 'd3a0dbb4-3bc1-407c-81e0-b79249fbf6d4', '130fac63-2d06-449c-b256-f962855d6646', '96017857-c5cf-4dd6-8364-c613e9acedf5'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 13:53:16 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [req-0b7f32cb-bf78-416b-a6f7-a70cecc162b5 req-cfb56076-08f2-4a74-8b69-7f97a0916c54 tempest-VolumesSnapshotsTestJSON-746625746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-83413aaa-97c9-4379-bfe4-fde65b4500d9 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:53:16 devstack sudo[92862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-83413aaa-97c9-4379-bfe4-fde65b4500d9 Jul 13 13:53:16 devstack sudo[92862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:53:16 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-4f0e2fc5-e704-49d0-acbf-8ca0a6ba5034 tempest-AttachVolumeNegativeTest-468633374 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:53:16 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-4f0e2fc5-e704-49d0-acbf-8ca0a6ba5034 tempest-AttachVolumeNegativeTest-468633374 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:53:16 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-4f0e2fc5-e704-49d0-acbf-8ca0a6ba5034 tempest-AttachVolumeNegativeTest-468633374 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 13:53:16 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-4f0e2fc5-e704-49d0-acbf-8ca0a6ba5034 tempest-AttachVolumeNegativeTest-468633374 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 13:53:16 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-4f0e2fc5-e704-49d0-acbf-8ca0a6ba5034 tempest-AttachVolumeNegativeTest-468633374 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:53:16 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-4f0e2fc5-e704-49d0-acbf-8ca0a6ba5034 tempest-AttachVolumeNegativeTest-468633374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:53:16 devstack sudo[92864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 Jul 13 13:53:16 devstack sudo[92864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:53:16 devstack sudo[92862]: pam_unix(sudo:session): session closed for user root Jul 13 13:53:16 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [req-0b7f32cb-bf78-416b-a6f7-a70cecc162b5 req-cfb56076-08f2-4a74-8b69-7f97a0916c54 tempest-VolumesSnapshotsTestJSON-746625746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-83413aaa-97c9-4379-bfe4-fde65b4500d9" returned: 0 in 0.311s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:53:16 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [req-0b7f32cb-bf78-416b-a6f7-a70cecc162b5 req-cfb56076-08f2-4a74-8b69-7f97a0916c54 tempest-VolumesSnapshotsTestJSON-746625746 None] <== create_volume: return (965ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'} {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 13 13:53:16 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [req-0b7f32cb-bf78-416b-a6f7-a70cecc162b5 req-cfb56076-08f2-4a74-8b69-7f97a0916c54 tempest-VolumesSnapshotsTestJSON-746625746 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.968s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:53:16 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [req-0b7f32cb-bf78-416b-a6f7-a70cecc162b5 req-cfb56076-08f2-4a74-8b69-7f97a0916c54 tempest-VolumesSnapshotsTestJSON-746625746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25088eec-a235-4360-8789-a500254322a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-83413aaa-97c9-4379-bfe4-fde65b4500d9', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:53:16 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [req-0b7f32cb-bf78-416b-a6f7-a70cecc162b5 req-cfb56076-08f2-4a74-8b69-7f97a0916c54 tempest-VolumesSnapshotsTestJSON-746625746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (279b06c8-96bf-424d-8c60-d140b7b7e6ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:53:16 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [req-0b7f32cb-bf78-416b-a6f7-a70cecc162b5 req-cfb56076-08f2-4a74-8b69-7f97a0916c54 tempest-VolumesSnapshotsTestJSON-746625746 None] Volume volume-83413aaa-97c9-4379-bfe4-fde65b4500d9 (83413aaa-97c9-4379-bfe4-fde65b4500d9): created successfully Jul 13 13:53:16 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [req-0b7f32cb-bf78-416b-a6f7-a70cecc162b5 req-cfb56076-08f2-4a74-8b69-7f97a0916c54 tempest-VolumesSnapshotsTestJSON-746625746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (279b06c8-96bf-424d-8c60-d140b7b7e6ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:53:16 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [req-0b7f32cb-bf78-416b-a6f7-a70cecc162b5 req-cfb56076-08f2-4a74-8b69-7f97a0916c54 tempest-VolumesSnapshotsTestJSON-746625746 None] Flow 'volume_create_manager' (40dafec6-e72c-44dd-9ee4-2fd16d9ef1f7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 13:53:16 devstack sudo[92864]: pam_unix(sudo:session): session closed for user root Jul 13 13:53:16 devstack cinder-volume[87098]: INFO cinder.volume.manager [req-0b7f32cb-bf78-416b-a6f7-a70cecc162b5 req-cfb56076-08f2-4a74-8b69-7f97a0916c54 tempest-VolumesSnapshotsTestJSON-746625746 None] Created volume successfully. Jul 13 13:53:16 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-4f0e2fc5-e704-49d0-acbf-8ca0a6ba5034 tempest-AttachVolumeNegativeTest-468633374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78" returned: 0 in 0.305s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:53:16 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-4f0e2fc5-e704-49d0-acbf-8ca0a6ba5034 tempest-AttachVolumeNegativeTest-468633374 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 13:53:16 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-4f0e2fc5-e704-49d0-acbf-8ca0a6ba5034 tempest-AttachVolumeNegativeTest-468633374 None] Deleted volume successfully. Jul 13 13:53:16 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-4f0e2fc5-e704-49d0-acbf-8ca0a6ba5034 tempest-AttachVolumeNegativeTest-468633374 None] Lock "cinder-41633fab-c379-4452-a7ae-4c357ee37b2d-delete_volume" released by "delete_volume" :: held 1.601s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 13:53:17 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-ceba9ba6-4304-41fd-b0ab-092e09e0e12a tempest-VolumeSnapshotQuotasNegativeTestJSON-1374858560 None] Acquiring lock "cinder-003ce600-63d7-41b7-8e9c-c16df098e723-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 13:53:17 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-ceba9ba6-4304-41fd-b0ab-092e09e0e12a tempest-VolumeSnapshotQuotasNegativeTestJSON-1374858560 None] Lock "cinder-003ce600-63d7-41b7-8e9c-c16df098e723-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 13:53:17 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-ceba9ba6-4304-41fd-b0ab-092e09e0e12a tempest-VolumeSnapshotQuotasNegativeTestJSON-1374858560 None] Acquiring lock "cinder-quobyte-003ce600-63d7-41b7-8e9c-c16df098e723" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 13:53:17 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-ceba9ba6-4304-41fd-b0ab-092e09e0e12a tempest-VolumeSnapshotQuotasNegativeTestJSON-1374858560 None] Lock "cinder-quobyte-003ce600-63d7-41b7-8e9c-c16df098e723" acquired by "delete_volume" :: waited 0.024s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 13:53:17 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[862244e9-a7b3-4dea-a7a3-fc937e9e83ed]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 13:53:17 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-ceba9ba6-4304-41fd-b0ab-092e09e0e12a tempest-VolumeSnapshotQuotasNegativeTestJSON-1374858560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-003ce600-63d7-41b7-8e9c-c16df098e723 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:53:17 devstack sudo[92871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-003ce600-63d7-41b7-8e9c-c16df098e723 Jul 13 13:53:17 devstack sudo[92871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:53:17 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-8e32689a-c2b9-41e6-9237-4eb98d021d96 tempest-AttachVolumeNegativeTest-468633374 None] Acquiring lock "cinder-304c6dea-b15e-46bc-90db-d48156d2081c-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 13:53:17 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-8e32689a-c2b9-41e6-9237-4eb98d021d96 tempest-AttachVolumeNegativeTest-468633374 None] Lock "cinder-304c6dea-b15e-46bc-90db-d48156d2081c-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 13:53:17 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-8e32689a-c2b9-41e6-9237-4eb98d021d96 tempest-AttachVolumeNegativeTest-468633374 None] Acquiring lock "cinder-quobyte-304c6dea-b15e-46bc-90db-d48156d2081c" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 13:53:17 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-8e32689a-c2b9-41e6-9237-4eb98d021d96 tempest-AttachVolumeNegativeTest-468633374 None] Lock "cinder-quobyte-304c6dea-b15e-46bc-90db-d48156d2081c" acquired by "delete_volume" :: waited 0.019s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 13:53:17 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b817dd1-7985-4686-9b50-c78fe1c08fc3]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 13:53:17 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-8e32689a-c2b9-41e6-9237-4eb98d021d96 tempest-AttachVolumeNegativeTest-468633374 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-304c6dea-b15e-46bc-90db-d48156d2081c {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:53:17 devstack sudo[92871]: pam_unix(sudo:session): session closed for user root Jul 13 13:53:17 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-ceba9ba6-4304-41fd-b0ab-092e09e0e12a tempest-VolumeSnapshotQuotasNegativeTestJSON-1374858560 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-003ce600-63d7-41b7-8e9c-c16df098e723" returned: 0 in 0.430s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:53:17 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-ceba9ba6-4304-41fd-b0ab-092e09e0e12a tempest-VolumeSnapshotQuotasNegativeTestJSON-1374858560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-003ce600-63d7-41b7-8e9c-c16df098e723 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:53:17 devstack sudo[92873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-304c6dea-b15e-46bc-90db-d48156d2081c Jul 13 13:53:17 devstack sudo[92873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:53:17 devstack sudo[92878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-003ce600-63d7-41b7-8e9c-c16df098e723 Jul 13 13:53:17 devstack sudo[92878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:53:18 devstack sudo[92878]: pam_unix(sudo:session): session closed for user root Jul 13 13:53:18 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-ceba9ba6-4304-41fd-b0ab-092e09e0e12a tempest-VolumeSnapshotQuotasNegativeTestJSON-1374858560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-003ce600-63d7-41b7-8e9c-c16df098e723" returned: 0 in 0.273s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:53:18 devstack sudo[92873]: pam_unix(sudo:session): session closed for user root Jul 13 13:53:18 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-ceba9ba6-4304-41fd-b0ab-092e09e0e12a tempest-VolumeSnapshotQuotasNegativeTestJSON-1374858560 None] Lock "cinder-quobyte-003ce600-63d7-41b7-8e9c-c16df098e723" released by "delete_volume" :: held 0.769s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 13:53:18 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-8e32689a-c2b9-41e6-9237-4eb98d021d96 tempest-AttachVolumeNegativeTest-468633374 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-304c6dea-b15e-46bc-90db-d48156d2081c" returned: 0 in 0.416s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:53:18 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-8e32689a-c2b9-41e6-9237-4eb98d021d96 tempest-AttachVolumeNegativeTest-468633374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-304c6dea-b15e-46bc-90db-d48156d2081c {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:53:18 devstack sudo[92892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-304c6dea-b15e-46bc-90db-d48156d2081c Jul 13 13:53:18 devstack sudo[92892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:53:18 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-ceba9ba6-4304-41fd-b0ab-092e09e0e12a tempest-VolumeSnapshotQuotasNegativeTestJSON-1374858560 None] Created reservations ['efc820dc-67bc-4361-85ae-aae14a38cbf1', '29d23832-646d-4aaf-9dc6-32dd5af0c304', 'bf465d7d-481f-410c-a2ef-5d13839fdf8c', '3a799143-30bd-496e-b4a4-ec5d9dfb613b'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 13:53:18 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [req-1d8f38ad-cf34-4bf4-8be9-7ecbdf534f90 req-03efd2cd-233e-4ae8-8e46-133df36e55d9 tempest-VolumesSnapshotsTestJSON-746625746 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:53:18 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [req-1d8f38ad-cf34-4bf4-8be9-7ecbdf534f90 req-03efd2cd-233e-4ae8-8e46-133df36e55d9 tempest-VolumesSnapshotsTestJSON-746625746 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:53:18 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [req-1d8f38ad-cf34-4bf4-8be9-7ecbdf534f90 req-03efd2cd-233e-4ae8-8e46-133df36e55d9 tempest-VolumesSnapshotsTestJSON-746625746 None] Creating offline snapshot 471fb23e-eab4-424d-ad07-10cd6d774bbe of volume 83413aaa-97c9-4379-bfe4-fde65b4500d9 {{(pid=87098) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 13 13:53:18 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a429f30-d9ae-4304-a8d7-c36660584fb9]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 13:53:18 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [req-1d8f38ad-cf34-4bf4-8be9-7ecbdf534f90 req-03efd2cd-233e-4ae8-8e46-133df36e55d9 tempest-VolumesSnapshotsTestJSON-746625746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-83413aaa-97c9-4379-bfe4-fde65b4500d9 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:53:18 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-ceba9ba6-4304-41fd-b0ab-092e09e0e12a tempest-VolumeSnapshotQuotasNegativeTestJSON-1374858560 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:53:18 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-ceba9ba6-4304-41fd-b0ab-092e09e0e12a tempest-VolumeSnapshotQuotasNegativeTestJSON-1374858560 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:53:18 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-ceba9ba6-4304-41fd-b0ab-092e09e0e12a tempest-VolumeSnapshotQuotasNegativeTestJSON-1374858560 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 13:53:18 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-ceba9ba6-4304-41fd-b0ab-092e09e0e12a tempest-VolumeSnapshotQuotasNegativeTestJSON-1374858560 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 13:53:18 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-ceba9ba6-4304-41fd-b0ab-092e09e0e12a tempest-VolumeSnapshotQuotasNegativeTestJSON-1374858560 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:53:18 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-ceba9ba6-4304-41fd-b0ab-092e09e0e12a tempest-VolumeSnapshotQuotasNegativeTestJSON-1374858560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:53:18 devstack sudo[92897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 Jul 13 13:53:18 devstack sudo[92897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:53:18 devstack sudo[92896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-83413aaa-97c9-4379-bfe4-fde65b4500d9 Jul 13 13:53:18 devstack sudo[92896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:53:18 devstack sudo[92892]: pam_unix(sudo:session): session closed for user root Jul 13 13:53:18 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-8e32689a-c2b9-41e6-9237-4eb98d021d96 tempest-AttachVolumeNegativeTest-468633374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-304c6dea-b15e-46bc-90db-d48156d2081c" returned: 0 in 0.336s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:53:18 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-8e32689a-c2b9-41e6-9237-4eb98d021d96 tempest-AttachVolumeNegativeTest-468633374 None] Lock "cinder-quobyte-304c6dea-b15e-46bc-90db-d48156d2081c" released by "delete_volume" :: held 0.806s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 13:53:18 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-8e32689a-c2b9-41e6-9237-4eb98d021d96 tempest-AttachVolumeNegativeTest-468633374 None] Created reservations ['0d8c95ce-6f65-4a0a-a811-b1e97effe5a2', 'ffbd876a-25d1-4a0b-80a3-5502d58e9ceb', 'f9fb05cb-91b0-449e-be23-2ce0566274f0', 'c5b5c608-aea8-4fe6-a259-cc850b80e28b'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 13:53:18 devstack sudo[92897]: pam_unix(sudo:session): session closed for user root Jul 13 13:53:18 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-ceba9ba6-4304-41fd-b0ab-092e09e0e12a tempest-VolumeSnapshotQuotasNegativeTestJSON-1374858560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78" returned: 0 in 0.309s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:53:18 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-ceba9ba6-4304-41fd-b0ab-092e09e0e12a tempest-VolumeSnapshotQuotasNegativeTestJSON-1374858560 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 13:53:18 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-ceba9ba6-4304-41fd-b0ab-092e09e0e12a tempest-VolumeSnapshotQuotasNegativeTestJSON-1374858560 None] Deleted volume successfully. Jul 13 13:53:18 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-8e32689a-c2b9-41e6-9237-4eb98d021d96 tempest-AttachVolumeNegativeTest-468633374 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:53:18 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-8e32689a-c2b9-41e6-9237-4eb98d021d96 tempest-AttachVolumeNegativeTest-468633374 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:53:18 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-8e32689a-c2b9-41e6-9237-4eb98d021d96 tempest-AttachVolumeNegativeTest-468633374 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 13:53:18 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-8e32689a-c2b9-41e6-9237-4eb98d021d96 tempest-AttachVolumeNegativeTest-468633374 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 13:53:18 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-8e32689a-c2b9-41e6-9237-4eb98d021d96 tempest-AttachVolumeNegativeTest-468633374 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:53:18 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-8e32689a-c2b9-41e6-9237-4eb98d021d96 tempest-AttachVolumeNegativeTest-468633374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:53:18 devstack sudo[92904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 Jul 13 13:53:18 devstack sudo[92904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:53:18 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-ceba9ba6-4304-41fd-b0ab-092e09e0e12a tempest-VolumeSnapshotQuotasNegativeTestJSON-1374858560 None] Lock "cinder-003ce600-63d7-41b7-8e9c-c16df098e723-delete_volume" released by "delete_volume" :: held 1.415s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 13:53:18 devstack sudo[92896]: pam_unix(sudo:session): session closed for user root Jul 13 13:53:18 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [req-1d8f38ad-cf34-4bf4-8be9-7ecbdf534f90 req-03efd2cd-233e-4ae8-8e46-133df36e55d9 tempest-VolumesSnapshotsTestJSON-746625746 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-83413aaa-97c9-4379-bfe4-fde65b4500d9" returned: 0 in 0.498s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:53:18 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [req-1d8f38ad-cf34-4bf4-8be9-7ecbdf534f90 req-03efd2cd-233e-4ae8-8e46-133df36e55d9 tempest-VolumesSnapshotsTestJSON-746625746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-83413aaa-97c9-4379-bfe4-fde65b4500d9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-83413aaa-97c9-4379-bfe4-fde65b4500d9.471fb23e-eab4-424d-ad07-10cd6d774bbe 1G {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:53:18 devstack sudo[92907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-83413aaa-97c9-4379-bfe4-fde65b4500d9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-83413aaa-97c9-4379-bfe4-fde65b4500d9.471fb23e-eab4-424d-ad07-10cd6d774bbe 1G Jul 13 13:53:18 devstack sudo[92907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:53:18 devstack sudo[92904]: pam_unix(sudo:session): session closed for user root Jul 13 13:53:18 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-8e32689a-c2b9-41e6-9237-4eb98d021d96 tempest-AttachVolumeNegativeTest-468633374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78" returned: 0 in 0.252s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:53:18 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-8e32689a-c2b9-41e6-9237-4eb98d021d96 tempest-AttachVolumeNegativeTest-468633374 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 13:53:18 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-8e32689a-c2b9-41e6-9237-4eb98d021d96 tempest-AttachVolumeNegativeTest-468633374 None] Deleted volume successfully. Jul 13 13:53:18 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-8e32689a-c2b9-41e6-9237-4eb98d021d96 tempest-AttachVolumeNegativeTest-468633374 None] Lock "cinder-304c6dea-b15e-46bc-90db-d48156d2081c-delete_volume" released by "delete_volume" :: held 1.344s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 13:53:18 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-45ba49bf-bc07-4f12-a314-ecd36a0401f5 tempest-AttachVolumeNegativeTest-468633374 None] Acquiring lock "cinder-82a84106-434a-4410-9614-dc7ca7555937-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 13:53:18 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-45ba49bf-bc07-4f12-a314-ecd36a0401f5 tempest-AttachVolumeNegativeTest-468633374 None] Lock "cinder-82a84106-434a-4410-9614-dc7ca7555937-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 13:53:19 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-45ba49bf-bc07-4f12-a314-ecd36a0401f5 tempest-AttachVolumeNegativeTest-468633374 None] Acquiring lock "cinder-quobyte-82a84106-434a-4410-9614-dc7ca7555937" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 13:53:19 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-45ba49bf-bc07-4f12-a314-ecd36a0401f5 tempest-AttachVolumeNegativeTest-468633374 None] Lock "cinder-quobyte-82a84106-434a-4410-9614-dc7ca7555937" acquired by "delete_volume" :: waited 0.022s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 13:53:19 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfed26c8-5b47-4b98-86fe-1eadadf6c981]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 13:53:19 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-45ba49bf-bc07-4f12-a314-ecd36a0401f5 tempest-AttachVolumeNegativeTest-468633374 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-82a84106-434a-4410-9614-dc7ca7555937 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:53:19 devstack sudo[92907]: pam_unix(sudo:session): session closed for user root Jul 13 13:53:19 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [req-1d8f38ad-cf34-4bf4-8be9-7ecbdf534f90 req-03efd2cd-233e-4ae8-8e46-133df36e55d9 tempest-VolumesSnapshotsTestJSON-746625746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-83413aaa-97c9-4379-bfe4-fde65b4500d9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-83413aaa-97c9-4379-bfe4-fde65b4500d9.471fb23e-eab4-424d-ad07-10cd6d774bbe 1G" returned: 0 in 0.525s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:53:19 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [req-1d8f38ad-cf34-4bf4-8be9-7ecbdf534f90 req-03efd2cd-233e-4ae8-8e46-133df36e55d9 tempest-VolumesSnapshotsTestJSON-746625746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-83413aaa-97c9-4379-bfe4-fde65b4500d9 -F qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-83413aaa-97c9-4379-bfe4-fde65b4500d9.471fb23e-eab4-424d-ad07-10cd6d774bbe {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:53:19 devstack sudo[92914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-82a84106-434a-4410-9614-dc7ca7555937 Jul 13 13:53:19 devstack sudo[92914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:53:19 devstack sudo[92915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-83413aaa-97c9-4379-bfe4-fde65b4500d9 -F qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-83413aaa-97c9-4379-bfe4-fde65b4500d9.471fb23e-eab4-424d-ad07-10cd6d774bbe Jul 13 13:53:19 devstack sudo[92915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:53:19 devstack sudo[92914]: pam_unix(sudo:session): session closed for user root Jul 13 13:53:19 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-45ba49bf-bc07-4f12-a314-ecd36a0401f5 tempest-AttachVolumeNegativeTest-468633374 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-82a84106-434a-4410-9614-dc7ca7555937" returned: 0 in 0.412s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:53:19 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-45ba49bf-bc07-4f12-a314-ecd36a0401f5 tempest-AttachVolumeNegativeTest-468633374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-82a84106-434a-4410-9614-dc7ca7555937 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:53:19 devstack sudo[92924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-82a84106-434a-4410-9614-dc7ca7555937 Jul 13 13:53:19 devstack sudo[92924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:53:19 devstack sudo[92915]: pam_unix(sudo:session): session closed for user root Jul 13 13:53:19 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [req-1d8f38ad-cf34-4bf4-8be9-7ecbdf534f90 req-03efd2cd-233e-4ae8-8e46-133df36e55d9 tempest-VolumesSnapshotsTestJSON-746625746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-83413aaa-97c9-4379-bfe4-fde65b4500d9 -F qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-83413aaa-97c9-4379-bfe4-fde65b4500d9.471fb23e-eab4-424d-ad07-10cd6d774bbe" returned: 0 in 0.328s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:53:19 devstack cinder-volume[87098]: WARNING cinder.volume.drivers.remotefs [req-1d8f38ad-cf34-4bf4-8be9-7ecbdf534f90 req-03efd2cd-233e-4ae8-8e46-133df36e55d9 tempest-VolumesSnapshotsTestJSON-746625746 None] /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-83413aaa-97c9-4379-bfe4-fde65b4500d9.471fb23e-eab4-424d-ad07-10cd6d774bbe is being set with open permissions: ugo+rw Jul 13 13:53:19 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [req-1d8f38ad-cf34-4bf4-8be9-7ecbdf534f90 req-03efd2cd-233e-4ae8-8e46-133df36e55d9 tempest-VolumesSnapshotsTestJSON-746625746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-83413aaa-97c9-4379-bfe4-fde65b4500d9.471fb23e-eab4-424d-ad07-10cd6d774bbe {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:53:19 devstack sudo[92926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-83413aaa-97c9-4379-bfe4-fde65b4500d9.471fb23e-eab4-424d-ad07-10cd6d774bbe Jul 13 13:53:19 devstack sudo[92926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:53:19 devstack sudo[92924]: pam_unix(sudo:session): session closed for user root Jul 13 13:53:19 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-45ba49bf-bc07-4f12-a314-ecd36a0401f5 tempest-AttachVolumeNegativeTest-468633374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-82a84106-434a-4410-9614-dc7ca7555937" returned: 0 in 0.296s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:53:19 devstack sudo[92926]: pam_unix(sudo:session): session closed for user root Jul 13 13:53:19 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [req-1d8f38ad-cf34-4bf4-8be9-7ecbdf534f90 req-03efd2cd-233e-4ae8-8e46-133df36e55d9 tempest-VolumesSnapshotsTestJSON-746625746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-83413aaa-97c9-4379-bfe4-fde65b4500d9.471fb23e-eab4-424d-ad07-10cd6d774bbe" returned: 0 in 0.266s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:53:19 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-45ba49bf-bc07-4f12-a314-ecd36a0401f5 tempest-AttachVolumeNegativeTest-468633374 None] Lock "cinder-quobyte-82a84106-434a-4410-9614-dc7ca7555937" released by "delete_volume" :: held 0.763s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 13:53:19 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [req-1d8f38ad-cf34-4bf4-8be9-7ecbdf534f90 req-03efd2cd-233e-4ae8-8e46-133df36e55d9 tempest-VolumesSnapshotsTestJSON-746625746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-83413aaa-97c9-4379-bfe4-fde65b4500d9.info {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:53:19 devstack sudo[92930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-83413aaa-97c9-4379-bfe4-fde65b4500d9.info Jul 13 13:53:19 devstack sudo[92930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:53:19 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-45ba49bf-bc07-4f12-a314-ecd36a0401f5 tempest-AttachVolumeNegativeTest-468633374 None] Created reservations ['482ad5bc-122e-464c-9f72-a3607f25f526', 'f1946283-72a0-454a-8d33-e3ca6946c035', 'ba4c0a0e-454c-4e97-8fc9-46777368382f', '83f97e63-1335-4a96-aad4-ff754ac1db2f'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 13:53:19 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-45ba49bf-bc07-4f12-a314-ecd36a0401f5 tempest-AttachVolumeNegativeTest-468633374 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:53:19 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-45ba49bf-bc07-4f12-a314-ecd36a0401f5 tempest-AttachVolumeNegativeTest-468633374 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:53:19 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-45ba49bf-bc07-4f12-a314-ecd36a0401f5 tempest-AttachVolumeNegativeTest-468633374 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 13:53:19 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-45ba49bf-bc07-4f12-a314-ecd36a0401f5 tempest-AttachVolumeNegativeTest-468633374 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 13:53:19 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-45ba49bf-bc07-4f12-a314-ecd36a0401f5 tempest-AttachVolumeNegativeTest-468633374 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:53:19 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-45ba49bf-bc07-4f12-a314-ecd36a0401f5 tempest-AttachVolumeNegativeTest-468633374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:53:20 devstack sudo[92932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 Jul 13 13:53:20 devstack sudo[92932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:53:20 devstack sudo[92930]: pam_unix(sudo:session): session closed for user root Jul 13 13:53:20 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [req-1d8f38ad-cf34-4bf4-8be9-7ecbdf534f90 req-03efd2cd-233e-4ae8-8e46-133df36e55d9 tempest-VolumesSnapshotsTestJSON-746625746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-83413aaa-97c9-4379-bfe4-fde65b4500d9.info" returned: 0 in 0.312s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:53:20 devstack cinder-volume[87098]: WARNING cinder.volume.drivers.remotefs [req-1d8f38ad-cf34-4bf4-8be9-7ecbdf534f90 req-03efd2cd-233e-4ae8-8e46-133df36e55d9 tempest-VolumesSnapshotsTestJSON-746625746 None] /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-83413aaa-97c9-4379-bfe4-fde65b4500d9.info is being set with open permissions: ugo+rw Jul 13 13:53:20 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [req-1d8f38ad-cf34-4bf4-8be9-7ecbdf534f90 req-03efd2cd-233e-4ae8-8e46-133df36e55d9 tempest-VolumesSnapshotsTestJSON-746625746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-83413aaa-97c9-4379-bfe4-fde65b4500d9.info {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:53:20 devstack sudo[92935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-83413aaa-97c9-4379-bfe4-fde65b4500d9.info Jul 13 13:53:20 devstack sudo[92935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:53:20 devstack sudo[92932]: pam_unix(sudo:session): session closed for user root Jul 13 13:53:20 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-45ba49bf-bc07-4f12-a314-ecd36a0401f5 tempest-AttachVolumeNegativeTest-468633374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78" returned: 0 in 0.326s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:53:20 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-45ba49bf-bc07-4f12-a314-ecd36a0401f5 tempest-AttachVolumeNegativeTest-468633374 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 13:53:20 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-45ba49bf-bc07-4f12-a314-ecd36a0401f5 tempest-AttachVolumeNegativeTest-468633374 None] Deleted volume successfully. Jul 13 13:53:20 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-45ba49bf-bc07-4f12-a314-ecd36a0401f5 tempest-AttachVolumeNegativeTest-468633374 None] Lock "cinder-82a84106-434a-4410-9614-dc7ca7555937-delete_volume" released by "delete_volume" :: held 1.369s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 13:53:20 devstack sudo[92935]: pam_unix(sudo:session): session closed for user root Jul 13 13:53:20 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [req-1d8f38ad-cf34-4bf4-8be9-7ecbdf534f90 req-03efd2cd-233e-4ae8-8e46-133df36e55d9 tempest-VolumesSnapshotsTestJSON-746625746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-83413aaa-97c9-4379-bfe4-fde65b4500d9.info" returned: 0 in 0.279s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:53:20 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [req-1d8f38ad-cf34-4bf4-8be9-7ecbdf534f90 req-03efd2cd-233e-4ae8-8e46-133df36e55d9 tempest-VolumesSnapshotsTestJSON-746625746 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.334s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:53:20 devstack cinder-volume[87098]: INFO cinder.volume.manager [req-1d8f38ad-cf34-4bf4-8be9-7ecbdf534f90 req-03efd2cd-233e-4ae8-8e46-133df36e55d9 tempest-VolumesSnapshotsTestJSON-746625746 None] Create snapshot completed successfully Jul 13 13:53:21 devstack cinder-volume[87098]: DEBUG cinder.coordination [req-245b83c9-72ce-4fb3-9cee-c0054611bc55 req-ccff419a-c093-4889-9f34-9045d7099c95 tempest-VolumesSnapshotsTestJSON-746625746 None] Acquiring lock "cinder-471fb23e-eab4-424d-ad07-10cd6d774bbe-delete_snapshot" by "delete_snapshot" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 13:53:21 devstack cinder-volume[87098]: DEBUG cinder.coordination [req-245b83c9-72ce-4fb3-9cee-c0054611bc55 req-ccff419a-c093-4889-9f34-9045d7099c95 tempest-VolumesSnapshotsTestJSON-746625746 None] Lock "cinder-471fb23e-eab4-424d-ad07-10cd6d774bbe-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 13:53:21 devstack cinder-volume[87098]: DEBUG cinder.coordination [req-245b83c9-72ce-4fb3-9cee-c0054611bc55 req-ccff419a-c093-4889-9f34-9045d7099c95 tempest-VolumesSnapshotsTestJSON-746625746 None] Acquiring lock "cinder-quobyte-83413aaa-97c9-4379-bfe4-fde65b4500d9" by "delete_snapshot" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 13:53:21 devstack cinder-volume[87098]: DEBUG cinder.coordination [req-245b83c9-72ce-4fb3-9cee-c0054611bc55 req-ccff419a-c093-4889-9f34-9045d7099c95 tempest-VolumesSnapshotsTestJSON-746625746 None] Lock "cinder-quobyte-83413aaa-97c9-4379-bfe4-fde65b4500d9" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 13:53:21 devstack cinder-volume[87098]: DEBUG cinder.coordination [req-245b83c9-72ce-4fb3-9cee-c0054611bc55 req-ccff419a-c093-4889-9f34-9045d7099c95 tempest-VolumesSnapshotsTestJSON-746625746 None] Acquiring lock "cinder-quobyte-471fb23e-eab4-424d-ad07-10cd6d774bbe" by "_delete_snapshot" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 13:53:21 devstack cinder-volume[87098]: DEBUG cinder.coordination [req-245b83c9-72ce-4fb3-9cee-c0054611bc55 req-ccff419a-c093-4889-9f34-9045d7099c95 tempest-VolumesSnapshotsTestJSON-746625746 None] Lock "cinder-quobyte-471fb23e-eab4-424d-ad07-10cd6d774bbe" acquired by "_delete_snapshot" :: waited 0.039s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 13:53:21 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [req-245b83c9-72ce-4fb3-9cee-c0054611bc55 req-ccff419a-c093-4889-9f34-9045d7099c95 tempest-VolumesSnapshotsTestJSON-746625746 None] Deleting offline snapshot 471fb23e-eab4-424d-ad07-10cd6d774bbe of volume 83413aaa-97c9-4379-bfe4-fde65b4500d9 {{(pid=87098) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 13 13:53:21 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [req-245b83c9-72ce-4fb3-9cee-c0054611bc55 req-ccff419a-c093-4889-9f34-9045d7099c95 tempest-VolumesSnapshotsTestJSON-746625746 None] snapshot_file for this snap is: volume-83413aaa-97c9-4379-bfe4-fde65b4500d9.471fb23e-eab4-424d-ad07-10cd6d774bbe {{(pid=87098) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 13 13:53:21 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[3eb0d36b-3d7a-4745-820a-9a5baa602d26]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 13:53:21 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [req-245b83c9-72ce-4fb3-9cee-c0054611bc55 req-ccff419a-c093-4889-9f34-9045d7099c95 tempest-VolumesSnapshotsTestJSON-746625746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-83413aaa-97c9-4379-bfe4-fde65b4500d9.471fb23e-eab4-424d-ad07-10cd6d774bbe {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:53:21 devstack sudo[92940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-83413aaa-97c9-4379-bfe4-fde65b4500d9.471fb23e-eab4-424d-ad07-10cd6d774bbe Jul 13 13:53:21 devstack sudo[92940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:53:22 devstack sudo[92940]: pam_unix(sudo:session): session closed for user root Jul 13 13:53:22 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [req-245b83c9-72ce-4fb3-9cee-c0054611bc55 req-ccff419a-c093-4889-9f34-9045d7099c95 tempest-VolumesSnapshotsTestJSON-746625746 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-83413aaa-97c9-4379-bfe4-fde65b4500d9.471fb23e-eab4-424d-ad07-10cd6d774bbe" returned: 0 in 0.417s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:53:22 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [req-245b83c9-72ce-4fb3-9cee-c0054611bc55 req-ccff419a-c093-4889-9f34-9045d7099c95 tempest-VolumesSnapshotsTestJSON-746625746 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-83413aaa-97c9-4379-bfe4-fde65b4500d9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87098) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 13 13:53:22 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f8a7fc9-a9aa-4c64-815a-e4cd4942447c]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 13:53:22 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [req-245b83c9-72ce-4fb3-9cee-c0054611bc55 req-ccff419a-c093-4889-9f34-9045d7099c95 tempest-VolumesSnapshotsTestJSON-746625746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-83413aaa-97c9-4379-bfe4-fde65b4500d9 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:53:22 devstack sudo[92945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-83413aaa-97c9-4379-bfe4-fde65b4500d9 Jul 13 13:53:22 devstack sudo[92945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:53:22 devstack sudo[92945]: pam_unix(sudo:session): session closed for user root Jul 13 13:53:22 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [req-245b83c9-72ce-4fb3-9cee-c0054611bc55 req-ccff419a-c093-4889-9f34-9045d7099c95 tempest-VolumesSnapshotsTestJSON-746625746 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-83413aaa-97c9-4379-bfe4-fde65b4500d9" returned: 0 in 0.423s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:53:22 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [req-245b83c9-72ce-4fb3-9cee-c0054611bc55 req-ccff419a-c093-4889-9f34-9045d7099c95 tempest-VolumesSnapshotsTestJSON-746625746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-83413aaa-97c9-4379-bfe4-fde65b4500d9.471fb23e-eab4-424d-ad07-10cd6d774bbe {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:53:22 devstack sudo[92950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-83413aaa-97c9-4379-bfe4-fde65b4500d9.471fb23e-eab4-424d-ad07-10cd6d774bbe Jul 13 13:53:22 devstack sudo[92950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:53:23 devstack sudo[92950]: pam_unix(sudo:session): session closed for user root Jul 13 13:53:23 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [req-245b83c9-72ce-4fb3-9cee-c0054611bc55 req-ccff419a-c093-4889-9f34-9045d7099c95 tempest-VolumesSnapshotsTestJSON-746625746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-83413aaa-97c9-4379-bfe4-fde65b4500d9.471fb23e-eab4-424d-ad07-10cd6d774bbe" returned: 0 in 0.444s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:53:23 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [req-245b83c9-72ce-4fb3-9cee-c0054611bc55 req-ccff419a-c093-4889-9f34-9045d7099c95 tempest-VolumesSnapshotsTestJSON-746625746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-83413aaa-97c9-4379-bfe4-fde65b4500d9.471fb23e-eab4-424d-ad07-10cd6d774bbe {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:53:23 devstack sudo[92955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-83413aaa-97c9-4379-bfe4-fde65b4500d9.471fb23e-eab4-424d-ad07-10cd6d774bbe Jul 13 13:53:23 devstack sudo[92955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:53:23 devstack sudo[92955]: pam_unix(sudo:session): session closed for user root Jul 13 13:53:23 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [req-245b83c9-72ce-4fb3-9cee-c0054611bc55 req-ccff419a-c093-4889-9f34-9045d7099c95 tempest-VolumesSnapshotsTestJSON-746625746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-83413aaa-97c9-4379-bfe4-fde65b4500d9.471fb23e-eab4-424d-ad07-10cd6d774bbe" returned: 0 in 0.296s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:53:23 devstack cinder-volume[87098]: DEBUG cinder.coordination [req-245b83c9-72ce-4fb3-9cee-c0054611bc55 req-ccff419a-c093-4889-9f34-9045d7099c95 tempest-VolumesSnapshotsTestJSON-746625746 None] Lock "cinder-quobyte-471fb23e-eab4-424d-ad07-10cd6d774bbe" released by "_delete_snapshot" :: held 1.739s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 13:53:23 devstack cinder-volume[87098]: DEBUG cinder.coordination [req-245b83c9-72ce-4fb3-9cee-c0054611bc55 req-ccff419a-c093-4889-9f34-9045d7099c95 tempest-VolumesSnapshotsTestJSON-746625746 None] Lock "cinder-quobyte-83413aaa-97c9-4379-bfe4-fde65b4500d9" released by "delete_snapshot" :: held 1.788s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 13:53:23 devstack cinder-volume[87098]: DEBUG cinder.quota [req-245b83c9-72ce-4fb3-9cee-c0054611bc55 req-ccff419a-c093-4889-9f34-9045d7099c95 tempest-VolumesSnapshotsTestJSON-746625746 None] Created reservations ['20f04cad-1ddf-483d-98af-94c0b4ecff08', '2fd64ee4-78dc-4d84-bd00-956147f0226a', '82bbb9e9-18ba-4a7c-b786-440ae1fd6892', '45860c58-e370-4939-9015-6ee2d5ec90ec'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 13:53:23 devstack cinder-volume[87098]: INFO cinder.volume.manager [req-245b83c9-72ce-4fb3-9cee-c0054611bc55 req-ccff419a-c093-4889-9f34-9045d7099c95 tempest-VolumesSnapshotsTestJSON-746625746 None] Delete snapshot completed successfully. Jul 13 13:53:23 devstack cinder-volume[87098]: DEBUG cinder.coordination [req-245b83c9-72ce-4fb3-9cee-c0054611bc55 req-ccff419a-c093-4889-9f34-9045d7099c95 tempest-VolumesSnapshotsTestJSON-746625746 None] Lock "cinder-471fb23e-eab4-424d-ad07-10cd6d774bbe-delete_snapshot" released by "delete_snapshot" :: held 1.980s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 13:53:23 devstack cinder-volume[87098]: DEBUG cinder.coordination [req-716d101a-ef16-4627-bdab-61cbb3f91269 req-4dd4b37c-6af6-4c4c-8962-6229c75cdb24 tempest-VolumesSnapshotsTestJSON-746625746 None] Acquiring lock "cinder-83413aaa-97c9-4379-bfe4-fde65b4500d9-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 13:53:24 devstack cinder-volume[87098]: DEBUG cinder.coordination [req-716d101a-ef16-4627-bdab-61cbb3f91269 req-4dd4b37c-6af6-4c4c-8962-6229c75cdb24 tempest-VolumesSnapshotsTestJSON-746625746 None] Lock "cinder-83413aaa-97c9-4379-bfe4-fde65b4500d9-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 13:53:24 devstack cinder-volume[87098]: DEBUG cinder.coordination [req-716d101a-ef16-4627-bdab-61cbb3f91269 req-4dd4b37c-6af6-4c4c-8962-6229c75cdb24 tempest-VolumesSnapshotsTestJSON-746625746 None] Acquiring lock "cinder-quobyte-83413aaa-97c9-4379-bfe4-fde65b4500d9" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 13:53:24 devstack cinder-volume[87098]: DEBUG cinder.coordination [req-716d101a-ef16-4627-bdab-61cbb3f91269 req-4dd4b37c-6af6-4c4c-8962-6229c75cdb24 tempest-VolumesSnapshotsTestJSON-746625746 None] Lock "cinder-quobyte-83413aaa-97c9-4379-bfe4-fde65b4500d9" acquired by "delete_volume" :: waited 0.015s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 13:53:24 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[936cd9db-1c61-43f2-a4ef-dd6beec7d747]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 13:53:24 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [req-716d101a-ef16-4627-bdab-61cbb3f91269 req-4dd4b37c-6af6-4c4c-8962-6229c75cdb24 tempest-VolumesSnapshotsTestJSON-746625746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-83413aaa-97c9-4379-bfe4-fde65b4500d9 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:53:24 devstack sudo[92959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-83413aaa-97c9-4379-bfe4-fde65b4500d9 Jul 13 13:53:24 devstack sudo[92959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:53:24 devstack sudo[92959]: pam_unix(sudo:session): session closed for user root Jul 13 13:53:24 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [req-716d101a-ef16-4627-bdab-61cbb3f91269 req-4dd4b37c-6af6-4c4c-8962-6229c75cdb24 tempest-VolumesSnapshotsTestJSON-746625746 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-83413aaa-97c9-4379-bfe4-fde65b4500d9" returned: 0 in 0.512s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:53:24 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [req-716d101a-ef16-4627-bdab-61cbb3f91269 req-4dd4b37c-6af6-4c4c-8962-6229c75cdb24 tempest-VolumesSnapshotsTestJSON-746625746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-83413aaa-97c9-4379-bfe4-fde65b4500d9 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:53:24 devstack sudo[92964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-83413aaa-97c9-4379-bfe4-fde65b4500d9 Jul 13 13:53:24 devstack sudo[92964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:53:25 devstack sudo[92964]: pam_unix(sudo:session): session closed for user root Jul 13 13:53:25 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [req-716d101a-ef16-4627-bdab-61cbb3f91269 req-4dd4b37c-6af6-4c4c-8962-6229c75cdb24 tempest-VolumesSnapshotsTestJSON-746625746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-83413aaa-97c9-4379-bfe4-fde65b4500d9" returned: 0 in 0.427s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:53:25 devstack cinder-volume[87098]: DEBUG cinder.coordination [req-716d101a-ef16-4627-bdab-61cbb3f91269 req-4dd4b37c-6af6-4c4c-8962-6229c75cdb24 tempest-VolumesSnapshotsTestJSON-746625746 None] Lock "cinder-quobyte-83413aaa-97c9-4379-bfe4-fde65b4500d9" released by "delete_volume" :: held 1.105s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 13:53:25 devstack cinder-volume[87098]: DEBUG cinder.quota [req-716d101a-ef16-4627-bdab-61cbb3f91269 req-4dd4b37c-6af6-4c4c-8962-6229c75cdb24 tempest-VolumesSnapshotsTestJSON-746625746 None] Created reservations ['ee0013a0-b5ae-4e04-be2a-bdc58cc72bcd', 'ae0266dd-fdbe-4e20-b04c-8972bb3e13a4', '6061985f-a8c7-4016-b408-8ffb3b07292a', 'e1934350-0576-4915-8d22-e72a31ef30fe'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 13:53:25 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [req-716d101a-ef16-4627-bdab-61cbb3f91269 req-4dd4b37c-6af6-4c4c-8962-6229c75cdb24 tempest-VolumesSnapshotsTestJSON-746625746 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:53:25 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [req-716d101a-ef16-4627-bdab-61cbb3f91269 req-4dd4b37c-6af6-4c4c-8962-6229c75cdb24 tempest-VolumesSnapshotsTestJSON-746625746 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:53:25 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [req-716d101a-ef16-4627-bdab-61cbb3f91269 req-4dd4b37c-6af6-4c4c-8962-6229c75cdb24 tempest-VolumesSnapshotsTestJSON-746625746 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 13:53:25 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [req-716d101a-ef16-4627-bdab-61cbb3f91269 req-4dd4b37c-6af6-4c4c-8962-6229c75cdb24 tempest-VolumesSnapshotsTestJSON-746625746 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 13:53:25 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [req-716d101a-ef16-4627-bdab-61cbb3f91269 req-4dd4b37c-6af6-4c4c-8962-6229c75cdb24 tempest-VolumesSnapshotsTestJSON-746625746 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:53:25 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [req-716d101a-ef16-4627-bdab-61cbb3f91269 req-4dd4b37c-6af6-4c4c-8962-6229c75cdb24 tempest-VolumesSnapshotsTestJSON-746625746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:53:25 devstack sudo[92967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 Jul 13 13:53:25 devstack sudo[92967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:53:25 devstack sudo[92967]: pam_unix(sudo:session): session closed for user root Jul 13 13:53:25 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [req-716d101a-ef16-4627-bdab-61cbb3f91269 req-4dd4b37c-6af6-4c4c-8962-6229c75cdb24 tempest-VolumesSnapshotsTestJSON-746625746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78" returned: 0 in 0.318s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:53:25 devstack cinder-volume[87098]: DEBUG cinder.manager [req-716d101a-ef16-4627-bdab-61cbb3f91269 req-4dd4b37c-6af6-4c4c-8962-6229c75cdb24 tempest-VolumesSnapshotsTestJSON-746625746 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 13:53:25 devstack cinder-volume[87098]: INFO cinder.volume.manager [req-716d101a-ef16-4627-bdab-61cbb3f91269 req-4dd4b37c-6af6-4c4c-8962-6229c75cdb24 tempest-VolumesSnapshotsTestJSON-746625746 None] Deleted volume successfully. Jul 13 13:53:25 devstack cinder-volume[87098]: DEBUG cinder.coordination [req-716d101a-ef16-4627-bdab-61cbb3f91269 req-4dd4b37c-6af6-4c4c-8962-6229c75cdb24 tempest-VolumesSnapshotsTestJSON-746625746 None] Lock "cinder-83413aaa-97c9-4379-bfe4-fde65b4500d9-delete_volume" released by "delete_volume" :: held 1.758s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 13:53:27 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-01ac5135-c6a7-4b66-aa66-ec7d27e0066c tempest-VolumesDeleteCascade-447158706 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 13:53:27 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-01ac5135-c6a7-4b66-aa66-ec7d27e0066c tempest-VolumesDeleteCascade-447158706 None] Flow 'volume_create_manager' (977ee4b5-9169-49ff-b74b-20e1dcafad41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 13:53:27 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-01ac5135-c6a7-4b66-aa66-ec7d27e0066c tempest-VolumesDeleteCascade-447158706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7892166-8365-4c3d-9e9c-01b085d51955) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:53:27 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-01ac5135-c6a7-4b66-aa66-ec7d27e0066c tempest-VolumesDeleteCascade-447158706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7892166-8365-4c3d-9e9c-01b085d51955) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T11:53:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1349004684',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d6acaa8-0e67-4582-9dd0-70d8aabadfcf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b76618fc355f47ae9294b7d4418a265c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T11:53:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T11:53:27Z,use_quota=True,user_id='c8b53fcce91246de98b34c2f5b885ade',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1147de8b-623b-426c-a13d-7fc824a80f67),volume_type_id=1147de8b-623b-426c-a13d-7fc824a80f67)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:53:27 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-01ac5135-c6a7-4b66-aa66-ec7d27e0066c tempest-VolumesDeleteCascade-447158706 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4d3b009-a2b9-456c-88fa-60368ffcd879) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:53:27 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-01ac5135-c6a7-4b66-aa66-ec7d27e0066c tempest-VolumesDeleteCascade-447158706 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4d3b009-a2b9-456c-88fa-60368ffcd879) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:53:27 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-01ac5135-c6a7-4b66-aa66-ec7d27e0066c tempest-VolumesDeleteCascade-447158706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8bc5ef97-5128-4c49-adc2-b7de1e62f503) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:53:27 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-01ac5135-c6a7-4b66-aa66-ec7d27e0066c tempest-VolumesDeleteCascade-447158706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8bc5ef97-5128-4c49-adc2-b7de1e62f503) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4d6acaa8-0e67-4582-9dd0-70d8aabadfcf', 'volume_name': 'volume-4d6acaa8-0e67-4582-9dd0-70d8aabadfcf', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:53:27 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-01ac5135-c6a7-4b66-aa66-ec7d27e0066c tempest-VolumesDeleteCascade-447158706 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c68f56c9-9285-482d-ac6a-a98b0526f7e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:53:27 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-01ac5135-c6a7-4b66-aa66-ec7d27e0066c tempest-VolumesDeleteCascade-447158706 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c68f56c9-9285-482d-ac6a-a98b0526f7e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:53:27 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-01ac5135-c6a7-4b66-aa66-ec7d27e0066c tempest-VolumesDeleteCascade-447158706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2ff9fa0-5c44-40be-910c-a1eec00c407b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:53:27 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-01ac5135-c6a7-4b66-aa66-ec7d27e0066c tempest-VolumesDeleteCascade-447158706 None] Volume 4d6acaa8-0e67-4582-9dd0-70d8aabadfcf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4d6acaa8-0e67-4582-9dd0-70d8aabadfcf', 'volume_size': 1} Jul 13 13:53:27 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-01ac5135-c6a7-4b66-aa66-ec7d27e0066c tempest-VolumesDeleteCascade-447158706 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:53:27 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-01ac5135-c6a7-4b66-aa66-ec7d27e0066c tempest-VolumesDeleteCascade-447158706 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:53:27 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-01ac5135-c6a7-4b66-aa66-ec7d27e0066c tempest-VolumesDeleteCascade-447158706 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T11:53:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1349004684',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d6acaa8-0e67-4582-9dd0-70d8aabadfcf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b76618fc355f47ae9294b7d4418a265c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T11:53:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T11:53:27Z,use_quota=True,user_id='c8b53fcce91246de98b34c2f5b885ade',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1147de8b-623b-426c-a13d-7fc824a80f67),volume_type_id=1147de8b-623b-426c-a13d-7fc824a80f67)}" {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 13 13:53:27 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-01ac5135-c6a7-4b66-aa66-ec7d27e0066c tempest-VolumesDeleteCascade-447158706 None] Creating volume 4d6acaa8-0e67-4582-9dd0-70d8aabadfcf {{(pid=87098) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 13 13:53:27 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-01ac5135-c6a7-4b66-aa66-ec7d27e0066c tempest-VolumesDeleteCascade-447158706 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:53:27 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-01ac5135-c6a7-4b66-aa66-ec7d27e0066c tempest-VolumesDeleteCascade-447158706 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:53:27 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-01ac5135-c6a7-4b66-aa66-ec7d27e0066c tempest-VolumesDeleteCascade-447158706 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 13:53:27 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-01ac5135-c6a7-4b66-aa66-ec7d27e0066c tempest-VolumesDeleteCascade-447158706 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 13:53:27 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-01ac5135-c6a7-4b66-aa66-ec7d27e0066c tempest-VolumesDeleteCascade-447158706 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:53:27 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-01ac5135-c6a7-4b66-aa66-ec7d27e0066c tempest-VolumesDeleteCascade-447158706 None] Selected osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 13:53:27 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-01ac5135-c6a7-4b66-aa66-ec7d27e0066c tempest-VolumesDeleteCascade-447158706 None] casted to osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 Jul 13 13:53:27 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-01ac5135-c6a7-4b66-aa66-ec7d27e0066c tempest-VolumesDeleteCascade-447158706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-4d6acaa8-0e67-4582-9dd0-70d8aabadfcf 1073741824 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:53:27 devstack sudo[92985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-4d6acaa8-0e67-4582-9dd0-70d8aabadfcf 1073741824 Jul 13 13:53:27 devstack sudo[92985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:53:28 devstack sudo[92985]: pam_unix(sudo:session): session closed for user root Jul 13 13:53:28 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-01ac5135-c6a7-4b66-aa66-ec7d27e0066c tempest-VolumesDeleteCascade-447158706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-4d6acaa8-0e67-4582-9dd0-70d8aabadfcf 1073741824" returned: 0 in 0.698s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:53:28 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-01ac5135-c6a7-4b66-aa66-ec7d27e0066c tempest-VolumesDeleteCascade-447158706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-4d6acaa8-0e67-4582-9dd0-70d8aabadfcf {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:53:28 devstack sudo[93001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-4d6acaa8-0e67-4582-9dd0-70d8aabadfcf Jul 13 13:53:28 devstack sudo[93001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:53:28 devstack sudo[93001]: pam_unix(sudo:session): session closed for user root Jul 13 13:53:28 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-01ac5135-c6a7-4b66-aa66-ec7d27e0066c tempest-VolumesDeleteCascade-447158706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-4d6acaa8-0e67-4582-9dd0-70d8aabadfcf" returned: 0 in 0.384s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:53:28 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-01ac5135-c6a7-4b66-aa66-ec7d27e0066c tempest-VolumesDeleteCascade-447158706 None] <== create_volume: return (1150ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'} {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 13 13:53:28 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-01ac5135-c6a7-4b66-aa66-ec7d27e0066c tempest-VolumesDeleteCascade-447158706 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.157s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:53:28 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-01ac5135-c6a7-4b66-aa66-ec7d27e0066c tempest-VolumesDeleteCascade-447158706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2ff9fa0-5c44-40be-910c-a1eec00c407b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4d6acaa8-0e67-4582-9dd0-70d8aabadfcf', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:53:28 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-01ac5135-c6a7-4b66-aa66-ec7d27e0066c tempest-VolumesDeleteCascade-447158706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f913eb88-eb3d-4e59-a734-bbac3b94af16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:53:28 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-01ac5135-c6a7-4b66-aa66-ec7d27e0066c tempest-VolumesDeleteCascade-447158706 None] Volume volume-4d6acaa8-0e67-4582-9dd0-70d8aabadfcf (4d6acaa8-0e67-4582-9dd0-70d8aabadfcf): created successfully Jul 13 13:53:28 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-01ac5135-c6a7-4b66-aa66-ec7d27e0066c tempest-VolumesDeleteCascade-447158706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f913eb88-eb3d-4e59-a734-bbac3b94af16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:53:28 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-01ac5135-c6a7-4b66-aa66-ec7d27e0066c tempest-VolumesDeleteCascade-447158706 None] Flow 'volume_create_manager' (977ee4b5-9169-49ff-b74b-20e1dcafad41) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 13:53:28 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-01ac5135-c6a7-4b66-aa66-ec7d27e0066c tempest-VolumesDeleteCascade-447158706 None] Created volume successfully. Jul 13 13:53:29 devstack cinder-volume[87098]: DEBUG oslo_service.periodic_task [None req-727a1692-ea28-4a77-b327-0d94e8f01efb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87098) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 13 13:53:29 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-727a1692-ea28-4a77-b327-0d94e8f01efb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:53:29 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-727a1692-ea28-4a77-b327-0d94e8f01efb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:53:29 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-727a1692-ea28-4a77-b327-0d94e8f01efb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 13:53:29 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-727a1692-ea28-4a77-b327-0d94e8f01efb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 13:53:29 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-727a1692-ea28-4a77-b327-0d94e8f01efb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:53:29 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-727a1692-ea28-4a77-b327-0d94e8f01efb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:53:29 devstack sudo[93007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 Jul 13 13:53:29 devstack sudo[93007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:53:29 devstack sudo[93007]: pam_unix(sudo:session): session closed for user root Jul 13 13:53:29 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-727a1692-ea28-4a77-b327-0d94e8f01efb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78" returned: 0 in 0.413s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:53:29 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-727a1692-ea28-4a77-b327-0d94e8f01efb None None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 13:53:29 devstack cinder-volume[87098]: DEBUG oslo_service.periodic_task [None req-727a1692-ea28-4a77-b327-0d94e8f01efb None None] Running periodic task VolumeManager._thread_info {{(pid=87098) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 13 13:53:29 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-727a1692-ea28-4a77-b327-0d94e8f01efb None None] thread count: 8 {{(pid=87098) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 13 13:53:29 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-727a1692-ea28-4a77-b327-0d94e8f01efb None None] thread info: [<_MainThread(MainThread, started 127988054597760)>, , , , , , , ] {{(pid=87098) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 13 13:53:29 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-377ba7a3-f85d-4f7a-ae5c-a1e0f360f2b1 tempest-VolumesDeleteCascade-447158706 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:53:29 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-377ba7a3-f85d-4f7a-ae5c-a1e0f360f2b1 tempest-VolumesDeleteCascade-447158706 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:53:29 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-377ba7a3-f85d-4f7a-ae5c-a1e0f360f2b1 tempest-VolumesDeleteCascade-447158706 None] Creating offline snapshot 5021b08e-f651-4f22-8eb5-7d2f1f8cf3cd of volume 4d6acaa8-0e67-4582-9dd0-70d8aabadfcf {{(pid=87098) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 13 13:53:29 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e23cdf3-e7a9-4b46-b19a-d8bea5a36ce0]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 13:53:29 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-377ba7a3-f85d-4f7a-ae5c-a1e0f360f2b1 tempest-VolumesDeleteCascade-447158706 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-4d6acaa8-0e67-4582-9dd0-70d8aabadfcf {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:53:30 devstack sudo[93010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-4d6acaa8-0e67-4582-9dd0-70d8aabadfcf Jul 13 13:53:30 devstack sudo[93010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:53:30 devstack sudo[93010]: pam_unix(sudo:session): session closed for user root Jul 13 13:53:30 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-377ba7a3-f85d-4f7a-ae5c-a1e0f360f2b1 tempest-VolumesDeleteCascade-447158706 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-4d6acaa8-0e67-4582-9dd0-70d8aabadfcf" returned: 0 in 0.460s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:53:30 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-377ba7a3-f85d-4f7a-ae5c-a1e0f360f2b1 tempest-VolumesDeleteCascade-447158706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-4d6acaa8-0e67-4582-9dd0-70d8aabadfcf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-4d6acaa8-0e67-4582-9dd0-70d8aabadfcf.5021b08e-f651-4f22-8eb5-7d2f1f8cf3cd 1G {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:53:30 devstack sudo[93015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-4d6acaa8-0e67-4582-9dd0-70d8aabadfcf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-4d6acaa8-0e67-4582-9dd0-70d8aabadfcf.5021b08e-f651-4f22-8eb5-7d2f1f8cf3cd 1G Jul 13 13:53:30 devstack sudo[93015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:53:31 devstack sudo[93015]: pam_unix(sudo:session): session closed for user root Jul 13 13:53:31 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-377ba7a3-f85d-4f7a-ae5c-a1e0f360f2b1 tempest-VolumesDeleteCascade-447158706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-4d6acaa8-0e67-4582-9dd0-70d8aabadfcf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-4d6acaa8-0e67-4582-9dd0-70d8aabadfcf.5021b08e-f651-4f22-8eb5-7d2f1f8cf3cd 1G" returned: 0 in 0.717s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:53:31 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-377ba7a3-f85d-4f7a-ae5c-a1e0f360f2b1 tempest-VolumesDeleteCascade-447158706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4d6acaa8-0e67-4582-9dd0-70d8aabadfcf -F qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-4d6acaa8-0e67-4582-9dd0-70d8aabadfcf.5021b08e-f651-4f22-8eb5-7d2f1f8cf3cd {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:53:31 devstack sudo[93021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4d6acaa8-0e67-4582-9dd0-70d8aabadfcf -F qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-4d6acaa8-0e67-4582-9dd0-70d8aabadfcf.5021b08e-f651-4f22-8eb5-7d2f1f8cf3cd Jul 13 13:53:31 devstack sudo[93021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:53:31 devstack sudo[93021]: pam_unix(sudo:session): session closed for user root Jul 13 13:53:31 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-377ba7a3-f85d-4f7a-ae5c-a1e0f360f2b1 tempest-VolumesDeleteCascade-447158706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4d6acaa8-0e67-4582-9dd0-70d8aabadfcf -F qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-4d6acaa8-0e67-4582-9dd0-70d8aabadfcf.5021b08e-f651-4f22-8eb5-7d2f1f8cf3cd" returned: 0 in 0.358s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:53:31 devstack cinder-volume[87098]: WARNING cinder.volume.drivers.remotefs [None req-377ba7a3-f85d-4f7a-ae5c-a1e0f360f2b1 tempest-VolumesDeleteCascade-447158706 None] /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-4d6acaa8-0e67-4582-9dd0-70d8aabadfcf.5021b08e-f651-4f22-8eb5-7d2f1f8cf3cd is being set with open permissions: ugo+rw Jul 13 13:53:31 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-377ba7a3-f85d-4f7a-ae5c-a1e0f360f2b1 tempest-VolumesDeleteCascade-447158706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-4d6acaa8-0e67-4582-9dd0-70d8aabadfcf.5021b08e-f651-4f22-8eb5-7d2f1f8cf3cd {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:53:31 devstack sudo[93027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-4d6acaa8-0e67-4582-9dd0-70d8aabadfcf.5021b08e-f651-4f22-8eb5-7d2f1f8cf3cd Jul 13 13:53:31 devstack sudo[93027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:53:31 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-32e46ed6-fc8c-41c4-a16b-9aa24a9f03e4 tempest-AttachVolumeShelveTestJSON-1995934202 None] Acquiring lock "cinder-1e08e8da-b20c-48db-a2fa-475a66c73eeb-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 13:53:31 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-32e46ed6-fc8c-41c4-a16b-9aa24a9f03e4 tempest-AttachVolumeShelveTestJSON-1995934202 None] Lock "cinder-1e08e8da-b20c-48db-a2fa-475a66c73eeb-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 13:53:31 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-32e46ed6-fc8c-41c4-a16b-9aa24a9f03e4 tempest-AttachVolumeShelveTestJSON-1995934202 None] Acquiring lock "cinder-quobyte-1e08e8da-b20c-48db-a2fa-475a66c73eeb" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 13:53:31 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-32e46ed6-fc8c-41c4-a16b-9aa24a9f03e4 tempest-AttachVolumeShelveTestJSON-1995934202 None] Lock "cinder-quobyte-1e08e8da-b20c-48db-a2fa-475a66c73eeb" acquired by "delete_volume" :: waited 0.031s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 13:53:31 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[62f3ad9a-e029-4b1b-ad4a-8620d75089af]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 13:53:31 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-32e46ed6-fc8c-41c4-a16b-9aa24a9f03e4 tempest-AttachVolumeShelveTestJSON-1995934202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-1e08e8da-b20c-48db-a2fa-475a66c73eeb {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:53:31 devstack sudo[93027]: pam_unix(sudo:session): session closed for user root Jul 13 13:53:31 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-377ba7a3-f85d-4f7a-ae5c-a1e0f360f2b1 tempest-VolumesDeleteCascade-447158706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-4d6acaa8-0e67-4582-9dd0-70d8aabadfcf.5021b08e-f651-4f22-8eb5-7d2f1f8cf3cd" returned: 0 in 0.333s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:53:31 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-377ba7a3-f85d-4f7a-ae5c-a1e0f360f2b1 tempest-VolumesDeleteCascade-447158706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-4d6acaa8-0e67-4582-9dd0-70d8aabadfcf.info {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:53:31 devstack sudo[93029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-1e08e8da-b20c-48db-a2fa-475a66c73eeb Jul 13 13:53:31 devstack sudo[93029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:53:31 devstack sudo[93031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-4d6acaa8-0e67-4582-9dd0-70d8aabadfcf.info Jul 13 13:53:31 devstack sudo[93031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:53:32 devstack sudo[93031]: pam_unix(sudo:session): session closed for user root Jul 13 13:53:32 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-377ba7a3-f85d-4f7a-ae5c-a1e0f360f2b1 tempest-VolumesDeleteCascade-447158706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-4d6acaa8-0e67-4582-9dd0-70d8aabadfcf.info" returned: 0 in 0.311s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:53:32 devstack cinder-volume[87098]: WARNING cinder.volume.drivers.remotefs [None req-377ba7a3-f85d-4f7a-ae5c-a1e0f360f2b1 tempest-VolumesDeleteCascade-447158706 None] /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-4d6acaa8-0e67-4582-9dd0-70d8aabadfcf.info is being set with open permissions: ugo+rw Jul 13 13:53:32 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-377ba7a3-f85d-4f7a-ae5c-a1e0f360f2b1 tempest-VolumesDeleteCascade-447158706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-4d6acaa8-0e67-4582-9dd0-70d8aabadfcf.info {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:53:32 devstack sudo[93029]: pam_unix(sudo:session): session closed for user root Jul 13 13:53:32 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-32e46ed6-fc8c-41c4-a16b-9aa24a9f03e4 tempest-AttachVolumeShelveTestJSON-1995934202 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-1e08e8da-b20c-48db-a2fa-475a66c73eeb" returned: 0 in 0.447s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:53:32 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-32e46ed6-fc8c-41c4-a16b-9aa24a9f03e4 tempest-AttachVolumeShelveTestJSON-1995934202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-1e08e8da-b20c-48db-a2fa-475a66c73eeb {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:53:32 devstack sudo[93039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-4d6acaa8-0e67-4582-9dd0-70d8aabadfcf.info Jul 13 13:53:32 devstack sudo[93039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:53:32 devstack sudo[93041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-1e08e8da-b20c-48db-a2fa-475a66c73eeb Jul 13 13:53:32 devstack sudo[93041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:53:32 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-b31464b1-c017-47fc-b834-05baae2aa1bf tempest-BackendsCapabilitiesAdminTestsJSON-894213969 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7577095031738, 'free_capacity_gb': 1775.7577095031738, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87098) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 13 13:53:32 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-b2f5b0a2-87d9-4b62-bfef-8bcfa74b0ee2 tempest-BackendsCapabilitiesAdminTestsJSON-894213969 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7577095031738, 'free_capacity_gb': 1775.7577095031738, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87098) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 13 13:53:32 devstack sudo[93039]: pam_unix(sudo:session): session closed for user root Jul 13 13:53:32 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-377ba7a3-f85d-4f7a-ae5c-a1e0f360f2b1 tempest-VolumesDeleteCascade-447158706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-4d6acaa8-0e67-4582-9dd0-70d8aabadfcf.info" returned: 0 in 0.313s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:53:32 devstack sudo[93041]: pam_unix(sudo:session): session closed for user root Jul 13 13:53:32 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-377ba7a3-f85d-4f7a-ae5c-a1e0f360f2b1 tempest-VolumesDeleteCascade-447158706 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.617s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:53:32 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-32e46ed6-fc8c-41c4-a16b-9aa24a9f03e4 tempest-AttachVolumeShelveTestJSON-1995934202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-1e08e8da-b20c-48db-a2fa-475a66c73eeb" returned: 0 in 0.316s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:53:32 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-32e46ed6-fc8c-41c4-a16b-9aa24a9f03e4 tempest-AttachVolumeShelveTestJSON-1995934202 None] Lock "cinder-quobyte-1e08e8da-b20c-48db-a2fa-475a66c73eeb" released by "delete_volume" :: held 0.831s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 13:53:32 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-377ba7a3-f85d-4f7a-ae5c-a1e0f360f2b1 tempest-VolumesDeleteCascade-447158706 None] Create snapshot completed successfully Jul 13 13:53:32 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-32e46ed6-fc8c-41c4-a16b-9aa24a9f03e4 tempest-AttachVolumeShelveTestJSON-1995934202 None] Created reservations ['8142ffb9-2ba0-46dc-b1cd-4993b393a06b', '549b0b56-1b72-4f62-9891-6a56dc094dd8', 'ef782871-b8c3-4c44-881f-f03b971ceec8', '7cf2d899-3b5e-4191-aba5-a8dd8b07b979'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 13:53:32 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-32e46ed6-fc8c-41c4-a16b-9aa24a9f03e4 tempest-AttachVolumeShelveTestJSON-1995934202 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:53:32 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-32e46ed6-fc8c-41c4-a16b-9aa24a9f03e4 tempest-AttachVolumeShelveTestJSON-1995934202 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:53:32 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-32e46ed6-fc8c-41c4-a16b-9aa24a9f03e4 tempest-AttachVolumeShelveTestJSON-1995934202 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 13:53:32 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-32e46ed6-fc8c-41c4-a16b-9aa24a9f03e4 tempest-AttachVolumeShelveTestJSON-1995934202 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 13:53:32 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-32e46ed6-fc8c-41c4-a16b-9aa24a9f03e4 tempest-AttachVolumeShelveTestJSON-1995934202 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:53:32 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-32e46ed6-fc8c-41c4-a16b-9aa24a9f03e4 tempest-AttachVolumeShelveTestJSON-1995934202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:53:32 devstack sudo[93045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 Jul 13 13:53:32 devstack sudo[93045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:53:32 devstack sudo[93045]: pam_unix(sudo:session): session closed for user root Jul 13 13:53:32 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-32e46ed6-fc8c-41c4-a16b-9aa24a9f03e4 tempest-AttachVolumeShelveTestJSON-1995934202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78" returned: 0 in 0.314s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:53:32 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-32e46ed6-fc8c-41c4-a16b-9aa24a9f03e4 tempest-AttachVolumeShelveTestJSON-1995934202 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 13:53:32 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-32e46ed6-fc8c-41c4-a16b-9aa24a9f03e4 tempest-AttachVolumeShelveTestJSON-1995934202 None] Deleted volume successfully. Jul 13 13:53:33 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-32e46ed6-fc8c-41c4-a16b-9aa24a9f03e4 tempest-AttachVolumeShelveTestJSON-1995934202 None] Lock "cinder-1e08e8da-b20c-48db-a2fa-475a66c73eeb-delete_volume" released by "delete_volume" :: held 1.429s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 13:53:33 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-6c7325b2-e447-4560-a350-c52623d24d64 tempest-VolumesDeleteCascade-447158706 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:53:33 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-6c7325b2-e447-4560-a350-c52623d24d64 tempest-VolumesDeleteCascade-447158706 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:53:33 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-6c7325b2-e447-4560-a350-c52623d24d64 tempest-VolumesDeleteCascade-447158706 None] Creating offline snapshot c12df310-9569-4f7b-bd88-523c09d8bfba of volume 4d6acaa8-0e67-4582-9dd0-70d8aabadfcf {{(pid=87098) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 13 13:53:33 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[a533bd5a-f844-445d-99bc-912aa3844019]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 13:53:33 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-6c7325b2-e447-4560-a350-c52623d24d64 tempest-VolumesDeleteCascade-447158706 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-4d6acaa8-0e67-4582-9dd0-70d8aabadfcf.5021b08e-f651-4f22-8eb5-7d2f1f8cf3cd {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:53:33 devstack sudo[93048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-4d6acaa8-0e67-4582-9dd0-70d8aabadfcf.5021b08e-f651-4f22-8eb5-7d2f1f8cf3cd Jul 13 13:53:33 devstack sudo[93048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:53:33 devstack sudo[93048]: pam_unix(sudo:session): session closed for user root Jul 13 13:53:33 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-6c7325b2-e447-4560-a350-c52623d24d64 tempest-VolumesDeleteCascade-447158706 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-4d6acaa8-0e67-4582-9dd0-70d8aabadfcf.5021b08e-f651-4f22-8eb5-7d2f1f8cf3cd" returned: 0 in 0.535s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:53:33 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-6c7325b2-e447-4560-a350-c52623d24d64 tempest-VolumesDeleteCascade-447158706 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4d6acaa8-0e67-4582-9dd0-70d8aabadfcf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87098) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 13 13:53:33 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-6c7325b2-e447-4560-a350-c52623d24d64 tempest-VolumesDeleteCascade-447158706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-4d6acaa8-0e67-4582-9dd0-70d8aabadfcf.5021b08e-f651-4f22-8eb5-7d2f1f8cf3cd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-4d6acaa8-0e67-4582-9dd0-70d8aabadfcf.c12df310-9569-4f7b-bd88-523c09d8bfba 1G {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:53:33 devstack sudo[93053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-4d6acaa8-0e67-4582-9dd0-70d8aabadfcf.5021b08e-f651-4f22-8eb5-7d2f1f8cf3cd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-4d6acaa8-0e67-4582-9dd0-70d8aabadfcf.c12df310-9569-4f7b-bd88-523c09d8bfba 1G Jul 13 13:53:33 devstack sudo[93053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:53:34 devstack sudo[93053]: pam_unix(sudo:session): session closed for user root Jul 13 13:53:34 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-6c7325b2-e447-4560-a350-c52623d24d64 tempest-VolumesDeleteCascade-447158706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-4d6acaa8-0e67-4582-9dd0-70d8aabadfcf.5021b08e-f651-4f22-8eb5-7d2f1f8cf3cd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-4d6acaa8-0e67-4582-9dd0-70d8aabadfcf.c12df310-9569-4f7b-bd88-523c09d8bfba 1G" returned: 0 in 0.528s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:53:34 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-6c7325b2-e447-4560-a350-c52623d24d64 tempest-VolumesDeleteCascade-447158706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4d6acaa8-0e67-4582-9dd0-70d8aabadfcf.5021b08e-f651-4f22-8eb5-7d2f1f8cf3cd -F qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-4d6acaa8-0e67-4582-9dd0-70d8aabadfcf.c12df310-9569-4f7b-bd88-523c09d8bfba {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:53:34 devstack sudo[93059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4d6acaa8-0e67-4582-9dd0-70d8aabadfcf.5021b08e-f651-4f22-8eb5-7d2f1f8cf3cd -F qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-4d6acaa8-0e67-4582-9dd0-70d8aabadfcf.c12df310-9569-4f7b-bd88-523c09d8bfba Jul 13 13:53:34 devstack sudo[93059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:53:34 devstack sudo[93059]: pam_unix(sudo:session): session closed for user root Jul 13 13:53:34 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-6c7325b2-e447-4560-a350-c52623d24d64 tempest-VolumesDeleteCascade-447158706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4d6acaa8-0e67-4582-9dd0-70d8aabadfcf.5021b08e-f651-4f22-8eb5-7d2f1f8cf3cd -F qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-4d6acaa8-0e67-4582-9dd0-70d8aabadfcf.c12df310-9569-4f7b-bd88-523c09d8bfba" returned: 0 in 0.448s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:53:34 devstack cinder-volume[87098]: WARNING cinder.volume.drivers.remotefs [None req-6c7325b2-e447-4560-a350-c52623d24d64 tempest-VolumesDeleteCascade-447158706 None] /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-4d6acaa8-0e67-4582-9dd0-70d8aabadfcf.c12df310-9569-4f7b-bd88-523c09d8bfba is being set with open permissions: ugo+rw Jul 13 13:53:34 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-6c7325b2-e447-4560-a350-c52623d24d64 tempest-VolumesDeleteCascade-447158706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-4d6acaa8-0e67-4582-9dd0-70d8aabadfcf.c12df310-9569-4f7b-bd88-523c09d8bfba {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:53:34 devstack sudo[93065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-4d6acaa8-0e67-4582-9dd0-70d8aabadfcf.c12df310-9569-4f7b-bd88-523c09d8bfba Jul 13 13:53:34 devstack sudo[93065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:53:35 devstack sudo[93065]: pam_unix(sudo:session): session closed for user root Jul 13 13:53:35 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-6c7325b2-e447-4560-a350-c52623d24d64 tempest-VolumesDeleteCascade-447158706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-4d6acaa8-0e67-4582-9dd0-70d8aabadfcf.c12df310-9569-4f7b-bd88-523c09d8bfba" returned: 0 in 0.293s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:53:35 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-6c7325b2-e447-4560-a350-c52623d24d64 tempest-VolumesDeleteCascade-447158706 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.943s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:53:35 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-6c7325b2-e447-4560-a350-c52623d24d64 tempest-VolumesDeleteCascade-447158706 None] Create snapshot completed successfully Jul 13 13:53:35 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-c8ceb1b9-97a7-4fc3-9f42-edd7393cd156 tempest-VolumesDeleteCascade-447158706 None] Acquiring lock "cinder-4d6acaa8-0e67-4582-9dd0-70d8aabadfcf-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 13:53:35 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-c8ceb1b9-97a7-4fc3-9f42-edd7393cd156 tempest-VolumesDeleteCascade-447158706 None] Lock "cinder-4d6acaa8-0e67-4582-9dd0-70d8aabadfcf-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 13:53:35 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-c8ceb1b9-97a7-4fc3-9f42-edd7393cd156 tempest-VolumesDeleteCascade-447158706 None] Performing cascade delete. {{(pid=87098) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jul 13 13:53:35 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-c8ceb1b9-97a7-4fc3-9f42-edd7393cd156 tempest-VolumesDeleteCascade-447158706 None] Acquiring lock "cinder-5021b08e-f651-4f22-8eb5-7d2f1f8cf3cd-delete_snapshot" by "delete_snapshot" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 13:53:35 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-c8ceb1b9-97a7-4fc3-9f42-edd7393cd156 tempest-VolumesDeleteCascade-447158706 None] Lock "cinder-5021b08e-f651-4f22-8eb5-7d2f1f8cf3cd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 13:53:35 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-c8ceb1b9-97a7-4fc3-9f42-edd7393cd156 tempest-VolumesDeleteCascade-447158706 None] Acquiring lock "cinder-quobyte-4d6acaa8-0e67-4582-9dd0-70d8aabadfcf" by "delete_snapshot" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 13:53:35 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-c8ceb1b9-97a7-4fc3-9f42-edd7393cd156 tempest-VolumesDeleteCascade-447158706 None] Lock "cinder-quobyte-4d6acaa8-0e67-4582-9dd0-70d8aabadfcf" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 13:53:35 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-c8ceb1b9-97a7-4fc3-9f42-edd7393cd156 tempest-VolumesDeleteCascade-447158706 None] Acquiring lock "cinder-quobyte-5021b08e-f651-4f22-8eb5-7d2f1f8cf3cd" by "_delete_snapshot" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 13:53:35 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-c8ceb1b9-97a7-4fc3-9f42-edd7393cd156 tempest-VolumesDeleteCascade-447158706 None] Lock "cinder-quobyte-5021b08e-f651-4f22-8eb5-7d2f1f8cf3cd" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 13:53:35 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-c8ceb1b9-97a7-4fc3-9f42-edd7393cd156 tempest-VolumesDeleteCascade-447158706 None] Deleting offline snapshot 5021b08e-f651-4f22-8eb5-7d2f1f8cf3cd of volume 4d6acaa8-0e67-4582-9dd0-70d8aabadfcf {{(pid=87098) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 13 13:53:35 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-c8ceb1b9-97a7-4fc3-9f42-edd7393cd156 tempest-VolumesDeleteCascade-447158706 None] snapshot_file for this snap is: volume-4d6acaa8-0e67-4582-9dd0-70d8aabadfcf.5021b08e-f651-4f22-8eb5-7d2f1f8cf3cd {{(pid=87098) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 13 13:53:35 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[887499c9-605d-497c-bb1d-0e25652ba420]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 13:53:35 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-c8ceb1b9-97a7-4fc3-9f42-edd7393cd156 tempest-VolumesDeleteCascade-447158706 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-4d6acaa8-0e67-4582-9dd0-70d8aabadfcf.5021b08e-f651-4f22-8eb5-7d2f1f8cf3cd {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:53:35 devstack sudo[93068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-4d6acaa8-0e67-4582-9dd0-70d8aabadfcf.5021b08e-f651-4f22-8eb5-7d2f1f8cf3cd Jul 13 13:53:35 devstack sudo[93068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:53:36 devstack sudo[93068]: pam_unix(sudo:session): session closed for user root Jul 13 13:53:36 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-c8ceb1b9-97a7-4fc3-9f42-edd7393cd156 tempest-VolumesDeleteCascade-447158706 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-4d6acaa8-0e67-4582-9dd0-70d8aabadfcf.5021b08e-f651-4f22-8eb5-7d2f1f8cf3cd" returned: 0 in 0.467s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:53:36 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-c8ceb1b9-97a7-4fc3-9f42-edd7393cd156 tempest-VolumesDeleteCascade-447158706 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4d6acaa8-0e67-4582-9dd0-70d8aabadfcf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87098) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 13 13:53:36 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3fc543d-bb7d-4e78-acaa-9539b3569883]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 13:53:36 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-c8ceb1b9-97a7-4fc3-9f42-edd7393cd156 tempest-VolumesDeleteCascade-447158706 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-4d6acaa8-0e67-4582-9dd0-70d8aabadfcf {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:53:36 devstack sudo[93074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-4d6acaa8-0e67-4582-9dd0-70d8aabadfcf Jul 13 13:53:36 devstack sudo[93074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:53:36 devstack sudo[93074]: pam_unix(sudo:session): session closed for user root Jul 13 13:53:36 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-c8ceb1b9-97a7-4fc3-9f42-edd7393cd156 tempest-VolumesDeleteCascade-447158706 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-4d6acaa8-0e67-4582-9dd0-70d8aabadfcf" returned: 0 in 0.490s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:53:36 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[f13e6563-0b03-4cbb-b11b-f51863f27b20]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 13:53:36 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-c8ceb1b9-97a7-4fc3-9f42-edd7393cd156 tempest-VolumesDeleteCascade-447158706 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-4d6acaa8-0e67-4582-9dd0-70d8aabadfcf.c12df310-9569-4f7b-bd88-523c09d8bfba {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:53:36 devstack sudo[93080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-4d6acaa8-0e67-4582-9dd0-70d8aabadfcf.c12df310-9569-4f7b-bd88-523c09d8bfba Jul 13 13:53:36 devstack sudo[93080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:53:37 devstack sudo[93080]: pam_unix(sudo:session): session closed for user root Jul 13 13:53:37 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-c8ceb1b9-97a7-4fc3-9f42-edd7393cd156 tempest-VolumesDeleteCascade-447158706 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-4d6acaa8-0e67-4582-9dd0-70d8aabadfcf.c12df310-9569-4f7b-bd88-523c09d8bfba" returned: 0 in 0.461s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:53:37 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-c8ceb1b9-97a7-4fc3-9f42-edd7393cd156 tempest-VolumesDeleteCascade-447158706 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4d6acaa8-0e67-4582-9dd0-70d8aabadfcf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87098) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 13 13:53:37 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8667eef-487b-464f-8a7e-0fe768e43555]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 13:53:37 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-c8ceb1b9-97a7-4fc3-9f42-edd7393cd156 tempest-VolumesDeleteCascade-447158706 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-4d6acaa8-0e67-4582-9dd0-70d8aabadfcf.5021b08e-f651-4f22-8eb5-7d2f1f8cf3cd {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:53:37 devstack sudo[93086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-4d6acaa8-0e67-4582-9dd0-70d8aabadfcf.5021b08e-f651-4f22-8eb5-7d2f1f8cf3cd Jul 13 13:53:37 devstack sudo[93086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:53:37 devstack sudo[93086]: pam_unix(sudo:session): session closed for user root Jul 13 13:53:37 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-c8ceb1b9-97a7-4fc3-9f42-edd7393cd156 tempest-VolumesDeleteCascade-447158706 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-4d6acaa8-0e67-4582-9dd0-70d8aabadfcf.5021b08e-f651-4f22-8eb5-7d2f1f8cf3cd" returned: 0 in 0.513s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:53:37 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-c8ceb1b9-97a7-4fc3-9f42-edd7393cd156 tempest-VolumesDeleteCascade-447158706 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4d6acaa8-0e67-4582-9dd0-70d8aabadfcf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87098) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 13 13:53:37 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8091770-b64a-4518-ab5c-0bfb477663f4]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 13:53:37 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-c8ceb1b9-97a7-4fc3-9f42-edd7393cd156 tempest-VolumesDeleteCascade-447158706 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-4d6acaa8-0e67-4582-9dd0-70d8aabadfcf {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:53:37 devstack sudo[93092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-4d6acaa8-0e67-4582-9dd0-70d8aabadfcf Jul 13 13:53:37 devstack sudo[93092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:53:38 devstack sudo[93092]: pam_unix(sudo:session): session closed for user root Jul 13 13:53:38 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-c8ceb1b9-97a7-4fc3-9f42-edd7393cd156 tempest-VolumesDeleteCascade-447158706 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-4d6acaa8-0e67-4582-9dd0-70d8aabadfcf" returned: 0 in 0.458s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:53:38 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-c8ceb1b9-97a7-4fc3-9f42-edd7393cd156 tempest-VolumesDeleteCascade-447158706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-4d6acaa8-0e67-4582-9dd0-70d8aabadfcf.5021b08e-f651-4f22-8eb5-7d2f1f8cf3cd {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:53:38 devstack sudo[93098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-4d6acaa8-0e67-4582-9dd0-70d8aabadfcf.5021b08e-f651-4f22-8eb5-7d2f1f8cf3cd Jul 13 13:53:38 devstack sudo[93098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:53:38 devstack sudo[93098]: pam_unix(sudo:session): session closed for user root Jul 13 13:53:38 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-c8ceb1b9-97a7-4fc3-9f42-edd7393cd156 tempest-VolumesDeleteCascade-447158706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-4d6acaa8-0e67-4582-9dd0-70d8aabadfcf.5021b08e-f651-4f22-8eb5-7d2f1f8cf3cd" returned: 0 in 0.450s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:53:38 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-c8ceb1b9-97a7-4fc3-9f42-edd7393cd156 tempest-VolumesDeleteCascade-447158706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-4d6acaa8-0e67-4582-9dd0-70d8aabadfcf.5021b08e-f651-4f22-8eb5-7d2f1f8cf3cd {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:53:38 devstack sudo[93103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-4d6acaa8-0e67-4582-9dd0-70d8aabadfcf.5021b08e-f651-4f22-8eb5-7d2f1f8cf3cd Jul 13 13:53:38 devstack sudo[93103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:53:38 devstack sudo[93103]: pam_unix(sudo:session): session closed for user root Jul 13 13:53:38 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-c8ceb1b9-97a7-4fc3-9f42-edd7393cd156 tempest-VolumesDeleteCascade-447158706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-4d6acaa8-0e67-4582-9dd0-70d8aabadfcf.5021b08e-f651-4f22-8eb5-7d2f1f8cf3cd" returned: 0 in 0.353s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:53:38 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-c8ceb1b9-97a7-4fc3-9f42-edd7393cd156 tempest-VolumesDeleteCascade-447158706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4d6acaa8-0e67-4582-9dd0-70d8aabadfcf /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-4d6acaa8-0e67-4582-9dd0-70d8aabadfcf.c12df310-9569-4f7b-bd88-523c09d8bfba -F qcow2 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:53:38 devstack sudo[93106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4d6acaa8-0e67-4582-9dd0-70d8aabadfcf /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-4d6acaa8-0e67-4582-9dd0-70d8aabadfcf.c12df310-9569-4f7b-bd88-523c09d8bfba -F qcow2 Jul 13 13:53:38 devstack sudo[93106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:53:39 devstack sudo[93106]: pam_unix(sudo:session): session closed for user root Jul 13 13:53:39 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-c8ceb1b9-97a7-4fc3-9f42-edd7393cd156 tempest-VolumesDeleteCascade-447158706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4d6acaa8-0e67-4582-9dd0-70d8aabadfcf /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-4d6acaa8-0e67-4582-9dd0-70d8aabadfcf.c12df310-9569-4f7b-bd88-523c09d8bfba -F qcow2" returned: 0 in 0.326s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:53:39 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-c8ceb1b9-97a7-4fc3-9f42-edd7393cd156 tempest-VolumesDeleteCascade-447158706 None] Lock "cinder-quobyte-5021b08e-f651-4f22-8eb5-7d2f1f8cf3cd" released by "_delete_snapshot" :: held 3.767s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 13:53:39 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-c8ceb1b9-97a7-4fc3-9f42-edd7393cd156 tempest-VolumesDeleteCascade-447158706 None] Lock "cinder-quobyte-4d6acaa8-0e67-4582-9dd0-70d8aabadfcf" released by "delete_snapshot" :: held 3.795s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 13:53:39 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-c8ceb1b9-97a7-4fc3-9f42-edd7393cd156 tempest-VolumesDeleteCascade-447158706 None] Created reservations ['199cc845-6393-488a-82cd-8f74512664cf', '2d3ad5be-6fd7-4bf6-b99d-218fabdd321d', '00b2c6a7-b5cf-40f6-abe9-6f8fef876bdd', '380c8f41-50d7-4e01-84ba-407c93ff4ced'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 13:53:39 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-c8ceb1b9-97a7-4fc3-9f42-edd7393cd156 tempest-VolumesDeleteCascade-447158706 None] Delete snapshot completed successfully. Jul 13 13:53:39 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-c8ceb1b9-97a7-4fc3-9f42-edd7393cd156 tempest-VolumesDeleteCascade-447158706 None] Lock "cinder-5021b08e-f651-4f22-8eb5-7d2f1f8cf3cd-delete_snapshot" released by "delete_snapshot" :: held 3.975s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 13:53:39 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-c8ceb1b9-97a7-4fc3-9f42-edd7393cd156 tempest-VolumesDeleteCascade-447158706 None] Acquiring lock "cinder-c12df310-9569-4f7b-bd88-523c09d8bfba-delete_snapshot" by "delete_snapshot" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 13:53:39 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-c8ceb1b9-97a7-4fc3-9f42-edd7393cd156 tempest-VolumesDeleteCascade-447158706 None] Lock "cinder-c12df310-9569-4f7b-bd88-523c09d8bfba-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 13:53:39 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-c8ceb1b9-97a7-4fc3-9f42-edd7393cd156 tempest-VolumesDeleteCascade-447158706 None] Acquiring lock "cinder-quobyte-4d6acaa8-0e67-4582-9dd0-70d8aabadfcf" by "delete_snapshot" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 13:53:39 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-c8ceb1b9-97a7-4fc3-9f42-edd7393cd156 tempest-VolumesDeleteCascade-447158706 None] Lock "cinder-quobyte-4d6acaa8-0e67-4582-9dd0-70d8aabadfcf" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 13:53:39 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-c8ceb1b9-97a7-4fc3-9f42-edd7393cd156 tempest-VolumesDeleteCascade-447158706 None] Acquiring lock "cinder-quobyte-c12df310-9569-4f7b-bd88-523c09d8bfba" by "_delete_snapshot" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 13:53:39 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-c8ceb1b9-97a7-4fc3-9f42-edd7393cd156 tempest-VolumesDeleteCascade-447158706 None] Lock "cinder-quobyte-c12df310-9569-4f7b-bd88-523c09d8bfba" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 13:53:39 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-c8ceb1b9-97a7-4fc3-9f42-edd7393cd156 tempest-VolumesDeleteCascade-447158706 None] Deleting offline snapshot c12df310-9569-4f7b-bd88-523c09d8bfba of volume 4d6acaa8-0e67-4582-9dd0-70d8aabadfcf {{(pid=87098) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 13 13:53:39 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-c8ceb1b9-97a7-4fc3-9f42-edd7393cd156 tempest-VolumesDeleteCascade-447158706 None] snapshot_file for this snap is: volume-4d6acaa8-0e67-4582-9dd0-70d8aabadfcf.c12df310-9569-4f7b-bd88-523c09d8bfba {{(pid=87098) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 13 13:53:39 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[2be3d767-9b99-40ba-8671-225205384d82]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 13:53:39 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-c8ceb1b9-97a7-4fc3-9f42-edd7393cd156 tempest-VolumesDeleteCascade-447158706 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-4d6acaa8-0e67-4582-9dd0-70d8aabadfcf.c12df310-9569-4f7b-bd88-523c09d8bfba {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:53:39 devstack sudo[93112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-4d6acaa8-0e67-4582-9dd0-70d8aabadfcf.c12df310-9569-4f7b-bd88-523c09d8bfba Jul 13 13:53:39 devstack sudo[93112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:53:40 devstack cinder-volume[87098]: DEBUG dbcounter [-] [87098] Writing DB stats cinder:SELECT=105,cinder:UPDATE=115,cinder:INSERT=27,cinder:DELETE=10 {{(pid=87098) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 13 13:53:40 devstack cinder-volume[87098]: DEBUG dbcounter [-] [87098] Writing DB stats cinder:SELECT=90,cinder:UPDATE=105,cinder:INSERT=27,cinder:DELETE=8 {{(pid=87098) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 13 13:53:40 devstack sudo[93112]: pam_unix(sudo:session): session closed for user root Jul 13 13:53:40 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-c8ceb1b9-97a7-4fc3-9f42-edd7393cd156 tempest-VolumesDeleteCascade-447158706 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-4d6acaa8-0e67-4582-9dd0-70d8aabadfcf.c12df310-9569-4f7b-bd88-523c09d8bfba" returned: 0 in 0.454s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:53:40 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-c8ceb1b9-97a7-4fc3-9f42-edd7393cd156 tempest-VolumesDeleteCascade-447158706 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4d6acaa8-0e67-4582-9dd0-70d8aabadfcf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87098) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 13 13:53:40 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[545fe06a-57c9-413c-b5bc-b9551770d566]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 13:53:40 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-c8ceb1b9-97a7-4fc3-9f42-edd7393cd156 tempest-VolumesDeleteCascade-447158706 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-4d6acaa8-0e67-4582-9dd0-70d8aabadfcf {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:53:40 devstack sudo[93120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-4d6acaa8-0e67-4582-9dd0-70d8aabadfcf Jul 13 13:53:40 devstack sudo[93120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:53:40 devstack sudo[93120]: pam_unix(sudo:session): session closed for user root Jul 13 13:53:40 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-c8ceb1b9-97a7-4fc3-9f42-edd7393cd156 tempest-VolumesDeleteCascade-447158706 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-4d6acaa8-0e67-4582-9dd0-70d8aabadfcf" returned: 0 in 0.456s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:53:40 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-c8ceb1b9-97a7-4fc3-9f42-edd7393cd156 tempest-VolumesDeleteCascade-447158706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-4d6acaa8-0e67-4582-9dd0-70d8aabadfcf.c12df310-9569-4f7b-bd88-523c09d8bfba {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:53:40 devstack sudo[93125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-4d6acaa8-0e67-4582-9dd0-70d8aabadfcf.c12df310-9569-4f7b-bd88-523c09d8bfba Jul 13 13:53:40 devstack sudo[93125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:53:40 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-620a29de-2138-41cb-800a-d56c9aea4b1e tempest-GroupSnapshotsV319Test-2097530846 None] Group tempest-GroupSnapshotsV319Test-Group-1585872558: creating Jul 13 13:53:40 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-620a29de-2138-41cb-800a-d56c9aea4b1e tempest-GroupSnapshotsV319Test-2097530846 None] Group tempest-GroupSnapshotsV319Test-Group-1585872558: created successfully Jul 13 13:53:40 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-620a29de-2138-41cb-800a-d56c9aea4b1e tempest-GroupSnapshotsV319Test-2097530846 None] Create group completed successfully. Jul 13 13:53:41 devstack sudo[93125]: pam_unix(sudo:session): session closed for user root Jul 13 13:53:41 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-c8ceb1b9-97a7-4fc3-9f42-edd7393cd156 tempest-VolumesDeleteCascade-447158706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-4d6acaa8-0e67-4582-9dd0-70d8aabadfcf.c12df310-9569-4f7b-bd88-523c09d8bfba" returned: 0 in 0.462s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:53:41 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-c8ceb1b9-97a7-4fc3-9f42-edd7393cd156 tempest-VolumesDeleteCascade-447158706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-4d6acaa8-0e67-4582-9dd0-70d8aabadfcf.c12df310-9569-4f7b-bd88-523c09d8bfba {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:53:41 devstack sudo[93131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-4d6acaa8-0e67-4582-9dd0-70d8aabadfcf.c12df310-9569-4f7b-bd88-523c09d8bfba Jul 13 13:53:41 devstack sudo[93131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:53:41 devstack sudo[93131]: pam_unix(sudo:session): session closed for user root Jul 13 13:53:41 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-c8ceb1b9-97a7-4fc3-9f42-edd7393cd156 tempest-VolumesDeleteCascade-447158706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-4d6acaa8-0e67-4582-9dd0-70d8aabadfcf.c12df310-9569-4f7b-bd88-523c09d8bfba" returned: 0 in 0.280s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:53:41 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-c8ceb1b9-97a7-4fc3-9f42-edd7393cd156 tempest-VolumesDeleteCascade-447158706 None] Lock "cinder-quobyte-c12df310-9569-4f7b-bd88-523c09d8bfba" released by "_delete_snapshot" :: held 1.790s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 13:53:41 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-c8ceb1b9-97a7-4fc3-9f42-edd7393cd156 tempest-VolumesDeleteCascade-447158706 None] Lock "cinder-quobyte-4d6acaa8-0e67-4582-9dd0-70d8aabadfcf" released by "delete_snapshot" :: held 1.834s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 13:53:41 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-c8ceb1b9-97a7-4fc3-9f42-edd7393cd156 tempest-VolumesDeleteCascade-447158706 None] Created reservations ['138b2553-a819-4425-9ae9-dcc9bc0f6416', '56a4ed74-fe1b-4ccb-8363-d57b73f1a7d0', '1e7f7c2b-5536-4732-b842-03ba38701f1f', 'e135a37f-1006-4d3f-9eec-4b0f726e447b'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 13:53:41 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-c8ceb1b9-97a7-4fc3-9f42-edd7393cd156 tempest-VolumesDeleteCascade-447158706 None] Delete snapshot completed successfully. Jul 13 13:53:41 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-c8ceb1b9-97a7-4fc3-9f42-edd7393cd156 tempest-VolumesDeleteCascade-447158706 None] Lock "cinder-c12df310-9569-4f7b-bd88-523c09d8bfba-delete_snapshot" released by "delete_snapshot" :: held 1.999s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 13:53:41 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-c8ceb1b9-97a7-4fc3-9f42-edd7393cd156 tempest-VolumesDeleteCascade-447158706 None] Snapshots deleted, issuing volume delete {{(pid=87098) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jul 13 13:53:41 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-c8ceb1b9-97a7-4fc3-9f42-edd7393cd156 tempest-VolumesDeleteCascade-447158706 None] Acquiring lock "cinder-quobyte-4d6acaa8-0e67-4582-9dd0-70d8aabadfcf" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 13:53:41 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-c8ceb1b9-97a7-4fc3-9f42-edd7393cd156 tempest-VolumesDeleteCascade-447158706 None] Lock "cinder-quobyte-4d6acaa8-0e67-4582-9dd0-70d8aabadfcf" acquired by "delete_volume" :: waited 0.017s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 13:53:41 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cd8c221-7694-4e57-a6f3-80e9e1976c46]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 13:53:41 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-c8ceb1b9-97a7-4fc3-9f42-edd7393cd156 tempest-VolumesDeleteCascade-447158706 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-4d6acaa8-0e67-4582-9dd0-70d8aabadfcf {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:53:41 devstack sudo[93134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-4d6acaa8-0e67-4582-9dd0-70d8aabadfcf Jul 13 13:53:41 devstack sudo[93134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:53:41 devstack sudo[93134]: pam_unix(sudo:session): session closed for user root Jul 13 13:53:41 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-c8ceb1b9-97a7-4fc3-9f42-edd7393cd156 tempest-VolumesDeleteCascade-447158706 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-4d6acaa8-0e67-4582-9dd0-70d8aabadfcf" returned: 0 in 0.410s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:53:41 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-c8ceb1b9-97a7-4fc3-9f42-edd7393cd156 tempest-VolumesDeleteCascade-447158706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-4d6acaa8-0e67-4582-9dd0-70d8aabadfcf {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:53:42 devstack sudo[93139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-4d6acaa8-0e67-4582-9dd0-70d8aabadfcf Jul 13 13:53:42 devstack sudo[93139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:53:42 devstack sudo[93139]: pam_unix(sudo:session): session closed for user root Jul 13 13:53:42 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-c8ceb1b9-97a7-4fc3-9f42-edd7393cd156 tempest-VolumesDeleteCascade-447158706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-4d6acaa8-0e67-4582-9dd0-70d8aabadfcf" returned: 0 in 0.339s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:53:42 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-c8ceb1b9-97a7-4fc3-9f42-edd7393cd156 tempest-VolumesDeleteCascade-447158706 None] Lock "cinder-quobyte-4d6acaa8-0e67-4582-9dd0-70d8aabadfcf" released by "delete_volume" :: held 0.843s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 13:53:42 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-c8ceb1b9-97a7-4fc3-9f42-edd7393cd156 tempest-VolumesDeleteCascade-447158706 None] Created reservations ['e8851207-9821-4991-8f33-11bd0d70b3b7', '8cd74e30-65bb-421a-9060-5cf186d40ebe', '27729f32-aad3-4197-94da-87e3c84047e9', '52d1c94e-419d-4bef-ae43-d3a4503e80cf'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 13:53:42 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-c8ceb1b9-97a7-4fc3-9f42-edd7393cd156 tempest-VolumesDeleteCascade-447158706 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:53:42 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-c8ceb1b9-97a7-4fc3-9f42-edd7393cd156 tempest-VolumesDeleteCascade-447158706 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:53:42 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-c8ceb1b9-97a7-4fc3-9f42-edd7393cd156 tempest-VolumesDeleteCascade-447158706 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 13:53:42 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-c8ceb1b9-97a7-4fc3-9f42-edd7393cd156 tempest-VolumesDeleteCascade-447158706 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 13:53:42 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-c8ceb1b9-97a7-4fc3-9f42-edd7393cd156 tempest-VolumesDeleteCascade-447158706 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:53:42 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-c8ceb1b9-97a7-4fc3-9f42-edd7393cd156 tempest-VolumesDeleteCascade-447158706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:53:42 devstack sudo[93142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 Jul 13 13:53:42 devstack sudo[93142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:53:42 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-5fec9297-77b2-4049-b93a-95d17f9435ca tempest-GroupSnapshotsV319Test-2097530846 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 13:53:42 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-5fec9297-77b2-4049-b93a-95d17f9435ca tempest-GroupSnapshotsV319Test-2097530846 None] Flow 'volume_create_manager' (031125dc-e7eb-46b8-90ad-4db5f0d3d285) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 13:53:42 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-5fec9297-77b2-4049-b93a-95d17f9435ca tempest-GroupSnapshotsV319Test-2097530846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86e0ae52-e179-4922-be92-d2d051e4e298) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:53:42 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-5fec9297-77b2-4049-b93a-95d17f9435ca tempest-GroupSnapshotsV319Test-2097530846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86e0ae52-e179-4922-be92-d2d051e4e298) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T11:53:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-762337240',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=57daf8a4-0892-4564-8a39-9681c807a472,host='devstack@QuobyteHD#QuobyteHD',id=14b9dce1-2744-41a7-b20e-83b37bbb67a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7ea86d9469444a1afc08dcde7261d90',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T11:53:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T11:53:43Z,use_quota=True,user_id='59458b0478b446199a5ca204ccb08697',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2fbe3caa-9a16-4429-a63e-22e76632c6e8),volume_type_id=2fbe3caa-9a16-4429-a63e-22e76632c6e8)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:53:42 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-5fec9297-77b2-4049-b93a-95d17f9435ca tempest-GroupSnapshotsV319Test-2097530846 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1a29fce-4a99-4702-a559-9c78ff1e7cdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:53:42 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-5fec9297-77b2-4049-b93a-95d17f9435ca tempest-GroupSnapshotsV319Test-2097530846 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1a29fce-4a99-4702-a559-9c78ff1e7cdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:53:42 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-5fec9297-77b2-4049-b93a-95d17f9435ca tempest-GroupSnapshotsV319Test-2097530846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7585bb69-b688-4a26-963a-23e855b39810) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:53:42 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-5fec9297-77b2-4049-b93a-95d17f9435ca tempest-GroupSnapshotsV319Test-2097530846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7585bb69-b688-4a26-963a-23e855b39810) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '14b9dce1-2744-41a7-b20e-83b37bbb67a7', 'volume_name': 'volume-14b9dce1-2744-41a7-b20e-83b37bbb67a7', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:53:42 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-5fec9297-77b2-4049-b93a-95d17f9435ca tempest-GroupSnapshotsV319Test-2097530846 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1064af97-95ef-4935-be5a-3fbfbf900a5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:53:42 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-5fec9297-77b2-4049-b93a-95d17f9435ca tempest-GroupSnapshotsV319Test-2097530846 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1064af97-95ef-4935-be5a-3fbfbf900a5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:53:42 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-5fec9297-77b2-4049-b93a-95d17f9435ca tempest-GroupSnapshotsV319Test-2097530846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b14b37e-4eb8-40b6-b7b1-98937f225174) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:53:42 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-5fec9297-77b2-4049-b93a-95d17f9435ca tempest-GroupSnapshotsV319Test-2097530846 None] Volume 14b9dce1-2744-41a7-b20e-83b37bbb67a7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-14b9dce1-2744-41a7-b20e-83b37bbb67a7', 'volume_size': 1} Jul 13 13:53:42 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-5fec9297-77b2-4049-b93a-95d17f9435ca tempest-GroupSnapshotsV319Test-2097530846 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:53:42 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-5fec9297-77b2-4049-b93a-95d17f9435ca tempest-GroupSnapshotsV319Test-2097530846 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:53:42 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-5fec9297-77b2-4049-b93a-95d17f9435ca tempest-GroupSnapshotsV319Test-2097530846 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=57daf8a4-0892-4564-8a39-9681c807a472,created_at=2026-07-13T11:53:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-762337240',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=57daf8a4-0892-4564-8a39-9681c807a472,host='devstack@QuobyteHD#QuobyteHD',id=14b9dce1-2744-41a7-b20e-83b37bbb67a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7ea86d9469444a1afc08dcde7261d90',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T11:53:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T11:53:43Z,use_quota=True,user_id='59458b0478b446199a5ca204ccb08697',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2fbe3caa-9a16-4429-a63e-22e76632c6e8),volume_type_id=2fbe3caa-9a16-4429-a63e-22e76632c6e8)}" {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 13 13:53:42 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-5fec9297-77b2-4049-b93a-95d17f9435ca tempest-GroupSnapshotsV319Test-2097530846 None] Creating volume 14b9dce1-2744-41a7-b20e-83b37bbb67a7 {{(pid=87098) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 13 13:53:42 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-5fec9297-77b2-4049-b93a-95d17f9435ca tempest-GroupSnapshotsV319Test-2097530846 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:53:42 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-5fec9297-77b2-4049-b93a-95d17f9435ca tempest-GroupSnapshotsV319Test-2097530846 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:53:42 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-5fec9297-77b2-4049-b93a-95d17f9435ca tempest-GroupSnapshotsV319Test-2097530846 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 13:53:42 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-5fec9297-77b2-4049-b93a-95d17f9435ca tempest-GroupSnapshotsV319Test-2097530846 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 13:53:42 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-5fec9297-77b2-4049-b93a-95d17f9435ca tempest-GroupSnapshotsV319Test-2097530846 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:53:42 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-5fec9297-77b2-4049-b93a-95d17f9435ca tempest-GroupSnapshotsV319Test-2097530846 None] Selected osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 13:53:42 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-5fec9297-77b2-4049-b93a-95d17f9435ca tempest-GroupSnapshotsV319Test-2097530846 None] casted to osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 Jul 13 13:53:42 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-5fec9297-77b2-4049-b93a-95d17f9435ca tempest-GroupSnapshotsV319Test-2097530846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-14b9dce1-2744-41a7-b20e-83b37bbb67a7 1073741824 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:53:42 devstack sudo[93144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-14b9dce1-2744-41a7-b20e-83b37bbb67a7 1073741824 Jul 13 13:53:42 devstack sudo[93144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:53:42 devstack sudo[93142]: pam_unix(sudo:session): session closed for user root Jul 13 13:53:42 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-c8ceb1b9-97a7-4fc3-9f42-edd7393cd156 tempest-VolumesDeleteCascade-447158706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78" returned: 0 in 0.369s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:53:42 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-c8ceb1b9-97a7-4fc3-9f42-edd7393cd156 tempest-VolumesDeleteCascade-447158706 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 13:53:42 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-c8ceb1b9-97a7-4fc3-9f42-edd7393cd156 tempest-VolumesDeleteCascade-447158706 None] Deleted volume successfully. Jul 13 13:53:42 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-c8ceb1b9-97a7-4fc3-9f42-edd7393cd156 tempest-VolumesDeleteCascade-447158706 None] Lock "cinder-4d6acaa8-0e67-4582-9dd0-70d8aabadfcf-delete_volume" released by "delete_volume" :: held 7.563s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 13:53:43 devstack sudo[93144]: pam_unix(sudo:session): session closed for user root Jul 13 13:53:43 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-5fec9297-77b2-4049-b93a-95d17f9435ca tempest-GroupSnapshotsV319Test-2097530846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-14b9dce1-2744-41a7-b20e-83b37bbb67a7 1073741824" returned: 0 in 0.541s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:53:43 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-5fec9297-77b2-4049-b93a-95d17f9435ca tempest-GroupSnapshotsV319Test-2097530846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-14b9dce1-2744-41a7-b20e-83b37bbb67a7 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:53:43 devstack sudo[93151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-14b9dce1-2744-41a7-b20e-83b37bbb67a7 Jul 13 13:53:43 devstack sudo[93151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:53:43 devstack sudo[93151]: pam_unix(sudo:session): session closed for user root Jul 13 13:53:43 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-5fec9297-77b2-4049-b93a-95d17f9435ca tempest-GroupSnapshotsV319Test-2097530846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-14b9dce1-2744-41a7-b20e-83b37bbb67a7" returned: 0 in 0.369s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:53:43 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-5fec9297-77b2-4049-b93a-95d17f9435ca tempest-GroupSnapshotsV319Test-2097530846 None] <== create_volume: return (974ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'} {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 13 13:53:43 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-5fec9297-77b2-4049-b93a-95d17f9435ca tempest-GroupSnapshotsV319Test-2097530846 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.978s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:53:43 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-5fec9297-77b2-4049-b93a-95d17f9435ca tempest-GroupSnapshotsV319Test-2097530846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b14b37e-4eb8-40b6-b7b1-98937f225174) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-14b9dce1-2744-41a7-b20e-83b37bbb67a7', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:53:43 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-5fec9297-77b2-4049-b93a-95d17f9435ca tempest-GroupSnapshotsV319Test-2097530846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b1ec5ef-31fd-49c5-b263-252c875af56a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:53:43 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-5fec9297-77b2-4049-b93a-95d17f9435ca tempest-GroupSnapshotsV319Test-2097530846 None] Volume volume-14b9dce1-2744-41a7-b20e-83b37bbb67a7 (14b9dce1-2744-41a7-b20e-83b37bbb67a7): created successfully Jul 13 13:53:43 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-5fec9297-77b2-4049-b93a-95d17f9435ca tempest-GroupSnapshotsV319Test-2097530846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b1ec5ef-31fd-49c5-b263-252c875af56a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:53:43 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-5fec9297-77b2-4049-b93a-95d17f9435ca tempest-GroupSnapshotsV319Test-2097530846 None] Flow 'volume_create_manager' (031125dc-e7eb-46b8-90ad-4db5f0d3d285) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 13:53:43 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-5fec9297-77b2-4049-b93a-95d17f9435ca tempest-GroupSnapshotsV319Test-2097530846 None] Created volume successfully. Jul 13 13:53:44 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-24df7300-c6ce-4fb8-8fe2-a69294cbd0b7 tempest-VolumesDeleteCascade-447158706 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 13:53:44 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-24df7300-c6ce-4fb8-8fe2-a69294cbd0b7 tempest-VolumesDeleteCascade-447158706 None] Flow 'volume_create_manager' (052c8381-dcbb-46bf-a80b-c45b1bc4dc66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 13:53:44 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-24df7300-c6ce-4fb8-8fe2-a69294cbd0b7 tempest-VolumesDeleteCascade-447158706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (efa86202-87f0-4590-b52e-6135ccbb6611) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:53:44 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-24df7300-c6ce-4fb8-8fe2-a69294cbd0b7 tempest-VolumesDeleteCascade-447158706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (efa86202-87f0-4590-b52e-6135ccbb6611) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T11:53:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-912262958',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26eca4b6-46d1-4f91-8dcc-005aa8d36ec6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b76618fc355f47ae9294b7d4418a265c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T11:53:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T11:53:44Z,use_quota=True,user_id='c8b53fcce91246de98b34c2f5b885ade',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1147de8b-623b-426c-a13d-7fc824a80f67),volume_type_id=1147de8b-623b-426c-a13d-7fc824a80f67)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:53:44 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-24df7300-c6ce-4fb8-8fe2-a69294cbd0b7 tempest-VolumesDeleteCascade-447158706 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76651cb1-485a-4545-97d9-abb77b95c90c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:53:44 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-24df7300-c6ce-4fb8-8fe2-a69294cbd0b7 tempest-VolumesDeleteCascade-447158706 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76651cb1-485a-4545-97d9-abb77b95c90c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:53:44 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-24df7300-c6ce-4fb8-8fe2-a69294cbd0b7 tempest-VolumesDeleteCascade-447158706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (640a5ad2-f2d6-4f15-a314-ac5e406633f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:53:44 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-24df7300-c6ce-4fb8-8fe2-a69294cbd0b7 tempest-VolumesDeleteCascade-447158706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (640a5ad2-f2d6-4f15-a314-ac5e406633f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '26eca4b6-46d1-4f91-8dcc-005aa8d36ec6', 'volume_name': 'volume-26eca4b6-46d1-4f91-8dcc-005aa8d36ec6', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:53:44 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-24df7300-c6ce-4fb8-8fe2-a69294cbd0b7 tempest-VolumesDeleteCascade-447158706 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11800f44-43e6-43e8-ba62-600b69f969ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:53:44 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-24df7300-c6ce-4fb8-8fe2-a69294cbd0b7 tempest-VolumesDeleteCascade-447158706 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11800f44-43e6-43e8-ba62-600b69f969ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:53:44 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-24df7300-c6ce-4fb8-8fe2-a69294cbd0b7 tempest-VolumesDeleteCascade-447158706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec4a358c-d10c-426d-b9e5-2c00a40b1d01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:53:44 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-24df7300-c6ce-4fb8-8fe2-a69294cbd0b7 tempest-VolumesDeleteCascade-447158706 None] Volume 26eca4b6-46d1-4f91-8dcc-005aa8d36ec6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-26eca4b6-46d1-4f91-8dcc-005aa8d36ec6', 'volume_size': 1} Jul 13 13:53:44 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-24df7300-c6ce-4fb8-8fe2-a69294cbd0b7 tempest-VolumesDeleteCascade-447158706 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:53:44 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-24df7300-c6ce-4fb8-8fe2-a69294cbd0b7 tempest-VolumesDeleteCascade-447158706 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:53:44 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-24df7300-c6ce-4fb8-8fe2-a69294cbd0b7 tempest-VolumesDeleteCascade-447158706 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T11:53:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-912262958',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26eca4b6-46d1-4f91-8dcc-005aa8d36ec6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b76618fc355f47ae9294b7d4418a265c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T11:53:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T11:53:44Z,use_quota=True,user_id='c8b53fcce91246de98b34c2f5b885ade',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1147de8b-623b-426c-a13d-7fc824a80f67),volume_type_id=1147de8b-623b-426c-a13d-7fc824a80f67)}" {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 13 13:53:44 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-24df7300-c6ce-4fb8-8fe2-a69294cbd0b7 tempest-VolumesDeleteCascade-447158706 None] Creating volume 26eca4b6-46d1-4f91-8dcc-005aa8d36ec6 {{(pid=87098) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 13 13:53:44 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-24df7300-c6ce-4fb8-8fe2-a69294cbd0b7 tempest-VolumesDeleteCascade-447158706 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:53:44 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-24df7300-c6ce-4fb8-8fe2-a69294cbd0b7 tempest-VolumesDeleteCascade-447158706 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:53:44 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-24df7300-c6ce-4fb8-8fe2-a69294cbd0b7 tempest-VolumesDeleteCascade-447158706 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 13:53:44 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-24df7300-c6ce-4fb8-8fe2-a69294cbd0b7 tempest-VolumesDeleteCascade-447158706 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 13:53:44 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-24df7300-c6ce-4fb8-8fe2-a69294cbd0b7 tempest-VolumesDeleteCascade-447158706 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:53:44 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-24df7300-c6ce-4fb8-8fe2-a69294cbd0b7 tempest-VolumesDeleteCascade-447158706 None] Selected osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 13:53:44 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-24df7300-c6ce-4fb8-8fe2-a69294cbd0b7 tempest-VolumesDeleteCascade-447158706 None] casted to osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 Jul 13 13:53:44 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-24df7300-c6ce-4fb8-8fe2-a69294cbd0b7 tempest-VolumesDeleteCascade-447158706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-26eca4b6-46d1-4f91-8dcc-005aa8d36ec6 1073741824 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:53:44 devstack sudo[93154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-26eca4b6-46d1-4f91-8dcc-005aa8d36ec6 1073741824 Jul 13 13:53:44 devstack sudo[93154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:53:44 devstack sudo[93154]: pam_unix(sudo:session): session closed for user root Jul 13 13:53:44 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-24df7300-c6ce-4fb8-8fe2-a69294cbd0b7 tempest-VolumesDeleteCascade-447158706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-26eca4b6-46d1-4f91-8dcc-005aa8d36ec6 1073741824" returned: 0 in 0.576s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:53:44 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-24df7300-c6ce-4fb8-8fe2-a69294cbd0b7 tempest-VolumesDeleteCascade-447158706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-26eca4b6-46d1-4f91-8dcc-005aa8d36ec6 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:53:44 devstack sudo[93160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-26eca4b6-46d1-4f91-8dcc-005aa8d36ec6 Jul 13 13:53:44 devstack sudo[93160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:53:45 devstack sudo[93160]: pam_unix(sudo:session): session closed for user root Jul 13 13:53:45 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-24df7300-c6ce-4fb8-8fe2-a69294cbd0b7 tempest-VolumesDeleteCascade-447158706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-26eca4b6-46d1-4f91-8dcc-005aa8d36ec6" returned: 0 in 0.244s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:53:45 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-24df7300-c6ce-4fb8-8fe2-a69294cbd0b7 tempest-VolumesDeleteCascade-447158706 None] <== create_volume: return (874ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'} {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 13 13:53:45 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-24df7300-c6ce-4fb8-8fe2-a69294cbd0b7 tempest-VolumesDeleteCascade-447158706 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.877s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:53:45 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-24df7300-c6ce-4fb8-8fe2-a69294cbd0b7 tempest-VolumesDeleteCascade-447158706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec4a358c-d10c-426d-b9e5-2c00a40b1d01) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-26eca4b6-46d1-4f91-8dcc-005aa8d36ec6', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:53:45 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-24df7300-c6ce-4fb8-8fe2-a69294cbd0b7 tempest-VolumesDeleteCascade-447158706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9dd881ae-642c-4398-99a9-414b2158da1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:53:45 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-24df7300-c6ce-4fb8-8fe2-a69294cbd0b7 tempest-VolumesDeleteCascade-447158706 None] Volume volume-26eca4b6-46d1-4f91-8dcc-005aa8d36ec6 (26eca4b6-46d1-4f91-8dcc-005aa8d36ec6): created successfully Jul 13 13:53:45 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-24df7300-c6ce-4fb8-8fe2-a69294cbd0b7 tempest-VolumesDeleteCascade-447158706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9dd881ae-642c-4398-99a9-414b2158da1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:53:45 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-24df7300-c6ce-4fb8-8fe2-a69294cbd0b7 tempest-VolumesDeleteCascade-447158706 None] Flow 'volume_create_manager' (052c8381-dcbb-46bf-a80b-c45b1bc4dc66) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 13:53:45 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-24df7300-c6ce-4fb8-8fe2-a69294cbd0b7 tempest-VolumesDeleteCascade-447158706 None] Created volume successfully. Jul 13 13:53:45 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-9c736c2d-cb21-4f3d-a052-d810460b290f tempest-GroupSnapshotsV319Test-2097530846 None] GroupSnapshot 34773052-ec0b-447b-81e4-04f1e0e92ba3: creating. Jul 13 13:53:45 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-9c736c2d-cb21-4f3d-a052-d810460b290f tempest-GroupSnapshotsV319Test-2097530846 None] Group snapshot 34773052-ec0b-447b-81e4-04f1e0e92ba3: creating. {{(pid=87098) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 13 13:53:45 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-9c736c2d-cb21-4f3d-a052-d810460b290f tempest-GroupSnapshotsV319Test-2097530846 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:53:45 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-9c736c2d-cb21-4f3d-a052-d810460b290f tempest-GroupSnapshotsV319Test-2097530846 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:53:45 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-9c736c2d-cb21-4f3d-a052-d810460b290f tempest-GroupSnapshotsV319Test-2097530846 None] Creating offline snapshot 84fe8baf-5c2d-47ed-a58d-66f4b14c40fa of volume 14b9dce1-2744-41a7-b20e-83b37bbb67a7 {{(pid=87098) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 13 13:53:45 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0eeb0f5-744c-4499-8523-31de05045f99]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 13:53:45 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-9c736c2d-cb21-4f3d-a052-d810460b290f tempest-GroupSnapshotsV319Test-2097530846 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-14b9dce1-2744-41a7-b20e-83b37bbb67a7 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:53:45 devstack sudo[93163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-14b9dce1-2744-41a7-b20e-83b37bbb67a7 Jul 13 13:53:45 devstack sudo[93163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:53:45 devstack sudo[93163]: pam_unix(sudo:session): session closed for user root Jul 13 13:53:45 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-9c736c2d-cb21-4f3d-a052-d810460b290f tempest-GroupSnapshotsV319Test-2097530846 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-14b9dce1-2744-41a7-b20e-83b37bbb67a7" returned: 0 in 0.407s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:53:45 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-9c736c2d-cb21-4f3d-a052-d810460b290f tempest-GroupSnapshotsV319Test-2097530846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-14b9dce1-2744-41a7-b20e-83b37bbb67a7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-14b9dce1-2744-41a7-b20e-83b37bbb67a7.84fe8baf-5c2d-47ed-a58d-66f4b14c40fa 1G {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:53:46 devstack sudo[93168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-14b9dce1-2744-41a7-b20e-83b37bbb67a7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-14b9dce1-2744-41a7-b20e-83b37bbb67a7.84fe8baf-5c2d-47ed-a58d-66f4b14c40fa 1G Jul 13 13:53:46 devstack sudo[93168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:53:46 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-d737dbcf-903a-4358-8b5e-513bc8d73af9 tempest-VolumesDeleteCascade-447158706 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:53:46 devstack sudo[93168]: pam_unix(sudo:session): session closed for user root Jul 13 13:53:46 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-9c736c2d-cb21-4f3d-a052-d810460b290f tempest-GroupSnapshotsV319Test-2097530846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-14b9dce1-2744-41a7-b20e-83b37bbb67a7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-14b9dce1-2744-41a7-b20e-83b37bbb67a7.84fe8baf-5c2d-47ed-a58d-66f4b14c40fa 1G" returned: 0 in 0.546s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:53:46 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-9c736c2d-cb21-4f3d-a052-d810460b290f tempest-GroupSnapshotsV319Test-2097530846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-14b9dce1-2744-41a7-b20e-83b37bbb67a7 -F qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-14b9dce1-2744-41a7-b20e-83b37bbb67a7.84fe8baf-5c2d-47ed-a58d-66f4b14c40fa {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:53:46 devstack sudo[93175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-14b9dce1-2744-41a7-b20e-83b37bbb67a7 -F qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-14b9dce1-2744-41a7-b20e-83b37bbb67a7.84fe8baf-5c2d-47ed-a58d-66f4b14c40fa Jul 13 13:53:46 devstack sudo[93175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:53:46 devstack sudo[93175]: pam_unix(sudo:session): session closed for user root Jul 13 13:53:46 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-9c736c2d-cb21-4f3d-a052-d810460b290f tempest-GroupSnapshotsV319Test-2097530846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-14b9dce1-2744-41a7-b20e-83b37bbb67a7 -F qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-14b9dce1-2744-41a7-b20e-83b37bbb67a7.84fe8baf-5c2d-47ed-a58d-66f4b14c40fa" returned: 0 in 0.418s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:53:46 devstack cinder-volume[87098]: WARNING cinder.volume.drivers.remotefs [None req-9c736c2d-cb21-4f3d-a052-d810460b290f tempest-GroupSnapshotsV319Test-2097530846 None] /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-14b9dce1-2744-41a7-b20e-83b37bbb67a7.84fe8baf-5c2d-47ed-a58d-66f4b14c40fa is being set with open permissions: ugo+rw: NotImplementedError Jul 13 13:53:46 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-9c736c2d-cb21-4f3d-a052-d810460b290f tempest-GroupSnapshotsV319Test-2097530846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-14b9dce1-2744-41a7-b20e-83b37bbb67a7.84fe8baf-5c2d-47ed-a58d-66f4b14c40fa {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:53:46 devstack sudo[93180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-14b9dce1-2744-41a7-b20e-83b37bbb67a7.84fe8baf-5c2d-47ed-a58d-66f4b14c40fa Jul 13 13:53:46 devstack sudo[93180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:53:47 devstack sudo[93180]: pam_unix(sudo:session): session closed for user root Jul 13 13:53:47 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-9c736c2d-cb21-4f3d-a052-d810460b290f tempest-GroupSnapshotsV319Test-2097530846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-14b9dce1-2744-41a7-b20e-83b37bbb67a7.84fe8baf-5c2d-47ed-a58d-66f4b14c40fa" returned: 0 in 0.272s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:53:47 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-9c736c2d-cb21-4f3d-a052-d810460b290f tempest-GroupSnapshotsV319Test-2097530846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-14b9dce1-2744-41a7-b20e-83b37bbb67a7.info {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:53:47 devstack sudo[93183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-14b9dce1-2744-41a7-b20e-83b37bbb67a7.info Jul 13 13:53:47 devstack sudo[93183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:53:47 devstack sudo[93183]: pam_unix(sudo:session): session closed for user root Jul 13 13:53:47 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-9c736c2d-cb21-4f3d-a052-d810460b290f tempest-GroupSnapshotsV319Test-2097530846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-14b9dce1-2744-41a7-b20e-83b37bbb67a7.info" returned: 0 in 0.329s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:53:47 devstack cinder-volume[87098]: WARNING cinder.volume.drivers.remotefs [None req-9c736c2d-cb21-4f3d-a052-d810460b290f tempest-GroupSnapshotsV319Test-2097530846 None] /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-14b9dce1-2744-41a7-b20e-83b37bbb67a7.info is being set with open permissions: ugo+rw: NotImplementedError Jul 13 13:53:47 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-9c736c2d-cb21-4f3d-a052-d810460b290f tempest-GroupSnapshotsV319Test-2097530846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-14b9dce1-2744-41a7-b20e-83b37bbb67a7.info {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:53:47 devstack sudo[93186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-14b9dce1-2744-41a7-b20e-83b37bbb67a7.info Jul 13 13:53:47 devstack sudo[93186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:53:47 devstack sudo[93186]: pam_unix(sudo:session): session closed for user root Jul 13 13:53:47 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-9c736c2d-cb21-4f3d-a052-d810460b290f tempest-GroupSnapshotsV319Test-2097530846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-14b9dce1-2744-41a7-b20e-83b37bbb67a7.info" returned: 0 in 0.295s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:53:47 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-9c736c2d-cb21-4f3d-a052-d810460b290f tempest-GroupSnapshotsV319Test-2097530846 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.373s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:53:47 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-d737dbcf-903a-4358-8b5e-513bc8d73af9 tempest-VolumesDeleteCascade-447158706 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.400s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:53:47 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-d737dbcf-903a-4358-8b5e-513bc8d73af9 tempest-VolumesDeleteCascade-447158706 None] Creating offline snapshot c5016170-2d95-4942-a473-780784239acc of volume 26eca4b6-46d1-4f91-8dcc-005aa8d36ec6 {{(pid=87098) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 13 13:53:47 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5be9179-57ea-4ef6-b9e1-adafc3fa7d8b]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 13:53:47 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-d737dbcf-903a-4358-8b5e-513bc8d73af9 tempest-VolumesDeleteCascade-447158706 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-26eca4b6-46d1-4f91-8dcc-005aa8d36ec6 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:53:48 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-9c736c2d-cb21-4f3d-a052-d810460b290f tempest-GroupSnapshotsV319Test-2097530846 None] group_snapshot 34773052-ec0b-447b-81e4-04f1e0e92ba3: created successfully Jul 13 13:53:48 devstack sudo[93189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-26eca4b6-46d1-4f91-8dcc-005aa8d36ec6 Jul 13 13:53:48 devstack sudo[93189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:53:48 devstack sudo[93189]: pam_unix(sudo:session): session closed for user root Jul 13 13:53:48 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-d737dbcf-903a-4358-8b5e-513bc8d73af9 tempest-VolumesDeleteCascade-447158706 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-26eca4b6-46d1-4f91-8dcc-005aa8d36ec6" returned: 0 in 0.482s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:53:48 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-d737dbcf-903a-4358-8b5e-513bc8d73af9 tempest-VolumesDeleteCascade-447158706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-26eca4b6-46d1-4f91-8dcc-005aa8d36ec6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-26eca4b6-46d1-4f91-8dcc-005aa8d36ec6.c5016170-2d95-4942-a473-780784239acc 1G {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:53:48 devstack sudo[93194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-26eca4b6-46d1-4f91-8dcc-005aa8d36ec6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-26eca4b6-46d1-4f91-8dcc-005aa8d36ec6.c5016170-2d95-4942-a473-780784239acc 1G Jul 13 13:53:48 devstack sudo[93194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:53:49 devstack sudo[93194]: pam_unix(sudo:session): session closed for user root Jul 13 13:53:49 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-d737dbcf-903a-4358-8b5e-513bc8d73af9 tempest-VolumesDeleteCascade-447158706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-26eca4b6-46d1-4f91-8dcc-005aa8d36ec6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-26eca4b6-46d1-4f91-8dcc-005aa8d36ec6.c5016170-2d95-4942-a473-780784239acc 1G" returned: 0 in 0.735s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:53:49 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-d737dbcf-903a-4358-8b5e-513bc8d73af9 tempest-VolumesDeleteCascade-447158706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-26eca4b6-46d1-4f91-8dcc-005aa8d36ec6 -F qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-26eca4b6-46d1-4f91-8dcc-005aa8d36ec6.c5016170-2d95-4942-a473-780784239acc {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:53:49 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-7d76020d-68ea-40ec-a753-9c6bcdf2e2be tempest-GroupSnapshotsV319Test-2097530846 None] group_snapshot 34773052-ec0b-447b-81e4-04f1e0e92ba3: deleting Jul 13 13:53:49 devstack sudo[93199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-26eca4b6-46d1-4f91-8dcc-005aa8d36ec6 -F qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-26eca4b6-46d1-4f91-8dcc-005aa8d36ec6.c5016170-2d95-4942-a473-780784239acc Jul 13 13:53:49 devstack sudo[93199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:53:49 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-7d76020d-68ea-40ec-a753-9c6bcdf2e2be tempest-GroupSnapshotsV319Test-2097530846 None] group_snapshot 34773052-ec0b-447b-81e4-04f1e0e92ba3: deleting {{(pid=87098) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 13 13:53:49 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-7d76020d-68ea-40ec-a753-9c6bcdf2e2be tempest-GroupSnapshotsV319Test-2097530846 None] Acquiring lock "cinder-quobyte-14b9dce1-2744-41a7-b20e-83b37bbb67a7" by "delete_snapshot" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 13:53:49 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-7d76020d-68ea-40ec-a753-9c6bcdf2e2be tempest-GroupSnapshotsV319Test-2097530846 None] Lock "cinder-quobyte-14b9dce1-2744-41a7-b20e-83b37bbb67a7" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 13:53:49 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-7d76020d-68ea-40ec-a753-9c6bcdf2e2be tempest-GroupSnapshotsV319Test-2097530846 None] Acquiring lock "cinder-quobyte-84fe8baf-5c2d-47ed-a58d-66f4b14c40fa" by "_delete_snapshot" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 13:53:49 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-7d76020d-68ea-40ec-a753-9c6bcdf2e2be tempest-GroupSnapshotsV319Test-2097530846 None] Lock "cinder-quobyte-84fe8baf-5c2d-47ed-a58d-66f4b14c40fa" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 13:53:49 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-7d76020d-68ea-40ec-a753-9c6bcdf2e2be tempest-GroupSnapshotsV319Test-2097530846 None] Deleting offline snapshot 84fe8baf-5c2d-47ed-a58d-66f4b14c40fa of volume 14b9dce1-2744-41a7-b20e-83b37bbb67a7 {{(pid=87098) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 13 13:53:49 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-7d76020d-68ea-40ec-a753-9c6bcdf2e2be tempest-GroupSnapshotsV319Test-2097530846 None] snapshot_file for this snap is: volume-14b9dce1-2744-41a7-b20e-83b37bbb67a7.84fe8baf-5c2d-47ed-a58d-66f4b14c40fa {{(pid=87098) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 13 13:53:49 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[593c3fc8-c07b-4059-90c5-9153792c301f]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 13:53:49 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-7d76020d-68ea-40ec-a753-9c6bcdf2e2be tempest-GroupSnapshotsV319Test-2097530846 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-14b9dce1-2744-41a7-b20e-83b37bbb67a7.84fe8baf-5c2d-47ed-a58d-66f4b14c40fa {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:53:49 devstack sudo[93201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-14b9dce1-2744-41a7-b20e-83b37bbb67a7.84fe8baf-5c2d-47ed-a58d-66f4b14c40fa Jul 13 13:53:49 devstack sudo[93201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:53:49 devstack sudo[93199]: pam_unix(sudo:session): session closed for user root Jul 13 13:53:49 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-d737dbcf-903a-4358-8b5e-513bc8d73af9 tempest-VolumesDeleteCascade-447158706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-26eca4b6-46d1-4f91-8dcc-005aa8d36ec6 -F qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-26eca4b6-46d1-4f91-8dcc-005aa8d36ec6.c5016170-2d95-4942-a473-780784239acc" returned: 0 in 0.497s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:53:49 devstack cinder-volume[87098]: WARNING cinder.volume.drivers.remotefs [None req-d737dbcf-903a-4358-8b5e-513bc8d73af9 tempest-VolumesDeleteCascade-447158706 None] /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-26eca4b6-46d1-4f91-8dcc-005aa8d36ec6.c5016170-2d95-4942-a473-780784239acc is being set with open permissions: ugo+rw Jul 13 13:53:49 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-d737dbcf-903a-4358-8b5e-513bc8d73af9 tempest-VolumesDeleteCascade-447158706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-26eca4b6-46d1-4f91-8dcc-005aa8d36ec6.c5016170-2d95-4942-a473-780784239acc {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:53:49 devstack sudo[93206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-26eca4b6-46d1-4f91-8dcc-005aa8d36ec6.c5016170-2d95-4942-a473-780784239acc Jul 13 13:53:49 devstack sudo[93206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:53:49 devstack sudo[93201]: pam_unix(sudo:session): session closed for user root Jul 13 13:53:50 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-7d76020d-68ea-40ec-a753-9c6bcdf2e2be tempest-GroupSnapshotsV319Test-2097530846 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-14b9dce1-2744-41a7-b20e-83b37bbb67a7.84fe8baf-5c2d-47ed-a58d-66f4b14c40fa" returned: 0 in 0.557s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:53:50 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-7d76020d-68ea-40ec-a753-9c6bcdf2e2be tempest-GroupSnapshotsV319Test-2097530846 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-14b9dce1-2744-41a7-b20e-83b37bbb67a7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87098) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 13 13:53:50 devstack sudo[93206]: pam_unix(sudo:session): session closed for user root Jul 13 13:53:50 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-d737dbcf-903a-4358-8b5e-513bc8d73af9 tempest-VolumesDeleteCascade-447158706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-26eca4b6-46d1-4f91-8dcc-005aa8d36ec6.c5016170-2d95-4942-a473-780784239acc" returned: 0 in 0.347s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:53:50 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8e3f483-98de-4502-b8a4-ba4caab64a0f]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 13:53:50 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-7d76020d-68ea-40ec-a753-9c6bcdf2e2be tempest-GroupSnapshotsV319Test-2097530846 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-14b9dce1-2744-41a7-b20e-83b37bbb67a7 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:53:50 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-ddf3b2f7-f47d-4606-8c6f-0284bc9b4d01 tempest-VolumeRetypeWithoutMigrationTest-1961621955 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 13:53:50 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-ddf3b2f7-f47d-4606-8c6f-0284bc9b4d01 tempest-VolumeRetypeWithoutMigrationTest-1961621955 None] Flow 'volume_create_manager' (97e74471-b38e-400d-9687-78c3dbcf2cbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 13:53:50 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-ddf3b2f7-f47d-4606-8c6f-0284bc9b4d01 tempest-VolumeRetypeWithoutMigrationTest-1961621955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (455ca401-e871-4e56-ac1d-664fd9ac5418) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:53:50 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-d737dbcf-903a-4358-8b5e-513bc8d73af9 tempest-VolumesDeleteCascade-447158706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-26eca4b6-46d1-4f91-8dcc-005aa8d36ec6.info {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:53:50 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-ddf3b2f7-f47d-4606-8c6f-0284bc9b4d01 tempest-VolumeRetypeWithoutMigrationTest-1961621955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (455ca401-e871-4e56-ac1d-664fd9ac5418) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T11:53:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1878618902',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ea40e6d-d09a-4fb2-a578-117e223d761f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e9f52ba4c9834f86b7c90756cb3b1bfc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T11:53:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T11:53:50Z,use_quota=True,user_id='3d89a290b4924e84a7d3344c74f1a3a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(40270e47-b9ab-415c-94e3-aac4cf485b30),volume_type_id=40270e47-b9ab-415c-94e3-aac4cf485b30)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:53:50 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-ddf3b2f7-f47d-4606-8c6f-0284bc9b4d01 tempest-VolumeRetypeWithoutMigrationTest-1961621955 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fae428dc-0b08-4d04-a026-a3b66a525edc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:53:50 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-ddf3b2f7-f47d-4606-8c6f-0284bc9b4d01 tempest-VolumeRetypeWithoutMigrationTest-1961621955 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fae428dc-0b08-4d04-a026-a3b66a525edc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:53:50 devstack sudo[93212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-14b9dce1-2744-41a7-b20e-83b37bbb67a7 Jul 13 13:53:50 devstack sudo[93212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:53:50 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-ddf3b2f7-f47d-4606-8c6f-0284bc9b4d01 tempest-VolumeRetypeWithoutMigrationTest-1961621955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fdf2214c-4a8e-465d-8ef5-f5de5b31aba8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:53:50 devstack sudo[93213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-26eca4b6-46d1-4f91-8dcc-005aa8d36ec6.info Jul 13 13:53:50 devstack sudo[93213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:53:50 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-ddf3b2f7-f47d-4606-8c6f-0284bc9b4d01 tempest-VolumeRetypeWithoutMigrationTest-1961621955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fdf2214c-4a8e-465d-8ef5-f5de5b31aba8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8ea40e6d-d09a-4fb2-a578-117e223d761f', 'volume_name': 'volume-8ea40e6d-d09a-4fb2-a578-117e223d761f', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:53:50 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-ddf3b2f7-f47d-4606-8c6f-0284bc9b4d01 tempest-VolumeRetypeWithoutMigrationTest-1961621955 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15320ea0-0258-4370-8c08-f6d3db030c0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:53:50 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-ddf3b2f7-f47d-4606-8c6f-0284bc9b4d01 tempest-VolumeRetypeWithoutMigrationTest-1961621955 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15320ea0-0258-4370-8c08-f6d3db030c0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:53:50 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-ddf3b2f7-f47d-4606-8c6f-0284bc9b4d01 tempest-VolumeRetypeWithoutMigrationTest-1961621955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57f646d9-e21e-4ecd-b3a1-480a762e41bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:53:50 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-ddf3b2f7-f47d-4606-8c6f-0284bc9b4d01 tempest-VolumeRetypeWithoutMigrationTest-1961621955 None] Volume 8ea40e6d-d09a-4fb2-a578-117e223d761f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8ea40e6d-d09a-4fb2-a578-117e223d761f', 'volume_size': 1} Jul 13 13:53:50 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-ddf3b2f7-f47d-4606-8c6f-0284bc9b4d01 tempest-VolumeRetypeWithoutMigrationTest-1961621955 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:53:50 devstack sudo[93213]: pam_unix(sudo:session): session closed for user root Jul 13 13:53:50 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-d737dbcf-903a-4358-8b5e-513bc8d73af9 tempest-VolumesDeleteCascade-447158706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-26eca4b6-46d1-4f91-8dcc-005aa8d36ec6.info" returned: 0 in 0.305s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:53:50 devstack cinder-volume[87098]: WARNING cinder.volume.drivers.remotefs [None req-d737dbcf-903a-4358-8b5e-513bc8d73af9 tempest-VolumesDeleteCascade-447158706 None] /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-26eca4b6-46d1-4f91-8dcc-005aa8d36ec6.info is being set with open permissions: ugo+rw Jul 13 13:53:50 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-d737dbcf-903a-4358-8b5e-513bc8d73af9 tempest-VolumesDeleteCascade-447158706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-26eca4b6-46d1-4f91-8dcc-005aa8d36ec6.info {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:53:50 devstack sudo[93212]: pam_unix(sudo:session): session closed for user root Jul 13 13:53:50 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-7d76020d-68ea-40ec-a753-9c6bcdf2e2be tempest-GroupSnapshotsV319Test-2097530846 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-14b9dce1-2744-41a7-b20e-83b37bbb67a7" returned: 0 in 0.424s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:53:50 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-7d76020d-68ea-40ec-a753-9c6bcdf2e2be tempest-GroupSnapshotsV319Test-2097530846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-14b9dce1-2744-41a7-b20e-83b37bbb67a7.84fe8baf-5c2d-47ed-a58d-66f4b14c40fa {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:53:50 devstack sudo[93220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-26eca4b6-46d1-4f91-8dcc-005aa8d36ec6.info Jul 13 13:53:50 devstack sudo[93220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:53:50 devstack sudo[93222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-14b9dce1-2744-41a7-b20e-83b37bbb67a7.84fe8baf-5c2d-47ed-a58d-66f4b14c40fa Jul 13 13:53:50 devstack sudo[93222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:53:50 devstack sudo[93220]: pam_unix(sudo:session): session closed for user root Jul 13 13:53:50 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-d737dbcf-903a-4358-8b5e-513bc8d73af9 tempest-VolumesDeleteCascade-447158706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-26eca4b6-46d1-4f91-8dcc-005aa8d36ec6.info" returned: 0 in 0.305s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:53:50 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-d737dbcf-903a-4358-8b5e-513bc8d73af9 tempest-VolumesDeleteCascade-447158706 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.859s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:53:50 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-ddf3b2f7-f47d-4606-8c6f-0284bc9b4d01 tempest-VolumeRetypeWithoutMigrationTest-1961621955 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.562s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:53:50 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-ddf3b2f7-f47d-4606-8c6f-0284bc9b4d01 tempest-VolumeRetypeWithoutMigrationTest-1961621955 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T11:53:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1878618902',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ea40e6d-d09a-4fb2-a578-117e223d761f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e9f52ba4c9834f86b7c90756cb3b1bfc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T11:53:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T11:53:50Z,use_quota=True,user_id='3d89a290b4924e84a7d3344c74f1a3a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(40270e47-b9ab-415c-94e3-aac4cf485b30),volume_type_id=40270e47-b9ab-415c-94e3-aac4cf485b30)}" {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 13 13:53:50 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-ddf3b2f7-f47d-4606-8c6f-0284bc9b4d01 tempest-VolumeRetypeWithoutMigrationTest-1961621955 None] Creating volume 8ea40e6d-d09a-4fb2-a578-117e223d761f {{(pid=87098) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 13 13:53:50 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-ddf3b2f7-f47d-4606-8c6f-0284bc9b4d01 tempest-VolumeRetypeWithoutMigrationTest-1961621955 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:53:50 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-ddf3b2f7-f47d-4606-8c6f-0284bc9b4d01 tempest-VolumeRetypeWithoutMigrationTest-1961621955 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:53:50 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-ddf3b2f7-f47d-4606-8c6f-0284bc9b4d01 tempest-VolumeRetypeWithoutMigrationTest-1961621955 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 13:53:50 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-ddf3b2f7-f47d-4606-8c6f-0284bc9b4d01 tempest-VolumeRetypeWithoutMigrationTest-1961621955 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 13:53:50 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-ddf3b2f7-f47d-4606-8c6f-0284bc9b4d01 tempest-VolumeRetypeWithoutMigrationTest-1961621955 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:53:50 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-ddf3b2f7-f47d-4606-8c6f-0284bc9b4d01 tempest-VolumeRetypeWithoutMigrationTest-1961621955 None] Selected osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 13:53:50 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-ddf3b2f7-f47d-4606-8c6f-0284bc9b4d01 tempest-VolumeRetypeWithoutMigrationTest-1961621955 None] casted to osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 Jul 13 13:53:50 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-ddf3b2f7-f47d-4606-8c6f-0284bc9b4d01 tempest-VolumeRetypeWithoutMigrationTest-1961621955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-8ea40e6d-d09a-4fb2-a578-117e223d761f 1073741824 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:53:50 devstack sudo[93229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-8ea40e6d-d09a-4fb2-a578-117e223d761f 1073741824 Jul 13 13:53:50 devstack sudo[93229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:53:50 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-d737dbcf-903a-4358-8b5e-513bc8d73af9 tempest-VolumesDeleteCascade-447158706 None] Create snapshot completed successfully Jul 13 13:53:50 devstack sudo[93222]: pam_unix(sudo:session): session closed for user root Jul 13 13:53:50 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-7d76020d-68ea-40ec-a753-9c6bcdf2e2be tempest-GroupSnapshotsV319Test-2097530846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-14b9dce1-2744-41a7-b20e-83b37bbb67a7.84fe8baf-5c2d-47ed-a58d-66f4b14c40fa" returned: 0 in 0.423s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:53:50 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-7d76020d-68ea-40ec-a753-9c6bcdf2e2be tempest-GroupSnapshotsV319Test-2097530846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-14b9dce1-2744-41a7-b20e-83b37bbb67a7.84fe8baf-5c2d-47ed-a58d-66f4b14c40fa {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:53:50 devstack sudo[93231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-14b9dce1-2744-41a7-b20e-83b37bbb67a7.84fe8baf-5c2d-47ed-a58d-66f4b14c40fa Jul 13 13:53:50 devstack sudo[93231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:53:51 devstack sudo[93231]: pam_unix(sudo:session): session closed for user root Jul 13 13:53:51 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-7d76020d-68ea-40ec-a753-9c6bcdf2e2be tempest-GroupSnapshotsV319Test-2097530846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-14b9dce1-2744-41a7-b20e-83b37bbb67a7.84fe8baf-5c2d-47ed-a58d-66f4b14c40fa" returned: 0 in 0.294s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:53:51 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-7d76020d-68ea-40ec-a753-9c6bcdf2e2be tempest-GroupSnapshotsV319Test-2097530846 None] Lock "cinder-quobyte-84fe8baf-5c2d-47ed-a58d-66f4b14c40fa" released by "_delete_snapshot" :: held 1.852s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 13:53:51 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-7d76020d-68ea-40ec-a753-9c6bcdf2e2be tempest-GroupSnapshotsV319Test-2097530846 None] Lock "cinder-quobyte-14b9dce1-2744-41a7-b20e-83b37bbb67a7" released by "delete_snapshot" :: held 1.885s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 13:53:51 devstack sudo[93229]: pam_unix(sudo:session): session closed for user root Jul 13 13:53:51 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-ddf3b2f7-f47d-4606-8c6f-0284bc9b4d01 tempest-VolumeRetypeWithoutMigrationTest-1961621955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-8ea40e6d-d09a-4fb2-a578-117e223d761f 1073741824" returned: 0 in 0.509s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:53:51 devstack cinder-volume[87098]: WARNING cinder.quota [None req-7d76020d-68ea-40ec-a753-9c6bcdf2e2be tempest-GroupSnapshotsV319Test-2097530846 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1927549925 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1927549925, it is now deprecated. Please use the default quota class for default quota. Jul 13 13:53:51 devstack cinder-volume[87098]: WARNING cinder.quota [None req-7d76020d-68ea-40ec-a753-9c6bcdf2e2be tempest-GroupSnapshotsV319Test-2097530846 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1927549925 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1927549925, it is now deprecated. Please use the default quota class for default quota. Jul 13 13:53:51 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-ddf3b2f7-f47d-4606-8c6f-0284bc9b4d01 tempest-VolumeRetypeWithoutMigrationTest-1961621955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-8ea40e6d-d09a-4fb2-a578-117e223d761f {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:53:51 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-7d76020d-68ea-40ec-a753-9c6bcdf2e2be tempest-GroupSnapshotsV319Test-2097530846 None] Created reservations ['38e0f2ec-629f-49db-8c0b-b396556886d4', 'f0b88ae7-3d74-4c9c-98c7-df8c5de3fc93', '4368e6d5-2376-4bf7-a692-955dd85be6c9', 'e3dca5cb-88de-4836-9e11-a57294ad0039'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 13:53:51 devstack sudo[93237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-8ea40e6d-d09a-4fb2-a578-117e223d761f Jul 13 13:53:51 devstack sudo[93237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:53:51 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-7d76020d-68ea-40ec-a753-9c6bcdf2e2be tempest-GroupSnapshotsV319Test-2097530846 None] group_snapshot 34773052-ec0b-447b-81e4-04f1e0e92ba3: deleted successfully Jul 13 13:53:51 devstack sudo[93237]: pam_unix(sudo:session): session closed for user root Jul 13 13:53:51 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-ddf3b2f7-f47d-4606-8c6f-0284bc9b4d01 tempest-VolumeRetypeWithoutMigrationTest-1961621955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-8ea40e6d-d09a-4fb2-a578-117e223d761f" returned: 0 in 0.341s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:53:51 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-ddf3b2f7-f47d-4606-8c6f-0284bc9b4d01 tempest-VolumeRetypeWithoutMigrationTest-1961621955 None] <== create_volume: return (899ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'} {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 13 13:53:51 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-ddf3b2f7-f47d-4606-8c6f-0284bc9b4d01 tempest-VolumeRetypeWithoutMigrationTest-1961621955 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.902s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:53:51 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-ddf3b2f7-f47d-4606-8c6f-0284bc9b4d01 tempest-VolumeRetypeWithoutMigrationTest-1961621955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57f646d9-e21e-4ecd-b3a1-480a762e41bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8ea40e6d-d09a-4fb2-a578-117e223d761f', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:53:51 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-ddf3b2f7-f47d-4606-8c6f-0284bc9b4d01 tempest-VolumeRetypeWithoutMigrationTest-1961621955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18fa7dfa-0c1f-4ba1-a432-193cf5437cd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:53:51 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-ddf3b2f7-f47d-4606-8c6f-0284bc9b4d01 tempest-VolumeRetypeWithoutMigrationTest-1961621955 None] Volume volume-8ea40e6d-d09a-4fb2-a578-117e223d761f (8ea40e6d-d09a-4fb2-a578-117e223d761f): created successfully Jul 13 13:53:51 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-ddf3b2f7-f47d-4606-8c6f-0284bc9b4d01 tempest-VolumeRetypeWithoutMigrationTest-1961621955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18fa7dfa-0c1f-4ba1-a432-193cf5437cd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:53:51 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-ddf3b2f7-f47d-4606-8c6f-0284bc9b4d01 tempest-VolumeRetypeWithoutMigrationTest-1961621955 None] Flow 'volume_create_manager' (97e74471-b38e-400d-9687-78c3dbcf2cbe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 13:53:51 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-ddf3b2f7-f47d-4606-8c6f-0284bc9b4d01 tempest-VolumeRetypeWithoutMigrationTest-1961621955 None] Created volume successfully. Jul 13 13:53:52 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-1914526d-2ee5-43e6-8210-815474af3b0c tempest-GroupSnapshotsV319Test-2097530846 None] Acquiring lock "cinder-quobyte-14b9dce1-2744-41a7-b20e-83b37bbb67a7" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 13:53:52 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-1914526d-2ee5-43e6-8210-815474af3b0c tempest-GroupSnapshotsV319Test-2097530846 None] Lock "cinder-quobyte-14b9dce1-2744-41a7-b20e-83b37bbb67a7" acquired by "delete_volume" :: waited 0.027s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 13:53:52 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[32cd1467-fd24-4e91-8741-e0ecee61d5b9]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 13:53:52 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-1914526d-2ee5-43e6-8210-815474af3b0c tempest-GroupSnapshotsV319Test-2097530846 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-14b9dce1-2744-41a7-b20e-83b37bbb67a7 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:53:52 devstack sudo[93240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-14b9dce1-2744-41a7-b20e-83b37bbb67a7 Jul 13 13:53:52 devstack sudo[93240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:53:52 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-c756f130-dd71-436f-8c68-c39c22006222 tempest-VolumesDeleteCascade-447158706 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 13:53:52 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-c756f130-dd71-436f-8c68-c39c22006222 tempest-VolumesDeleteCascade-447158706 None] Flow 'volume_create_manager' (c5ba4336-a751-46a9-b7ea-d541d9cdd6c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 13:53:52 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-c756f130-dd71-436f-8c68-c39c22006222 tempest-VolumesDeleteCascade-447158706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dcff328c-654b-4a5b-a5f4-99ae074c6145) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:53:52 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-c756f130-dd71-436f-8c68-c39c22006222 tempest-VolumesDeleteCascade-447158706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dcff328c-654b-4a5b-a5f4-99ae074c6145) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T11:53:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1886123039',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0db4affc-9ded-423f-a6d4-81dfa9150238,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b76618fc355f47ae9294b7d4418a265c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T11:53:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=c5016170-2d95-4942-a473-780784239acc,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T11:53:52Z,use_quota=True,user_id='c8b53fcce91246de98b34c2f5b885ade',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1147de8b-623b-426c-a13d-7fc824a80f67),volume_type_id=1147de8b-623b-426c-a13d-7fc824a80f67)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:53:52 devstack sudo[93240]: pam_unix(sudo:session): session closed for user root Jul 13 13:53:52 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-c756f130-dd71-436f-8c68-c39c22006222 tempest-VolumesDeleteCascade-447158706 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3579cea-02ad-4780-bc65-76f443e6786c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:53:52 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-c756f130-dd71-436f-8c68-c39c22006222 tempest-VolumesDeleteCascade-447158706 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3579cea-02ad-4780-bc65-76f443e6786c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:53:52 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-c756f130-dd71-436f-8c68-c39c22006222 tempest-VolumesDeleteCascade-447158706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78adb75a-794b-4625-932b-306fab93ac3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:53:52 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-c756f130-dd71-436f-8c68-c39c22006222 tempest-VolumesDeleteCascade-447158706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78adb75a-794b-4625-932b-306fab93ac3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '0db4affc-9ded-423f-a6d4-81dfa9150238', 'volume_name': 'volume-0db4affc-9ded-423f-a6d4-81dfa9150238', 'volume_size': 1, 'snapshot_id': 'c5016170-2d95-4942-a473-780784239acc'}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:53:52 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-c756f130-dd71-436f-8c68-c39c22006222 tempest-VolumesDeleteCascade-447158706 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f41884d5-c58b-46d3-885c-383592e73f15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:53:52 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-c756f130-dd71-436f-8c68-c39c22006222 tempest-VolumesDeleteCascade-447158706 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f41884d5-c58b-46d3-885c-383592e73f15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:53:52 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-c756f130-dd71-436f-8c68-c39c22006222 tempest-VolumesDeleteCascade-447158706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7d5546b-4741-473d-a634-68d160d4948b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:53:52 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-c756f130-dd71-436f-8c68-c39c22006222 tempest-VolumesDeleteCascade-447158706 None] Volume 0db4affc-9ded-423f-a6d4-81dfa9150238: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-0db4affc-9ded-423f-a6d4-81dfa9150238', 'volume_size': 1, 'snapshot_id': 'c5016170-2d95-4942-a473-780784239acc'} Jul 13 13:53:52 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-1914526d-2ee5-43e6-8210-815474af3b0c tempest-GroupSnapshotsV319Test-2097530846 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-14b9dce1-2744-41a7-b20e-83b37bbb67a7" returned: 0 in 0.560s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:53:52 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-1914526d-2ee5-43e6-8210-815474af3b0c tempest-GroupSnapshotsV319Test-2097530846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-14b9dce1-2744-41a7-b20e-83b37bbb67a7 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:53:52 devstack sudo[93246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-14b9dce1-2744-41a7-b20e-83b37bbb67a7 Jul 13 13:53:52 devstack sudo[93246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:53:52 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-c756f130-dd71-436f-8c68-c39c22006222 tempest-VolumesDeleteCascade-447158706 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:53:52 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-c756f130-dd71-436f-8c68-c39c22006222 tempest-VolumesDeleteCascade-447158706 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:53:52 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-c756f130-dd71-436f-8c68-c39c22006222 tempest-VolumesDeleteCascade-447158706 None] Acquiring lock "cinder-quobyte-c5016170-2d95-4942-a473-780784239acc-0db4affc-9ded-423f-a6d4-81dfa9150238" by "_create_volume_from_snapshot" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 13:53:52 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-c756f130-dd71-436f-8c68-c39c22006222 tempest-VolumesDeleteCascade-447158706 None] Lock "cinder-quobyte-c5016170-2d95-4942-a473-780784239acc-0db4affc-9ded-423f-a6d4-81dfa9150238" acquired by "_create_volume_from_snapshot" :: waited 0.020s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 13:53:52 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-c756f130-dd71-436f-8c68-c39c22006222 tempest-VolumesDeleteCascade-447158706 None] Creating volume 0db4affc-9ded-423f-a6d4-81dfa9150238 from snapshot c5016170-2d95-4942-a473-780784239acc {{(pid=87098) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 13 13:53:52 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-c756f130-dd71-436f-8c68-c39c22006222 tempest-VolumesDeleteCascade-447158706 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:53:52 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-c756f130-dd71-436f-8c68-c39c22006222 tempest-VolumesDeleteCascade-447158706 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:53:52 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-c756f130-dd71-436f-8c68-c39c22006222 tempest-VolumesDeleteCascade-447158706 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 13:53:52 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-c756f130-dd71-436f-8c68-c39c22006222 tempest-VolumesDeleteCascade-447158706 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 13:53:52 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-c756f130-dd71-436f-8c68-c39c22006222 tempest-VolumesDeleteCascade-447158706 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:53:52 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-c756f130-dd71-436f-8c68-c39c22006222 tempest-VolumesDeleteCascade-447158706 None] Selected osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 13:53:52 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-c756f130-dd71-436f-8c68-c39c22006222 tempest-VolumesDeleteCascade-447158706 None] Acquiring lock "cinder-quobyte-0db4affc-9ded-423f-a6d4-81dfa9150238" by "_copy_volume_from_snapshot" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 13:53:52 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-c756f130-dd71-436f-8c68-c39c22006222 tempest-VolumesDeleteCascade-447158706 None] Lock "cinder-quobyte-0db4affc-9ded-423f-a6d4-81dfa9150238" acquired by "_copy_volume_from_snapshot" :: waited 0.022s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 13:53:52 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-c756f130-dd71-436f-8c68-c39c22006222 tempest-VolumesDeleteCascade-447158706 None] snapshot: c5016170-2d95-4942-a473-780784239acc, volume: 0db4affc-9ded-423f-a6d4-81dfa9150238, {{(pid=87098) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 13 13:53:52 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-c756f130-dd71-436f-8c68-c39c22006222 tempest-VolumesDeleteCascade-447158706 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:53:52 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-c756f130-dd71-436f-8c68-c39c22006222 tempest-VolumesDeleteCascade-447158706 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:53:52 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-c756f130-dd71-436f-8c68-c39c22006222 tempest-VolumesDeleteCascade-447158706 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 13:53:52 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-c756f130-dd71-436f-8c68-c39c22006222 tempest-VolumesDeleteCascade-447158706 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 13:53:52 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-c756f130-dd71-436f-8c68-c39c22006222 tempest-VolumesDeleteCascade-447158706 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:53:52 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce8e2240-0db9-4270-8c08-caf30d70ed36]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 13:53:52 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-c756f130-dd71-436f-8c68-c39c22006222 tempest-VolumesDeleteCascade-447158706 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-26eca4b6-46d1-4f91-8dcc-005aa8d36ec6.c5016170-2d95-4942-a473-780784239acc {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:53:52 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-d60878e1-18cb-4710-a262-11eac09b0efe tempest-VolumeRetypeWithoutMigrationTest-1961621955 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:53:52 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-d60878e1-18cb-4710-a262-11eac09b0efe tempest-VolumeRetypeWithoutMigrationTest-1961621955 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:53:52 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-d60878e1-18cb-4710-a262-11eac09b0efe tempest-VolumeRetypeWithoutMigrationTest-1961621955 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 13:53:52 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-d60878e1-18cb-4710-a262-11eac09b0efe tempest-VolumeRetypeWithoutMigrationTest-1961621955 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 13:53:52 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-d60878e1-18cb-4710-a262-11eac09b0efe tempest-VolumeRetypeWithoutMigrationTest-1961621955 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:53:52 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-d60878e1-18cb-4710-a262-11eac09b0efe tempest-VolumeRetypeWithoutMigrationTest-1961621955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:53:52 devstack sudo[93249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 Jul 13 13:53:52 devstack sudo[93249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:53:52 devstack sudo[93248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-26eca4b6-46d1-4f91-8dcc-005aa8d36ec6.c5016170-2d95-4942-a473-780784239acc Jul 13 13:53:52 devstack sudo[93248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:53:52 devstack sudo[93246]: pam_unix(sudo:session): session closed for user root Jul 13 13:53:52 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-1914526d-2ee5-43e6-8210-815474af3b0c tempest-GroupSnapshotsV319Test-2097530846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-14b9dce1-2744-41a7-b20e-83b37bbb67a7" returned: 0 in 0.289s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:53:53 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-1914526d-2ee5-43e6-8210-815474af3b0c tempest-GroupSnapshotsV319Test-2097530846 None] Lock "cinder-quobyte-14b9dce1-2744-41a7-b20e-83b37bbb67a7" released by "delete_volume" :: held 0.931s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 13:53:53 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-1914526d-2ee5-43e6-8210-815474af3b0c tempest-GroupSnapshotsV319Test-2097530846 None] Created reservations ['939f192d-5e8e-4517-ae36-15aff9fc5579'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 13:53:53 devstack cinder-volume[87098]: WARNING cinder.quota [None req-1914526d-2ee5-43e6-8210-815474af3b0c tempest-GroupSnapshotsV319Test-2097530846 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1927549925 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1927549925, it is now deprecated. Please use the default quota class for default quota. Jul 13 13:53:53 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-1914526d-2ee5-43e6-8210-815474af3b0c tempest-GroupSnapshotsV319Test-2097530846 None] Created reservations ['eb031ea4-0799-4975-952a-29ff76cc103d', 'dd6d854c-b556-4988-8a16-6c86f06182c7', '2dc6a2d4-b812-4261-ab25-8c28641e6bf8', '121c3123-4ad2-4a49-bf61-b8fb66fea208'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 13:53:53 devstack sudo[93249]: pam_unix(sudo:session): session closed for user root Jul 13 13:53:53 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-d60878e1-18cb-4710-a262-11eac09b0efe tempest-VolumeRetypeWithoutMigrationTest-1961621955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78" returned: 0 in 0.289s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:53:53 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-d60878e1-18cb-4710-a262-11eac09b0efe tempest-VolumeRetypeWithoutMigrationTest-1961621955 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 13:53:53 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-d60878e1-18cb-4710-a262-11eac09b0efe tempest-VolumeRetypeWithoutMigrationTest-1961621955 None] Retype volume completed successfully. Jul 13 13:53:53 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-1914526d-2ee5-43e6-8210-815474af3b0c tempest-GroupSnapshotsV319Test-2097530846 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:53:53 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-1914526d-2ee5-43e6-8210-815474af3b0c tempest-GroupSnapshotsV319Test-2097530846 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:53:53 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-1914526d-2ee5-43e6-8210-815474af3b0c tempest-GroupSnapshotsV319Test-2097530846 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 13:53:53 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-1914526d-2ee5-43e6-8210-815474af3b0c tempest-GroupSnapshotsV319Test-2097530846 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 13:53:53 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-1914526d-2ee5-43e6-8210-815474af3b0c tempest-GroupSnapshotsV319Test-2097530846 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:53:53 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-1914526d-2ee5-43e6-8210-815474af3b0c tempest-GroupSnapshotsV319Test-2097530846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:53:53 devstack sudo[93248]: pam_unix(sudo:session): session closed for user root Jul 13 13:53:53 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-c756f130-dd71-436f-8c68-c39c22006222 tempest-VolumesDeleteCascade-447158706 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-26eca4b6-46d1-4f91-8dcc-005aa8d36ec6.c5016170-2d95-4942-a473-780784239acc" returned: 0 in 0.487s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:53:53 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-c756f130-dd71-436f-8c68-c39c22006222 tempest-VolumesDeleteCascade-447158706 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-26eca4b6-46d1-4f91-8dcc-005aa8d36ec6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87098) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 13 13:53:53 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-c756f130-dd71-436f-8c68-c39c22006222 tempest-VolumesDeleteCascade-447158706 None] will copy from snapshot at /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-26eca4b6-46d1-4f91-8dcc-005aa8d36ec6 {{(pid=87098) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 13 13:53:53 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-c756f130-dd71-436f-8c68-c39c22006222 tempest-VolumesDeleteCascade-447158706 None] Creating direct copy from snapshot {{(pid=87098) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 13 13:53:53 devstack sudo[93257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 Jul 13 13:53:53 devstack sudo[93257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:53:53 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[78f4de5f-373a-4ad8-828a-d06d98c7b3b9]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 13:53:53 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-c756f130-dd71-436f-8c68-c39c22006222 tempest-VolumesDeleteCascade-447158706 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-26eca4b6-46d1-4f91-8dcc-005aa8d36ec6 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:53:53 devstack sudo[93259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-26eca4b6-46d1-4f91-8dcc-005aa8d36ec6 Jul 13 13:53:53 devstack sudo[93259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:53:53 devstack sudo[93257]: pam_unix(sudo:session): session closed for user root Jul 13 13:53:53 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-1914526d-2ee5-43e6-8210-815474af3b0c tempest-GroupSnapshotsV319Test-2097530846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78" returned: 0 in 0.294s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:53:53 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-1914526d-2ee5-43e6-8210-815474af3b0c tempest-GroupSnapshotsV319Test-2097530846 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 13:53:53 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-1914526d-2ee5-43e6-8210-815474af3b0c tempest-GroupSnapshotsV319Test-2097530846 None] Delete group completed successfully. Jul 13 13:53:53 devstack sudo[93259]: pam_unix(sudo:session): session closed for user root Jul 13 13:53:53 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-c756f130-dd71-436f-8c68-c39c22006222 tempest-VolumesDeleteCascade-447158706 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-26eca4b6-46d1-4f91-8dcc-005aa8d36ec6" returned: 0 in 0.413s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:53:53 devstack cinder-volume[87098]: DEBUG cinder.utils [None req-c756f130-dd71-436f-8c68-c39c22006222 tempest-VolumesDeleteCascade-447158706 None] Path /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-0db4affc-9ded-423f-a6d4-81dfa9150238 not found in is_blk_device check {{(pid=87098) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 13 13:53:53 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-c756f130-dd71-436f-8c68-c39c22006222 tempest-VolumesDeleteCascade-447158706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-26eca4b6-46d1-4f91-8dcc-005aa8d36ec6 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-0db4affc-9ded-423f-a6d4-81dfa9150238 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:53:53 devstack sudo[93265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-26eca4b6-46d1-4f91-8dcc-005aa8d36ec6 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-0db4affc-9ded-423f-a6d4-81dfa9150238 Jul 13 13:53:53 devstack sudo[93265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:53:54 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-f5eeabcf-ea94-42d7-87e6-72a3526d7097 tempest-VolumeRetypeWithoutMigrationTest-1961621955 None] Acquiring lock "cinder-8ea40e6d-d09a-4fb2-a578-117e223d761f-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 13:53:54 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-f5eeabcf-ea94-42d7-87e6-72a3526d7097 tempest-VolumeRetypeWithoutMigrationTest-1961621955 None] Lock "cinder-8ea40e6d-d09a-4fb2-a578-117e223d761f-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 13:53:54 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-f5eeabcf-ea94-42d7-87e6-72a3526d7097 tempest-VolumeRetypeWithoutMigrationTest-1961621955 None] Acquiring lock "cinder-quobyte-8ea40e6d-d09a-4fb2-a578-117e223d761f" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 13:53:54 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-f5eeabcf-ea94-42d7-87e6-72a3526d7097 tempest-VolumeRetypeWithoutMigrationTest-1961621955 None] Lock "cinder-quobyte-8ea40e6d-d09a-4fb2-a578-117e223d761f" acquired by "delete_volume" :: waited 0.019s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 13:53:54 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[143ade8a-c601-4165-959a-a198d4692ddf]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 13:53:54 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-f5eeabcf-ea94-42d7-87e6-72a3526d7097 tempest-VolumeRetypeWithoutMigrationTest-1961621955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-8ea40e6d-d09a-4fb2-a578-117e223d761f {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:53:54 devstack sudo[93270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-8ea40e6d-d09a-4fb2-a578-117e223d761f Jul 13 13:53:54 devstack sudo[93270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:53:54 devstack sudo[93270]: pam_unix(sudo:session): session closed for user root Jul 13 13:53:54 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-f5eeabcf-ea94-42d7-87e6-72a3526d7097 tempest-VolumeRetypeWithoutMigrationTest-1961621955 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-8ea40e6d-d09a-4fb2-a578-117e223d761f" returned: 0 in 0.562s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:53:54 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-f5eeabcf-ea94-42d7-87e6-72a3526d7097 tempest-VolumeRetypeWithoutMigrationTest-1961621955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-8ea40e6d-d09a-4fb2-a578-117e223d761f {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:53:54 devstack sudo[93282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-8ea40e6d-d09a-4fb2-a578-117e223d761f Jul 13 13:53:54 devstack sudo[93282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:53:55 devstack sudo[93282]: pam_unix(sudo:session): session closed for user root Jul 13 13:53:55 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-f5eeabcf-ea94-42d7-87e6-72a3526d7097 tempest-VolumeRetypeWithoutMigrationTest-1961621955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-8ea40e6d-d09a-4fb2-a578-117e223d761f" returned: 0 in 0.663s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:53:55 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-f5eeabcf-ea94-42d7-87e6-72a3526d7097 tempest-VolumeRetypeWithoutMigrationTest-1961621955 None] Lock "cinder-quobyte-8ea40e6d-d09a-4fb2-a578-117e223d761f" released by "delete_volume" :: held 1.301s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 13:53:55 devstack cinder-volume[87098]: WARNING cinder.quota [None req-f5eeabcf-ea94-42d7-87e6-72a3526d7097 tempest-VolumeRetypeWithoutMigrationTest-1961621955 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jul 13 13:53:55 devstack cinder-volume[87098]: WARNING cinder.quota [None req-f5eeabcf-ea94-42d7-87e6-72a3526d7097 tempest-VolumeRetypeWithoutMigrationTest-1961621955 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jul 13 13:53:55 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-f5eeabcf-ea94-42d7-87e6-72a3526d7097 tempest-VolumeRetypeWithoutMigrationTest-1961621955 None] Created reservations ['13047a93-1930-460e-b051-893e27fc86c6', '18bc49de-5ff5-471b-be29-f26fae20d834', 'ced48317-87d9-48b7-91d2-8adfe1f8f949', '5decda79-8227-4091-940e-ca720c8d5929'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 13:53:55 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-f5eeabcf-ea94-42d7-87e6-72a3526d7097 tempest-VolumeRetypeWithoutMigrationTest-1961621955 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:53:55 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-f5eeabcf-ea94-42d7-87e6-72a3526d7097 tempest-VolumeRetypeWithoutMigrationTest-1961621955 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:53:55 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-f5eeabcf-ea94-42d7-87e6-72a3526d7097 tempest-VolumeRetypeWithoutMigrationTest-1961621955 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 13:53:55 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-f5eeabcf-ea94-42d7-87e6-72a3526d7097 tempest-VolumeRetypeWithoutMigrationTest-1961621955 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 13:53:55 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-f5eeabcf-ea94-42d7-87e6-72a3526d7097 tempest-VolumeRetypeWithoutMigrationTest-1961621955 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:53:55 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-f5eeabcf-ea94-42d7-87e6-72a3526d7097 tempest-VolumeRetypeWithoutMigrationTest-1961621955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:53:56 devstack sudo[93286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 Jul 13 13:53:56 devstack sudo[93286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:53:56 devstack sudo[93286]: pam_unix(sudo:session): session closed for user root Jul 13 13:53:56 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-f5eeabcf-ea94-42d7-87e6-72a3526d7097 tempest-VolumeRetypeWithoutMigrationTest-1961621955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78" returned: 0 in 0.479s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:53:56 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-f5eeabcf-ea94-42d7-87e6-72a3526d7097 tempest-VolumeRetypeWithoutMigrationTest-1961621955 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 13:53:56 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-f5eeabcf-ea94-42d7-87e6-72a3526d7097 tempest-VolumeRetypeWithoutMigrationTest-1961621955 None] Deleted volume successfully. Jul 13 13:53:56 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-f5eeabcf-ea94-42d7-87e6-72a3526d7097 tempest-VolumeRetypeWithoutMigrationTest-1961621955 None] Lock "cinder-8ea40e6d-d09a-4fb2-a578-117e223d761f-delete_volume" released by "delete_volume" :: held 2.452s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 13:54:00 devstack sudo[93265]: pam_unix(sudo:session): session closed for user root Jul 13 13:54:00 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-c756f130-dd71-436f-8c68-c39c22006222 tempest-VolumesDeleteCascade-447158706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-26eca4b6-46d1-4f91-8dcc-005aa8d36ec6 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-0db4affc-9ded-423f-a6d4-81dfa9150238" returned: 0 in 6.394s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:54:00 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[778ff1fc-7723-45e1-88b9-f02a8f892cb5]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 13:54:00 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-c756f130-dd71-436f-8c68-c39c22006222 tempest-VolumesDeleteCascade-447158706 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-26eca4b6-46d1-4f91-8dcc-005aa8d36ec6 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:54:00 devstack sudo[93294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-26eca4b6-46d1-4f91-8dcc-005aa8d36ec6 Jul 13 13:54:00 devstack sudo[93294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:54:00 devstack sudo[93294]: pam_unix(sudo:session): session closed for user root Jul 13 13:54:00 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-c756f130-dd71-436f-8c68-c39c22006222 tempest-VolumesDeleteCascade-447158706 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-26eca4b6-46d1-4f91-8dcc-005aa8d36ec6" returned: 0 in 0.671s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:54:00 devstack cinder-volume[87098]: DEBUG cinder.image.image_utils [None req-c756f130-dd71-436f-8c68-c39c22006222 tempest-VolumesDeleteCascade-447158706 None] Image conversion details: src /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-26eca4b6-46d1-4f91-8dcc-005aa8d36ec6, size 1024.00 MB, duration 6.39 sec, destination /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-0db4affc-9ded-423f-a6d4-81dfa9150238 {{(pid=87098) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 13 13:54:00 devstack cinder-volume[87098]: INFO cinder.image.image_utils [None req-c756f130-dd71-436f-8c68-c39c22006222 tempest-VolumesDeleteCascade-447158706 None] Converted 1024.00 MB image at 160.13 MB/s Jul 13 13:54:00 devstack cinder-volume[87098]: WARNING cinder.volume.drivers.remotefs [None req-c756f130-dd71-436f-8c68-c39c22006222 tempest-VolumesDeleteCascade-447158706 None] /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-0db4affc-9ded-423f-a6d4-81dfa9150238 is being set with open permissions: ugo+rw Jul 13 13:54:00 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-c756f130-dd71-436f-8c68-c39c22006222 tempest-VolumesDeleteCascade-447158706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-0db4affc-9ded-423f-a6d4-81dfa9150238 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:54:00 devstack sudo[93300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-0db4affc-9ded-423f-a6d4-81dfa9150238 Jul 13 13:54:00 devstack sudo[93300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:54:01 devstack sudo[93300]: pam_unix(sudo:session): session closed for user root Jul 13 13:54:01 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-c756f130-dd71-436f-8c68-c39c22006222 tempest-VolumesDeleteCascade-447158706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-0db4affc-9ded-423f-a6d4-81dfa9150238" returned: 0 in 0.336s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:54:01 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-c756f130-dd71-436f-8c68-c39c22006222 tempest-VolumesDeleteCascade-447158706 None] Lock "cinder-quobyte-0db4affc-9ded-423f-a6d4-81dfa9150238" released by "_copy_volume_from_snapshot" :: held 8.425s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 13:54:01 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-c756f130-dd71-436f-8c68-c39c22006222 tempest-VolumesDeleteCascade-447158706 None] Lock "cinder-quobyte-c5016170-2d95-4942-a473-780784239acc-0db4affc-9ded-423f-a6d4-81dfa9150238" released by "_create_volume_from_snapshot" :: held 8.464s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 13:54:01 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-c756f130-dd71-436f-8c68-c39c22006222 tempest-VolumesDeleteCascade-447158706 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.485s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:54:01 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-c756f130-dd71-436f-8c68-c39c22006222 tempest-VolumesDeleteCascade-447158706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7d5546b-4741-473d-a634-68d160d4948b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0db4affc-9ded-423f-a6d4-81dfa9150238', 'volume_size': 1, 'snapshot_id': 'c5016170-2d95-4942-a473-780784239acc'}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:54:01 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-c756f130-dd71-436f-8c68-c39c22006222 tempest-VolumesDeleteCascade-447158706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1353fb0a-4b24-41f5-9890-1517dd1bfa03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:54:01 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-c756f130-dd71-436f-8c68-c39c22006222 tempest-VolumesDeleteCascade-447158706 None] Volume volume-0db4affc-9ded-423f-a6d4-81dfa9150238 (0db4affc-9ded-423f-a6d4-81dfa9150238): created successfully Jul 13 13:54:01 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-c756f130-dd71-436f-8c68-c39c22006222 tempest-VolumesDeleteCascade-447158706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1353fb0a-4b24-41f5-9890-1517dd1bfa03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:54:01 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-c756f130-dd71-436f-8c68-c39c22006222 tempest-VolumesDeleteCascade-447158706 None] Flow 'volume_create_manager' (c5ba4336-a751-46a9-b7ea-d541d9cdd6c0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 13:54:01 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-c756f130-dd71-436f-8c68-c39c22006222 tempest-VolumesDeleteCascade-447158706 None] Created volume successfully. Jul 13 13:54:01 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-f7490380-d12c-43bd-9faa-157eae70cd06 tempest-VolumesDeleteCascade-447158706 None] Acquiring lock "cinder-26eca4b6-46d1-4f91-8dcc-005aa8d36ec6-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 13:54:01 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-f7490380-d12c-43bd-9faa-157eae70cd06 tempest-VolumesDeleteCascade-447158706 None] Lock "cinder-26eca4b6-46d1-4f91-8dcc-005aa8d36ec6-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 13:54:01 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-f7490380-d12c-43bd-9faa-157eae70cd06 tempest-VolumesDeleteCascade-447158706 None] Performing cascade delete. {{(pid=87098) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jul 13 13:54:01 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-f7490380-d12c-43bd-9faa-157eae70cd06 tempest-VolumesDeleteCascade-447158706 None] Acquiring lock "cinder-c5016170-2d95-4942-a473-780784239acc-delete_snapshot" by "delete_snapshot" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 13:54:01 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-f7490380-d12c-43bd-9faa-157eae70cd06 tempest-VolumesDeleteCascade-447158706 None] Lock "cinder-c5016170-2d95-4942-a473-780784239acc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 13:54:01 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-f7490380-d12c-43bd-9faa-157eae70cd06 tempest-VolumesDeleteCascade-447158706 None] Acquiring lock "cinder-quobyte-26eca4b6-46d1-4f91-8dcc-005aa8d36ec6" by "delete_snapshot" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 13:54:02 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-f7490380-d12c-43bd-9faa-157eae70cd06 tempest-VolumesDeleteCascade-447158706 None] Lock "cinder-quobyte-26eca4b6-46d1-4f91-8dcc-005aa8d36ec6" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 13:54:02 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-f7490380-d12c-43bd-9faa-157eae70cd06 tempest-VolumesDeleteCascade-447158706 None] Acquiring lock "cinder-quobyte-c5016170-2d95-4942-a473-780784239acc" by "_delete_snapshot" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 13:54:02 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-f7490380-d12c-43bd-9faa-157eae70cd06 tempest-VolumesDeleteCascade-447158706 None] Lock "cinder-quobyte-c5016170-2d95-4942-a473-780784239acc" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 13:54:02 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-f7490380-d12c-43bd-9faa-157eae70cd06 tempest-VolumesDeleteCascade-447158706 None] Deleting offline snapshot c5016170-2d95-4942-a473-780784239acc of volume 26eca4b6-46d1-4f91-8dcc-005aa8d36ec6 {{(pid=87098) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 13 13:54:02 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-f7490380-d12c-43bd-9faa-157eae70cd06 tempest-VolumesDeleteCascade-447158706 None] snapshot_file for this snap is: volume-26eca4b6-46d1-4f91-8dcc-005aa8d36ec6.c5016170-2d95-4942-a473-780784239acc {{(pid=87098) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 13 13:54:02 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[68ebe200-95f7-4e97-a378-bbf731fc171b]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 13:54:02 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-f7490380-d12c-43bd-9faa-157eae70cd06 tempest-VolumesDeleteCascade-447158706 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-26eca4b6-46d1-4f91-8dcc-005aa8d36ec6.c5016170-2d95-4942-a473-780784239acc {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:54:02 devstack sudo[93338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-26eca4b6-46d1-4f91-8dcc-005aa8d36ec6.c5016170-2d95-4942-a473-780784239acc Jul 13 13:54:02 devstack sudo[93338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:54:02 devstack sudo[93338]: pam_unix(sudo:session): session closed for user root Jul 13 13:54:02 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-f7490380-d12c-43bd-9faa-157eae70cd06 tempest-VolumesDeleteCascade-447158706 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-26eca4b6-46d1-4f91-8dcc-005aa8d36ec6.c5016170-2d95-4942-a473-780784239acc" returned: 0 in 0.509s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:54:02 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-f7490380-d12c-43bd-9faa-157eae70cd06 tempest-VolumesDeleteCascade-447158706 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-26eca4b6-46d1-4f91-8dcc-005aa8d36ec6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87098) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 13 13:54:02 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed620b1d-9815-4bc9-911f-afb02189ef13]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 13:54:02 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-f7490380-d12c-43bd-9faa-157eae70cd06 tempest-VolumesDeleteCascade-447158706 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-26eca4b6-46d1-4f91-8dcc-005aa8d36ec6 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:54:02 devstack sudo[93354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-26eca4b6-46d1-4f91-8dcc-005aa8d36ec6 Jul 13 13:54:02 devstack sudo[93354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:54:03 devstack sudo[93354]: pam_unix(sudo:session): session closed for user root Jul 13 13:54:03 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-f7490380-d12c-43bd-9faa-157eae70cd06 tempest-VolumesDeleteCascade-447158706 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-26eca4b6-46d1-4f91-8dcc-005aa8d36ec6" returned: 0 in 0.578s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:54:03 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-f7490380-d12c-43bd-9faa-157eae70cd06 tempest-VolumesDeleteCascade-447158706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-26eca4b6-46d1-4f91-8dcc-005aa8d36ec6.c5016170-2d95-4942-a473-780784239acc {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:54:03 devstack sudo[93375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-26eca4b6-46d1-4f91-8dcc-005aa8d36ec6.c5016170-2d95-4942-a473-780784239acc Jul 13 13:54:03 devstack sudo[93375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:54:03 devstack sudo[93375]: pam_unix(sudo:session): session closed for user root Jul 13 13:54:03 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-f7490380-d12c-43bd-9faa-157eae70cd06 tempest-VolumesDeleteCascade-447158706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-26eca4b6-46d1-4f91-8dcc-005aa8d36ec6.c5016170-2d95-4942-a473-780784239acc" returned: 0 in 0.431s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:54:03 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-f7490380-d12c-43bd-9faa-157eae70cd06 tempest-VolumesDeleteCascade-447158706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-26eca4b6-46d1-4f91-8dcc-005aa8d36ec6.c5016170-2d95-4942-a473-780784239acc {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:54:03 devstack sudo[93380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-26eca4b6-46d1-4f91-8dcc-005aa8d36ec6.c5016170-2d95-4942-a473-780784239acc Jul 13 13:54:03 devstack sudo[93380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:54:04 devstack sudo[93380]: pam_unix(sudo:session): session closed for user root Jul 13 13:54:04 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-f7490380-d12c-43bd-9faa-157eae70cd06 tempest-VolumesDeleteCascade-447158706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-26eca4b6-46d1-4f91-8dcc-005aa8d36ec6.c5016170-2d95-4942-a473-780784239acc" returned: 0 in 0.490s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:54:04 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-f7490380-d12c-43bd-9faa-157eae70cd06 tempest-VolumesDeleteCascade-447158706 None] Lock "cinder-quobyte-c5016170-2d95-4942-a473-780784239acc" released by "_delete_snapshot" :: held 2.211s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 13:54:04 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-f7490380-d12c-43bd-9faa-157eae70cd06 tempest-VolumesDeleteCascade-447158706 None] Lock "cinder-quobyte-26eca4b6-46d1-4f91-8dcc-005aa8d36ec6" released by "delete_snapshot" :: held 2.248s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 13:54:04 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-f7490380-d12c-43bd-9faa-157eae70cd06 tempest-VolumesDeleteCascade-447158706 None] Created reservations ['aaa02ee3-00cb-44dc-a72b-12e5e701b2ec', '806c3e8f-6dd3-4c53-a31c-cad437763099', 'bb9a021b-0029-4298-8f6f-91c1a72aa56a', '1e697a6d-95f9-4463-a3f2-61b5e6a1850f'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 13:54:04 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-f7490380-d12c-43bd-9faa-157eae70cd06 tempest-VolumesDeleteCascade-447158706 None] Delete snapshot completed successfully. Jul 13 13:54:04 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-f7490380-d12c-43bd-9faa-157eae70cd06 tempest-VolumesDeleteCascade-447158706 None] Lock "cinder-c5016170-2d95-4942-a473-780784239acc-delete_snapshot" released by "delete_snapshot" :: held 2.412s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 13:54:04 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-f7490380-d12c-43bd-9faa-157eae70cd06 tempest-VolumesDeleteCascade-447158706 None] Snapshots deleted, issuing volume delete {{(pid=87098) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jul 13 13:54:04 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-f7490380-d12c-43bd-9faa-157eae70cd06 tempest-VolumesDeleteCascade-447158706 None] Acquiring lock "cinder-quobyte-26eca4b6-46d1-4f91-8dcc-005aa8d36ec6" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 13:54:04 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-f7490380-d12c-43bd-9faa-157eae70cd06 tempest-VolumesDeleteCascade-447158706 None] Lock "cinder-quobyte-26eca4b6-46d1-4f91-8dcc-005aa8d36ec6" acquired by "delete_volume" :: waited 0.015s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 13:54:04 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[a62d1f60-7cdb-428c-a61d-1521b426f2f4]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 13:54:04 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-f7490380-d12c-43bd-9faa-157eae70cd06 tempest-VolumesDeleteCascade-447158706 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-26eca4b6-46d1-4f91-8dcc-005aa8d36ec6 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:54:04 devstack sudo[93383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-26eca4b6-46d1-4f91-8dcc-005aa8d36ec6 Jul 13 13:54:04 devstack sudo[93383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:54:04 devstack sudo[93383]: pam_unix(sudo:session): session closed for user root Jul 13 13:54:04 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-f7490380-d12c-43bd-9faa-157eae70cd06 tempest-VolumesDeleteCascade-447158706 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-26eca4b6-46d1-4f91-8dcc-005aa8d36ec6" returned: 0 in 0.451s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:54:04 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-f7490380-d12c-43bd-9faa-157eae70cd06 tempest-VolumesDeleteCascade-447158706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-26eca4b6-46d1-4f91-8dcc-005aa8d36ec6 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:54:04 devstack sudo[93389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-26eca4b6-46d1-4f91-8dcc-005aa8d36ec6 Jul 13 13:54:04 devstack sudo[93389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:54:05 devstack sudo[93389]: pam_unix(sudo:session): session closed for user root Jul 13 13:54:05 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-f7490380-d12c-43bd-9faa-157eae70cd06 tempest-VolumesDeleteCascade-447158706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-26eca4b6-46d1-4f91-8dcc-005aa8d36ec6" returned: 0 in 0.352s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:54:05 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-f7490380-d12c-43bd-9faa-157eae70cd06 tempest-VolumesDeleteCascade-447158706 None] Lock "cinder-quobyte-26eca4b6-46d1-4f91-8dcc-005aa8d36ec6" released by "delete_volume" :: held 0.887s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 13:54:05 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-f7490380-d12c-43bd-9faa-157eae70cd06 tempest-VolumesDeleteCascade-447158706 None] Created reservations ['a571d86c-fad4-4a1c-a152-55c363aa5cab', 'dcaf4258-c110-4aeb-844c-453dcbe014d8', '310372b9-d0bc-42ad-bcec-f25f498855ec', '0239a043-5ebd-4ad7-9bfd-b849cf5104dc'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 13:54:05 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-f7490380-d12c-43bd-9faa-157eae70cd06 tempest-VolumesDeleteCascade-447158706 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:54:05 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-f7490380-d12c-43bd-9faa-157eae70cd06 tempest-VolumesDeleteCascade-447158706 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:54:05 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-f7490380-d12c-43bd-9faa-157eae70cd06 tempest-VolumesDeleteCascade-447158706 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 13:54:05 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-f7490380-d12c-43bd-9faa-157eae70cd06 tempest-VolumesDeleteCascade-447158706 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 13:54:05 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-f7490380-d12c-43bd-9faa-157eae70cd06 tempest-VolumesDeleteCascade-447158706 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:54:05 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-f7490380-d12c-43bd-9faa-157eae70cd06 tempest-VolumesDeleteCascade-447158706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:54:05 devstack sudo[93392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 Jul 13 13:54:05 devstack sudo[93392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:54:05 devstack sudo[93392]: pam_unix(sudo:session): session closed for user root Jul 13 13:54:05 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-f7490380-d12c-43bd-9faa-157eae70cd06 tempest-VolumesDeleteCascade-447158706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78" returned: 0 in 0.437s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:54:05 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-f7490380-d12c-43bd-9faa-157eae70cd06 tempest-VolumesDeleteCascade-447158706 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 13:54:05 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-f7490380-d12c-43bd-9faa-157eae70cd06 tempest-VolumesDeleteCascade-447158706 None] Deleted volume successfully. Jul 13 13:54:05 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-f7490380-d12c-43bd-9faa-157eae70cd06 tempest-VolumesDeleteCascade-447158706 None] Lock "cinder-26eca4b6-46d1-4f91-8dcc-005aa8d36ec6-delete_volume" released by "delete_volume" :: held 4.094s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 13:54:05 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-7862ab3b-360e-41c4-9486-b25027aa5e90 tempest-SnapshotsActionsTest-1565083684 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 13:54:06 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-7862ab3b-360e-41c4-9486-b25027aa5e90 tempest-SnapshotsActionsTest-1565083684 None] Flow 'volume_create_manager' (0c96a356-d9dd-4c24-8ba4-971f3a254248) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 13:54:06 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-7862ab3b-360e-41c4-9486-b25027aa5e90 tempest-SnapshotsActionsTest-1565083684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e366a0e-b990-4f60-bd93-1f23b277f41a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:54:06 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-7862ab3b-360e-41c4-9486-b25027aa5e90 tempest-SnapshotsActionsTest-1565083684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e366a0e-b990-4f60-bd93-1f23b277f41a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T11:54:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1344713155',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e77cb2d8-9e38-4e97-884a-243b4a24a834,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66605e8d1ae14b1bb9090c133f505164',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T11:54:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T11:54:06Z,use_quota=True,user_id='ae10334d2cec480fae67b856f1819f09',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1147de8b-623b-426c-a13d-7fc824a80f67),volume_type_id=1147de8b-623b-426c-a13d-7fc824a80f67)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:54:06 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-7862ab3b-360e-41c4-9486-b25027aa5e90 tempest-SnapshotsActionsTest-1565083684 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f4bac1c-40be-4f53-a5ed-320ec1108e31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:54:06 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-7862ab3b-360e-41c4-9486-b25027aa5e90 tempest-SnapshotsActionsTest-1565083684 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f4bac1c-40be-4f53-a5ed-320ec1108e31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:54:06 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-7862ab3b-360e-41c4-9486-b25027aa5e90 tempest-SnapshotsActionsTest-1565083684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89f04be4-5b54-44c9-9a35-f8ce95031639) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:54:06 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-7862ab3b-360e-41c4-9486-b25027aa5e90 tempest-SnapshotsActionsTest-1565083684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89f04be4-5b54-44c9-9a35-f8ce95031639) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e77cb2d8-9e38-4e97-884a-243b4a24a834', 'volume_name': 'volume-e77cb2d8-9e38-4e97-884a-243b4a24a834', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:54:06 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-7862ab3b-360e-41c4-9486-b25027aa5e90 tempest-SnapshotsActionsTest-1565083684 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (160bf7dd-f011-42b3-904d-c6b526ce9d42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:54:06 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-7862ab3b-360e-41c4-9486-b25027aa5e90 tempest-SnapshotsActionsTest-1565083684 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (160bf7dd-f011-42b3-904d-c6b526ce9d42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:54:06 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-7862ab3b-360e-41c4-9486-b25027aa5e90 tempest-SnapshotsActionsTest-1565083684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7445c980-8bf1-4078-b4c1-9b52244f869f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:54:06 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-7862ab3b-360e-41c4-9486-b25027aa5e90 tempest-SnapshotsActionsTest-1565083684 None] Volume e77cb2d8-9e38-4e97-884a-243b4a24a834: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e77cb2d8-9e38-4e97-884a-243b4a24a834', 'volume_size': 1} Jul 13 13:54:06 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-7862ab3b-360e-41c4-9486-b25027aa5e90 tempest-SnapshotsActionsTest-1565083684 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:54:06 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-7862ab3b-360e-41c4-9486-b25027aa5e90 tempest-SnapshotsActionsTest-1565083684 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:54:06 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-7862ab3b-360e-41c4-9486-b25027aa5e90 tempest-SnapshotsActionsTest-1565083684 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T11:54:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1344713155',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e77cb2d8-9e38-4e97-884a-243b4a24a834,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66605e8d1ae14b1bb9090c133f505164',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T11:54:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T11:54:06Z,use_quota=True,user_id='ae10334d2cec480fae67b856f1819f09',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1147de8b-623b-426c-a13d-7fc824a80f67),volume_type_id=1147de8b-623b-426c-a13d-7fc824a80f67)}" {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 13 13:54:06 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-7862ab3b-360e-41c4-9486-b25027aa5e90 tempest-SnapshotsActionsTest-1565083684 None] Creating volume e77cb2d8-9e38-4e97-884a-243b4a24a834 {{(pid=87098) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 13 13:54:06 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-7862ab3b-360e-41c4-9486-b25027aa5e90 tempest-SnapshotsActionsTest-1565083684 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:54:06 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-7862ab3b-360e-41c4-9486-b25027aa5e90 tempest-SnapshotsActionsTest-1565083684 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:54:06 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-7862ab3b-360e-41c4-9486-b25027aa5e90 tempest-SnapshotsActionsTest-1565083684 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 13:54:06 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-7862ab3b-360e-41c4-9486-b25027aa5e90 tempest-SnapshotsActionsTest-1565083684 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 13:54:06 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-7862ab3b-360e-41c4-9486-b25027aa5e90 tempest-SnapshotsActionsTest-1565083684 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:54:06 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-7862ab3b-360e-41c4-9486-b25027aa5e90 tempest-SnapshotsActionsTest-1565083684 None] Selected osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 13:54:06 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-7862ab3b-360e-41c4-9486-b25027aa5e90 tempest-SnapshotsActionsTest-1565083684 None] casted to osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 Jul 13 13:54:06 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-7862ab3b-360e-41c4-9486-b25027aa5e90 tempest-SnapshotsActionsTest-1565083684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-e77cb2d8-9e38-4e97-884a-243b4a24a834 1073741824 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:54:06 devstack sudo[93396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-e77cb2d8-9e38-4e97-884a-243b4a24a834 1073741824 Jul 13 13:54:06 devstack sudo[93396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:54:06 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-918e0007-19e4-4c6d-ac3a-5ac5b5710938 tempest-VolumesDeleteCascade-447158706 None] Acquiring lock "cinder-0db4affc-9ded-423f-a6d4-81dfa9150238-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 13:54:06 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-918e0007-19e4-4c6d-ac3a-5ac5b5710938 tempest-VolumesDeleteCascade-447158706 None] Lock "cinder-0db4affc-9ded-423f-a6d4-81dfa9150238-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 13:54:06 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-918e0007-19e4-4c6d-ac3a-5ac5b5710938 tempest-VolumesDeleteCascade-447158706 None] Acquiring lock "cinder-quobyte-0db4affc-9ded-423f-a6d4-81dfa9150238" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 13:54:06 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-918e0007-19e4-4c6d-ac3a-5ac5b5710938 tempest-VolumesDeleteCascade-447158706 None] Lock "cinder-quobyte-0db4affc-9ded-423f-a6d4-81dfa9150238" acquired by "delete_volume" :: waited 0.037s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 13:54:06 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[85e16146-d504-4132-83b0-0558992ec016]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 13:54:06 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-918e0007-19e4-4c6d-ac3a-5ac5b5710938 tempest-VolumesDeleteCascade-447158706 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-0db4affc-9ded-423f-a6d4-81dfa9150238 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:54:06 devstack sudo[93396]: pam_unix(sudo:session): session closed for user root Jul 13 13:54:06 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-7862ab3b-360e-41c4-9486-b25027aa5e90 tempest-SnapshotsActionsTest-1565083684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-e77cb2d8-9e38-4e97-884a-243b4a24a834 1073741824" returned: 0 in 0.766s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:54:06 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-7862ab3b-360e-41c4-9486-b25027aa5e90 tempest-SnapshotsActionsTest-1565083684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-e77cb2d8-9e38-4e97-884a-243b4a24a834 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:54:07 devstack sudo[93419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-e77cb2d8-9e38-4e97-884a-243b4a24a834 Jul 13 13:54:07 devstack sudo[93419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:54:07 devstack sudo[93413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-0db4affc-9ded-423f-a6d4-81dfa9150238 Jul 13 13:54:07 devstack sudo[93413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:54:07 devstack sudo[93419]: pam_unix(sudo:session): session closed for user root Jul 13 13:54:07 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-7862ab3b-360e-41c4-9486-b25027aa5e90 tempest-SnapshotsActionsTest-1565083684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-e77cb2d8-9e38-4e97-884a-243b4a24a834" returned: 0 in 0.554s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:54:07 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-7862ab3b-360e-41c4-9486-b25027aa5e90 tempest-SnapshotsActionsTest-1565083684 None] <== create_volume: return (1444ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'} {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 13 13:54:07 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-7862ab3b-360e-41c4-9486-b25027aa5e90 tempest-SnapshotsActionsTest-1565083684 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.448s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:54:07 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-7862ab3b-360e-41c4-9486-b25027aa5e90 tempest-SnapshotsActionsTest-1565083684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7445c980-8bf1-4078-b4c1-9b52244f869f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e77cb2d8-9e38-4e97-884a-243b4a24a834', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:54:07 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-7862ab3b-360e-41c4-9486-b25027aa5e90 tempest-SnapshotsActionsTest-1565083684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b23699f-5c09-4c3e-a00b-baf12f51bdbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:54:07 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-7862ab3b-360e-41c4-9486-b25027aa5e90 tempest-SnapshotsActionsTest-1565083684 None] Volume volume-e77cb2d8-9e38-4e97-884a-243b4a24a834 (e77cb2d8-9e38-4e97-884a-243b4a24a834): created successfully Jul 13 13:54:07 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-7862ab3b-360e-41c4-9486-b25027aa5e90 tempest-SnapshotsActionsTest-1565083684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b23699f-5c09-4c3e-a00b-baf12f51bdbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:54:07 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-7862ab3b-360e-41c4-9486-b25027aa5e90 tempest-SnapshotsActionsTest-1565083684 None] Flow 'volume_create_manager' (0c96a356-d9dd-4c24-8ba4-971f3a254248) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 13:54:07 devstack sudo[93413]: pam_unix(sudo:session): session closed for user root Jul 13 13:54:07 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-918e0007-19e4-4c6d-ac3a-5ac5b5710938 tempest-VolumesDeleteCascade-447158706 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-0db4affc-9ded-423f-a6d4-81dfa9150238" returned: 0 in 0.935s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:54:07 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-918e0007-19e4-4c6d-ac3a-5ac5b5710938 tempest-VolumesDeleteCascade-447158706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-0db4affc-9ded-423f-a6d4-81dfa9150238 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:54:07 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-7862ab3b-360e-41c4-9486-b25027aa5e90 tempest-SnapshotsActionsTest-1565083684 None] Created volume successfully. Jul 13 13:54:07 devstack sudo[93471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-0db4affc-9ded-423f-a6d4-81dfa9150238 Jul 13 13:54:07 devstack sudo[93471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:54:08 devstack sudo[93471]: pam_unix(sudo:session): session closed for user root Jul 13 13:54:08 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-918e0007-19e4-4c6d-ac3a-5ac5b5710938 tempest-VolumesDeleteCascade-447158706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-0db4affc-9ded-423f-a6d4-81dfa9150238" returned: 0 in 0.395s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:54:08 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-918e0007-19e4-4c6d-ac3a-5ac5b5710938 tempest-VolumesDeleteCascade-447158706 None] Lock "cinder-quobyte-0db4affc-9ded-423f-a6d4-81dfa9150238" released by "delete_volume" :: held 1.450s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 13:54:08 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-918e0007-19e4-4c6d-ac3a-5ac5b5710938 tempest-VolumesDeleteCascade-447158706 None] Created reservations ['20102adf-da41-46da-aa42-fb8770a03c0b', '342a9bd1-034a-45ce-a1fa-4404738f42a5', '205b2804-1935-48c2-83c1-da3f5cb4045c', '9eddb2aa-1c38-430b-85f9-442de6d73a61'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 13:54:08 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-918e0007-19e4-4c6d-ac3a-5ac5b5710938 tempest-VolumesDeleteCascade-447158706 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:54:08 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-918e0007-19e4-4c6d-ac3a-5ac5b5710938 tempest-VolumesDeleteCascade-447158706 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:54:08 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-918e0007-19e4-4c6d-ac3a-5ac5b5710938 tempest-VolumesDeleteCascade-447158706 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 13:54:08 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-918e0007-19e4-4c6d-ac3a-5ac5b5710938 tempest-VolumesDeleteCascade-447158706 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 13:54:08 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-918e0007-19e4-4c6d-ac3a-5ac5b5710938 tempest-VolumesDeleteCascade-447158706 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:54:08 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-918e0007-19e4-4c6d-ac3a-5ac5b5710938 tempest-VolumesDeleteCascade-447158706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:54:08 devstack sudo[93480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 Jul 13 13:54:08 devstack sudo[93480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:54:08 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-66ca89c7-5dc8-499a-83a4-11559cdaa5f2 tempest-SnapshotsActionsTest-1565083684 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:54:08 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-66ca89c7-5dc8-499a-83a4-11559cdaa5f2 tempest-SnapshotsActionsTest-1565083684 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.004s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:54:08 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-66ca89c7-5dc8-499a-83a4-11559cdaa5f2 tempest-SnapshotsActionsTest-1565083684 None] Creating offline snapshot 2fe39cbc-c80c-44a6-9305-ffc5bbccbf48 of volume e77cb2d8-9e38-4e97-884a-243b4a24a834 {{(pid=87098) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 13 13:54:08 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a010a04-cdf5-432c-8ee6-cb0fe037b7fe]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 13:54:08 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-66ca89c7-5dc8-499a-83a4-11559cdaa5f2 tempest-SnapshotsActionsTest-1565083684 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-e77cb2d8-9e38-4e97-884a-243b4a24a834 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:54:08 devstack sudo[93482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-e77cb2d8-9e38-4e97-884a-243b4a24a834 Jul 13 13:54:08 devstack sudo[93482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:54:09 devstack sudo[93480]: pam_unix(sudo:session): session closed for user root Jul 13 13:54:09 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-918e0007-19e4-4c6d-ac3a-5ac5b5710938 tempest-VolumesDeleteCascade-447158706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78" returned: 0 in 0.716s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:54:09 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-918e0007-19e4-4c6d-ac3a-5ac5b5710938 tempest-VolumesDeleteCascade-447158706 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 13:54:09 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-918e0007-19e4-4c6d-ac3a-5ac5b5710938 tempest-VolumesDeleteCascade-447158706 None] Deleted volume successfully. Jul 13 13:54:09 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-918e0007-19e4-4c6d-ac3a-5ac5b5710938 tempest-VolumesDeleteCascade-447158706 None] Lock "cinder-0db4affc-9ded-423f-a6d4-81dfa9150238-delete_volume" released by "delete_volume" :: held 2.601s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 13:54:09 devstack sudo[93482]: pam_unix(sudo:session): session closed for user root Jul 13 13:54:09 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-66ca89c7-5dc8-499a-83a4-11559cdaa5f2 tempest-SnapshotsActionsTest-1565083684 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-e77cb2d8-9e38-4e97-884a-243b4a24a834" returned: 0 in 0.777s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:54:09 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-66ca89c7-5dc8-499a-83a4-11559cdaa5f2 tempest-SnapshotsActionsTest-1565083684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-e77cb2d8-9e38-4e97-884a-243b4a24a834,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-e77cb2d8-9e38-4e97-884a-243b4a24a834.2fe39cbc-c80c-44a6-9305-ffc5bbccbf48 1G {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:54:09 devstack sudo[93490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-e77cb2d8-9e38-4e97-884a-243b4a24a834,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-e77cb2d8-9e38-4e97-884a-243b4a24a834.2fe39cbc-c80c-44a6-9305-ffc5bbccbf48 1G Jul 13 13:54:09 devstack sudo[93490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:54:09 devstack sudo[93490]: pam_unix(sudo:session): session closed for user root Jul 13 13:54:09 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-66ca89c7-5dc8-499a-83a4-11559cdaa5f2 tempest-SnapshotsActionsTest-1565083684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-e77cb2d8-9e38-4e97-884a-243b4a24a834,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-e77cb2d8-9e38-4e97-884a-243b4a24a834.2fe39cbc-c80c-44a6-9305-ffc5bbccbf48 1G" returned: 0 in 0.617s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:54:09 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-66ca89c7-5dc8-499a-83a4-11559cdaa5f2 tempest-SnapshotsActionsTest-1565083684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e77cb2d8-9e38-4e97-884a-243b4a24a834 -F qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-e77cb2d8-9e38-4e97-884a-243b4a24a834.2fe39cbc-c80c-44a6-9305-ffc5bbccbf48 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:54:10 devstack sudo[93496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e77cb2d8-9e38-4e97-884a-243b4a24a834 -F qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-e77cb2d8-9e38-4e97-884a-243b4a24a834.2fe39cbc-c80c-44a6-9305-ffc5bbccbf48 Jul 13 13:54:10 devstack sudo[93496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:54:10 devstack sudo[93496]: pam_unix(sudo:session): session closed for user root Jul 13 13:54:10 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-66ca89c7-5dc8-499a-83a4-11559cdaa5f2 tempest-SnapshotsActionsTest-1565083684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e77cb2d8-9e38-4e97-884a-243b4a24a834 -F qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-e77cb2d8-9e38-4e97-884a-243b4a24a834.2fe39cbc-c80c-44a6-9305-ffc5bbccbf48" returned: 0 in 0.528s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:54:10 devstack cinder-volume[87098]: WARNING cinder.volume.drivers.remotefs [None req-66ca89c7-5dc8-499a-83a4-11559cdaa5f2 tempest-SnapshotsActionsTest-1565083684 None] /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-e77cb2d8-9e38-4e97-884a-243b4a24a834.2fe39cbc-c80c-44a6-9305-ffc5bbccbf48 is being set with open permissions: ugo+rw Jul 13 13:54:10 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-66ca89c7-5dc8-499a-83a4-11559cdaa5f2 tempest-SnapshotsActionsTest-1565083684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-e77cb2d8-9e38-4e97-884a-243b4a24a834.2fe39cbc-c80c-44a6-9305-ffc5bbccbf48 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:54:10 devstack sudo[93501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-e77cb2d8-9e38-4e97-884a-243b4a24a834.2fe39cbc-c80c-44a6-9305-ffc5bbccbf48 Jul 13 13:54:10 devstack sudo[93501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:54:10 devstack sudo[93501]: pam_unix(sudo:session): session closed for user root Jul 13 13:54:10 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-66ca89c7-5dc8-499a-83a4-11559cdaa5f2 tempest-SnapshotsActionsTest-1565083684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-e77cb2d8-9e38-4e97-884a-243b4a24a834.2fe39cbc-c80c-44a6-9305-ffc5bbccbf48" returned: 0 in 0.401s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:54:10 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-66ca89c7-5dc8-499a-83a4-11559cdaa5f2 tempest-SnapshotsActionsTest-1565083684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-e77cb2d8-9e38-4e97-884a-243b4a24a834.info {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:54:11 devstack sudo[93504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-e77cb2d8-9e38-4e97-884a-243b4a24a834.info Jul 13 13:54:11 devstack sudo[93504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:54:11 devstack sudo[93504]: pam_unix(sudo:session): session closed for user root Jul 13 13:54:11 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-66ca89c7-5dc8-499a-83a4-11559cdaa5f2 tempest-SnapshotsActionsTest-1565083684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-e77cb2d8-9e38-4e97-884a-243b4a24a834.info" returned: 0 in 0.451s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:54:11 devstack cinder-volume[87098]: WARNING cinder.volume.drivers.remotefs [None req-66ca89c7-5dc8-499a-83a4-11559cdaa5f2 tempest-SnapshotsActionsTest-1565083684 None] /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-e77cb2d8-9e38-4e97-884a-243b4a24a834.info is being set with open permissions: ugo+rw Jul 13 13:54:11 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-66ca89c7-5dc8-499a-83a4-11559cdaa5f2 tempest-SnapshotsActionsTest-1565083684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-e77cb2d8-9e38-4e97-884a-243b4a24a834.info {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:54:11 devstack sudo[93507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-e77cb2d8-9e38-4e97-884a-243b4a24a834.info Jul 13 13:54:11 devstack sudo[93507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:54:11 devstack sudo[93507]: pam_unix(sudo:session): session closed for user root Jul 13 13:54:11 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-66ca89c7-5dc8-499a-83a4-11559cdaa5f2 tempest-SnapshotsActionsTest-1565083684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-e77cb2d8-9e38-4e97-884a-243b4a24a834.info" returned: 0 in 0.371s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:54:11 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-66ca89c7-5dc8-499a-83a4-11559cdaa5f2 tempest-SnapshotsActionsTest-1565083684 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.321s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:54:11 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-66ca89c7-5dc8-499a-83a4-11559cdaa5f2 tempest-SnapshotsActionsTest-1565083684 None] Create snapshot completed successfully Jul 13 13:54:13 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-4c7e7a73-59ee-4f07-addb-1a01e6fa9758 tempest-SnapshotsActionsTest-1565083684 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:54:13 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-4c7e7a73-59ee-4f07-addb-1a01e6fa9758 tempest-SnapshotsActionsTest-1565083684 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:54:13 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-4c7e7a73-59ee-4f07-addb-1a01e6fa9758 tempest-SnapshotsActionsTest-1565083684 None] Creating offline snapshot 8951ded8-57e9-4640-b5ec-8bc5b1f9f6c6 of volume e77cb2d8-9e38-4e97-884a-243b4a24a834 {{(pid=87098) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 13 13:54:13 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ffc270f-e8c3-4a24-9e93-a7911c150528]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 13:54:13 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-4c7e7a73-59ee-4f07-addb-1a01e6fa9758 tempest-SnapshotsActionsTest-1565083684 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-e77cb2d8-9e38-4e97-884a-243b4a24a834.2fe39cbc-c80c-44a6-9305-ffc5bbccbf48 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:54:14 devstack sudo[93512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-e77cb2d8-9e38-4e97-884a-243b4a24a834.2fe39cbc-c80c-44a6-9305-ffc5bbccbf48 Jul 13 13:54:14 devstack sudo[93512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:54:14 devstack sudo[93512]: pam_unix(sudo:session): session closed for user root Jul 13 13:54:14 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-4c7e7a73-59ee-4f07-addb-1a01e6fa9758 tempest-SnapshotsActionsTest-1565083684 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-e77cb2d8-9e38-4e97-884a-243b4a24a834.2fe39cbc-c80c-44a6-9305-ffc5bbccbf48" returned: 0 in 0.500s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:54:14 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-4c7e7a73-59ee-4f07-addb-1a01e6fa9758 tempest-SnapshotsActionsTest-1565083684 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e77cb2d8-9e38-4e97-884a-243b4a24a834(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87098) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 13 13:54:14 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-4c7e7a73-59ee-4f07-addb-1a01e6fa9758 tempest-SnapshotsActionsTest-1565083684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-e77cb2d8-9e38-4e97-884a-243b4a24a834.2fe39cbc-c80c-44a6-9305-ffc5bbccbf48,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-e77cb2d8-9e38-4e97-884a-243b4a24a834.8951ded8-57e9-4640-b5ec-8bc5b1f9f6c6 1G {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:54:14 devstack sudo[93518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-e77cb2d8-9e38-4e97-884a-243b4a24a834.2fe39cbc-c80c-44a6-9305-ffc5bbccbf48,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-e77cb2d8-9e38-4e97-884a-243b4a24a834.8951ded8-57e9-4640-b5ec-8bc5b1f9f6c6 1G Jul 13 13:54:14 devstack sudo[93518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:54:15 devstack sudo[93518]: pam_unix(sudo:session): session closed for user root Jul 13 13:54:15 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-4c7e7a73-59ee-4f07-addb-1a01e6fa9758 tempest-SnapshotsActionsTest-1565083684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-e77cb2d8-9e38-4e97-884a-243b4a24a834.2fe39cbc-c80c-44a6-9305-ffc5bbccbf48,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-e77cb2d8-9e38-4e97-884a-243b4a24a834.8951ded8-57e9-4640-b5ec-8bc5b1f9f6c6 1G" returned: 0 in 0.693s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:54:15 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-4c7e7a73-59ee-4f07-addb-1a01e6fa9758 tempest-SnapshotsActionsTest-1565083684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e77cb2d8-9e38-4e97-884a-243b4a24a834.2fe39cbc-c80c-44a6-9305-ffc5bbccbf48 -F qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-e77cb2d8-9e38-4e97-884a-243b4a24a834.8951ded8-57e9-4640-b5ec-8bc5b1f9f6c6 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:54:15 devstack sudo[93524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e77cb2d8-9e38-4e97-884a-243b4a24a834.2fe39cbc-c80c-44a6-9305-ffc5bbccbf48 -F qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-e77cb2d8-9e38-4e97-884a-243b4a24a834.8951ded8-57e9-4640-b5ec-8bc5b1f9f6c6 Jul 13 13:54:15 devstack sudo[93524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:54:15 devstack sudo[93524]: pam_unix(sudo:session): session closed for user root Jul 13 13:54:15 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-4c7e7a73-59ee-4f07-addb-1a01e6fa9758 tempest-SnapshotsActionsTest-1565083684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e77cb2d8-9e38-4e97-884a-243b4a24a834.2fe39cbc-c80c-44a6-9305-ffc5bbccbf48 -F qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-e77cb2d8-9e38-4e97-884a-243b4a24a834.8951ded8-57e9-4640-b5ec-8bc5b1f9f6c6" returned: 0 in 0.411s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:54:15 devstack cinder-volume[87098]: WARNING cinder.volume.drivers.remotefs [None req-4c7e7a73-59ee-4f07-addb-1a01e6fa9758 tempest-SnapshotsActionsTest-1565083684 None] /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-e77cb2d8-9e38-4e97-884a-243b4a24a834.8951ded8-57e9-4640-b5ec-8bc5b1f9f6c6 is being set with open permissions: ugo+rw Jul 13 13:54:15 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-4c7e7a73-59ee-4f07-addb-1a01e6fa9758 tempest-SnapshotsActionsTest-1565083684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-e77cb2d8-9e38-4e97-884a-243b4a24a834.8951ded8-57e9-4640-b5ec-8bc5b1f9f6c6 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:54:15 devstack sudo[93530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-e77cb2d8-9e38-4e97-884a-243b4a24a834.8951ded8-57e9-4640-b5ec-8bc5b1f9f6c6 Jul 13 13:54:15 devstack sudo[93530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:54:15 devstack sudo[93530]: pam_unix(sudo:session): session closed for user root Jul 13 13:54:15 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-4c7e7a73-59ee-4f07-addb-1a01e6fa9758 tempest-SnapshotsActionsTest-1565083684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-e77cb2d8-9e38-4e97-884a-243b4a24a834.8951ded8-57e9-4640-b5ec-8bc5b1f9f6c6" returned: 0 in 0.325s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:54:15 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-4c7e7a73-59ee-4f07-addb-1a01e6fa9758 tempest-SnapshotsActionsTest-1565083684 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.096s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:54:15 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-4c7e7a73-59ee-4f07-addb-1a01e6fa9758 tempest-SnapshotsActionsTest-1565083684 None] Create snapshot completed successfully Jul 13 13:54:17 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-927f0f11-a38b-4b5b-8bf6-3c753370035b tempest-SnapshotsActionsTest-1484405774 None] Acquiring lock "cinder-8951ded8-57e9-4640-b5ec-8bc5b1f9f6c6-delete_snapshot" by "delete_snapshot" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 13:54:17 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-927f0f11-a38b-4b5b-8bf6-3c753370035b tempest-SnapshotsActionsTest-1484405774 None] Lock "cinder-8951ded8-57e9-4640-b5ec-8bc5b1f9f6c6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 13:54:17 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-927f0f11-a38b-4b5b-8bf6-3c753370035b tempest-SnapshotsActionsTest-1484405774 None] Acquiring lock "cinder-quobyte-e77cb2d8-9e38-4e97-884a-243b4a24a834" by "delete_snapshot" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 13:54:17 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-927f0f11-a38b-4b5b-8bf6-3c753370035b tempest-SnapshotsActionsTest-1484405774 None] Lock "cinder-quobyte-e77cb2d8-9e38-4e97-884a-243b4a24a834" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 13:54:17 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-927f0f11-a38b-4b5b-8bf6-3c753370035b tempest-SnapshotsActionsTest-1484405774 None] Acquiring lock "cinder-quobyte-8951ded8-57e9-4640-b5ec-8bc5b1f9f6c6" by "_delete_snapshot" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 13:54:17 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-927f0f11-a38b-4b5b-8bf6-3c753370035b tempest-SnapshotsActionsTest-1484405774 None] Lock "cinder-quobyte-8951ded8-57e9-4640-b5ec-8bc5b1f9f6c6" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 13:54:17 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-927f0f11-a38b-4b5b-8bf6-3c753370035b tempest-SnapshotsActionsTest-1484405774 None] Deleting offline snapshot 8951ded8-57e9-4640-b5ec-8bc5b1f9f6c6 of volume e77cb2d8-9e38-4e97-884a-243b4a24a834 {{(pid=87098) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 13 13:54:17 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-927f0f11-a38b-4b5b-8bf6-3c753370035b tempest-SnapshotsActionsTest-1484405774 None] snapshot_file for this snap is: volume-e77cb2d8-9e38-4e97-884a-243b4a24a834.8951ded8-57e9-4640-b5ec-8bc5b1f9f6c6 {{(pid=87098) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 13 13:54:17 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[baca5ee4-bbd0-4467-ba18-8179961251d0]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 13:54:17 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-927f0f11-a38b-4b5b-8bf6-3c753370035b tempest-SnapshotsActionsTest-1484405774 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-e77cb2d8-9e38-4e97-884a-243b4a24a834.8951ded8-57e9-4640-b5ec-8bc5b1f9f6c6 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:54:17 devstack sudo[93534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-e77cb2d8-9e38-4e97-884a-243b4a24a834.8951ded8-57e9-4640-b5ec-8bc5b1f9f6c6 Jul 13 13:54:17 devstack sudo[93534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:54:17 devstack sudo[93534]: pam_unix(sudo:session): session closed for user root Jul 13 13:54:17 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-927f0f11-a38b-4b5b-8bf6-3c753370035b tempest-SnapshotsActionsTest-1484405774 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-e77cb2d8-9e38-4e97-884a-243b4a24a834.8951ded8-57e9-4640-b5ec-8bc5b1f9f6c6" returned: 0 in 0.568s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:54:17 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-927f0f11-a38b-4b5b-8bf6-3c753370035b tempest-SnapshotsActionsTest-1484405774 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e77cb2d8-9e38-4e97-884a-243b4a24a834(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87098) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 13 13:54:17 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2336c6c-6e2c-4f0c-a53c-0b808a1a010a]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 13:54:17 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-927f0f11-a38b-4b5b-8bf6-3c753370035b tempest-SnapshotsActionsTest-1484405774 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-e77cb2d8-9e38-4e97-884a-243b4a24a834.2fe39cbc-c80c-44a6-9305-ffc5bbccbf48 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:54:18 devstack sudo[93539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-e77cb2d8-9e38-4e97-884a-243b4a24a834.2fe39cbc-c80c-44a6-9305-ffc5bbccbf48 Jul 13 13:54:18 devstack sudo[93539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:54:18 devstack sudo[93539]: pam_unix(sudo:session): session closed for user root Jul 13 13:54:18 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-927f0f11-a38b-4b5b-8bf6-3c753370035b tempest-SnapshotsActionsTest-1484405774 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-e77cb2d8-9e38-4e97-884a-243b4a24a834.2fe39cbc-c80c-44a6-9305-ffc5bbccbf48" returned: 0 in 0.704s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:54:18 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-927f0f11-a38b-4b5b-8bf6-3c753370035b tempest-SnapshotsActionsTest-1484405774 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e77cb2d8-9e38-4e97-884a-243b4a24a834(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87098) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 13 13:54:18 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-927f0f11-a38b-4b5b-8bf6-3c753370035b tempest-SnapshotsActionsTest-1484405774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-e77cb2d8-9e38-4e97-884a-243b4a24a834.8951ded8-57e9-4640-b5ec-8bc5b1f9f6c6 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:54:18 devstack sudo[93553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-e77cb2d8-9e38-4e97-884a-243b4a24a834.8951ded8-57e9-4640-b5ec-8bc5b1f9f6c6 Jul 13 13:54:18 devstack sudo[93553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:54:19 devstack sudo[93553]: pam_unix(sudo:session): session closed for user root Jul 13 13:54:19 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-927f0f11-a38b-4b5b-8bf6-3c753370035b tempest-SnapshotsActionsTest-1484405774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-e77cb2d8-9e38-4e97-884a-243b4a24a834.8951ded8-57e9-4640-b5ec-8bc5b1f9f6c6" returned: 0 in 0.497s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:54:19 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-927f0f11-a38b-4b5b-8bf6-3c753370035b tempest-SnapshotsActionsTest-1484405774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-e77cb2d8-9e38-4e97-884a-243b4a24a834.8951ded8-57e9-4640-b5ec-8bc5b1f9f6c6 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:54:19 devstack sudo[93558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-e77cb2d8-9e38-4e97-884a-243b4a24a834.8951ded8-57e9-4640-b5ec-8bc5b1f9f6c6 Jul 13 13:54:19 devstack sudo[93558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:54:19 devstack sudo[93558]: pam_unix(sudo:session): session closed for user root Jul 13 13:54:19 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-927f0f11-a38b-4b5b-8bf6-3c753370035b tempest-SnapshotsActionsTest-1484405774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-e77cb2d8-9e38-4e97-884a-243b4a24a834.8951ded8-57e9-4640-b5ec-8bc5b1f9f6c6" returned: 0 in 0.337s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:54:19 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-927f0f11-a38b-4b5b-8bf6-3c753370035b tempest-SnapshotsActionsTest-1484405774 None] Lock "cinder-quobyte-8951ded8-57e9-4640-b5ec-8bc5b1f9f6c6" released by "_delete_snapshot" :: held 2.245s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 13:54:19 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-927f0f11-a38b-4b5b-8bf6-3c753370035b tempest-SnapshotsActionsTest-1484405774 None] Lock "cinder-quobyte-e77cb2d8-9e38-4e97-884a-243b4a24a834" released by "delete_snapshot" :: held 2.287s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 13:54:19 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-927f0f11-a38b-4b5b-8bf6-3c753370035b tempest-SnapshotsActionsTest-1484405774 None] Created reservations ['5bce62e1-bcb6-4c9d-836c-7c8ef9278c05', '6ff0da79-31ac-458e-ab4c-4c94eef7eb6c', '1c6d6916-5bf7-43f4-9493-132b323dc97d', '23b53682-00d7-4a79-9e64-ddcda88495e5'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 13:54:19 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-927f0f11-a38b-4b5b-8bf6-3c753370035b tempest-SnapshotsActionsTest-1484405774 None] Delete snapshot completed successfully. Jul 13 13:54:19 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-927f0f11-a38b-4b5b-8bf6-3c753370035b tempest-SnapshotsActionsTest-1484405774 None] Lock "cinder-8951ded8-57e9-4640-b5ec-8bc5b1f9f6c6-delete_snapshot" released by "delete_snapshot" :: held 2.530s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 13:54:20 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-018c2c3b-c101-4137-b0e5-85a24761a60c tempest-SnapshotsActionsTest-1565083684 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:54:20 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-018c2c3b-c101-4137-b0e5-85a24761a60c tempest-SnapshotsActionsTest-1565083684 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:54:21 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-018c2c3b-c101-4137-b0e5-85a24761a60c tempest-SnapshotsActionsTest-1565083684 None] Creating offline snapshot 4d4fe225-5032-4242-b96f-f2373e204703 of volume e77cb2d8-9e38-4e97-884a-243b4a24a834 {{(pid=87098) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 13 13:54:21 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[babd893d-47ea-4c06-b7e9-a6965e0d282a]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 13:54:21 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-018c2c3b-c101-4137-b0e5-85a24761a60c tempest-SnapshotsActionsTest-1565083684 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-e77cb2d8-9e38-4e97-884a-243b4a24a834.2fe39cbc-c80c-44a6-9305-ffc5bbccbf48 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:54:21 devstack sudo[93575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-e77cb2d8-9e38-4e97-884a-243b4a24a834.2fe39cbc-c80c-44a6-9305-ffc5bbccbf48 Jul 13 13:54:21 devstack sudo[93575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:54:21 devstack sudo[93575]: pam_unix(sudo:session): session closed for user root Jul 13 13:54:21 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-018c2c3b-c101-4137-b0e5-85a24761a60c tempest-SnapshotsActionsTest-1565083684 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-e77cb2d8-9e38-4e97-884a-243b4a24a834.2fe39cbc-c80c-44a6-9305-ffc5bbccbf48" returned: 0 in 0.570s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:54:21 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-018c2c3b-c101-4137-b0e5-85a24761a60c tempest-SnapshotsActionsTest-1565083684 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e77cb2d8-9e38-4e97-884a-243b4a24a834(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87098) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 13 13:54:21 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-018c2c3b-c101-4137-b0e5-85a24761a60c tempest-SnapshotsActionsTest-1565083684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-e77cb2d8-9e38-4e97-884a-243b4a24a834.2fe39cbc-c80c-44a6-9305-ffc5bbccbf48,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-e77cb2d8-9e38-4e97-884a-243b4a24a834.4d4fe225-5032-4242-b96f-f2373e204703 1G {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:54:21 devstack sudo[93580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-e77cb2d8-9e38-4e97-884a-243b4a24a834.2fe39cbc-c80c-44a6-9305-ffc5bbccbf48,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-e77cb2d8-9e38-4e97-884a-243b4a24a834.4d4fe225-5032-4242-b96f-f2373e204703 1G Jul 13 13:54:21 devstack sudo[93580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:54:22 devstack sudo[93580]: pam_unix(sudo:session): session closed for user root Jul 13 13:54:22 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-018c2c3b-c101-4137-b0e5-85a24761a60c tempest-SnapshotsActionsTest-1565083684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-e77cb2d8-9e38-4e97-884a-243b4a24a834.2fe39cbc-c80c-44a6-9305-ffc5bbccbf48,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-e77cb2d8-9e38-4e97-884a-243b4a24a834.4d4fe225-5032-4242-b96f-f2373e204703 1G" returned: 0 in 0.525s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:54:22 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-018c2c3b-c101-4137-b0e5-85a24761a60c tempest-SnapshotsActionsTest-1565083684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e77cb2d8-9e38-4e97-884a-243b4a24a834.2fe39cbc-c80c-44a6-9305-ffc5bbccbf48 -F qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-e77cb2d8-9e38-4e97-884a-243b4a24a834.4d4fe225-5032-4242-b96f-f2373e204703 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:54:22 devstack sudo[93587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e77cb2d8-9e38-4e97-884a-243b4a24a834.2fe39cbc-c80c-44a6-9305-ffc5bbccbf48 -F qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-e77cb2d8-9e38-4e97-884a-243b4a24a834.4d4fe225-5032-4242-b96f-f2373e204703 Jul 13 13:54:22 devstack sudo[93587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:54:22 devstack sudo[93587]: pam_unix(sudo:session): session closed for user root Jul 13 13:54:22 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-018c2c3b-c101-4137-b0e5-85a24761a60c tempest-SnapshotsActionsTest-1565083684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e77cb2d8-9e38-4e97-884a-243b4a24a834.2fe39cbc-c80c-44a6-9305-ffc5bbccbf48 -F qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-e77cb2d8-9e38-4e97-884a-243b4a24a834.4d4fe225-5032-4242-b96f-f2373e204703" returned: 0 in 0.426s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:54:22 devstack cinder-volume[87098]: WARNING cinder.volume.drivers.remotefs [None req-018c2c3b-c101-4137-b0e5-85a24761a60c tempest-SnapshotsActionsTest-1565083684 None] /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-e77cb2d8-9e38-4e97-884a-243b4a24a834.4d4fe225-5032-4242-b96f-f2373e204703 is being set with open permissions: ugo+rw Jul 13 13:54:22 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-018c2c3b-c101-4137-b0e5-85a24761a60c tempest-SnapshotsActionsTest-1565083684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-e77cb2d8-9e38-4e97-884a-243b4a24a834.4d4fe225-5032-4242-b96f-f2373e204703 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:54:22 devstack sudo[93592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-e77cb2d8-9e38-4e97-884a-243b4a24a834.4d4fe225-5032-4242-b96f-f2373e204703 Jul 13 13:54:22 devstack sudo[93592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:54:22 devstack sudo[93592]: pam_unix(sudo:session): session closed for user root Jul 13 13:54:22 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-018c2c3b-c101-4137-b0e5-85a24761a60c tempest-SnapshotsActionsTest-1565083684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-e77cb2d8-9e38-4e97-884a-243b4a24a834.4d4fe225-5032-4242-b96f-f2373e204703" returned: 0 in 0.294s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:54:22 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-018c2c3b-c101-4137-b0e5-85a24761a60c tempest-SnapshotsActionsTest-1565083684 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.020s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:54:23 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-018c2c3b-c101-4137-b0e5-85a24761a60c tempest-SnapshotsActionsTest-1565083684 None] Create snapshot completed successfully Jul 13 13:54:23 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-9feb05af-e8e5-429a-8c37-9ffcadefb26a tempest-SnapshotsActionsTest-1484405774 None] Acquiring lock "cinder-4d4fe225-5032-4242-b96f-f2373e204703-delete_snapshot" by "delete_snapshot" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 13:54:23 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-9feb05af-e8e5-429a-8c37-9ffcadefb26a tempest-SnapshotsActionsTest-1484405774 None] Lock "cinder-4d4fe225-5032-4242-b96f-f2373e204703-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 13:54:23 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-9feb05af-e8e5-429a-8c37-9ffcadefb26a tempest-SnapshotsActionsTest-1484405774 None] Acquiring lock "cinder-quobyte-e77cb2d8-9e38-4e97-884a-243b4a24a834" by "delete_snapshot" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 13:54:23 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-9feb05af-e8e5-429a-8c37-9ffcadefb26a tempest-SnapshotsActionsTest-1484405774 None] Lock "cinder-quobyte-e77cb2d8-9e38-4e97-884a-243b4a24a834" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 13:54:23 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-9feb05af-e8e5-429a-8c37-9ffcadefb26a tempest-SnapshotsActionsTest-1484405774 None] Acquiring lock "cinder-quobyte-4d4fe225-5032-4242-b96f-f2373e204703" by "_delete_snapshot" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 13:54:23 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-9feb05af-e8e5-429a-8c37-9ffcadefb26a tempest-SnapshotsActionsTest-1484405774 None] Lock "cinder-quobyte-4d4fe225-5032-4242-b96f-f2373e204703" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 13:54:23 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-9feb05af-e8e5-429a-8c37-9ffcadefb26a tempest-SnapshotsActionsTest-1484405774 None] Deleting offline snapshot 4d4fe225-5032-4242-b96f-f2373e204703 of volume e77cb2d8-9e38-4e97-884a-243b4a24a834 {{(pid=87098) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 13 13:54:23 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-9feb05af-e8e5-429a-8c37-9ffcadefb26a tempest-SnapshotsActionsTest-1484405774 None] snapshot_file for this snap is: volume-e77cb2d8-9e38-4e97-884a-243b4a24a834.4d4fe225-5032-4242-b96f-f2373e204703 {{(pid=87098) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 13 13:54:23 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3671d6d-6f00-4528-a84b-cab9d17c05e1]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 13:54:23 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-9feb05af-e8e5-429a-8c37-9ffcadefb26a tempest-SnapshotsActionsTest-1484405774 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-e77cb2d8-9e38-4e97-884a-243b4a24a834.4d4fe225-5032-4242-b96f-f2373e204703 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:54:23 devstack sudo[93595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-e77cb2d8-9e38-4e97-884a-243b4a24a834.4d4fe225-5032-4242-b96f-f2373e204703 Jul 13 13:54:23 devstack sudo[93595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:54:23 devstack sudo[93595]: pam_unix(sudo:session): session closed for user root Jul 13 13:54:23 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-9feb05af-e8e5-429a-8c37-9ffcadefb26a tempest-SnapshotsActionsTest-1484405774 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-e77cb2d8-9e38-4e97-884a-243b4a24a834.4d4fe225-5032-4242-b96f-f2373e204703" returned: 0 in 0.436s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:54:23 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-9feb05af-e8e5-429a-8c37-9ffcadefb26a tempest-SnapshotsActionsTest-1484405774 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e77cb2d8-9e38-4e97-884a-243b4a24a834(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87098) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 13 13:54:23 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[bad498d6-c9e2-4d9a-94b5-d34f96f38004]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 13:54:23 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-9feb05af-e8e5-429a-8c37-9ffcadefb26a tempest-SnapshotsActionsTest-1484405774 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-e77cb2d8-9e38-4e97-884a-243b4a24a834.2fe39cbc-c80c-44a6-9305-ffc5bbccbf48 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:54:24 devstack sudo[93602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-e77cb2d8-9e38-4e97-884a-243b4a24a834.2fe39cbc-c80c-44a6-9305-ffc5bbccbf48 Jul 13 13:54:24 devstack sudo[93602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:54:24 devstack sudo[93602]: pam_unix(sudo:session): session closed for user root Jul 13 13:54:24 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-9feb05af-e8e5-429a-8c37-9ffcadefb26a tempest-SnapshotsActionsTest-1484405774 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-e77cb2d8-9e38-4e97-884a-243b4a24a834.2fe39cbc-c80c-44a6-9305-ffc5bbccbf48" returned: 0 in 0.402s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:54:24 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-9feb05af-e8e5-429a-8c37-9ffcadefb26a tempest-SnapshotsActionsTest-1484405774 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e77cb2d8-9e38-4e97-884a-243b4a24a834(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87098) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 13 13:54:24 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-9feb05af-e8e5-429a-8c37-9ffcadefb26a tempest-SnapshotsActionsTest-1484405774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-e77cb2d8-9e38-4e97-884a-243b4a24a834.4d4fe225-5032-4242-b96f-f2373e204703 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:54:24 devstack sudo[93607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-e77cb2d8-9e38-4e97-884a-243b4a24a834.4d4fe225-5032-4242-b96f-f2373e204703 Jul 13 13:54:24 devstack sudo[93607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:54:24 devstack sudo[93607]: pam_unix(sudo:session): session closed for user root Jul 13 13:54:24 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-9feb05af-e8e5-429a-8c37-9ffcadefb26a tempest-SnapshotsActionsTest-1484405774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-e77cb2d8-9e38-4e97-884a-243b4a24a834.4d4fe225-5032-4242-b96f-f2373e204703" returned: 0 in 0.569s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:54:24 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-9feb05af-e8e5-429a-8c37-9ffcadefb26a tempest-SnapshotsActionsTest-1484405774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-e77cb2d8-9e38-4e97-884a-243b4a24a834.4d4fe225-5032-4242-b96f-f2373e204703 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:54:24 devstack sudo[93613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-e77cb2d8-9e38-4e97-884a-243b4a24a834.4d4fe225-5032-4242-b96f-f2373e204703 Jul 13 13:54:24 devstack sudo[93613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:54:25 devstack sudo[93613]: pam_unix(sudo:session): session closed for user root Jul 13 13:54:25 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-9feb05af-e8e5-429a-8c37-9ffcadefb26a tempest-SnapshotsActionsTest-1484405774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-e77cb2d8-9e38-4e97-884a-243b4a24a834.4d4fe225-5032-4242-b96f-f2373e204703" returned: 0 in 0.309s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:54:25 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-9feb05af-e8e5-429a-8c37-9ffcadefb26a tempest-SnapshotsActionsTest-1484405774 None] Lock "cinder-quobyte-4d4fe225-5032-4242-b96f-f2373e204703" released by "_delete_snapshot" :: held 1.833s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 13:54:25 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-9feb05af-e8e5-429a-8c37-9ffcadefb26a tempest-SnapshotsActionsTest-1484405774 None] Lock "cinder-quobyte-e77cb2d8-9e38-4e97-884a-243b4a24a834" released by "delete_snapshot" :: held 1.865s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 13:54:25 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-9feb05af-e8e5-429a-8c37-9ffcadefb26a tempest-SnapshotsActionsTest-1484405774 None] Created reservations ['95a92e1d-3752-472d-8c67-4aef89b2ad4c', '16122e9c-9c3d-422c-a992-009b5d528165', '9adc1e71-d152-4665-9571-a9468a0b3b9c', 'ec2fc884-3cba-450b-bc72-f9e05ce13ae7'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 13:54:25 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-9feb05af-e8e5-429a-8c37-9ffcadefb26a tempest-SnapshotsActionsTest-1484405774 None] Delete snapshot completed successfully. Jul 13 13:54:25 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-9feb05af-e8e5-429a-8c37-9ffcadefb26a tempest-SnapshotsActionsTest-1484405774 None] Lock "cinder-4d4fe225-5032-4242-b96f-f2373e204703-delete_snapshot" released by "delete_snapshot" :: held 2.052s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 13:54:25 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-5270bbd0-7b49-48fc-bfc9-2ac7d3b5e64a tempest-SnapshotsActionsTest-1565083684 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:54:25 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-5270bbd0-7b49-48fc-bfc9-2ac7d3b5e64a tempest-SnapshotsActionsTest-1565083684 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:54:25 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-5270bbd0-7b49-48fc-bfc9-2ac7d3b5e64a tempest-SnapshotsActionsTest-1565083684 None] Creating offline snapshot 990b30f8-fc9a-4dec-9044-b893251416e2 of volume e77cb2d8-9e38-4e97-884a-243b4a24a834 {{(pid=87098) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 13 13:54:25 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[686e5ef9-270d-4fb6-9f21-a884c714be1b]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 13:54:25 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-5270bbd0-7b49-48fc-bfc9-2ac7d3b5e64a tempest-SnapshotsActionsTest-1565083684 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-e77cb2d8-9e38-4e97-884a-243b4a24a834.2fe39cbc-c80c-44a6-9305-ffc5bbccbf48 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:54:26 devstack sudo[93616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-e77cb2d8-9e38-4e97-884a-243b4a24a834.2fe39cbc-c80c-44a6-9305-ffc5bbccbf48 Jul 13 13:54:26 devstack sudo[93616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:54:26 devstack sudo[93616]: pam_unix(sudo:session): session closed for user root Jul 13 13:54:26 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-5270bbd0-7b49-48fc-bfc9-2ac7d3b5e64a tempest-SnapshotsActionsTest-1565083684 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-e77cb2d8-9e38-4e97-884a-243b4a24a834.2fe39cbc-c80c-44a6-9305-ffc5bbccbf48" returned: 0 in 0.491s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:54:26 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-5270bbd0-7b49-48fc-bfc9-2ac7d3b5e64a tempest-SnapshotsActionsTest-1565083684 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e77cb2d8-9e38-4e97-884a-243b4a24a834(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87098) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 13 13:54:26 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-5270bbd0-7b49-48fc-bfc9-2ac7d3b5e64a tempest-SnapshotsActionsTest-1565083684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-e77cb2d8-9e38-4e97-884a-243b4a24a834.2fe39cbc-c80c-44a6-9305-ffc5bbccbf48,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-e77cb2d8-9e38-4e97-884a-243b4a24a834.990b30f8-fc9a-4dec-9044-b893251416e2 1G {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:54:26 devstack sudo[93622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-e77cb2d8-9e38-4e97-884a-243b4a24a834.2fe39cbc-c80c-44a6-9305-ffc5bbccbf48,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-e77cb2d8-9e38-4e97-884a-243b4a24a834.990b30f8-fc9a-4dec-9044-b893251416e2 1G Jul 13 13:54:26 devstack sudo[93622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:54:27 devstack sudo[93622]: pam_unix(sudo:session): session closed for user root Jul 13 13:54:27 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-5270bbd0-7b49-48fc-bfc9-2ac7d3b5e64a tempest-SnapshotsActionsTest-1565083684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-e77cb2d8-9e38-4e97-884a-243b4a24a834.2fe39cbc-c80c-44a6-9305-ffc5bbccbf48,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-e77cb2d8-9e38-4e97-884a-243b4a24a834.990b30f8-fc9a-4dec-9044-b893251416e2 1G" returned: 0 in 0.590s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:54:27 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-5270bbd0-7b49-48fc-bfc9-2ac7d3b5e64a tempest-SnapshotsActionsTest-1565083684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e77cb2d8-9e38-4e97-884a-243b4a24a834.2fe39cbc-c80c-44a6-9305-ffc5bbccbf48 -F qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-e77cb2d8-9e38-4e97-884a-243b4a24a834.990b30f8-fc9a-4dec-9044-b893251416e2 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:54:27 devstack sudo[93629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e77cb2d8-9e38-4e97-884a-243b4a24a834.2fe39cbc-c80c-44a6-9305-ffc5bbccbf48 -F qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-e77cb2d8-9e38-4e97-884a-243b4a24a834.990b30f8-fc9a-4dec-9044-b893251416e2 Jul 13 13:54:27 devstack sudo[93629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:54:27 devstack sudo[93629]: pam_unix(sudo:session): session closed for user root Jul 13 13:54:27 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-5270bbd0-7b49-48fc-bfc9-2ac7d3b5e64a tempest-SnapshotsActionsTest-1565083684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e77cb2d8-9e38-4e97-884a-243b4a24a834.2fe39cbc-c80c-44a6-9305-ffc5bbccbf48 -F qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-e77cb2d8-9e38-4e97-884a-243b4a24a834.990b30f8-fc9a-4dec-9044-b893251416e2" returned: 0 in 0.316s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:54:27 devstack cinder-volume[87098]: WARNING cinder.volume.drivers.remotefs [None req-5270bbd0-7b49-48fc-bfc9-2ac7d3b5e64a tempest-SnapshotsActionsTest-1565083684 None] /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-e77cb2d8-9e38-4e97-884a-243b4a24a834.990b30f8-fc9a-4dec-9044-b893251416e2 is being set with open permissions: ugo+rw Jul 13 13:54:27 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-5270bbd0-7b49-48fc-bfc9-2ac7d3b5e64a tempest-SnapshotsActionsTest-1565083684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-e77cb2d8-9e38-4e97-884a-243b4a24a834.990b30f8-fc9a-4dec-9044-b893251416e2 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:54:27 devstack sudo[93635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-e77cb2d8-9e38-4e97-884a-243b4a24a834.990b30f8-fc9a-4dec-9044-b893251416e2 Jul 13 13:54:27 devstack sudo[93635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:54:27 devstack sudo[93635]: pam_unix(sudo:session): session closed for user root Jul 13 13:54:27 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-0166a9a0-905c-40f5-92f0-eb5f324d2050 tempest-VolumesActionsTest-1880950110 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 13:54:27 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-0166a9a0-905c-40f5-92f0-eb5f324d2050 tempest-VolumesActionsTest-1880950110 None] Flow 'volume_create_manager' (9cd87a1d-1b7d-494b-af2c-a37b24656ceb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 13:54:27 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-0166a9a0-905c-40f5-92f0-eb5f324d2050 tempest-VolumesActionsTest-1880950110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec16799c-eb64-46ac-93c3-8fb96d727ea3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:54:27 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-5270bbd0-7b49-48fc-bfc9-2ac7d3b5e64a tempest-SnapshotsActionsTest-1565083684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-e77cb2d8-9e38-4e97-884a-243b4a24a834.990b30f8-fc9a-4dec-9044-b893251416e2" returned: 0 in 0.348s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:54:27 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-0166a9a0-905c-40f5-92f0-eb5f324d2050 tempest-VolumesActionsTest-1880950110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec16799c-eb64-46ac-93c3-8fb96d727ea3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T11:54:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1441560087',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a52b84de-fb6a-46db-b2ae-b126c4a239c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1024172c991c4a2fa24ba220269c454a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T11:54:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T11:54:28Z,use_quota=True,user_id='4991d11932e9452684e711bf0a84ac82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1147de8b-623b-426c-a13d-7fc824a80f67),volume_type_id=1147de8b-623b-426c-a13d-7fc824a80f67)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:54:27 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-0166a9a0-905c-40f5-92f0-eb5f324d2050 tempest-VolumesActionsTest-1880950110 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5da9665-bce7-4cde-88a6-4dec6401ab2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:54:27 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-0166a9a0-905c-40f5-92f0-eb5f324d2050 tempest-VolumesActionsTest-1880950110 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5da9665-bce7-4cde-88a6-4dec6401ab2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:54:27 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-0166a9a0-905c-40f5-92f0-eb5f324d2050 tempest-VolumesActionsTest-1880950110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83862fe5-6b5f-4eca-916d-1efcb9c68d97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:54:27 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-0166a9a0-905c-40f5-92f0-eb5f324d2050 tempest-VolumesActionsTest-1880950110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83862fe5-6b5f-4eca-916d-1efcb9c68d97) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a52b84de-fb6a-46db-b2ae-b126c4a239c8', 'volume_name': 'volume-a52b84de-fb6a-46db-b2ae-b126c4a239c8', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:54:27 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-0166a9a0-905c-40f5-92f0-eb5f324d2050 tempest-VolumesActionsTest-1880950110 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98b0d19b-2c0f-47f1-b53b-7b4ae6836d2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:54:27 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-0166a9a0-905c-40f5-92f0-eb5f324d2050 tempest-VolumesActionsTest-1880950110 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98b0d19b-2c0f-47f1-b53b-7b4ae6836d2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:54:27 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-0166a9a0-905c-40f5-92f0-eb5f324d2050 tempest-VolumesActionsTest-1880950110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc142a82-c2f6-46bc-a849-e50ca2a1bad4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:54:27 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-0166a9a0-905c-40f5-92f0-eb5f324d2050 tempest-VolumesActionsTest-1880950110 None] Volume a52b84de-fb6a-46db-b2ae-b126c4a239c8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a52b84de-fb6a-46db-b2ae-b126c4a239c8', 'volume_size': 1} Jul 13 13:54:27 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-0166a9a0-905c-40f5-92f0-eb5f324d2050 tempest-VolumesActionsTest-1880950110 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:54:27 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-5270bbd0-7b49-48fc-bfc9-2ac7d3b5e64a tempest-SnapshotsActionsTest-1565083684 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.926s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:54:27 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-0166a9a0-905c-40f5-92f0-eb5f324d2050 tempest-VolumesActionsTest-1880950110 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.028s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:54:27 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-0166a9a0-905c-40f5-92f0-eb5f324d2050 tempest-VolumesActionsTest-1880950110 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T11:54:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1441560087',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a52b84de-fb6a-46db-b2ae-b126c4a239c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1024172c991c4a2fa24ba220269c454a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T11:54:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T11:54:28Z,use_quota=True,user_id='4991d11932e9452684e711bf0a84ac82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1147de8b-623b-426c-a13d-7fc824a80f67),volume_type_id=1147de8b-623b-426c-a13d-7fc824a80f67)}" {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 13 13:54:27 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-0166a9a0-905c-40f5-92f0-eb5f324d2050 tempest-VolumesActionsTest-1880950110 None] Creating volume a52b84de-fb6a-46db-b2ae-b126c4a239c8 {{(pid=87098) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 13 13:54:27 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-0166a9a0-905c-40f5-92f0-eb5f324d2050 tempest-VolumesActionsTest-1880950110 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:54:27 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-0166a9a0-905c-40f5-92f0-eb5f324d2050 tempest-VolumesActionsTest-1880950110 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:54:27 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-0166a9a0-905c-40f5-92f0-eb5f324d2050 tempest-VolumesActionsTest-1880950110 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 13:54:27 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-0166a9a0-905c-40f5-92f0-eb5f324d2050 tempest-VolumesActionsTest-1880950110 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 13:54:27 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-0166a9a0-905c-40f5-92f0-eb5f324d2050 tempest-VolumesActionsTest-1880950110 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:54:27 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-0166a9a0-905c-40f5-92f0-eb5f324d2050 tempest-VolumesActionsTest-1880950110 None] Selected osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 13:54:27 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-0166a9a0-905c-40f5-92f0-eb5f324d2050 tempest-VolumesActionsTest-1880950110 None] casted to osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 Jul 13 13:54:27 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-0166a9a0-905c-40f5-92f0-eb5f324d2050 tempest-VolumesActionsTest-1880950110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-a52b84de-fb6a-46db-b2ae-b126c4a239c8 1073741824 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:54:27 devstack sudo[93638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-a52b84de-fb6a-46db-b2ae-b126c4a239c8 1073741824 Jul 13 13:54:27 devstack sudo[93638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:54:27 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-5270bbd0-7b49-48fc-bfc9-2ac7d3b5e64a tempest-SnapshotsActionsTest-1565083684 None] Create snapshot completed successfully Jul 13 13:54:28 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-78d188a0-130e-4e07-958e-dc1394be02c5 tempest-SnapshotMetadataTestJSON-1526519816 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 13:54:28 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-78d188a0-130e-4e07-958e-dc1394be02c5 tempest-SnapshotMetadataTestJSON-1526519816 None] Flow 'volume_create_manager' (af04db28-730d-4a40-b7f6-9a4b8982cfca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 13:54:28 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-78d188a0-130e-4e07-958e-dc1394be02c5 tempest-SnapshotMetadataTestJSON-1526519816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ceaf7306-f861-4f0a-a8a8-bfd2ae103a5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:54:28 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-78d188a0-130e-4e07-958e-dc1394be02c5 tempest-SnapshotMetadataTestJSON-1526519816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ceaf7306-f861-4f0a-a8a8-bfd2ae103a5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T11:54:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1045050510',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dcec246d-017e-4967-8a11-3342ca5ed260,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5fbbe9d86b42416d8045c238cf1bab83',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T11:54:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T11:54:28Z,use_quota=True,user_id='300ec40caa1c4f9a80e358bef9f5b278',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1147de8b-623b-426c-a13d-7fc824a80f67),volume_type_id=1147de8b-623b-426c-a13d-7fc824a80f67)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:54:28 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-78d188a0-130e-4e07-958e-dc1394be02c5 tempest-SnapshotMetadataTestJSON-1526519816 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4d4dd56-2412-428a-bb8f-64a0ca949fa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:54:28 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-78d188a0-130e-4e07-958e-dc1394be02c5 tempest-SnapshotMetadataTestJSON-1526519816 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4d4dd56-2412-428a-bb8f-64a0ca949fa5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:54:28 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-78d188a0-130e-4e07-958e-dc1394be02c5 tempest-SnapshotMetadataTestJSON-1526519816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7152d38e-74b6-45ae-80d9-1938a16ac5e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:54:28 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-78d188a0-130e-4e07-958e-dc1394be02c5 tempest-SnapshotMetadataTestJSON-1526519816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7152d38e-74b6-45ae-80d9-1938a16ac5e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dcec246d-017e-4967-8a11-3342ca5ed260', 'volume_name': 'volume-dcec246d-017e-4967-8a11-3342ca5ed260', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:54:28 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-78d188a0-130e-4e07-958e-dc1394be02c5 tempest-SnapshotMetadataTestJSON-1526519816 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9785db3f-288f-4fc0-aecf-b28b8e5f1df9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:54:28 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-78d188a0-130e-4e07-958e-dc1394be02c5 tempest-SnapshotMetadataTestJSON-1526519816 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9785db3f-288f-4fc0-aecf-b28b8e5f1df9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:54:28 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-78d188a0-130e-4e07-958e-dc1394be02c5 tempest-SnapshotMetadataTestJSON-1526519816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb17ac2d-f522-4b12-9a53-f86c522e8b0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:54:28 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-78d188a0-130e-4e07-958e-dc1394be02c5 tempest-SnapshotMetadataTestJSON-1526519816 None] Volume dcec246d-017e-4967-8a11-3342ca5ed260: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dcec246d-017e-4967-8a11-3342ca5ed260', 'volume_size': 1} Jul 13 13:54:28 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-78d188a0-130e-4e07-958e-dc1394be02c5 tempest-SnapshotMetadataTestJSON-1526519816 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:54:28 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-54ca2075-624e-4173-9f2a-895688e53b02 tempest-SnapshotsActionsTest-1484405774 None] Acquiring lock "cinder-990b30f8-fc9a-4dec-9044-b893251416e2-delete_snapshot" by "delete_snapshot" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 13:54:28 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-54ca2075-624e-4173-9f2a-895688e53b02 tempest-SnapshotsActionsTest-1484405774 None] Lock "cinder-990b30f8-fc9a-4dec-9044-b893251416e2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 13:54:28 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-54ca2075-624e-4173-9f2a-895688e53b02 tempest-SnapshotsActionsTest-1484405774 None] Acquiring lock "cinder-quobyte-e77cb2d8-9e38-4e97-884a-243b4a24a834" by "delete_snapshot" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 13:54:28 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-54ca2075-624e-4173-9f2a-895688e53b02 tempest-SnapshotsActionsTest-1484405774 None] Lock "cinder-quobyte-e77cb2d8-9e38-4e97-884a-243b4a24a834" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 13:54:28 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-54ca2075-624e-4173-9f2a-895688e53b02 tempest-SnapshotsActionsTest-1484405774 None] Acquiring lock "cinder-quobyte-990b30f8-fc9a-4dec-9044-b893251416e2" by "_delete_snapshot" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 13:54:28 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-54ca2075-624e-4173-9f2a-895688e53b02 tempest-SnapshotsActionsTest-1484405774 None] Lock "cinder-quobyte-990b30f8-fc9a-4dec-9044-b893251416e2" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 13:54:28 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-54ca2075-624e-4173-9f2a-895688e53b02 tempest-SnapshotsActionsTest-1484405774 None] Deleting offline snapshot 990b30f8-fc9a-4dec-9044-b893251416e2 of volume e77cb2d8-9e38-4e97-884a-243b4a24a834 {{(pid=87098) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 13 13:54:28 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-54ca2075-624e-4173-9f2a-895688e53b02 tempest-SnapshotsActionsTest-1484405774 None] snapshot_file for this snap is: volume-e77cb2d8-9e38-4e97-884a-243b4a24a834.990b30f8-fc9a-4dec-9044-b893251416e2 {{(pid=87098) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 13 13:54:28 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5ad3a13-253c-4a4b-9637-33cd5ae8952e]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 13:54:28 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-54ca2075-624e-4173-9f2a-895688e53b02 tempest-SnapshotsActionsTest-1484405774 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-e77cb2d8-9e38-4e97-884a-243b4a24a834.990b30f8-fc9a-4dec-9044-b893251416e2 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:54:28 devstack sudo[93638]: pam_unix(sudo:session): session closed for user root Jul 13 13:54:28 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-0166a9a0-905c-40f5-92f0-eb5f324d2050 tempest-VolumesActionsTest-1880950110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-a52b84de-fb6a-46db-b2ae-b126c4a239c8 1073741824" returned: 0 in 0.577s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:54:28 devstack sudo[93644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-e77cb2d8-9e38-4e97-884a-243b4a24a834.990b30f8-fc9a-4dec-9044-b893251416e2 Jul 13 13:54:28 devstack sudo[93644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:54:28 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-0166a9a0-905c-40f5-92f0-eb5f324d2050 tempest-VolumesActionsTest-1880950110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-a52b84de-fb6a-46db-b2ae-b126c4a239c8 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:54:28 devstack sudo[93646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-a52b84de-fb6a-46db-b2ae-b126c4a239c8 Jul 13 13:54:28 devstack sudo[93646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:54:28 devstack sudo[93644]: pam_unix(sudo:session): session closed for user root Jul 13 13:54:28 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-54ca2075-624e-4173-9f2a-895688e53b02 tempest-SnapshotsActionsTest-1484405774 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-e77cb2d8-9e38-4e97-884a-243b4a24a834.990b30f8-fc9a-4dec-9044-b893251416e2" returned: 0 in 0.403s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:54:28 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-54ca2075-624e-4173-9f2a-895688e53b02 tempest-SnapshotsActionsTest-1484405774 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e77cb2d8-9e38-4e97-884a-243b4a24a834(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87098) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 13 13:54:28 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a4a7f08-39fe-4603-8244-0bd0c894345e]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 13:54:28 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-54ca2075-624e-4173-9f2a-895688e53b02 tempest-SnapshotsActionsTest-1484405774 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-e77cb2d8-9e38-4e97-884a-243b4a24a834.2fe39cbc-c80c-44a6-9305-ffc5bbccbf48 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:54:28 devstack sudo[93646]: pam_unix(sudo:session): session closed for user root Jul 13 13:54:28 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-0166a9a0-905c-40f5-92f0-eb5f324d2050 tempest-VolumesActionsTest-1880950110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-a52b84de-fb6a-46db-b2ae-b126c4a239c8" returned: 0 in 0.332s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:54:28 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-0166a9a0-905c-40f5-92f0-eb5f324d2050 tempest-VolumesActionsTest-1880950110 None] <== create_volume: return (962ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'} {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 13 13:54:28 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-0166a9a0-905c-40f5-92f0-eb5f324d2050 tempest-VolumesActionsTest-1880950110 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.965s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:54:28 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-78d188a0-130e-4e07-958e-dc1394be02c5 tempest-SnapshotMetadataTestJSON-1526519816 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.578s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:54:28 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-78d188a0-130e-4e07-958e-dc1394be02c5 tempest-SnapshotMetadataTestJSON-1526519816 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T11:54:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1045050510',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dcec246d-017e-4967-8a11-3342ca5ed260,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5fbbe9d86b42416d8045c238cf1bab83',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T11:54:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T11:54:28Z,use_quota=True,user_id='300ec40caa1c4f9a80e358bef9f5b278',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1147de8b-623b-426c-a13d-7fc824a80f67),volume_type_id=1147de8b-623b-426c-a13d-7fc824a80f67)}" {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 13 13:54:28 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-78d188a0-130e-4e07-958e-dc1394be02c5 tempest-SnapshotMetadataTestJSON-1526519816 None] Creating volume dcec246d-017e-4967-8a11-3342ca5ed260 {{(pid=87098) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 13 13:54:28 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-78d188a0-130e-4e07-958e-dc1394be02c5 tempest-SnapshotMetadataTestJSON-1526519816 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:54:28 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-78d188a0-130e-4e07-958e-dc1394be02c5 tempest-SnapshotMetadataTestJSON-1526519816 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:54:28 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-78d188a0-130e-4e07-958e-dc1394be02c5 tempest-SnapshotMetadataTestJSON-1526519816 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 13:54:28 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-78d188a0-130e-4e07-958e-dc1394be02c5 tempest-SnapshotMetadataTestJSON-1526519816 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 13:54:28 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-78d188a0-130e-4e07-958e-dc1394be02c5 tempest-SnapshotMetadataTestJSON-1526519816 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:54:28 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-78d188a0-130e-4e07-958e-dc1394be02c5 tempest-SnapshotMetadataTestJSON-1526519816 None] Selected osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 13:54:28 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-78d188a0-130e-4e07-958e-dc1394be02c5 tempest-SnapshotMetadataTestJSON-1526519816 None] casted to osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 Jul 13 13:54:28 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-78d188a0-130e-4e07-958e-dc1394be02c5 tempest-SnapshotMetadataTestJSON-1526519816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-dcec246d-017e-4967-8a11-3342ca5ed260 1073741824 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:54:28 devstack sudo[93653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-dcec246d-017e-4967-8a11-3342ca5ed260 1073741824 Jul 13 13:54:28 devstack sudo[93653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:54:28 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-0166a9a0-905c-40f5-92f0-eb5f324d2050 tempest-VolumesActionsTest-1880950110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc142a82-c2f6-46bc-a849-e50ca2a1bad4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a52b84de-fb6a-46db-b2ae-b126c4a239c8', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:54:28 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-0166a9a0-905c-40f5-92f0-eb5f324d2050 tempest-VolumesActionsTest-1880950110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12f1d1d2-a3fe-406b-a211-c7e483d2fc47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:54:28 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-0166a9a0-905c-40f5-92f0-eb5f324d2050 tempest-VolumesActionsTest-1880950110 None] Volume volume-a52b84de-fb6a-46db-b2ae-b126c4a239c8 (a52b84de-fb6a-46db-b2ae-b126c4a239c8): created successfully Jul 13 13:54:28 devstack sudo[93652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-e77cb2d8-9e38-4e97-884a-243b4a24a834.2fe39cbc-c80c-44a6-9305-ffc5bbccbf48 Jul 13 13:54:28 devstack sudo[93652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:54:28 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-0166a9a0-905c-40f5-92f0-eb5f324d2050 tempest-VolumesActionsTest-1880950110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12f1d1d2-a3fe-406b-a211-c7e483d2fc47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:54:28 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-0166a9a0-905c-40f5-92f0-eb5f324d2050 tempest-VolumesActionsTest-1880950110 None] Flow 'volume_create_manager' (9cd87a1d-1b7d-494b-af2c-a37b24656ceb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 13:54:28 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-0166a9a0-905c-40f5-92f0-eb5f324d2050 tempest-VolumesActionsTest-1880950110 None] Created volume successfully. Jul 13 13:54:29 devstack cinder-volume[87098]: DEBUG oslo_service.periodic_task [None req-727a1692-ea28-4a77-b327-0d94e8f01efb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87098) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 13 13:54:29 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-727a1692-ea28-4a77-b327-0d94e8f01efb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:54:29 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-727a1692-ea28-4a77-b327-0d94e8f01efb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:54:29 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-727a1692-ea28-4a77-b327-0d94e8f01efb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 13:54:29 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-727a1692-ea28-4a77-b327-0d94e8f01efb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 13:54:29 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-727a1692-ea28-4a77-b327-0d94e8f01efb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:54:29 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-727a1692-ea28-4a77-b327-0d94e8f01efb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:54:29 devstack sudo[93658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 Jul 13 13:54:29 devstack sudo[93658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:54:29 devstack sudo[93652]: pam_unix(sudo:session): session closed for user root Jul 13 13:54:29 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-54ca2075-624e-4173-9f2a-895688e53b02 tempest-SnapshotsActionsTest-1484405774 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-e77cb2d8-9e38-4e97-884a-243b4a24a834.2fe39cbc-c80c-44a6-9305-ffc5bbccbf48" returned: 0 in 0.429s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:54:29 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-54ca2075-624e-4173-9f2a-895688e53b02 tempest-SnapshotsActionsTest-1484405774 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e77cb2d8-9e38-4e97-884a-243b4a24a834(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87098) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 13 13:54:29 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-54ca2075-624e-4173-9f2a-895688e53b02 tempest-SnapshotsActionsTest-1484405774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-e77cb2d8-9e38-4e97-884a-243b4a24a834.990b30f8-fc9a-4dec-9044-b893251416e2 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:54:29 devstack sudo[93665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-e77cb2d8-9e38-4e97-884a-243b4a24a834.990b30f8-fc9a-4dec-9044-b893251416e2 Jul 13 13:54:29 devstack sudo[93665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:54:29 devstack sudo[93653]: pam_unix(sudo:session): session closed for user root Jul 13 13:54:29 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-78d188a0-130e-4e07-958e-dc1394be02c5 tempest-SnapshotMetadataTestJSON-1526519816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-dcec246d-017e-4967-8a11-3342ca5ed260 1073741824" returned: 0 in 0.461s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:54:29 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-78d188a0-130e-4e07-958e-dc1394be02c5 tempest-SnapshotMetadataTestJSON-1526519816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-dcec246d-017e-4967-8a11-3342ca5ed260 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:54:29 devstack sudo[93669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-dcec246d-017e-4967-8a11-3342ca5ed260 Jul 13 13:54:29 devstack sudo[93669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:54:29 devstack sudo[93658]: pam_unix(sudo:session): session closed for user root Jul 13 13:54:29 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-727a1692-ea28-4a77-b327-0d94e8f01efb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78" returned: 0 in 0.315s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:54:29 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-727a1692-ea28-4a77-b327-0d94e8f01efb None None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 13:54:29 devstack cinder-volume[87098]: DEBUG oslo_service.periodic_task [None req-727a1692-ea28-4a77-b327-0d94e8f01efb None None] Running periodic task VolumeManager._thread_info {{(pid=87098) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 13 13:54:29 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-727a1692-ea28-4a77-b327-0d94e8f01efb None None] thread count: 8 {{(pid=87098) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 13 13:54:29 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-727a1692-ea28-4a77-b327-0d94e8f01efb None None] thread info: [<_MainThread(MainThread, started 127988054597760)>, , , , , , , ] {{(pid=87098) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 13 13:54:29 devstack sudo[93665]: pam_unix(sudo:session): session closed for user root Jul 13 13:54:29 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-54ca2075-624e-4173-9f2a-895688e53b02 tempest-SnapshotsActionsTest-1484405774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-e77cb2d8-9e38-4e97-884a-243b4a24a834.990b30f8-fc9a-4dec-9044-b893251416e2" returned: 0 in 0.420s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:54:29 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-54ca2075-624e-4173-9f2a-895688e53b02 tempest-SnapshotsActionsTest-1484405774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-e77cb2d8-9e38-4e97-884a-243b4a24a834.990b30f8-fc9a-4dec-9044-b893251416e2 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:54:29 devstack sudo[93669]: pam_unix(sudo:session): session closed for user root Jul 13 13:54:29 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-78d188a0-130e-4e07-958e-dc1394be02c5 tempest-SnapshotMetadataTestJSON-1526519816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-dcec246d-017e-4967-8a11-3342ca5ed260" returned: 0 in 0.310s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:54:29 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-78d188a0-130e-4e07-958e-dc1394be02c5 tempest-SnapshotMetadataTestJSON-1526519816 None] <== create_volume: return (829ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'} {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 13 13:54:29 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-78d188a0-130e-4e07-958e-dc1394be02c5 tempest-SnapshotMetadataTestJSON-1526519816 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.832s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:54:29 devstack sudo[93675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-e77cb2d8-9e38-4e97-884a-243b4a24a834.990b30f8-fc9a-4dec-9044-b893251416e2 Jul 13 13:54:29 devstack sudo[93675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:54:29 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-78d188a0-130e-4e07-958e-dc1394be02c5 tempest-SnapshotMetadataTestJSON-1526519816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb17ac2d-f522-4b12-9a53-f86c522e8b0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dcec246d-017e-4967-8a11-3342ca5ed260', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:54:29 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-78d188a0-130e-4e07-958e-dc1394be02c5 tempest-SnapshotMetadataTestJSON-1526519816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d561e536-b531-478e-a809-a29400435179) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:54:29 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-78d188a0-130e-4e07-958e-dc1394be02c5 tempest-SnapshotMetadataTestJSON-1526519816 None] Volume volume-dcec246d-017e-4967-8a11-3342ca5ed260 (dcec246d-017e-4967-8a11-3342ca5ed260): created successfully Jul 13 13:54:29 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-78d188a0-130e-4e07-958e-dc1394be02c5 tempest-SnapshotMetadataTestJSON-1526519816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d561e536-b531-478e-a809-a29400435179) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:54:29 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-78d188a0-130e-4e07-958e-dc1394be02c5 tempest-SnapshotMetadataTestJSON-1526519816 None] Flow 'volume_create_manager' (af04db28-730d-4a40-b7f6-9a4b8982cfca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 13:54:29 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-78d188a0-130e-4e07-958e-dc1394be02c5 tempest-SnapshotMetadataTestJSON-1526519816 None] Created volume successfully. Jul 13 13:54:29 devstack sudo[93675]: pam_unix(sudo:session): session closed for user root Jul 13 13:54:29 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-54ca2075-624e-4173-9f2a-895688e53b02 tempest-SnapshotsActionsTest-1484405774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-e77cb2d8-9e38-4e97-884a-243b4a24a834.990b30f8-fc9a-4dec-9044-b893251416e2" returned: 0 in 0.281s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:54:29 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-54ca2075-624e-4173-9f2a-895688e53b02 tempest-SnapshotsActionsTest-1484405774 None] Lock "cinder-quobyte-990b30f8-fc9a-4dec-9044-b893251416e2" released by "_delete_snapshot" :: held 1.651s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 13:54:29 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-54ca2075-624e-4173-9f2a-895688e53b02 tempest-SnapshotsActionsTest-1484405774 None] Lock "cinder-quobyte-e77cb2d8-9e38-4e97-884a-243b4a24a834" released by "delete_snapshot" :: held 1.678s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 13:54:29 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-54ca2075-624e-4173-9f2a-895688e53b02 tempest-SnapshotsActionsTest-1484405774 None] Created reservations ['4fb73d0d-ffc0-481a-9f43-ff870da13c03', 'c142236c-df91-4ee1-b847-6cb97a80ebb2', '6e5aa041-5fb8-4232-8267-24c4f02cb930', '65dd33ac-30f0-4ed3-b1dd-ee28a7e6a6b8'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 13:54:30 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-54ca2075-624e-4173-9f2a-895688e53b02 tempest-SnapshotsActionsTest-1484405774 None] Delete snapshot completed successfully. Jul 13 13:54:30 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-54ca2075-624e-4173-9f2a-895688e53b02 tempest-SnapshotsActionsTest-1484405774 None] Lock "cinder-990b30f8-fc9a-4dec-9044-b893251416e2-delete_snapshot" released by "delete_snapshot" :: held 1.830s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 13:54:30 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-c43ec992-34f9-4ca2-838c-985e17d527d9 tempest-SnapshotMetadataTestJSON-1526519816 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:54:30 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-c43ec992-34f9-4ca2-838c-985e17d527d9 tempest-SnapshotMetadataTestJSON-1526519816 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:54:30 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-c43ec992-34f9-4ca2-838c-985e17d527d9 tempest-SnapshotMetadataTestJSON-1526519816 None] Creating offline snapshot 4c089064-c39c-4f4a-96fc-f322119d6247 of volume dcec246d-017e-4967-8a11-3342ca5ed260 {{(pid=87098) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 13 13:54:30 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[67a87625-366a-4249-9069-8f35fae990e9]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 13:54:30 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-c43ec992-34f9-4ca2-838c-985e17d527d9 tempest-SnapshotMetadataTestJSON-1526519816 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-dcec246d-017e-4967-8a11-3342ca5ed260 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:54:30 devstack sudo[93678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-dcec246d-017e-4967-8a11-3342ca5ed260 Jul 13 13:54:30 devstack sudo[93678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:54:30 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-f5d10cfd-b5ab-41d9-a69e-d416aa4cc62a tempest-SnapshotsActionsTest-1565083684 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:54:30 devstack sudo[93678]: pam_unix(sudo:session): session closed for user root Jul 13 13:54:30 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-c43ec992-34f9-4ca2-838c-985e17d527d9 tempest-SnapshotMetadataTestJSON-1526519816 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-dcec246d-017e-4967-8a11-3342ca5ed260" returned: 0 in 0.474s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:54:30 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-c43ec992-34f9-4ca2-838c-985e17d527d9 tempest-SnapshotMetadataTestJSON-1526519816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-dcec246d-017e-4967-8a11-3342ca5ed260,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-dcec246d-017e-4967-8a11-3342ca5ed260.4c089064-c39c-4f4a-96fc-f322119d6247 1G {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:54:30 devstack sudo[93686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-dcec246d-017e-4967-8a11-3342ca5ed260,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-dcec246d-017e-4967-8a11-3342ca5ed260.4c089064-c39c-4f4a-96fc-f322119d6247 1G Jul 13 13:54:30 devstack sudo[93686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:54:31 devstack sudo[93686]: pam_unix(sudo:session): session closed for user root Jul 13 13:54:31 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-c43ec992-34f9-4ca2-838c-985e17d527d9 tempest-SnapshotMetadataTestJSON-1526519816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-dcec246d-017e-4967-8a11-3342ca5ed260,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-dcec246d-017e-4967-8a11-3342ca5ed260.4c089064-c39c-4f4a-96fc-f322119d6247 1G" returned: 0 in 0.481s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:54:31 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-c43ec992-34f9-4ca2-838c-985e17d527d9 tempest-SnapshotMetadataTestJSON-1526519816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dcec246d-017e-4967-8a11-3342ca5ed260 -F qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-dcec246d-017e-4967-8a11-3342ca5ed260.4c089064-c39c-4f4a-96fc-f322119d6247 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:54:31 devstack sudo[93693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dcec246d-017e-4967-8a11-3342ca5ed260 -F qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-dcec246d-017e-4967-8a11-3342ca5ed260.4c089064-c39c-4f4a-96fc-f322119d6247 Jul 13 13:54:31 devstack sudo[93693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:54:31 devstack sudo[93693]: pam_unix(sudo:session): session closed for user root Jul 13 13:54:31 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-c43ec992-34f9-4ca2-838c-985e17d527d9 tempest-SnapshotMetadataTestJSON-1526519816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dcec246d-017e-4967-8a11-3342ca5ed260 -F qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-dcec246d-017e-4967-8a11-3342ca5ed260.4c089064-c39c-4f4a-96fc-f322119d6247" returned: 0 in 0.341s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:54:31 devstack cinder-volume[87098]: WARNING cinder.volume.drivers.remotefs [None req-c43ec992-34f9-4ca2-838c-985e17d527d9 tempest-SnapshotMetadataTestJSON-1526519816 None] /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-dcec246d-017e-4967-8a11-3342ca5ed260.4c089064-c39c-4f4a-96fc-f322119d6247 is being set with open permissions: ugo+rw Jul 13 13:54:31 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-c43ec992-34f9-4ca2-838c-985e17d527d9 tempest-SnapshotMetadataTestJSON-1526519816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-dcec246d-017e-4967-8a11-3342ca5ed260.4c089064-c39c-4f4a-96fc-f322119d6247 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:54:31 devstack sudo[93698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-dcec246d-017e-4967-8a11-3342ca5ed260.4c089064-c39c-4f4a-96fc-f322119d6247 Jul 13 13:54:31 devstack sudo[93698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:54:31 devstack sudo[93698]: pam_unix(sudo:session): session closed for user root Jul 13 13:54:31 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-c43ec992-34f9-4ca2-838c-985e17d527d9 tempest-SnapshotMetadataTestJSON-1526519816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-dcec246d-017e-4967-8a11-3342ca5ed260.4c089064-c39c-4f4a-96fc-f322119d6247" returned: 0 in 0.295s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:54:32 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-c43ec992-34f9-4ca2-838c-985e17d527d9 tempest-SnapshotMetadataTestJSON-1526519816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-dcec246d-017e-4967-8a11-3342ca5ed260.info {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:54:32 devstack sudo[93701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-dcec246d-017e-4967-8a11-3342ca5ed260.info Jul 13 13:54:32 devstack sudo[93701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:54:32 devstack sudo[93701]: pam_unix(sudo:session): session closed for user root Jul 13 13:54:32 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-c43ec992-34f9-4ca2-838c-985e17d527d9 tempest-SnapshotMetadataTestJSON-1526519816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-dcec246d-017e-4967-8a11-3342ca5ed260.info" returned: 0 in 0.315s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:54:32 devstack cinder-volume[87098]: WARNING cinder.volume.drivers.remotefs [None req-c43ec992-34f9-4ca2-838c-985e17d527d9 tempest-SnapshotMetadataTestJSON-1526519816 None] /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-dcec246d-017e-4967-8a11-3342ca5ed260.info is being set with open permissions: ugo+rw Jul 13 13:54:32 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-c43ec992-34f9-4ca2-838c-985e17d527d9 tempest-SnapshotMetadataTestJSON-1526519816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-dcec246d-017e-4967-8a11-3342ca5ed260.info {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:54:32 devstack sudo[93709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-dcec246d-017e-4967-8a11-3342ca5ed260.info Jul 13 13:54:32 devstack sudo[93709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:54:32 devstack sudo[93709]: pam_unix(sudo:session): session closed for user root Jul 13 13:54:32 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-c43ec992-34f9-4ca2-838c-985e17d527d9 tempest-SnapshotMetadataTestJSON-1526519816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-dcec246d-017e-4967-8a11-3342ca5ed260.info" returned: 0 in 0.328s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:54:32 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-c43ec992-34f9-4ca2-838c-985e17d527d9 tempest-SnapshotMetadataTestJSON-1526519816 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.374s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:54:32 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-f5d10cfd-b5ab-41d9-a69e-d416aa4cc62a tempest-SnapshotsActionsTest-1565083684 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.942s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:54:32 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-f5d10cfd-b5ab-41d9-a69e-d416aa4cc62a tempest-SnapshotsActionsTest-1565083684 None] Creating offline snapshot 83a3469f-19ac-4fe7-ba01-50d8352fcb17 of volume e77cb2d8-9e38-4e97-884a-243b4a24a834 {{(pid=87098) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 13 13:54:32 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-c43ec992-34f9-4ca2-838c-985e17d527d9 tempest-SnapshotMetadataTestJSON-1526519816 None] Create snapshot completed successfully Jul 13 13:54:32 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[65747acf-1fc5-4eb3-b0a1-cf26f4e873b3]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 13:54:32 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-f5d10cfd-b5ab-41d9-a69e-d416aa4cc62a tempest-SnapshotsActionsTest-1565083684 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-e77cb2d8-9e38-4e97-884a-243b4a24a834.2fe39cbc-c80c-44a6-9305-ffc5bbccbf48 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:54:33 devstack sudo[93727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-e77cb2d8-9e38-4e97-884a-243b4a24a834.2fe39cbc-c80c-44a6-9305-ffc5bbccbf48 Jul 13 13:54:33 devstack sudo[93727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:54:33 devstack sudo[93727]: pam_unix(sudo:session): session closed for user root Jul 13 13:54:33 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-f5d10cfd-b5ab-41d9-a69e-d416aa4cc62a tempest-SnapshotsActionsTest-1565083684 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-e77cb2d8-9e38-4e97-884a-243b4a24a834.2fe39cbc-c80c-44a6-9305-ffc5bbccbf48" returned: 0 in 0.481s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:54:33 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-f5d10cfd-b5ab-41d9-a69e-d416aa4cc62a tempest-SnapshotsActionsTest-1565083684 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e77cb2d8-9e38-4e97-884a-243b4a24a834(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87098) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 13 13:54:33 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-f5d10cfd-b5ab-41d9-a69e-d416aa4cc62a tempest-SnapshotsActionsTest-1565083684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-e77cb2d8-9e38-4e97-884a-243b4a24a834.2fe39cbc-c80c-44a6-9305-ffc5bbccbf48,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-e77cb2d8-9e38-4e97-884a-243b4a24a834.83a3469f-19ac-4fe7-ba01-50d8352fcb17 1G {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:54:33 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-bbd76cb1-3c4d-4151-9dac-348ce51a0f69 tempest-AttachVolumeTestJSON-2118030158 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 13:54:33 devstack sudo[93736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-e77cb2d8-9e38-4e97-884a-243b4a24a834.2fe39cbc-c80c-44a6-9305-ffc5bbccbf48,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-e77cb2d8-9e38-4e97-884a-243b4a24a834.83a3469f-19ac-4fe7-ba01-50d8352fcb17 1G Jul 13 13:54:33 devstack sudo[93736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:54:33 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-bbd76cb1-3c4d-4151-9dac-348ce51a0f69 tempest-AttachVolumeTestJSON-2118030158 None] Flow 'volume_create_manager' (1a74ec0a-b577-4547-8752-8fe75ffbf2bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 13:54:33 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-bbd76cb1-3c4d-4151-9dac-348ce51a0f69 tempest-AttachVolumeTestJSON-2118030158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35176714-d355-45a2-a9c2-e715a2f2e675) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:54:33 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-bbd76cb1-3c4d-4151-9dac-348ce51a0f69 tempest-AttachVolumeTestJSON-2118030158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35176714-d355-45a2-a9c2-e715a2f2e675) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T11:54:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-932262054',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6137375d-767f-471c-9779-832082fd5e63,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87e8b6519220410eabbdd6d9ce4eeaa0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T11:54:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T11:54:33Z,use_quota=True,user_id='24581d52b8074543a263e3dfca61f079',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1147de8b-623b-426c-a13d-7fc824a80f67),volume_type_id=1147de8b-623b-426c-a13d-7fc824a80f67)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:54:33 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-bbd76cb1-3c4d-4151-9dac-348ce51a0f69 tempest-AttachVolumeTestJSON-2118030158 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb876189-bde6-4613-8406-ce9624791e15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:54:33 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-bbd76cb1-3c4d-4151-9dac-348ce51a0f69 tempest-AttachVolumeTestJSON-2118030158 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb876189-bde6-4613-8406-ce9624791e15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:54:33 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-bbd76cb1-3c4d-4151-9dac-348ce51a0f69 tempest-AttachVolumeTestJSON-2118030158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd92949d-e815-44f2-8e79-a539df2e3c82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:54:33 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-bbd76cb1-3c4d-4151-9dac-348ce51a0f69 tempest-AttachVolumeTestJSON-2118030158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd92949d-e815-44f2-8e79-a539df2e3c82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6137375d-767f-471c-9779-832082fd5e63', 'volume_name': 'volume-6137375d-767f-471c-9779-832082fd5e63', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:54:33 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-bbd76cb1-3c4d-4151-9dac-348ce51a0f69 tempest-AttachVolumeTestJSON-2118030158 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96d9db8f-ccaf-4138-b593-ade523a7ac32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:54:33 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-bbd76cb1-3c4d-4151-9dac-348ce51a0f69 tempest-AttachVolumeTestJSON-2118030158 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96d9db8f-ccaf-4138-b593-ade523a7ac32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:54:33 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-bbd76cb1-3c4d-4151-9dac-348ce51a0f69 tempest-AttachVolumeTestJSON-2118030158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef936182-7a96-43ce-819c-d94966c8482d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:54:33 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-bbd76cb1-3c4d-4151-9dac-348ce51a0f69 tempest-AttachVolumeTestJSON-2118030158 None] Volume 6137375d-767f-471c-9779-832082fd5e63: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6137375d-767f-471c-9779-832082fd5e63', 'volume_size': 1} Jul 13 13:54:33 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-bbd76cb1-3c4d-4151-9dac-348ce51a0f69 tempest-AttachVolumeTestJSON-2118030158 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:54:34 devstack sudo[93736]: pam_unix(sudo:session): session closed for user root Jul 13 13:54:34 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-f5d10cfd-b5ab-41d9-a69e-d416aa4cc62a tempest-SnapshotsActionsTest-1565083684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-e77cb2d8-9e38-4e97-884a-243b4a24a834.2fe39cbc-c80c-44a6-9305-ffc5bbccbf48,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-e77cb2d8-9e38-4e97-884a-243b4a24a834.83a3469f-19ac-4fe7-ba01-50d8352fcb17 1G" returned: 0 in 0.611s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:54:34 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-f5d10cfd-b5ab-41d9-a69e-d416aa4cc62a tempest-SnapshotsActionsTest-1565083684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e77cb2d8-9e38-4e97-884a-243b4a24a834.2fe39cbc-c80c-44a6-9305-ffc5bbccbf48 -F qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-e77cb2d8-9e38-4e97-884a-243b4a24a834.83a3469f-19ac-4fe7-ba01-50d8352fcb17 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:54:34 devstack sudo[93742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e77cb2d8-9e38-4e97-884a-243b4a24a834.2fe39cbc-c80c-44a6-9305-ffc5bbccbf48 -F qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-e77cb2d8-9e38-4e97-884a-243b4a24a834.83a3469f-19ac-4fe7-ba01-50d8352fcb17 Jul 13 13:54:34 devstack sudo[93742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:54:34 devstack sudo[93742]: pam_unix(sudo:session): session closed for user root Jul 13 13:54:34 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-f5d10cfd-b5ab-41d9-a69e-d416aa4cc62a tempest-SnapshotsActionsTest-1565083684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e77cb2d8-9e38-4e97-884a-243b4a24a834.2fe39cbc-c80c-44a6-9305-ffc5bbccbf48 -F qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-e77cb2d8-9e38-4e97-884a-243b4a24a834.83a3469f-19ac-4fe7-ba01-50d8352fcb17" returned: 0 in 0.393s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:54:34 devstack cinder-volume[87098]: WARNING cinder.volume.drivers.remotefs [None req-f5d10cfd-b5ab-41d9-a69e-d416aa4cc62a tempest-SnapshotsActionsTest-1565083684 None] /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-e77cb2d8-9e38-4e97-884a-243b4a24a834.83a3469f-19ac-4fe7-ba01-50d8352fcb17 is being set with open permissions: ugo+rw Jul 13 13:54:34 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-f5d10cfd-b5ab-41d9-a69e-d416aa4cc62a tempest-SnapshotsActionsTest-1565083684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-e77cb2d8-9e38-4e97-884a-243b4a24a834.83a3469f-19ac-4fe7-ba01-50d8352fcb17 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:54:34 devstack sudo[93748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-e77cb2d8-9e38-4e97-884a-243b4a24a834.83a3469f-19ac-4fe7-ba01-50d8352fcb17 Jul 13 13:54:34 devstack sudo[93748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:54:34 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-1438e901-ae06-42f5-aae2-d7add9a76975 tempest-SnapshotMetadataTestJSON-1526519816 None] Acquiring lock "cinder-4c089064-c39c-4f4a-96fc-f322119d6247-delete_snapshot" by "delete_snapshot" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 13:54:34 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-1438e901-ae06-42f5-aae2-d7add9a76975 tempest-SnapshotMetadataTestJSON-1526519816 None] Lock "cinder-4c089064-c39c-4f4a-96fc-f322119d6247-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 13:54:34 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-1438e901-ae06-42f5-aae2-d7add9a76975 tempest-SnapshotMetadataTestJSON-1526519816 None] Acquiring lock "cinder-quobyte-dcec246d-017e-4967-8a11-3342ca5ed260" by "delete_snapshot" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 13:54:34 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-1438e901-ae06-42f5-aae2-d7add9a76975 tempest-SnapshotMetadataTestJSON-1526519816 None] Lock "cinder-quobyte-dcec246d-017e-4967-8a11-3342ca5ed260" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 13:54:34 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-1438e901-ae06-42f5-aae2-d7add9a76975 tempest-SnapshotMetadataTestJSON-1526519816 None] Acquiring lock "cinder-quobyte-4c089064-c39c-4f4a-96fc-f322119d6247" by "_delete_snapshot" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 13:54:34 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-1438e901-ae06-42f5-aae2-d7add9a76975 tempest-SnapshotMetadataTestJSON-1526519816 None] Lock "cinder-quobyte-4c089064-c39c-4f4a-96fc-f322119d6247" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 13:54:34 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-1438e901-ae06-42f5-aae2-d7add9a76975 tempest-SnapshotMetadataTestJSON-1526519816 None] Deleting offline snapshot 4c089064-c39c-4f4a-96fc-f322119d6247 of volume dcec246d-017e-4967-8a11-3342ca5ed260 {{(pid=87098) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 13 13:54:34 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-1438e901-ae06-42f5-aae2-d7add9a76975 tempest-SnapshotMetadataTestJSON-1526519816 None] snapshot_file for this snap is: volume-dcec246d-017e-4967-8a11-3342ca5ed260.4c089064-c39c-4f4a-96fc-f322119d6247 {{(pid=87098) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 13 13:54:34 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7ee7abc-8669-471b-877f-fa0e8986b77a]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 13:54:34 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-1438e901-ae06-42f5-aae2-d7add9a76975 tempest-SnapshotMetadataTestJSON-1526519816 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-dcec246d-017e-4967-8a11-3342ca5ed260.4c089064-c39c-4f4a-96fc-f322119d6247 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:54:34 devstack sudo[93750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-dcec246d-017e-4967-8a11-3342ca5ed260.4c089064-c39c-4f4a-96fc-f322119d6247 Jul 13 13:54:34 devstack sudo[93750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:54:34 devstack sudo[93748]: pam_unix(sudo:session): session closed for user root Jul 13 13:54:34 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-f5d10cfd-b5ab-41d9-a69e-d416aa4cc62a tempest-SnapshotsActionsTest-1565083684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-e77cb2d8-9e38-4e97-884a-243b4a24a834.83a3469f-19ac-4fe7-ba01-50d8352fcb17" returned: 0 in 0.346s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:54:34 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-f5d10cfd-b5ab-41d9-a69e-d416aa4cc62a tempest-SnapshotsActionsTest-1565083684 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.069s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:54:34 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-bbd76cb1-3c4d-4151-9dac-348ce51a0f69 tempest-AttachVolumeTestJSON-2118030158 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.301s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:54:34 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-bbd76cb1-3c4d-4151-9dac-348ce51a0f69 tempest-AttachVolumeTestJSON-2118030158 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T11:54:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-932262054',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6137375d-767f-471c-9779-832082fd5e63,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87e8b6519220410eabbdd6d9ce4eeaa0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T11:54:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T11:54:33Z,use_quota=True,user_id='24581d52b8074543a263e3dfca61f079',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1147de8b-623b-426c-a13d-7fc824a80f67),volume_type_id=1147de8b-623b-426c-a13d-7fc824a80f67)}" {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 13 13:54:34 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-bbd76cb1-3c4d-4151-9dac-348ce51a0f69 tempest-AttachVolumeTestJSON-2118030158 None] Creating volume 6137375d-767f-471c-9779-832082fd5e63 {{(pid=87098) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 13 13:54:34 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-bbd76cb1-3c4d-4151-9dac-348ce51a0f69 tempest-AttachVolumeTestJSON-2118030158 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:54:34 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-bbd76cb1-3c4d-4151-9dac-348ce51a0f69 tempest-AttachVolumeTestJSON-2118030158 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:54:34 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-bbd76cb1-3c4d-4151-9dac-348ce51a0f69 tempest-AttachVolumeTestJSON-2118030158 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 13:54:34 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-bbd76cb1-3c4d-4151-9dac-348ce51a0f69 tempest-AttachVolumeTestJSON-2118030158 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 13:54:34 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-bbd76cb1-3c4d-4151-9dac-348ce51a0f69 tempest-AttachVolumeTestJSON-2118030158 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:54:34 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-bbd76cb1-3c4d-4151-9dac-348ce51a0f69 tempest-AttachVolumeTestJSON-2118030158 None] Selected osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 13:54:34 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-bbd76cb1-3c4d-4151-9dac-348ce51a0f69 tempest-AttachVolumeTestJSON-2118030158 None] casted to osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 Jul 13 13:54:34 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-bbd76cb1-3c4d-4151-9dac-348ce51a0f69 tempest-AttachVolumeTestJSON-2118030158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-6137375d-767f-471c-9779-832082fd5e63 1073741824 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:54:34 devstack sudo[93753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-6137375d-767f-471c-9779-832082fd5e63 1073741824 Jul 13 13:54:34 devstack sudo[93753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:54:34 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-f5d10cfd-b5ab-41d9-a69e-d416aa4cc62a tempest-SnapshotsActionsTest-1565083684 None] Create snapshot completed successfully Jul 13 13:54:35 devstack sudo[93750]: pam_unix(sudo:session): session closed for user root Jul 13 13:54:35 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-1438e901-ae06-42f5-aae2-d7add9a76975 tempest-SnapshotMetadataTestJSON-1526519816 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-dcec246d-017e-4967-8a11-3342ca5ed260.4c089064-c39c-4f4a-96fc-f322119d6247" returned: 0 in 0.519s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:54:35 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-1438e901-ae06-42f5-aae2-d7add9a76975 tempest-SnapshotMetadataTestJSON-1526519816 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dcec246d-017e-4967-8a11-3342ca5ed260(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87098) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 13 13:54:35 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[e411a027-4311-4d0d-824a-d0a90056c384]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 13:54:35 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-1438e901-ae06-42f5-aae2-d7add9a76975 tempest-SnapshotMetadataTestJSON-1526519816 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-dcec246d-017e-4967-8a11-3342ca5ed260 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:54:35 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-94a9853f-64e5-4747-b3dc-32d3cec44e43 tempest-SnapshotsActionsTest-1484405774 None] Acquiring lock "cinder-83a3469f-19ac-4fe7-ba01-50d8352fcb17-delete_snapshot" by "delete_snapshot" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 13:54:35 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-94a9853f-64e5-4747-b3dc-32d3cec44e43 tempest-SnapshotsActionsTest-1484405774 None] Lock "cinder-83a3469f-19ac-4fe7-ba01-50d8352fcb17-delete_snapshot" acquired by "delete_snapshot" :: waited 0.043s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 13:54:35 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-94a9853f-64e5-4747-b3dc-32d3cec44e43 tempest-SnapshotsActionsTest-1484405774 None] Acquiring lock "cinder-quobyte-e77cb2d8-9e38-4e97-884a-243b4a24a834" by "delete_snapshot" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 13:54:35 devstack sudo[93777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-dcec246d-017e-4967-8a11-3342ca5ed260 Jul 13 13:54:35 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-94a9853f-64e5-4747-b3dc-32d3cec44e43 tempest-SnapshotsActionsTest-1484405774 None] Lock "cinder-quobyte-e77cb2d8-9e38-4e97-884a-243b4a24a834" acquired by "delete_snapshot" :: waited 0.050s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 13:54:35 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-94a9853f-64e5-4747-b3dc-32d3cec44e43 tempest-SnapshotsActionsTest-1484405774 None] Acquiring lock "cinder-quobyte-83a3469f-19ac-4fe7-ba01-50d8352fcb17" by "_delete_snapshot" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 13:54:35 devstack sudo[93777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:54:35 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-94a9853f-64e5-4747-b3dc-32d3cec44e43 tempest-SnapshotsActionsTest-1484405774 None] Lock "cinder-quobyte-83a3469f-19ac-4fe7-ba01-50d8352fcb17" acquired by "_delete_snapshot" :: waited 0.040s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 13:54:35 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-94a9853f-64e5-4747-b3dc-32d3cec44e43 tempest-SnapshotsActionsTest-1484405774 None] Deleting offline snapshot 83a3469f-19ac-4fe7-ba01-50d8352fcb17 of volume e77cb2d8-9e38-4e97-884a-243b4a24a834 {{(pid=87098) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 13 13:54:35 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-94a9853f-64e5-4747-b3dc-32d3cec44e43 tempest-SnapshotsActionsTest-1484405774 None] snapshot_file for this snap is: volume-e77cb2d8-9e38-4e97-884a-243b4a24a834.83a3469f-19ac-4fe7-ba01-50d8352fcb17 {{(pid=87098) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 13 13:54:35 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ef97797-4b15-4efb-a68b-0fa1c4b0bb8c]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 13:54:35 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-94a9853f-64e5-4747-b3dc-32d3cec44e43 tempest-SnapshotsActionsTest-1484405774 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-e77cb2d8-9e38-4e97-884a-243b4a24a834.83a3469f-19ac-4fe7-ba01-50d8352fcb17 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:54:35 devstack sudo[93817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-e77cb2d8-9e38-4e97-884a-243b4a24a834.83a3469f-19ac-4fe7-ba01-50d8352fcb17 Jul 13 13:54:35 devstack sudo[93817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:54:35 devstack sudo[93753]: pam_unix(sudo:session): session closed for user root Jul 13 13:54:35 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-bbd76cb1-3c4d-4151-9dac-348ce51a0f69 tempest-AttachVolumeTestJSON-2118030158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-6137375d-767f-471c-9779-832082fd5e63 1073741824" returned: 0 in 1.066s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:54:36 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-bbd76cb1-3c4d-4151-9dac-348ce51a0f69 tempest-AttachVolumeTestJSON-2118030158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-6137375d-767f-471c-9779-832082fd5e63 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:54:36 devstack sudo[93828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-6137375d-767f-471c-9779-832082fd5e63 Jul 13 13:54:36 devstack sudo[93828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:54:36 devstack sudo[93777]: pam_unix(sudo:session): session closed for user root Jul 13 13:54:36 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-1438e901-ae06-42f5-aae2-d7add9a76975 tempest-SnapshotMetadataTestJSON-1526519816 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-dcec246d-017e-4967-8a11-3342ca5ed260" returned: 0 in 1.063s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:54:36 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-1438e901-ae06-42f5-aae2-d7add9a76975 tempest-SnapshotMetadataTestJSON-1526519816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-dcec246d-017e-4967-8a11-3342ca5ed260.4c089064-c39c-4f4a-96fc-f322119d6247 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:54:36 devstack sudo[93838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-dcec246d-017e-4967-8a11-3342ca5ed260.4c089064-c39c-4f4a-96fc-f322119d6247 Jul 13 13:54:36 devstack sudo[93838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:54:36 devstack sudo[93817]: pam_unix(sudo:session): session closed for user root Jul 13 13:54:36 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-94a9853f-64e5-4747-b3dc-32d3cec44e43 tempest-SnapshotsActionsTest-1484405774 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-e77cb2d8-9e38-4e97-884a-243b4a24a834.83a3469f-19ac-4fe7-ba01-50d8352fcb17" returned: 0 in 0.815s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:54:36 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-94a9853f-64e5-4747-b3dc-32d3cec44e43 tempest-SnapshotsActionsTest-1484405774 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e77cb2d8-9e38-4e97-884a-243b4a24a834(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87098) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 13 13:54:36 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4432cc0-f7b8-4181-8c7f-ba54339c24d3]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 13:54:36 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-94a9853f-64e5-4747-b3dc-32d3cec44e43 tempest-SnapshotsActionsTest-1484405774 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-e77cb2d8-9e38-4e97-884a-243b4a24a834.2fe39cbc-c80c-44a6-9305-ffc5bbccbf48 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:54:36 devstack sudo[93828]: pam_unix(sudo:session): session closed for user root Jul 13 13:54:36 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-bbd76cb1-3c4d-4151-9dac-348ce51a0f69 tempest-AttachVolumeTestJSON-2118030158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-6137375d-767f-471c-9779-832082fd5e63" returned: 0 in 0.545s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:54:36 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-bbd76cb1-3c4d-4151-9dac-348ce51a0f69 tempest-AttachVolumeTestJSON-2118030158 None] <== create_volume: return (1742ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'} {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 13 13:54:36 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-bbd76cb1-3c4d-4151-9dac-348ce51a0f69 tempest-AttachVolumeTestJSON-2118030158 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.746s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:54:36 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-bbd76cb1-3c4d-4151-9dac-348ce51a0f69 tempest-AttachVolumeTestJSON-2118030158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef936182-7a96-43ce-819c-d94966c8482d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6137375d-767f-471c-9779-832082fd5e63', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:54:36 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-bbd76cb1-3c4d-4151-9dac-348ce51a0f69 tempest-AttachVolumeTestJSON-2118030158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28515a7b-e11f-49ad-80e1-47c22a544a54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:54:36 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-bbd76cb1-3c4d-4151-9dac-348ce51a0f69 tempest-AttachVolumeTestJSON-2118030158 None] Volume volume-6137375d-767f-471c-9779-832082fd5e63 (6137375d-767f-471c-9779-832082fd5e63): created successfully Jul 13 13:54:36 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-bbd76cb1-3c4d-4151-9dac-348ce51a0f69 tempest-AttachVolumeTestJSON-2118030158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28515a7b-e11f-49ad-80e1-47c22a544a54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:54:36 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-bbd76cb1-3c4d-4151-9dac-348ce51a0f69 tempest-AttachVolumeTestJSON-2118030158 None] Flow 'volume_create_manager' (1a74ec0a-b577-4547-8752-8fe75ffbf2bc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 13:54:36 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-bbd76cb1-3c4d-4151-9dac-348ce51a0f69 tempest-AttachVolumeTestJSON-2118030158 None] Created volume successfully. Jul 13 13:54:36 devstack sudo[93845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-e77cb2d8-9e38-4e97-884a-243b4a24a834.2fe39cbc-c80c-44a6-9305-ffc5bbccbf48 Jul 13 13:54:36 devstack sudo[93845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:54:36 devstack sudo[93838]: pam_unix(sudo:session): session closed for user root Jul 13 13:54:36 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-1438e901-ae06-42f5-aae2-d7add9a76975 tempest-SnapshotMetadataTestJSON-1526519816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-dcec246d-017e-4967-8a11-3342ca5ed260.4c089064-c39c-4f4a-96fc-f322119d6247" returned: 0 in 0.610s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:54:36 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-1438e901-ae06-42f5-aae2-d7add9a76975 tempest-SnapshotMetadataTestJSON-1526519816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-dcec246d-017e-4967-8a11-3342ca5ed260.4c089064-c39c-4f4a-96fc-f322119d6247 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:54:36 devstack sudo[93853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-dcec246d-017e-4967-8a11-3342ca5ed260.4c089064-c39c-4f4a-96fc-f322119d6247 Jul 13 13:54:36 devstack sudo[93853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:54:37 devstack sudo[93845]: pam_unix(sudo:session): session closed for user root Jul 13 13:54:37 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-94a9853f-64e5-4747-b3dc-32d3cec44e43 tempest-SnapshotsActionsTest-1484405774 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-e77cb2d8-9e38-4e97-884a-243b4a24a834.2fe39cbc-c80c-44a6-9305-ffc5bbccbf48" returned: 0 in 0.630s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:54:37 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-94a9853f-64e5-4747-b3dc-32d3cec44e43 tempest-SnapshotsActionsTest-1484405774 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e77cb2d8-9e38-4e97-884a-243b4a24a834(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87098) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 13 13:54:37 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-94a9853f-64e5-4747-b3dc-32d3cec44e43 tempest-SnapshotsActionsTest-1484405774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-e77cb2d8-9e38-4e97-884a-243b4a24a834.83a3469f-19ac-4fe7-ba01-50d8352fcb17 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:54:37 devstack sudo[93858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-e77cb2d8-9e38-4e97-884a-243b4a24a834.83a3469f-19ac-4fe7-ba01-50d8352fcb17 Jul 13 13:54:37 devstack sudo[93858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:54:37 devstack sudo[93853]: pam_unix(sudo:session): session closed for user root Jul 13 13:54:37 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-1438e901-ae06-42f5-aae2-d7add9a76975 tempest-SnapshotMetadataTestJSON-1526519816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-dcec246d-017e-4967-8a11-3342ca5ed260.4c089064-c39c-4f4a-96fc-f322119d6247" returned: 0 in 0.379s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:54:37 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-1438e901-ae06-42f5-aae2-d7add9a76975 tempest-SnapshotMetadataTestJSON-1526519816 None] Lock "cinder-quobyte-4c089064-c39c-4f4a-96fc-f322119d6247" released by "_delete_snapshot" :: held 2.746s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 13:54:37 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-1438e901-ae06-42f5-aae2-d7add9a76975 tempest-SnapshotMetadataTestJSON-1526519816 None] Lock "cinder-quobyte-dcec246d-017e-4967-8a11-3342ca5ed260" released by "delete_snapshot" :: held 2.768s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 13:54:37 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-1438e901-ae06-42f5-aae2-d7add9a76975 tempest-SnapshotMetadataTestJSON-1526519816 None] Created reservations ['30c46010-1dc1-4c45-8899-a03b2711c9d3', 'ea098b8c-231e-44cc-aaa4-569550dc5846', 'e5f7e092-24a4-4545-a610-cb75b04d63dd', '4e1b8ad7-41bd-4680-9a5a-d93f71a909fc'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 13:54:37 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-1438e901-ae06-42f5-aae2-d7add9a76975 tempest-SnapshotMetadataTestJSON-1526519816 None] Delete snapshot completed successfully. Jul 13 13:54:37 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-1438e901-ae06-42f5-aae2-d7add9a76975 tempest-SnapshotMetadataTestJSON-1526519816 None] Lock "cinder-4c089064-c39c-4f4a-96fc-f322119d6247-delete_snapshot" released by "delete_snapshot" :: held 2.914s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 13:54:37 devstack sudo[93858]: pam_unix(sudo:session): session closed for user root Jul 13 13:54:37 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-94a9853f-64e5-4747-b3dc-32d3cec44e43 tempest-SnapshotsActionsTest-1484405774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-e77cb2d8-9e38-4e97-884a-243b4a24a834.83a3469f-19ac-4fe7-ba01-50d8352fcb17" returned: 0 in 0.396s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:54:37 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-94a9853f-64e5-4747-b3dc-32d3cec44e43 tempest-SnapshotsActionsTest-1484405774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-e77cb2d8-9e38-4e97-884a-243b4a24a834.83a3469f-19ac-4fe7-ba01-50d8352fcb17 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:54:37 devstack sudo[93865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-e77cb2d8-9e38-4e97-884a-243b4a24a834.83a3469f-19ac-4fe7-ba01-50d8352fcb17 Jul 13 13:54:37 devstack sudo[93865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:54:37 devstack sudo[93865]: pam_unix(sudo:session): session closed for user root Jul 13 13:54:37 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-94a9853f-64e5-4747-b3dc-32d3cec44e43 tempest-SnapshotsActionsTest-1484405774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-e77cb2d8-9e38-4e97-884a-243b4a24a834.83a3469f-19ac-4fe7-ba01-50d8352fcb17" returned: 0 in 0.334s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:54:37 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-94a9853f-64e5-4747-b3dc-32d3cec44e43 tempest-SnapshotsActionsTest-1484405774 None] Lock "cinder-quobyte-83a3469f-19ac-4fe7-ba01-50d8352fcb17" released by "_delete_snapshot" :: held 2.403s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 13:54:37 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-76df86bc-7ede-4188-b61d-f9bbfed6dae6 tempest-SnapshotMetadataTestJSON-1526519816 None] Acquiring lock "cinder-dcec246d-017e-4967-8a11-3342ca5ed260-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 13:54:37 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-4fd310ae-cad7-4d20-b844-fa4d4d61d45e tempest-VolumesActionsTest-1880950110 None] Acquiring lock "cinder-a52b84de-fb6a-46db-b2ae-b126c4a239c8" by "attach_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 13:54:37 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-94a9853f-64e5-4747-b3dc-32d3cec44e43 tempest-SnapshotsActionsTest-1484405774 None] Lock "cinder-quobyte-e77cb2d8-9e38-4e97-884a-243b4a24a834" released by "delete_snapshot" :: held 2.486s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 13:54:37 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-4fd310ae-cad7-4d20-b844-fa4d4d61d45e tempest-VolumesActionsTest-1880950110 None] Lock "cinder-a52b84de-fb6a-46db-b2ae-b126c4a239c8" acquired by "attach_volume" :: waited 0.027s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 13:54:38 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-76df86bc-7ede-4188-b61d-f9bbfed6dae6 tempest-SnapshotMetadataTestJSON-1526519816 None] Lock "cinder-dcec246d-017e-4967-8a11-3342ca5ed260-delete_volume" acquired by "delete_volume" :: waited 0.070s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 13:54:38 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-76df86bc-7ede-4188-b61d-f9bbfed6dae6 tempest-SnapshotMetadataTestJSON-1526519816 None] Acquiring lock "cinder-quobyte-dcec246d-017e-4967-8a11-3342ca5ed260" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 13:54:38 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-4fd310ae-cad7-4d20-b844-fa4d4d61d45e tempest-VolumesActionsTest-1880950110 None] Attaching volume a52b84de-fb6a-46db-b2ae-b126c4a239c8 to instance 93f4f974-2871-4893-a7a3-901c386e72c7 at mountpoint /dev/vdb on host None. Jul 13 13:54:38 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-76df86bc-7ede-4188-b61d-f9bbfed6dae6 tempest-SnapshotMetadataTestJSON-1526519816 None] Lock "cinder-quobyte-dcec246d-017e-4967-8a11-3342ca5ed260" acquired by "delete_volume" :: waited 0.033s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 13:54:38 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-94a9853f-64e5-4747-b3dc-32d3cec44e43 tempest-SnapshotsActionsTest-1484405774 None] Created reservations ['4e6d48d2-a655-4b79-ad70-88f19fb5134c', '55c8f95f-5c80-4bfc-a8cb-ed40a00041e5', '4c0d15a8-b6cc-4271-b5b7-70480af46c0a', '9444202c-068a-47e6-9b7a-7686ac52f874'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 13:54:38 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[af81ff3d-6d7d-430e-868a-52875662d398]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 13:54:38 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-76df86bc-7ede-4188-b61d-f9bbfed6dae6 tempest-SnapshotMetadataTestJSON-1526519816 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-dcec246d-017e-4967-8a11-3342ca5ed260 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:54:38 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-4fd310ae-cad7-4d20-b844-fa4d4d61d45e tempest-VolumesActionsTest-1880950110 None] Attach volume completed successfully. Jul 13 13:54:38 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-4fd310ae-cad7-4d20-b844-fa4d4d61d45e tempest-VolumesActionsTest-1880950110 None] Lock "cinder-a52b84de-fb6a-46db-b2ae-b126c4a239c8" released by "attach_volume" :: held 0.331s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 13:54:38 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-94a9853f-64e5-4747-b3dc-32d3cec44e43 tempest-SnapshotsActionsTest-1484405774 None] Delete snapshot completed successfully. Jul 13 13:54:38 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-94a9853f-64e5-4747-b3dc-32d3cec44e43 tempest-SnapshotsActionsTest-1484405774 None] Lock "cinder-83a3469f-19ac-4fe7-ba01-50d8352fcb17-delete_snapshot" released by "delete_snapshot" :: held 2.987s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 13:54:38 devstack sudo[93872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-dcec246d-017e-4967-8a11-3342ca5ed260 Jul 13 13:54:38 devstack sudo[93872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:54:38 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-5a30e4d0-56b5-4f26-b3e7-3bd045f2bf9b tempest-VolumesActionsTest-1880950110 None] Acquiring lock "cinder-a52b84de-fb6a-46db-b2ae-b126c4a239c8-detach_volume" by "detach_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 13:54:38 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-5a30e4d0-56b5-4f26-b3e7-3bd045f2bf9b tempest-VolumesActionsTest-1880950110 None] Lock "cinder-a52b84de-fb6a-46db-b2ae-b126c4a239c8-detach_volume" acquired by "detach_volume" :: waited 0.069s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 13:54:38 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-5a30e4d0-56b5-4f26-b3e7-3bd045f2bf9b tempest-VolumesActionsTest-1880950110 None] Detaching volume a52b84de-fb6a-46db-b2ae-b126c4a239c8 from instance 93f4f974-2871-4893-a7a3-901c386e72c7. Jul 13 13:54:38 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-5a30e4d0-56b5-4f26-b3e7-3bd045f2bf9b tempest-VolumesActionsTest-1880950110 None] Detach volume completed successfully. Jul 13 13:54:38 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-5a30e4d0-56b5-4f26-b3e7-3bd045f2bf9b tempest-VolumesActionsTest-1880950110 None] Lock "cinder-a52b84de-fb6a-46db-b2ae-b126c4a239c8-detach_volume" released by "detach_volume" :: held 0.124s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 13:54:38 devstack sudo[93872]: pam_unix(sudo:session): session closed for user root Jul 13 13:54:38 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-76df86bc-7ede-4188-b61d-f9bbfed6dae6 tempest-SnapshotMetadataTestJSON-1526519816 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-dcec246d-017e-4967-8a11-3342ca5ed260" returned: 0 in 0.729s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:54:39 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-76df86bc-7ede-4188-b61d-f9bbfed6dae6 tempest-SnapshotMetadataTestJSON-1526519816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-dcec246d-017e-4967-8a11-3342ca5ed260 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:54:39 devstack sudo[93886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-dcec246d-017e-4967-8a11-3342ca5ed260 Jul 13 13:54:39 devstack sudo[93886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:54:39 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [req-8bb8ac3b-e38b-42dc-81c0-c0dc84aa471f req-8c57012f-3484-4e09-bd6b-3641cbe8d769 tempest-AttachVolumeTestJSON-2118030158 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:54:39 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [req-8bb8ac3b-e38b-42dc-81c0-c0dc84aa471f req-8c57012f-3484-4e09-bd6b-3641cbe8d769 tempest-AttachVolumeTestJSON-2118030158 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:54:39 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b69d2fd-9de7-4e8a-8a43-ca7c07c393a2]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 13:54:39 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [req-8bb8ac3b-e38b-42dc-81c0-c0dc84aa471f req-8c57012f-3484-4e09-bd6b-3641cbe8d769 tempest-AttachVolumeTestJSON-2118030158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-6137375d-767f-471c-9779-832082fd5e63 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:54:39 devstack sudo[93889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-6137375d-767f-471c-9779-832082fd5e63 Jul 13 13:54:39 devstack sudo[93889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:54:39 devstack sudo[93886]: pam_unix(sudo:session): session closed for user root Jul 13 13:54:39 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-76df86bc-7ede-4188-b61d-f9bbfed6dae6 tempest-SnapshotMetadataTestJSON-1526519816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-dcec246d-017e-4967-8a11-3342ca5ed260" returned: 0 in 0.515s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:54:39 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-76df86bc-7ede-4188-b61d-f9bbfed6dae6 tempest-SnapshotMetadataTestJSON-1526519816 None] Lock "cinder-quobyte-dcec246d-017e-4967-8a11-3342ca5ed260" released by "delete_volume" :: held 1.347s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 13:54:39 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-919369fc-db76-4bbc-ad3a-161114eb55f5 tempest-SnapshotsActionsTest-1565083684 None] Acquiring lock "cinder-2fe39cbc-c80c-44a6-9305-ffc5bbccbf48-delete_snapshot" by "delete_snapshot" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 13:54:39 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-919369fc-db76-4bbc-ad3a-161114eb55f5 tempest-SnapshotsActionsTest-1565083684 None] Lock "cinder-2fe39cbc-c80c-44a6-9305-ffc5bbccbf48-delete_snapshot" acquired by "delete_snapshot" :: waited 0.053s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 13:54:39 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-919369fc-db76-4bbc-ad3a-161114eb55f5 tempest-SnapshotsActionsTest-1565083684 None] Acquiring lock "cinder-quobyte-e77cb2d8-9e38-4e97-884a-243b4a24a834" by "delete_snapshot" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 13:54:39 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-919369fc-db76-4bbc-ad3a-161114eb55f5 tempest-SnapshotsActionsTest-1565083684 None] Lock "cinder-quobyte-e77cb2d8-9e38-4e97-884a-243b4a24a834" acquired by "delete_snapshot" :: waited 0.046s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 13:54:39 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-919369fc-db76-4bbc-ad3a-161114eb55f5 tempest-SnapshotsActionsTest-1565083684 None] Acquiring lock "cinder-quobyte-2fe39cbc-c80c-44a6-9305-ffc5bbccbf48" by "_delete_snapshot" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 13:54:39 devstack sudo[93889]: pam_unix(sudo:session): session closed for user root Jul 13 13:54:39 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [req-8bb8ac3b-e38b-42dc-81c0-c0dc84aa471f req-8c57012f-3484-4e09-bd6b-3641cbe8d769 tempest-AttachVolumeTestJSON-2118030158 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-6137375d-767f-471c-9779-832082fd5e63" returned: 0 in 0.591s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:54:39 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [req-8bb8ac3b-e38b-42dc-81c0-c0dc84aa471f req-8c57012f-3484-4e09-bd6b-3641cbe8d769 tempest-AttachVolumeTestJSON-2118030158 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.642s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:54:39 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-919369fc-db76-4bbc-ad3a-161114eb55f5 tempest-SnapshotsActionsTest-1565083684 None] Lock "cinder-quobyte-2fe39cbc-c80c-44a6-9305-ffc5bbccbf48" acquired by "_delete_snapshot" :: waited 0.154s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 13:54:39 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-919369fc-db76-4bbc-ad3a-161114eb55f5 tempest-SnapshotsActionsTest-1565083684 None] Deleting offline snapshot 2fe39cbc-c80c-44a6-9305-ffc5bbccbf48 of volume e77cb2d8-9e38-4e97-884a-243b4a24a834 {{(pid=87098) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 13 13:54:39 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-919369fc-db76-4bbc-ad3a-161114eb55f5 tempest-SnapshotsActionsTest-1565083684 None] snapshot_file for this snap is: volume-e77cb2d8-9e38-4e97-884a-243b4a24a834.2fe39cbc-c80c-44a6-9305-ffc5bbccbf48 {{(pid=87098) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 13 13:54:39 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-76df86bc-7ede-4188-b61d-f9bbfed6dae6 tempest-SnapshotMetadataTestJSON-1526519816 None] Created reservations ['10b094bf-b00b-4911-8c71-a121d6c74d01', '7aad502d-de3d-456c-8c6c-43c189702588', 'f52822f6-d089-46b1-8833-280e6d17bd1a', '4100e3bb-ea1c-4340-af2e-5f0040e0593e'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 13:54:39 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[52e2aa2a-13de-4c92-aa4f-0a8f093324c4]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 13:54:39 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-919369fc-db76-4bbc-ad3a-161114eb55f5 tempest-SnapshotsActionsTest-1565083684 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-e77cb2d8-9e38-4e97-884a-243b4a24a834.2fe39cbc-c80c-44a6-9305-ffc5bbccbf48 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:54:40 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [req-8bb8ac3b-e38b-42dc-81c0-c0dc84aa471f req-8c57012f-3484-4e09-bd6b-3641cbe8d769 tempest-AttachVolumeTestJSON-2118030158 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654', 'name': 'volume-6137375d-767f-471c-9779-832082fd5e63', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ffad73cb-f52a-484e-b69e-78a6812d5947', 'enforce_multipath': True} {{(pid=87098) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 13 13:54:40 devstack cinder-volume[87098]: DEBUG dbcounter [-] [87098] Writing DB stats cinder:SELECT=125,cinder:UPDATE=132,cinder:INSERT=35,cinder:DELETE=10 {{(pid=87098) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 13 13:54:40 devstack sudo[93913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-e77cb2d8-9e38-4e97-884a-243b4a24a834.2fe39cbc-c80c-44a6-9305-ffc5bbccbf48 Jul 13 13:54:40 devstack sudo[93913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:54:40 devstack cinder-volume[87098]: DEBUG dbcounter [-] [87098] Writing DB stats cinder:SELECT=144,cinder:UPDATE=143,cinder:INSERT=35,cinder:DELETE=9 {{(pid=87098) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 13 13:54:40 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-76df86bc-7ede-4188-b61d-f9bbfed6dae6 tempest-SnapshotMetadataTestJSON-1526519816 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:54:40 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-76df86bc-7ede-4188-b61d-f9bbfed6dae6 tempest-SnapshotMetadataTestJSON-1526519816 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:54:40 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-76df86bc-7ede-4188-b61d-f9bbfed6dae6 tempest-SnapshotMetadataTestJSON-1526519816 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 13:54:40 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-76df86bc-7ede-4188-b61d-f9bbfed6dae6 tempest-SnapshotMetadataTestJSON-1526519816 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 13:54:40 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-76df86bc-7ede-4188-b61d-f9bbfed6dae6 tempest-SnapshotMetadataTestJSON-1526519816 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:54:40 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-76df86bc-7ede-4188-b61d-f9bbfed6dae6 tempest-SnapshotMetadataTestJSON-1526519816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:54:40 devstack sudo[93920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 Jul 13 13:54:40 devstack sudo[93920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:54:40 devstack cinder-volume[87098]: INFO cinder.volume.manager [req-8bb8ac3b-e38b-42dc-81c0-c0dc84aa471f req-8c57012f-3484-4e09-bd6b-3641cbe8d769 tempest-AttachVolumeTestJSON-2118030158 None] attachment_update completed successfully. Jul 13 13:54:40 devstack sudo[93913]: pam_unix(sudo:session): session closed for user root Jul 13 13:54:40 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-919369fc-db76-4bbc-ad3a-161114eb55f5 tempest-SnapshotsActionsTest-1565083684 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-e77cb2d8-9e38-4e97-884a-243b4a24a834.2fe39cbc-c80c-44a6-9305-ffc5bbccbf48" returned: 0 in 0.614s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:54:40 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-919369fc-db76-4bbc-ad3a-161114eb55f5 tempest-SnapshotsActionsTest-1565083684 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e77cb2d8-9e38-4e97-884a-243b4a24a834(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87098) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 13 13:54:40 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f86c16c-8375-41e1-b01c-fcbb4557b69d]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 13:54:40 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-919369fc-db76-4bbc-ad3a-161114eb55f5 tempest-SnapshotsActionsTest-1565083684 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-e77cb2d8-9e38-4e97-884a-243b4a24a834 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:54:40 devstack sudo[93920]: pam_unix(sudo:session): session closed for user root Jul 13 13:54:40 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-76df86bc-7ede-4188-b61d-f9bbfed6dae6 tempest-SnapshotMetadataTestJSON-1526519816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78" returned: 0 in 0.535s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:54:40 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-76df86bc-7ede-4188-b61d-f9bbfed6dae6 tempest-SnapshotMetadataTestJSON-1526519816 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 13:54:40 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-76df86bc-7ede-4188-b61d-f9bbfed6dae6 tempest-SnapshotMetadataTestJSON-1526519816 None] Deleted volume successfully. Jul 13 13:54:40 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-76df86bc-7ede-4188-b61d-f9bbfed6dae6 tempest-SnapshotMetadataTestJSON-1526519816 None] Lock "cinder-dcec246d-017e-4967-8a11-3342ca5ed260-delete_volume" released by "delete_volume" :: held 2.766s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 13:54:40 devstack sudo[93997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-e77cb2d8-9e38-4e97-884a-243b4a24a834 Jul 13 13:54:40 devstack sudo[93997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:54:41 devstack sudo[93997]: pam_unix(sudo:session): session closed for user root Jul 13 13:54:41 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-919369fc-db76-4bbc-ad3a-161114eb55f5 tempest-SnapshotsActionsTest-1565083684 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-e77cb2d8-9e38-4e97-884a-243b4a24a834" returned: 0 in 0.990s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:54:41 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-919369fc-db76-4bbc-ad3a-161114eb55f5 tempest-SnapshotsActionsTest-1565083684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-e77cb2d8-9e38-4e97-884a-243b4a24a834.2fe39cbc-c80c-44a6-9305-ffc5bbccbf48 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:54:41 devstack sudo[94324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-e77cb2d8-9e38-4e97-884a-243b4a24a834.2fe39cbc-c80c-44a6-9305-ffc5bbccbf48 Jul 13 13:54:41 devstack sudo[94324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:54:42 devstack sudo[94324]: pam_unix(sudo:session): session closed for user root Jul 13 13:54:42 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-919369fc-db76-4bbc-ad3a-161114eb55f5 tempest-SnapshotsActionsTest-1565083684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-e77cb2d8-9e38-4e97-884a-243b4a24a834.2fe39cbc-c80c-44a6-9305-ffc5bbccbf48" returned: 0 in 0.470s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:54:42 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-919369fc-db76-4bbc-ad3a-161114eb55f5 tempest-SnapshotsActionsTest-1565083684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-e77cb2d8-9e38-4e97-884a-243b4a24a834.2fe39cbc-c80c-44a6-9305-ffc5bbccbf48 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:54:42 devstack sudo[94329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-e77cb2d8-9e38-4e97-884a-243b4a24a834.2fe39cbc-c80c-44a6-9305-ffc5bbccbf48 Jul 13 13:54:42 devstack sudo[94329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:54:42 devstack sudo[94329]: pam_unix(sudo:session): session closed for user root Jul 13 13:54:42 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-919369fc-db76-4bbc-ad3a-161114eb55f5 tempest-SnapshotsActionsTest-1565083684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-e77cb2d8-9e38-4e97-884a-243b4a24a834.2fe39cbc-c80c-44a6-9305-ffc5bbccbf48" returned: 0 in 0.343s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:54:42 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-919369fc-db76-4bbc-ad3a-161114eb55f5 tempest-SnapshotsActionsTest-1565083684 None] Lock "cinder-quobyte-2fe39cbc-c80c-44a6-9305-ffc5bbccbf48" released by "_delete_snapshot" :: held 2.677s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 13:54:42 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-919369fc-db76-4bbc-ad3a-161114eb55f5 tempest-SnapshotsActionsTest-1565083684 None] Lock "cinder-quobyte-e77cb2d8-9e38-4e97-884a-243b4a24a834" released by "delete_snapshot" :: held 2.865s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 13:54:42 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-919369fc-db76-4bbc-ad3a-161114eb55f5 tempest-SnapshotsActionsTest-1565083684 None] Created reservations ['36230b1e-8f0d-4a70-bf5e-d192f68c23f9', 'ab2c0955-ca97-4e28-9718-8c10f365e4cc', 'fa58bec5-f88b-4ce2-a35c-c2c82707250a', '764e2e5c-df21-4ada-acf7-8ecf47ae9862'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 13:54:42 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-919369fc-db76-4bbc-ad3a-161114eb55f5 tempest-SnapshotsActionsTest-1565083684 None] Delete snapshot completed successfully. Jul 13 13:54:42 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-919369fc-db76-4bbc-ad3a-161114eb55f5 tempest-SnapshotsActionsTest-1565083684 None] Lock "cinder-2fe39cbc-c80c-44a6-9305-ffc5bbccbf48-delete_snapshot" released by "delete_snapshot" :: held 3.176s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 13:54:43 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-cd68feb1-238b-48e7-b0a0-ea7bfb9c3936 tempest-SnapshotsActionsTest-1565083684 None] Acquiring lock "cinder-e77cb2d8-9e38-4e97-884a-243b4a24a834-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 13:54:43 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-cd68feb1-238b-48e7-b0a0-ea7bfb9c3936 tempest-SnapshotsActionsTest-1565083684 None] Lock "cinder-e77cb2d8-9e38-4e97-884a-243b4a24a834-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 13:54:43 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-cd68feb1-238b-48e7-b0a0-ea7bfb9c3936 tempest-SnapshotsActionsTest-1565083684 None] Acquiring lock "cinder-quobyte-e77cb2d8-9e38-4e97-884a-243b4a24a834" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 13:54:43 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-cd68feb1-238b-48e7-b0a0-ea7bfb9c3936 tempest-SnapshotsActionsTest-1565083684 None] Lock "cinder-quobyte-e77cb2d8-9e38-4e97-884a-243b4a24a834" acquired by "delete_volume" :: waited 0.026s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 13:54:43 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb76d0d6-8f33-4349-994b-609ecc18a3e9]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 13:54:43 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-cd68feb1-238b-48e7-b0a0-ea7bfb9c3936 tempest-SnapshotsActionsTest-1565083684 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-e77cb2d8-9e38-4e97-884a-243b4a24a834 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:54:43 devstack sudo[94338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-e77cb2d8-9e38-4e97-884a-243b4a24a834 Jul 13 13:54:43 devstack sudo[94338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:54:43 devstack sudo[94338]: pam_unix(sudo:session): session closed for user root Jul 13 13:54:43 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-cd68feb1-238b-48e7-b0a0-ea7bfb9c3936 tempest-SnapshotsActionsTest-1565083684 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-e77cb2d8-9e38-4e97-884a-243b4a24a834" returned: 0 in 0.474s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:54:43 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-cd68feb1-238b-48e7-b0a0-ea7bfb9c3936 tempest-SnapshotsActionsTest-1565083684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-e77cb2d8-9e38-4e97-884a-243b4a24a834 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:54:43 devstack sudo[94346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-e77cb2d8-9e38-4e97-884a-243b4a24a834 Jul 13 13:54:43 devstack sudo[94346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:54:44 devstack sudo[94346]: pam_unix(sudo:session): session closed for user root Jul 13 13:54:44 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-cd68feb1-238b-48e7-b0a0-ea7bfb9c3936 tempest-SnapshotsActionsTest-1565083684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-e77cb2d8-9e38-4e97-884a-243b4a24a834" returned: 0 in 0.339s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:54:44 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-cd68feb1-238b-48e7-b0a0-ea7bfb9c3936 tempest-SnapshotsActionsTest-1565083684 None] Lock "cinder-quobyte-e77cb2d8-9e38-4e97-884a-243b4a24a834" released by "delete_volume" :: held 0.906s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 13:54:44 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-cd68feb1-238b-48e7-b0a0-ea7bfb9c3936 tempest-SnapshotsActionsTest-1565083684 None] Created reservations ['a70f2307-a08c-430d-a50c-56fe833e7d80', '3d85d265-aec2-407c-9662-c30b403d1697', 'baf65cb9-e757-4f0f-94c1-c635455b6364', 'f4f44f5b-cd8d-4e56-a116-6f3ab83cd325'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 13:54:44 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-cd68feb1-238b-48e7-b0a0-ea7bfb9c3936 tempest-SnapshotsActionsTest-1565083684 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:54:44 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-cd68feb1-238b-48e7-b0a0-ea7bfb9c3936 tempest-SnapshotsActionsTest-1565083684 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:54:44 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-cd68feb1-238b-48e7-b0a0-ea7bfb9c3936 tempest-SnapshotsActionsTest-1565083684 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 13:54:44 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-cd68feb1-238b-48e7-b0a0-ea7bfb9c3936 tempest-SnapshotsActionsTest-1565083684 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 13:54:44 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-cd68feb1-238b-48e7-b0a0-ea7bfb9c3936 tempest-SnapshotsActionsTest-1565083684 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:54:44 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-cd68feb1-238b-48e7-b0a0-ea7bfb9c3936 tempest-SnapshotsActionsTest-1565083684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:54:44 devstack sudo[94351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 Jul 13 13:54:44 devstack sudo[94351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:54:44 devstack sudo[94351]: pam_unix(sudo:session): session closed for user root Jul 13 13:54:44 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-cd68feb1-238b-48e7-b0a0-ea7bfb9c3936 tempest-SnapshotsActionsTest-1565083684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78" returned: 0 in 0.358s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:54:44 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-cd68feb1-238b-48e7-b0a0-ea7bfb9c3936 tempest-SnapshotsActionsTest-1565083684 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 13:54:44 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-cd68feb1-238b-48e7-b0a0-ea7bfb9c3936 tempest-SnapshotsActionsTest-1565083684 None] Deleted volume successfully. Jul 13 13:54:44 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-cd68feb1-238b-48e7-b0a0-ea7bfb9c3936 tempest-SnapshotsActionsTest-1565083684 None] Lock "cinder-e77cb2d8-9e38-4e97-884a-243b4a24a834-delete_volume" released by "delete_volume" :: held 1.637s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 13:54:46 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-c792ca3c-85e5-4f9c-8dfa-999a286b2b33 tempest-AbsoluteLimitsTests-985126938 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 13:54:46 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-c792ca3c-85e5-4f9c-8dfa-999a286b2b33 tempest-AbsoluteLimitsTests-985126938 None] Flow 'volume_create_manager' (e1dd9588-1ae9-41de-b2b9-827f4e398efb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 13:54:46 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-c792ca3c-85e5-4f9c-8dfa-999a286b2b33 tempest-AbsoluteLimitsTests-985126938 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99adaf8f-6188-490f-a9cf-a12f1f3972fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:54:46 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-c792ca3c-85e5-4f9c-8dfa-999a286b2b33 tempest-AbsoluteLimitsTests-985126938 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99adaf8f-6188-490f-a9cf-a12f1f3972fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T11:54:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-632262773',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30b4047d-2021-469c-a5c9-69162b747398,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73ab547ef7ed4671b60e1571330b2650',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T11:54:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T11:54:47Z,use_quota=True,user_id='78cfea91b96e4b84885d2d2a9c6dca4d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1147de8b-623b-426c-a13d-7fc824a80f67),volume_type_id=1147de8b-623b-426c-a13d-7fc824a80f67)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:54:46 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-c792ca3c-85e5-4f9c-8dfa-999a286b2b33 tempest-AbsoluteLimitsTests-985126938 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c472e988-7491-45a1-9908-db83d525a64a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:54:46 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-c792ca3c-85e5-4f9c-8dfa-999a286b2b33 tempest-AbsoluteLimitsTests-985126938 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c472e988-7491-45a1-9908-db83d525a64a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:54:46 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-c792ca3c-85e5-4f9c-8dfa-999a286b2b33 tempest-AbsoluteLimitsTests-985126938 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (303d02bc-2bb8-4d1b-ab5b-78b499ccca5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:54:46 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-c792ca3c-85e5-4f9c-8dfa-999a286b2b33 tempest-AbsoluteLimitsTests-985126938 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (303d02bc-2bb8-4d1b-ab5b-78b499ccca5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '30b4047d-2021-469c-a5c9-69162b747398', 'volume_name': 'volume-30b4047d-2021-469c-a5c9-69162b747398', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:54:46 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-c792ca3c-85e5-4f9c-8dfa-999a286b2b33 tempest-AbsoluteLimitsTests-985126938 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7efe357-293f-41d5-884d-04be2abf0568) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:54:46 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-c792ca3c-85e5-4f9c-8dfa-999a286b2b33 tempest-AbsoluteLimitsTests-985126938 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7efe357-293f-41d5-884d-04be2abf0568) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:54:46 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-c792ca3c-85e5-4f9c-8dfa-999a286b2b33 tempest-AbsoluteLimitsTests-985126938 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (295f8528-4f38-4637-93a8-d470e6d4b335) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:54:46 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-c792ca3c-85e5-4f9c-8dfa-999a286b2b33 tempest-AbsoluteLimitsTests-985126938 None] Volume 30b4047d-2021-469c-a5c9-69162b747398: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-30b4047d-2021-469c-a5c9-69162b747398', 'volume_size': 1} Jul 13 13:54:46 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-c792ca3c-85e5-4f9c-8dfa-999a286b2b33 tempest-AbsoluteLimitsTests-985126938 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:54:46 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-c792ca3c-85e5-4f9c-8dfa-999a286b2b33 tempest-AbsoluteLimitsTests-985126938 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:54:46 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-c792ca3c-85e5-4f9c-8dfa-999a286b2b33 tempest-AbsoluteLimitsTests-985126938 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T11:54:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-632262773',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30b4047d-2021-469c-a5c9-69162b747398,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73ab547ef7ed4671b60e1571330b2650',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T11:54:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T11:54:47Z,use_quota=True,user_id='78cfea91b96e4b84885d2d2a9c6dca4d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1147de8b-623b-426c-a13d-7fc824a80f67),volume_type_id=1147de8b-623b-426c-a13d-7fc824a80f67)}" {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 13 13:54:46 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-c792ca3c-85e5-4f9c-8dfa-999a286b2b33 tempest-AbsoluteLimitsTests-985126938 None] Creating volume 30b4047d-2021-469c-a5c9-69162b747398 {{(pid=87098) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 13 13:54:46 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-c792ca3c-85e5-4f9c-8dfa-999a286b2b33 tempest-AbsoluteLimitsTests-985126938 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:54:46 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-c792ca3c-85e5-4f9c-8dfa-999a286b2b33 tempest-AbsoluteLimitsTests-985126938 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:54:46 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-c792ca3c-85e5-4f9c-8dfa-999a286b2b33 tempest-AbsoluteLimitsTests-985126938 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 13:54:46 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-c792ca3c-85e5-4f9c-8dfa-999a286b2b33 tempest-AbsoluteLimitsTests-985126938 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 13:54:46 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-c792ca3c-85e5-4f9c-8dfa-999a286b2b33 tempest-AbsoluteLimitsTests-985126938 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:54:46 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-c792ca3c-85e5-4f9c-8dfa-999a286b2b33 tempest-AbsoluteLimitsTests-985126938 None] Selected osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 13:54:46 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-c792ca3c-85e5-4f9c-8dfa-999a286b2b33 tempest-AbsoluteLimitsTests-985126938 None] casted to osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 Jul 13 13:54:46 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-c792ca3c-85e5-4f9c-8dfa-999a286b2b33 tempest-AbsoluteLimitsTests-985126938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-30b4047d-2021-469c-a5c9-69162b747398 1073741824 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:54:46 devstack sudo[94481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-30b4047d-2021-469c-a5c9-69162b747398 1073741824 Jul 13 13:54:46 devstack sudo[94481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:54:47 devstack sudo[94481]: pam_unix(sudo:session): session closed for user root Jul 13 13:54:47 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-c792ca3c-85e5-4f9c-8dfa-999a286b2b33 tempest-AbsoluteLimitsTests-985126938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-30b4047d-2021-469c-a5c9-69162b747398 1073741824" returned: 0 in 0.729s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:54:47 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-c792ca3c-85e5-4f9c-8dfa-999a286b2b33 tempest-AbsoluteLimitsTests-985126938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-30b4047d-2021-469c-a5c9-69162b747398 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:54:47 devstack sudo[94509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-30b4047d-2021-469c-a5c9-69162b747398 Jul 13 13:54:47 devstack sudo[94509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:54:48 devstack sudo[94509]: pam_unix(sudo:session): session closed for user root Jul 13 13:54:48 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-c792ca3c-85e5-4f9c-8dfa-999a286b2b33 tempest-AbsoluteLimitsTests-985126938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-30b4047d-2021-469c-a5c9-69162b747398" returned: 0 in 0.638s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:54:48 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-c792ca3c-85e5-4f9c-8dfa-999a286b2b33 tempest-AbsoluteLimitsTests-985126938 None] <== create_volume: return (1464ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'} {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 13 13:54:48 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-c792ca3c-85e5-4f9c-8dfa-999a286b2b33 tempest-AbsoluteLimitsTests-985126938 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.466s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:54:48 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-c792ca3c-85e5-4f9c-8dfa-999a286b2b33 tempest-AbsoluteLimitsTests-985126938 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (295f8528-4f38-4637-93a8-d470e6d4b335) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-30b4047d-2021-469c-a5c9-69162b747398', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:54:48 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-c792ca3c-85e5-4f9c-8dfa-999a286b2b33 tempest-AbsoluteLimitsTests-985126938 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2cc8654d-7cea-46c5-8ef5-eac40d8c054d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:54:48 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-c792ca3c-85e5-4f9c-8dfa-999a286b2b33 tempest-AbsoluteLimitsTests-985126938 None] Volume volume-30b4047d-2021-469c-a5c9-69162b747398 (30b4047d-2021-469c-a5c9-69162b747398): created successfully Jul 13 13:54:48 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-c792ca3c-85e5-4f9c-8dfa-999a286b2b33 tempest-AbsoluteLimitsTests-985126938 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2cc8654d-7cea-46c5-8ef5-eac40d8c054d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:54:48 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-c792ca3c-85e5-4f9c-8dfa-999a286b2b33 tempest-AbsoluteLimitsTests-985126938 None] Flow 'volume_create_manager' (e1dd9588-1ae9-41de-b2b9-827f4e398efb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 13:54:48 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-c792ca3c-85e5-4f9c-8dfa-999a286b2b33 tempest-AbsoluteLimitsTests-985126938 None] Created volume successfully. Jul 13 13:54:48 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-102ff5da-344f-40d3-94a4-d0382f51f74d tempest-AbsoluteLimitsTests-985126938 None] Acquiring lock "cinder-30b4047d-2021-469c-a5c9-69162b747398-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 13:54:49 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-102ff5da-344f-40d3-94a4-d0382f51f74d tempest-AbsoluteLimitsTests-985126938 None] Lock "cinder-30b4047d-2021-469c-a5c9-69162b747398-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 13:54:49 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-102ff5da-344f-40d3-94a4-d0382f51f74d tempest-AbsoluteLimitsTests-985126938 None] Acquiring lock "cinder-quobyte-30b4047d-2021-469c-a5c9-69162b747398" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 13:54:49 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-102ff5da-344f-40d3-94a4-d0382f51f74d tempest-AbsoluteLimitsTests-985126938 None] Lock "cinder-quobyte-30b4047d-2021-469c-a5c9-69162b747398" acquired by "delete_volume" :: waited 0.043s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 13:54:49 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccd0c654-12e7-4f3a-9659-51c0502b623d]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 13:54:49 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-102ff5da-344f-40d3-94a4-d0382f51f74d tempest-AbsoluteLimitsTests-985126938 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-30b4047d-2021-469c-a5c9-69162b747398 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:54:49 devstack sudo[94884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-30b4047d-2021-469c-a5c9-69162b747398 Jul 13 13:54:49 devstack sudo[94884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:54:49 devstack sudo[94884]: pam_unix(sudo:session): session closed for user root Jul 13 13:54:49 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-102ff5da-344f-40d3-94a4-d0382f51f74d tempest-AbsoluteLimitsTests-985126938 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-30b4047d-2021-469c-a5c9-69162b747398" returned: 0 in 0.545s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:54:49 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-102ff5da-344f-40d3-94a4-d0382f51f74d tempest-AbsoluteLimitsTests-985126938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-30b4047d-2021-469c-a5c9-69162b747398 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:54:49 devstack sudo[94892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-30b4047d-2021-469c-a5c9-69162b747398 Jul 13 13:54:49 devstack sudo[94892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:54:50 devstack sudo[94892]: pam_unix(sudo:session): session closed for user root Jul 13 13:54:50 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-102ff5da-344f-40d3-94a4-d0382f51f74d tempest-AbsoluteLimitsTests-985126938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-30b4047d-2021-469c-a5c9-69162b747398" returned: 0 in 0.307s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:54:50 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-102ff5da-344f-40d3-94a4-d0382f51f74d tempest-AbsoluteLimitsTests-985126938 None] Lock "cinder-quobyte-30b4047d-2021-469c-a5c9-69162b747398" released by "delete_volume" :: held 0.946s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 13:54:50 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-102ff5da-344f-40d3-94a4-d0382f51f74d tempest-AbsoluteLimitsTests-985126938 None] Created reservations ['884bc5ce-e24f-4669-b908-5336ae6e3c1b', '8d68d700-64f3-4926-a612-1d18ae9fdbde', 'ec0a037a-acfd-466a-9ffa-73cf0010ee7b', '2d6d946e-c74d-494b-a6fb-d1f1b6743be2'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 13:54:50 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-102ff5da-344f-40d3-94a4-d0382f51f74d tempest-AbsoluteLimitsTests-985126938 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:54:50 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-102ff5da-344f-40d3-94a4-d0382f51f74d tempest-AbsoluteLimitsTests-985126938 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:54:50 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-102ff5da-344f-40d3-94a4-d0382f51f74d tempest-AbsoluteLimitsTests-985126938 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 13:54:50 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-102ff5da-344f-40d3-94a4-d0382f51f74d tempest-AbsoluteLimitsTests-985126938 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 13:54:50 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-102ff5da-344f-40d3-94a4-d0382f51f74d tempest-AbsoluteLimitsTests-985126938 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:54:50 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-102ff5da-344f-40d3-94a4-d0382f51f74d tempest-AbsoluteLimitsTests-985126938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:54:50 devstack sudo[94895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 Jul 13 13:54:50 devstack sudo[94895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:54:51 devstack sudo[94895]: pam_unix(sudo:session): session closed for user root Jul 13 13:54:51 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-102ff5da-344f-40d3-94a4-d0382f51f74d tempest-AbsoluteLimitsTests-985126938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78" returned: 0 in 0.856s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:54:51 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-102ff5da-344f-40d3-94a4-d0382f51f74d tempest-AbsoluteLimitsTests-985126938 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 13:54:51 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-102ff5da-344f-40d3-94a4-d0382f51f74d tempest-AbsoluteLimitsTests-985126938 None] Deleted volume successfully. Jul 13 13:54:51 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-102ff5da-344f-40d3-94a4-d0382f51f74d tempest-AbsoluteLimitsTests-985126938 None] Lock "cinder-30b4047d-2021-469c-a5c9-69162b747398-delete_volume" released by "delete_volume" :: held 2.248s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 13:54:54 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-72cae79b-8bc1-45f4-bb64-0ca60c47bb97 tempest-VolumesActionsTest-1880950110 None] Acquiring lock "cinder-a52b84de-fb6a-46db-b2ae-b126c4a239c8" by "attach_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 13:54:54 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-72cae79b-8bc1-45f4-bb64-0ca60c47bb97 tempest-VolumesActionsTest-1880950110 None] Lock "cinder-a52b84de-fb6a-46db-b2ae-b126c4a239c8" acquired by "attach_volume" :: waited 0.027s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 13:54:54 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-72cae79b-8bc1-45f4-bb64-0ca60c47bb97 tempest-VolumesActionsTest-1880950110 None] Attaching volume a52b84de-fb6a-46db-b2ae-b126c4a239c8 to instance 02ca2b66-608f-4658-b91e-e4a378bd5c1b at mountpoint /dev/vdb on host None. Jul 13 13:54:54 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-72cae79b-8bc1-45f4-bb64-0ca60c47bb97 tempest-VolumesActionsTest-1880950110 None] Attach volume completed successfully. Jul 13 13:54:54 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-72cae79b-8bc1-45f4-bb64-0ca60c47bb97 tempest-VolumesActionsTest-1880950110 None] Lock "cinder-a52b84de-fb6a-46db-b2ae-b126c4a239c8" released by "attach_volume" :: held 0.156s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 13:54:54 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-d6751ad8-f2f4-411f-ad2f-5f151c6e5373 tempest-VolumesActionsTest-1880950110 None] Acquiring lock "cinder-a52b84de-fb6a-46db-b2ae-b126c4a239c8-detach_volume" by "detach_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 13:54:54 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-d6751ad8-f2f4-411f-ad2f-5f151c6e5373 tempest-VolumesActionsTest-1880950110 None] Lock "cinder-a52b84de-fb6a-46db-b2ae-b126c4a239c8-detach_volume" acquired by "detach_volume" :: waited 0.026s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 13:54:54 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-d6751ad8-f2f4-411f-ad2f-5f151c6e5373 tempest-VolumesActionsTest-1880950110 None] Detaching volume a52b84de-fb6a-46db-b2ae-b126c4a239c8 from instance 02ca2b66-608f-4658-b91e-e4a378bd5c1b. Jul 13 13:54:54 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-d6751ad8-f2f4-411f-ad2f-5f151c6e5373 tempest-VolumesActionsTest-1880950110 None] Detach volume completed successfully. Jul 13 13:54:54 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-d6751ad8-f2f4-411f-ad2f-5f151c6e5373 tempest-VolumesActionsTest-1880950110 None] Lock "cinder-a52b84de-fb6a-46db-b2ae-b126c4a239c8-detach_volume" released by "detach_volume" :: held 0.093s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 13:54:56 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-8e5fb00a-3f0e-4cd0-9ed6-34d374a6b470 tempest-VolumeQuotasNegativeTestJSON-746405727 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 13:54:56 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-8e5fb00a-3f0e-4cd0-9ed6-34d374a6b470 tempest-VolumeQuotasNegativeTestJSON-746405727 None] Flow 'volume_create_manager' (c4af0d5f-0db5-46e2-b424-ce5f715acdff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 13:54:56 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-8e5fb00a-3f0e-4cd0-9ed6-34d374a6b470 tempest-VolumeQuotasNegativeTestJSON-746405727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b670a541-3c66-446d-95cb-947a1342607f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:54:56 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-8e5fb00a-3f0e-4cd0-9ed6-34d374a6b470 tempest-VolumeQuotasNegativeTestJSON-746405727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b670a541-3c66-446d-95cb-947a1342607f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T11:54:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1171975512',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cbd0b090-430b-4798-86ce-9af980b43ae0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf6eb9b5f02d430f84e57623d3ab3eba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T11:54:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T11:54:57Z,use_quota=True,user_id='ad94ecd7dd5544f088115404210d9927',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1147de8b-623b-426c-a13d-7fc824a80f67),volume_type_id=1147de8b-623b-426c-a13d-7fc824a80f67)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:54:56 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-8e5fb00a-3f0e-4cd0-9ed6-34d374a6b470 tempest-VolumeQuotasNegativeTestJSON-746405727 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (120fd226-b476-4e08-ad6d-0d4005fc4d0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:54:56 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-8e5fb00a-3f0e-4cd0-9ed6-34d374a6b470 tempest-VolumeQuotasNegativeTestJSON-746405727 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (120fd226-b476-4e08-ad6d-0d4005fc4d0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:54:56 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-8e5fb00a-3f0e-4cd0-9ed6-34d374a6b470 tempest-VolumeQuotasNegativeTestJSON-746405727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b743a00c-8930-49cf-9556-5ec30380a248) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:54:56 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-8e5fb00a-3f0e-4cd0-9ed6-34d374a6b470 tempest-VolumeQuotasNegativeTestJSON-746405727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b743a00c-8930-49cf-9556-5ec30380a248) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cbd0b090-430b-4798-86ce-9af980b43ae0', 'volume_name': 'volume-cbd0b090-430b-4798-86ce-9af980b43ae0', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:54:56 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-8e5fb00a-3f0e-4cd0-9ed6-34d374a6b470 tempest-VolumeQuotasNegativeTestJSON-746405727 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9fc96b6f-c23d-45fd-ae25-62dde7ab1af3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:54:56 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-8e5fb00a-3f0e-4cd0-9ed6-34d374a6b470 tempest-VolumeQuotasNegativeTestJSON-746405727 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9fc96b6f-c23d-45fd-ae25-62dde7ab1af3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:54:56 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-8e5fb00a-3f0e-4cd0-9ed6-34d374a6b470 tempest-VolumeQuotasNegativeTestJSON-746405727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d115939-8fb5-4346-997b-4a219b1864f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:54:56 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-8e5fb00a-3f0e-4cd0-9ed6-34d374a6b470 tempest-VolumeQuotasNegativeTestJSON-746405727 None] Volume cbd0b090-430b-4798-86ce-9af980b43ae0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cbd0b090-430b-4798-86ce-9af980b43ae0', 'volume_size': 1} Jul 13 13:54:56 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-8e5fb00a-3f0e-4cd0-9ed6-34d374a6b470 tempest-VolumeQuotasNegativeTestJSON-746405727 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:54:56 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-8e5fb00a-3f0e-4cd0-9ed6-34d374a6b470 tempest-VolumeQuotasNegativeTestJSON-746405727 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:54:56 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-8e5fb00a-3f0e-4cd0-9ed6-34d374a6b470 tempest-VolumeQuotasNegativeTestJSON-746405727 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T11:54:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1171975512',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cbd0b090-430b-4798-86ce-9af980b43ae0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf6eb9b5f02d430f84e57623d3ab3eba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T11:54:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T11:54:57Z,use_quota=True,user_id='ad94ecd7dd5544f088115404210d9927',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1147de8b-623b-426c-a13d-7fc824a80f67),volume_type_id=1147de8b-623b-426c-a13d-7fc824a80f67)}" {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 13 13:54:56 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-8e5fb00a-3f0e-4cd0-9ed6-34d374a6b470 tempest-VolumeQuotasNegativeTestJSON-746405727 None] Creating volume cbd0b090-430b-4798-86ce-9af980b43ae0 {{(pid=87098) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 13 13:54:56 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-8e5fb00a-3f0e-4cd0-9ed6-34d374a6b470 tempest-VolumeQuotasNegativeTestJSON-746405727 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:54:57 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-8e5fb00a-3f0e-4cd0-9ed6-34d374a6b470 tempest-VolumeQuotasNegativeTestJSON-746405727 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:54:57 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-8e5fb00a-3f0e-4cd0-9ed6-34d374a6b470 tempest-VolumeQuotasNegativeTestJSON-746405727 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 13:54:57 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-8e5fb00a-3f0e-4cd0-9ed6-34d374a6b470 tempest-VolumeQuotasNegativeTestJSON-746405727 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 13:54:57 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-8e5fb00a-3f0e-4cd0-9ed6-34d374a6b470 tempest-VolumeQuotasNegativeTestJSON-746405727 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:54:57 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-8e5fb00a-3f0e-4cd0-9ed6-34d374a6b470 tempest-VolumeQuotasNegativeTestJSON-746405727 None] Selected osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 13:54:57 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-8e5fb00a-3f0e-4cd0-9ed6-34d374a6b470 tempest-VolumeQuotasNegativeTestJSON-746405727 None] casted to osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 Jul 13 13:54:57 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-8e5fb00a-3f0e-4cd0-9ed6-34d374a6b470 tempest-VolumeQuotasNegativeTestJSON-746405727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-cbd0b090-430b-4798-86ce-9af980b43ae0 1073741824 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:54:57 devstack sudo[94983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-cbd0b090-430b-4798-86ce-9af980b43ae0 1073741824 Jul 13 13:54:57 devstack sudo[94983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:54:57 devstack sudo[94983]: pam_unix(sudo:session): session closed for user root Jul 13 13:54:57 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-8e5fb00a-3f0e-4cd0-9ed6-34d374a6b470 tempest-VolumeQuotasNegativeTestJSON-746405727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-cbd0b090-430b-4798-86ce-9af980b43ae0 1073741824" returned: 0 in 0.720s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:54:57 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-8e5fb00a-3f0e-4cd0-9ed6-34d374a6b470 tempest-VolumeQuotasNegativeTestJSON-746405727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-cbd0b090-430b-4798-86ce-9af980b43ae0 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:54:57 devstack sudo[94992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-cbd0b090-430b-4798-86ce-9af980b43ae0 Jul 13 13:54:57 devstack sudo[94992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:54:58 devstack sudo[94992]: pam_unix(sudo:session): session closed for user root Jul 13 13:54:58 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-8e5fb00a-3f0e-4cd0-9ed6-34d374a6b470 tempest-VolumeQuotasNegativeTestJSON-746405727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-cbd0b090-430b-4798-86ce-9af980b43ae0" returned: 0 in 0.332s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:54:58 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-8e5fb00a-3f0e-4cd0-9ed6-34d374a6b470 tempest-VolumeQuotasNegativeTestJSON-746405727 None] <== create_volume: return (1120ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'} {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 13 13:54:58 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-8e5fb00a-3f0e-4cd0-9ed6-34d374a6b470 tempest-VolumeQuotasNegativeTestJSON-746405727 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.124s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:54:58 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-8e5fb00a-3f0e-4cd0-9ed6-34d374a6b470 tempest-VolumeQuotasNegativeTestJSON-746405727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d115939-8fb5-4346-997b-4a219b1864f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cbd0b090-430b-4798-86ce-9af980b43ae0', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:54:58 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-8e5fb00a-3f0e-4cd0-9ed6-34d374a6b470 tempest-VolumeQuotasNegativeTestJSON-746405727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (467cbe08-421b-4b7b-810c-e039786cdbff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:54:58 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-8e5fb00a-3f0e-4cd0-9ed6-34d374a6b470 tempest-VolumeQuotasNegativeTestJSON-746405727 None] Volume volume-cbd0b090-430b-4798-86ce-9af980b43ae0 (cbd0b090-430b-4798-86ce-9af980b43ae0): created successfully Jul 13 13:54:58 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-8e5fb00a-3f0e-4cd0-9ed6-34d374a6b470 tempest-VolumeQuotasNegativeTestJSON-746405727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (467cbe08-421b-4b7b-810c-e039786cdbff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:54:58 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-8e5fb00a-3f0e-4cd0-9ed6-34d374a6b470 tempest-VolumeQuotasNegativeTestJSON-746405727 None] Flow 'volume_create_manager' (c4af0d5f-0db5-46e2-b424-ce5f715acdff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 13:54:58 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-8e5fb00a-3f0e-4cd0-9ed6-34d374a6b470 tempest-VolumeQuotasNegativeTestJSON-746405727 None] Created volume successfully. Jul 13 13:54:59 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-5cfab625-2d7f-4625-8653-6b37c71bc12d tempest-VolumeQuotasNegativeTestJSON-746405727 None] Acquiring lock "cinder-cbd0b090-430b-4798-86ce-9af980b43ae0-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 13:54:59 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-5cfab625-2d7f-4625-8653-6b37c71bc12d tempest-VolumeQuotasNegativeTestJSON-746405727 None] Lock "cinder-cbd0b090-430b-4798-86ce-9af980b43ae0-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 13:55:00 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-5cfab625-2d7f-4625-8653-6b37c71bc12d tempest-VolumeQuotasNegativeTestJSON-746405727 None] Acquiring lock "cinder-quobyte-cbd0b090-430b-4798-86ce-9af980b43ae0" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 13:55:00 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-5cfab625-2d7f-4625-8653-6b37c71bc12d tempest-VolumeQuotasNegativeTestJSON-746405727 None] Lock "cinder-quobyte-cbd0b090-430b-4798-86ce-9af980b43ae0" acquired by "delete_volume" :: waited 0.030s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 13:55:00 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[58dc25c7-1848-4483-9849-befc23cba89b]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 13:55:00 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-5cfab625-2d7f-4625-8653-6b37c71bc12d tempest-VolumeQuotasNegativeTestJSON-746405727 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-cbd0b090-430b-4798-86ce-9af980b43ae0 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:55:00 devstack sudo[94995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-cbd0b090-430b-4798-86ce-9af980b43ae0 Jul 13 13:55:00 devstack sudo[94995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:55:00 devstack sudo[94995]: pam_unix(sudo:session): session closed for user root Jul 13 13:55:00 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-5cfab625-2d7f-4625-8653-6b37c71bc12d tempest-VolumeQuotasNegativeTestJSON-746405727 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-cbd0b090-430b-4798-86ce-9af980b43ae0" returned: 0 in 0.483s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:55:00 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-5cfab625-2d7f-4625-8653-6b37c71bc12d tempest-VolumeQuotasNegativeTestJSON-746405727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-cbd0b090-430b-4798-86ce-9af980b43ae0 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:55:00 devstack sudo[95002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-cbd0b090-430b-4798-86ce-9af980b43ae0 Jul 13 13:55:00 devstack sudo[95002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:55:00 devstack sudo[95002]: pam_unix(sudo:session): session closed for user root Jul 13 13:55:00 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-5cfab625-2d7f-4625-8653-6b37c71bc12d tempest-VolumeQuotasNegativeTestJSON-746405727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-cbd0b090-430b-4798-86ce-9af980b43ae0" returned: 0 in 0.272s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:55:00 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-5cfab625-2d7f-4625-8653-6b37c71bc12d tempest-VolumeQuotasNegativeTestJSON-746405727 None] Lock "cinder-quobyte-cbd0b090-430b-4798-86ce-9af980b43ae0" released by "delete_volume" :: held 0.822s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 13:55:00 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-5cfab625-2d7f-4625-8653-6b37c71bc12d tempest-VolumeQuotasNegativeTestJSON-746405727 None] Created reservations ['2e277b0c-af15-46ca-b6a2-d45fa1d349c3', '31ad8da1-98b0-4cf5-8d69-55cfd9187bbd', 'ff8d20a7-f3ab-485b-8b18-3e94b070efad', '2b24d280-e76a-430d-9f1f-3ef90cd0b306'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 13:55:01 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-5cfab625-2d7f-4625-8653-6b37c71bc12d tempest-VolumeQuotasNegativeTestJSON-746405727 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:55:01 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-5cfab625-2d7f-4625-8653-6b37c71bc12d tempest-VolumeQuotasNegativeTestJSON-746405727 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:55:01 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-5cfab625-2d7f-4625-8653-6b37c71bc12d tempest-VolumeQuotasNegativeTestJSON-746405727 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 13:55:01 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-5cfab625-2d7f-4625-8653-6b37c71bc12d tempest-VolumeQuotasNegativeTestJSON-746405727 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 13:55:01 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-5cfab625-2d7f-4625-8653-6b37c71bc12d tempest-VolumeQuotasNegativeTestJSON-746405727 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:55:01 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-5cfab625-2d7f-4625-8653-6b37c71bc12d tempest-VolumeQuotasNegativeTestJSON-746405727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:55:01 devstack sudo[95005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 Jul 13 13:55:01 devstack sudo[95005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:55:01 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-06e3d2b4-7f18-4702-ade7-a86ee2198791 tempest-VolumesActionsTest-1880950110 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:55:01 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-06e3d2b4-7f18-4702-ade7-a86ee2198791 tempest-VolumesActionsTest-1880950110 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.008s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:55:01 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[21f18498-5f28-46c2-9349-2af9b7cd0119]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 13:55:01 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-06e3d2b4-7f18-4702-ade7-a86ee2198791 tempest-VolumesActionsTest-1880950110 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-a52b84de-fb6a-46db-b2ae-b126c4a239c8 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:55:01 devstack sudo[95005]: pam_unix(sudo:session): session closed for user root Jul 13 13:55:01 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-5cfab625-2d7f-4625-8653-6b37c71bc12d tempest-VolumeQuotasNegativeTestJSON-746405727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78" returned: 0 in 0.364s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:55:01 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-5cfab625-2d7f-4625-8653-6b37c71bc12d tempest-VolumeQuotasNegativeTestJSON-746405727 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 13:55:01 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-5cfab625-2d7f-4625-8653-6b37c71bc12d tempest-VolumeQuotasNegativeTestJSON-746405727 None] Deleted volume successfully. Jul 13 13:55:01 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-5cfab625-2d7f-4625-8653-6b37c71bc12d tempest-VolumeQuotasNegativeTestJSON-746405727 None] Lock "cinder-cbd0b090-430b-4798-86ce-9af980b43ae0-delete_volume" released by "delete_volume" :: held 1.538s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 13:55:01 devstack sudo[95008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-a52b84de-fb6a-46db-b2ae-b126c4a239c8 Jul 13 13:55:01 devstack sudo[95008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:55:01 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-28458c14-914e-43bc-9015-6f8516d37863 tempest-VolumesTransfersV357Test-1520228763 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 13:55:01 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-28458c14-914e-43bc-9015-6f8516d37863 tempest-VolumesTransfersV357Test-1520228763 None] Flow 'volume_create_manager' (b07432b0-f14b-42a1-8776-92818ae2c31e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 13:55:01 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-28458c14-914e-43bc-9015-6f8516d37863 tempest-VolumesTransfersV357Test-1520228763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e593fa4-8d9a-4ecf-a5dd-4b14ad6d8e1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:55:01 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-28458c14-914e-43bc-9015-6f8516d37863 tempest-VolumesTransfersV357Test-1520228763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e593fa4-8d9a-4ecf-a5dd-4b14ad6d8e1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T11:55:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1824913948',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43631f65-85a8-43b4-b87d-c3a1bbebb705,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8197d7ad1e7f450b8d31aeafb4e33090',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T11:55:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T11:55:02Z,use_quota=True,user_id='6024f627b40c445089fa10cbc0e66cd2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1147de8b-623b-426c-a13d-7fc824a80f67),volume_type_id=1147de8b-623b-426c-a13d-7fc824a80f67)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:55:01 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-28458c14-914e-43bc-9015-6f8516d37863 tempest-VolumesTransfersV357Test-1520228763 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6d86ccf-990b-4246-a952-eae5a9f3ebae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:55:01 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-28458c14-914e-43bc-9015-6f8516d37863 tempest-VolumesTransfersV357Test-1520228763 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6d86ccf-990b-4246-a952-eae5a9f3ebae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:55:01 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-28458c14-914e-43bc-9015-6f8516d37863 tempest-VolumesTransfersV357Test-1520228763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (900b7649-f502-478c-a26e-072c30f6463a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:55:01 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-28458c14-914e-43bc-9015-6f8516d37863 tempest-VolumesTransfersV357Test-1520228763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (900b7649-f502-478c-a26e-072c30f6463a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '43631f65-85a8-43b4-b87d-c3a1bbebb705', 'volume_name': 'volume-43631f65-85a8-43b4-b87d-c3a1bbebb705', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:55:01 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-28458c14-914e-43bc-9015-6f8516d37863 tempest-VolumesTransfersV357Test-1520228763 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c5878f2-50f4-4f45-8075-c824fb3d28d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:55:01 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-28458c14-914e-43bc-9015-6f8516d37863 tempest-VolumesTransfersV357Test-1520228763 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c5878f2-50f4-4f45-8075-c824fb3d28d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:55:01 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-28458c14-914e-43bc-9015-6f8516d37863 tempest-VolumesTransfersV357Test-1520228763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f861009-7fbd-4d08-93a2-b17783db04fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:55:01 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-28458c14-914e-43bc-9015-6f8516d37863 tempest-VolumesTransfersV357Test-1520228763 None] Volume 43631f65-85a8-43b4-b87d-c3a1bbebb705: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-43631f65-85a8-43b4-b87d-c3a1bbebb705', 'volume_size': 1} Jul 13 13:55:01 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-28458c14-914e-43bc-9015-6f8516d37863 tempest-VolumesTransfersV357Test-1520228763 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:55:01 devstack sudo[95008]: pam_unix(sudo:session): session closed for user root Jul 13 13:55:01 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-06e3d2b4-7f18-4702-ade7-a86ee2198791 tempest-VolumesActionsTest-1880950110 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-a52b84de-fb6a-46db-b2ae-b126c4a239c8" returned: 0 in 0.532s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:55:01 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[46b3cfdd-7def-47aa-8cac-d3bcf8f9653e]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 13:55:01 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-06e3d2b4-7f18-4702-ade7-a86ee2198791 tempest-VolumesActionsTest-1880950110 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-a52b84de-fb6a-46db-b2ae-b126c4a239c8 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:55:02 devstack sudo[95013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-a52b84de-fb6a-46db-b2ae-b126c4a239c8 Jul 13 13:55:02 devstack sudo[95013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:55:02 devstack sudo[95013]: pam_unix(sudo:session): session closed for user root Jul 13 13:55:02 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-06e3d2b4-7f18-4702-ade7-a86ee2198791 tempest-VolumesActionsTest-1880950110 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-a52b84de-fb6a-46db-b2ae-b126c4a239c8" returned: 0 in 0.410s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:55:02 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-06e3d2b4-7f18-4702-ade7-a86ee2198791 tempest-VolumesActionsTest-1880950110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-a52b84de-fb6a-46db-b2ae-b126c4a239c8 /opt/stack/data/cinder/conversion/a52b84de-fb6a-46db-b2ae-b126c4a239c8.temp_image.3c0561cd-aa85-479c-bd25-a63b25492383z_mku1au.img {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:55:02 devstack sudo[95021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-a52b84de-fb6a-46db-b2ae-b126c4a239c8 /opt/stack/data/cinder/conversion/a52b84de-fb6a-46db-b2ae-b126c4a239c8.temp_image.3c0561cd-aa85-479c-bd25-a63b25492383z_mku1au.img Jul 13 13:55:02 devstack sudo[95021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:55:07 devstack sudo[95021]: pam_unix(sudo:session): session closed for user root Jul 13 13:55:07 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-06e3d2b4-7f18-4702-ade7-a86ee2198791 tempest-VolumesActionsTest-1880950110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-a52b84de-fb6a-46db-b2ae-b126c4a239c8 /opt/stack/data/cinder/conversion/a52b84de-fb6a-46db-b2ae-b126c4a239c8.temp_image.3c0561cd-aa85-479c-bd25-a63b25492383z_mku1au.img" returned: 0 in 5.312s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:55:07 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5d316e2-9c88-4deb-a9c5-26a92506a0bb]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 13:55:07 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-06e3d2b4-7f18-4702-ade7-a86ee2198791 tempest-VolumesActionsTest-1880950110 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-a52b84de-fb6a-46db-b2ae-b126c4a239c8 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:55:07 devstack sudo[95444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-a52b84de-fb6a-46db-b2ae-b126c4a239c8 Jul 13 13:55:07 devstack sudo[95444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:55:08 devstack sudo[95444]: pam_unix(sudo:session): session closed for user root Jul 13 13:55:08 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-06e3d2b4-7f18-4702-ade7-a86ee2198791 tempest-VolumesActionsTest-1880950110 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-a52b84de-fb6a-46db-b2ae-b126c4a239c8" returned: 0 in 0.548s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:55:08 devstack cinder-volume[87098]: DEBUG cinder.image.image_utils [None req-06e3d2b4-7f18-4702-ade7-a86ee2198791 tempest-VolumesActionsTest-1880950110 None] Image conversion details: src /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-a52b84de-fb6a-46db-b2ae-b126c4a239c8, size 1024.00 MB, duration 5.31 sec, destination /opt/stack/data/cinder/conversion/a52b84de-fb6a-46db-b2ae-b126c4a239c8.temp_image.3c0561cd-aa85-479c-bd25-a63b25492383z_mku1au.img {{(pid=87098) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 13 13:55:08 devstack cinder-volume[87098]: INFO cinder.image.image_utils [None req-06e3d2b4-7f18-4702-ade7-a86ee2198791 tempest-VolumesActionsTest-1880950110 None] Converted 1024.00 MB image at 192.72 MB/s Jul 13 13:55:08 devstack cinder-volume[87098]: DEBUG cinder.image.image_utils [None req-06e3d2b4-7f18-4702-ade7-a86ee2198791 tempest-VolumesActionsTest-1880950110 None] 3c0561cd-aa85-479c-bd25-a63b25492383 was raw, no need to convert to raw {{(pid=87098) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Jul 13 13:55:10 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-7f529ac6-738d-4da2-8003-b4b67ddd25e6 tempest-VolumesServicesTestJSON-1981182976 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 13:55:10 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-7f529ac6-738d-4da2-8003-b4b67ddd25e6 tempest-VolumesServicesTestJSON-1981182976 None] Flow 'volume_create_manager' (98c6a1bc-391e-4175-b0bb-fc29b3c59246) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 13:55:10 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-7f529ac6-738d-4da2-8003-b4b67ddd25e6 tempest-VolumesServicesTestJSON-1981182976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (696ea010-74c7-40a6-850e-ad88702e3ea2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:55:10 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-7f529ac6-738d-4da2-8003-b4b67ddd25e6 tempest-VolumesServicesTestJSON-1981182976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (696ea010-74c7-40a6-850e-ad88702e3ea2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T11:55:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-38163403',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dfb4d1ad-93e4-4c33-b7ec-19129c3dece8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b367d284bd8c43d9bbf9db430107a640',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T11:55:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T11:55:10Z,use_quota=True,user_id='42bc4758fdae474d9f06f16a18c4a765',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1147de8b-623b-426c-a13d-7fc824a80f67),volume_type_id=1147de8b-623b-426c-a13d-7fc824a80f67)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:55:10 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-7f529ac6-738d-4da2-8003-b4b67ddd25e6 tempest-VolumesServicesTestJSON-1981182976 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d806e77c-a3c2-4d3f-86ca-60554a688755) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:55:10 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-7f529ac6-738d-4da2-8003-b4b67ddd25e6 tempest-VolumesServicesTestJSON-1981182976 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d806e77c-a3c2-4d3f-86ca-60554a688755) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:55:10 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-7f529ac6-738d-4da2-8003-b4b67ddd25e6 tempest-VolumesServicesTestJSON-1981182976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d07994bb-15c9-4d5e-bf2f-85aa88c51b2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:55:10 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-7f529ac6-738d-4da2-8003-b4b67ddd25e6 tempest-VolumesServicesTestJSON-1981182976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d07994bb-15c9-4d5e-bf2f-85aa88c51b2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dfb4d1ad-93e4-4c33-b7ec-19129c3dece8', 'volume_name': 'volume-dfb4d1ad-93e4-4c33-b7ec-19129c3dece8', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:55:10 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-7f529ac6-738d-4da2-8003-b4b67ddd25e6 tempest-VolumesServicesTestJSON-1981182976 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c64503bb-2dbc-42b9-90e9-c317bfe4d99f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:55:10 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-7f529ac6-738d-4da2-8003-b4b67ddd25e6 tempest-VolumesServicesTestJSON-1981182976 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c64503bb-2dbc-42b9-90e9-c317bfe4d99f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:55:10 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-7f529ac6-738d-4da2-8003-b4b67ddd25e6 tempest-VolumesServicesTestJSON-1981182976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6344ced7-7478-4f6a-a303-942bd797f942) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:55:10 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-7f529ac6-738d-4da2-8003-b4b67ddd25e6 tempest-VolumesServicesTestJSON-1981182976 None] Volume dfb4d1ad-93e4-4c33-b7ec-19129c3dece8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dfb4d1ad-93e4-4c33-b7ec-19129c3dece8', 'volume_size': 1} Jul 13 13:55:10 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-7f529ac6-738d-4da2-8003-b4b67ddd25e6 tempest-VolumesServicesTestJSON-1981182976 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:55:20 devstack cinder-volume[87098]: DEBUG dbcounter [-] [87098] Writing DB stats cinder:UPDATE=41,cinder:SELECT=40,cinder:DELETE=4,cinder:INSERT=8 {{(pid=87098) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 13 13:55:20 devstack cinder-volume[87098]: DEBUG dbcounter [-] [87098] Writing DB stats cinder:SELECT=32,cinder:INSERT=12,cinder:UPDATE=40,cinder:DELETE=2 {{(pid=87098) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 13 13:55:27 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-06e3d2b4-7f18-4702-ade7-a86ee2198791 tempest-VolumesActionsTest-1880950110 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 26.374s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:55:27 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-06e3d2b4-7f18-4702-ade7-a86ee2198791 tempest-VolumesActionsTest-1880950110 None] Uploaded volume to glance image-id: 3c0561cd-aa85-479c-bd25-a63b25492383. {{(pid=87098) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jul 13 13:55:27 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-28458c14-914e-43bc-9015-6f8516d37863 tempest-VolumesTransfersV357Test-1520228763 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 26.056s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:55:27 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-28458c14-914e-43bc-9015-6f8516d37863 tempest-VolumesTransfersV357Test-1520228763 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T11:55:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1824913948',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43631f65-85a8-43b4-b87d-c3a1bbebb705,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8197d7ad1e7f450b8d31aeafb4e33090',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T11:55:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T11:55:02Z,use_quota=True,user_id='6024f627b40c445089fa10cbc0e66cd2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1147de8b-623b-426c-a13d-7fc824a80f67),volume_type_id=1147de8b-623b-426c-a13d-7fc824a80f67)}" {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 13 13:55:27 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-28458c14-914e-43bc-9015-6f8516d37863 tempest-VolumesTransfersV357Test-1520228763 None] Creating volume 43631f65-85a8-43b4-b87d-c3a1bbebb705 {{(pid=87098) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 13 13:55:27 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-28458c14-914e-43bc-9015-6f8516d37863 tempest-VolumesTransfersV357Test-1520228763 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:55:27 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-28458c14-914e-43bc-9015-6f8516d37863 tempest-VolumesTransfersV357Test-1520228763 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:55:27 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-28458c14-914e-43bc-9015-6f8516d37863 tempest-VolumesTransfersV357Test-1520228763 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 13:55:27 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-28458c14-914e-43bc-9015-6f8516d37863 tempest-VolumesTransfersV357Test-1520228763 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 13:55:27 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-28458c14-914e-43bc-9015-6f8516d37863 tempest-VolumesTransfersV357Test-1520228763 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:55:27 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-28458c14-914e-43bc-9015-6f8516d37863 tempest-VolumesTransfersV357Test-1520228763 None] Selected osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 13:55:27 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-28458c14-914e-43bc-9015-6f8516d37863 tempest-VolumesTransfersV357Test-1520228763 None] casted to osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 Jul 13 13:55:27 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-28458c14-914e-43bc-9015-6f8516d37863 tempest-VolumesTransfersV357Test-1520228763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-43631f65-85a8-43b4-b87d-c3a1bbebb705 1073741824 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:55:27 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-06e3d2b4-7f18-4702-ade7-a86ee2198791 tempest-VolumesActionsTest-1880950110 None] Copy volume to image completed successfully. Jul 13 13:55:27 devstack sudo[95570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-43631f65-85a8-43b4-b87d-c3a1bbebb705 1073741824 Jul 13 13:55:27 devstack sudo[95570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:55:27 devstack cinder-volume[87098]: INFO cinder.volume.manager [req-b2cb923a-df53-479a-94e7-e7fd28a7c37c req-f7af7c09-3724-472b-959d-b7636bf42ba1 tempest-AttachVolumeTestJSON-2118030158 None] Terminate volume connection completed successfully. Jul 13 13:55:27 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [req-b2cb923a-df53-479a-94e7-e7fd28a7c37c req-f7af7c09-3724-472b-959d-b7636bf42ba1 tempest-AttachVolumeTestJSON-2118030158 None] Deleting attachment ffad73cb-f52a-484e-b69e-78a6812d5947. {{(pid=87098) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 13 13:55:28 devstack sudo[95570]: pam_unix(sudo:session): session closed for user root Jul 13 13:55:28 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-28458c14-914e-43bc-9015-6f8516d37863 tempest-VolumesTransfersV357Test-1520228763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-43631f65-85a8-43b4-b87d-c3a1bbebb705 1073741824" returned: 0 in 0.478s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:55:28 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-28458c14-914e-43bc-9015-6f8516d37863 tempest-VolumesTransfersV357Test-1520228763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-43631f65-85a8-43b4-b87d-c3a1bbebb705 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:55:28 devstack sudo[95578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-43631f65-85a8-43b4-b87d-c3a1bbebb705 Jul 13 13:55:28 devstack sudo[95578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:55:28 devstack sudo[95578]: pam_unix(sudo:session): session closed for user root Jul 13 13:55:28 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-28458c14-914e-43bc-9015-6f8516d37863 tempest-VolumesTransfersV357Test-1520228763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-43631f65-85a8-43b4-b87d-c3a1bbebb705" returned: 0 in 0.244s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:55:28 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-28458c14-914e-43bc-9015-6f8516d37863 tempest-VolumesTransfersV357Test-1520228763 None] <== create_volume: return (759ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'} {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 13 13:55:28 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-28458c14-914e-43bc-9015-6f8516d37863 tempest-VolumesTransfersV357Test-1520228763 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.761s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:55:28 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-7f529ac6-738d-4da2-8003-b4b67ddd25e6 tempest-VolumesServicesTestJSON-1981182976 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 17.869s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:55:28 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-7f529ac6-738d-4da2-8003-b4b67ddd25e6 tempest-VolumesServicesTestJSON-1981182976 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T11:55:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-38163403',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dfb4d1ad-93e4-4c33-b7ec-19129c3dece8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b367d284bd8c43d9bbf9db430107a640',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T11:55:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T11:55:10Z,use_quota=True,user_id='42bc4758fdae474d9f06f16a18c4a765',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1147de8b-623b-426c-a13d-7fc824a80f67),volume_type_id=1147de8b-623b-426c-a13d-7fc824a80f67)}" {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 13 13:55:28 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-7f529ac6-738d-4da2-8003-b4b67ddd25e6 tempest-VolumesServicesTestJSON-1981182976 None] Creating volume dfb4d1ad-93e4-4c33-b7ec-19129c3dece8 {{(pid=87098) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 13 13:55:28 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-7f529ac6-738d-4da2-8003-b4b67ddd25e6 tempest-VolumesServicesTestJSON-1981182976 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:55:28 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-7f529ac6-738d-4da2-8003-b4b67ddd25e6 tempest-VolumesServicesTestJSON-1981182976 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:55:28 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-7f529ac6-738d-4da2-8003-b4b67ddd25e6 tempest-VolumesServicesTestJSON-1981182976 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 13:55:28 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-7f529ac6-738d-4da2-8003-b4b67ddd25e6 tempest-VolumesServicesTestJSON-1981182976 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 13:55:28 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-7f529ac6-738d-4da2-8003-b4b67ddd25e6 tempest-VolumesServicesTestJSON-1981182976 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:55:28 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-7f529ac6-738d-4da2-8003-b4b67ddd25e6 tempest-VolumesServicesTestJSON-1981182976 None] Selected osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 13:55:28 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-7f529ac6-738d-4da2-8003-b4b67ddd25e6 tempest-VolumesServicesTestJSON-1981182976 None] casted to osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 Jul 13 13:55:28 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-7f529ac6-738d-4da2-8003-b4b67ddd25e6 tempest-VolumesServicesTestJSON-1981182976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-dfb4d1ad-93e4-4c33-b7ec-19129c3dece8 1073741824 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:55:28 devstack sudo[95581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-dfb4d1ad-93e4-4c33-b7ec-19129c3dece8 1073741824 Jul 13 13:55:28 devstack sudo[95581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:55:28 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-28458c14-914e-43bc-9015-6f8516d37863 tempest-VolumesTransfersV357Test-1520228763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f861009-7fbd-4d08-93a2-b17783db04fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-43631f65-85a8-43b4-b87d-c3a1bbebb705', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:55:28 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-28458c14-914e-43bc-9015-6f8516d37863 tempest-VolumesTransfersV357Test-1520228763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (288c88eb-435a-45ef-ad6b-7ae1bc47cea6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:55:28 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-28458c14-914e-43bc-9015-6f8516d37863 tempest-VolumesTransfersV357Test-1520228763 None] Volume volume-43631f65-85a8-43b4-b87d-c3a1bbebb705 (43631f65-85a8-43b4-b87d-c3a1bbebb705): created successfully Jul 13 13:55:28 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-28458c14-914e-43bc-9015-6f8516d37863 tempest-VolumesTransfersV357Test-1520228763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (288c88eb-435a-45ef-ad6b-7ae1bc47cea6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:55:28 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-28458c14-914e-43bc-9015-6f8516d37863 tempest-VolumesTransfersV357Test-1520228763 None] Flow 'volume_create_manager' (b07432b0-f14b-42a1-8776-92818ae2c31e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 13:55:28 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-28458c14-914e-43bc-9015-6f8516d37863 tempest-VolumesTransfersV357Test-1520228763 None] Created volume successfully. Jul 13 13:55:29 devstack cinder-volume[87098]: DEBUG oslo_service.periodic_task [None req-727a1692-ea28-4a77-b327-0d94e8f01efb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87098) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 13 13:55:29 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-727a1692-ea28-4a77-b327-0d94e8f01efb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:55:29 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-727a1692-ea28-4a77-b327-0d94e8f01efb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:55:29 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-727a1692-ea28-4a77-b327-0d94e8f01efb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 13:55:29 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-727a1692-ea28-4a77-b327-0d94e8f01efb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 13:55:29 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-727a1692-ea28-4a77-b327-0d94e8f01efb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:55:29 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-727a1692-ea28-4a77-b327-0d94e8f01efb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:55:29 devstack sudo[95588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 Jul 13 13:55:29 devstack sudo[95588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:55:29 devstack sudo[95581]: pam_unix(sudo:session): session closed for user root Jul 13 13:55:29 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-7f529ac6-738d-4da2-8003-b4b67ddd25e6 tempest-VolumesServicesTestJSON-1981182976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-dfb4d1ad-93e4-4c33-b7ec-19129c3dece8 1073741824" returned: 0 in 0.732s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:55:29 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-7f529ac6-738d-4da2-8003-b4b67ddd25e6 tempest-VolumesServicesTestJSON-1981182976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-dfb4d1ad-93e4-4c33-b7ec-19129c3dece8 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:55:29 devstack sudo[95590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-dfb4d1ad-93e4-4c33-b7ec-19129c3dece8 Jul 13 13:55:29 devstack sudo[95590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:55:29 devstack sudo[95588]: pam_unix(sudo:session): session closed for user root Jul 13 13:55:29 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-727a1692-ea28-4a77-b327-0d94e8f01efb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78" returned: 0 in 0.363s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:55:29 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-727a1692-ea28-4a77-b327-0d94e8f01efb None None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 13:55:29 devstack cinder-volume[87098]: DEBUG oslo_service.periodic_task [None req-727a1692-ea28-4a77-b327-0d94e8f01efb None None] Running periodic task VolumeManager._thread_info {{(pid=87098) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 13 13:55:29 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-727a1692-ea28-4a77-b327-0d94e8f01efb None None] thread count: 28 {{(pid=87098) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 13 13:55:29 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-727a1692-ea28-4a77-b327-0d94e8f01efb None None] thread info: [<_MainThread(MainThread, started 127988054597760)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87098) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 13 13:55:29 devstack sudo[95590]: pam_unix(sudo:session): session closed for user root Jul 13 13:55:29 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-7f529ac6-738d-4da2-8003-b4b67ddd25e6 tempest-VolumesServicesTestJSON-1981182976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-dfb4d1ad-93e4-4c33-b7ec-19129c3dece8" returned: 0 in 0.306s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:55:29 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-7f529ac6-738d-4da2-8003-b4b67ddd25e6 tempest-VolumesServicesTestJSON-1981182976 None] <== create_volume: return (1092ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'} {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 13 13:55:29 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-7f529ac6-738d-4da2-8003-b4b67ddd25e6 tempest-VolumesServicesTestJSON-1981182976 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.097s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:55:29 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-7f529ac6-738d-4da2-8003-b4b67ddd25e6 tempest-VolumesServicesTestJSON-1981182976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6344ced7-7478-4f6a-a303-942bd797f942) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dfb4d1ad-93e4-4c33-b7ec-19129c3dece8', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:55:29 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-7f529ac6-738d-4da2-8003-b4b67ddd25e6 tempest-VolumesServicesTestJSON-1981182976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01920c33-acc7-4930-a0e5-997838c7ae5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:55:29 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-7f529ac6-738d-4da2-8003-b4b67ddd25e6 tempest-VolumesServicesTestJSON-1981182976 None] Volume volume-dfb4d1ad-93e4-4c33-b7ec-19129c3dece8 (dfb4d1ad-93e4-4c33-b7ec-19129c3dece8): created successfully Jul 13 13:55:29 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-7f529ac6-738d-4da2-8003-b4b67ddd25e6 tempest-VolumesServicesTestJSON-1981182976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01920c33-acc7-4930-a0e5-997838c7ae5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:55:29 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-7f529ac6-738d-4da2-8003-b4b67ddd25e6 tempest-VolumesServicesTestJSON-1981182976 None] Flow 'volume_create_manager' (98c6a1bc-391e-4175-b0bb-fc29b3c59246) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 13:55:29 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-7f529ac6-738d-4da2-8003-b4b67ddd25e6 tempest-VolumesServicesTestJSON-1981182976 None] Created volume successfully. Jul 13 13:55:29 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-a794bdd4-8294-47c6-b81f-8fb11498b045 tempest-VolumesTransfersV357Test-838760313 None] Transfer volume completed successfully. Jul 13 13:55:30 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-16b6f170-8858-49f9-bf8b-5e83e395e0dd tempest-VolumesActionsTest-1880950110 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:55:30 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-16b6f170-8858-49f9-bf8b-5e83e395e0dd tempest-VolumesActionsTest-1880950110 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:55:30 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ee93353-7386-4521-8cf4-4f033a94074f]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 13:55:30 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-16b6f170-8858-49f9-bf8b-5e83e395e0dd tempest-VolumesActionsTest-1880950110 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-a52b84de-fb6a-46db-b2ae-b126c4a239c8 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:55:30 devstack sudo[95598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-a52b84de-fb6a-46db-b2ae-b126c4a239c8 Jul 13 13:55:30 devstack sudo[95598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:55:30 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-488f6eba-8fce-4800-b34d-b679e6e2cdab tempest-VolumesServicesTestJSON-1981182976 None] Acquiring lock "cinder-dfb4d1ad-93e4-4c33-b7ec-19129c3dece8-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 13:55:30 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-488f6eba-8fce-4800-b34d-b679e6e2cdab tempest-VolumesServicesTestJSON-1981182976 None] Lock "cinder-dfb4d1ad-93e4-4c33-b7ec-19129c3dece8-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 13:55:30 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-488f6eba-8fce-4800-b34d-b679e6e2cdab tempest-VolumesServicesTestJSON-1981182976 None] Acquiring lock "cinder-quobyte-dfb4d1ad-93e4-4c33-b7ec-19129c3dece8" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 13:55:30 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-488f6eba-8fce-4800-b34d-b679e6e2cdab tempest-VolumesServicesTestJSON-1981182976 None] Lock "cinder-quobyte-dfb4d1ad-93e4-4c33-b7ec-19129c3dece8" acquired by "delete_volume" :: waited 0.026s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 13:55:30 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[83ce8b61-3bc3-47e4-90fd-fd3c9f405e96]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 13:55:30 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-488f6eba-8fce-4800-b34d-b679e6e2cdab tempest-VolumesServicesTestJSON-1981182976 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-dfb4d1ad-93e4-4c33-b7ec-19129c3dece8 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:55:30 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-8a480de4-fc4c-47d0-b738-0e1b747a817f tempest-VolumesTransfersV357Test-956505013 None] Acquiring lock "cinder-43631f65-85a8-43b4-b87d-c3a1bbebb705-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 13:55:30 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-8a480de4-fc4c-47d0-b738-0e1b747a817f tempest-VolumesTransfersV357Test-956505013 None] Lock "cinder-43631f65-85a8-43b4-b87d-c3a1bbebb705-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 13:55:30 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-8a480de4-fc4c-47d0-b738-0e1b747a817f tempest-VolumesTransfersV357Test-956505013 None] Acquiring lock "cinder-quobyte-43631f65-85a8-43b4-b87d-c3a1bbebb705" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 13:55:30 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-8a480de4-fc4c-47d0-b738-0e1b747a817f tempest-VolumesTransfersV357Test-956505013 None] Lock "cinder-quobyte-43631f65-85a8-43b4-b87d-c3a1bbebb705" acquired by "delete_volume" :: waited 0.026s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 13:55:30 devstack sudo[95600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-dfb4d1ad-93e4-4c33-b7ec-19129c3dece8 Jul 13 13:55:30 devstack sudo[95600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:55:30 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e2989cc-3c71-4510-819f-398c1fe58bec]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 13:55:30 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-8a480de4-fc4c-47d0-b738-0e1b747a817f tempest-VolumesTransfersV357Test-956505013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-43631f65-85a8-43b4-b87d-c3a1bbebb705 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:55:30 devstack sudo[95598]: pam_unix(sudo:session): session closed for user root Jul 13 13:55:30 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-16b6f170-8858-49f9-bf8b-5e83e395e0dd tempest-VolumesActionsTest-1880950110 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-a52b84de-fb6a-46db-b2ae-b126c4a239c8" returned: 0 in 0.620s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:55:30 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6d5b52c-fff6-4886-bcce-b9b2b1a0368b]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 13:55:30 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-16b6f170-8858-49f9-bf8b-5e83e395e0dd tempest-VolumesActionsTest-1880950110 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-a52b84de-fb6a-46db-b2ae-b126c4a239c8 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:55:30 devstack sudo[95605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-43631f65-85a8-43b4-b87d-c3a1bbebb705 Jul 13 13:55:30 devstack sudo[95605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:55:30 devstack sudo[95607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-a52b84de-fb6a-46db-b2ae-b126c4a239c8 Jul 13 13:55:30 devstack sudo[95607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:55:30 devstack sudo[95600]: pam_unix(sudo:session): session closed for user root Jul 13 13:55:30 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-488f6eba-8fce-4800-b34d-b679e6e2cdab tempest-VolumesServicesTestJSON-1981182976 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-dfb4d1ad-93e4-4c33-b7ec-19129c3dece8" returned: 0 in 0.518s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:55:30 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-488f6eba-8fce-4800-b34d-b679e6e2cdab tempest-VolumesServicesTestJSON-1981182976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-dfb4d1ad-93e4-4c33-b7ec-19129c3dece8 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:55:30 devstack sudo[95614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-dfb4d1ad-93e4-4c33-b7ec-19129c3dece8 Jul 13 13:55:30 devstack sudo[95614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:55:30 devstack sudo[95605]: pam_unix(sudo:session): session closed for user root Jul 13 13:55:30 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-8a480de4-fc4c-47d0-b738-0e1b747a817f tempest-VolumesTransfersV357Test-956505013 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-43631f65-85a8-43b4-b87d-c3a1bbebb705" returned: 0 in 0.408s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:55:30 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-8a480de4-fc4c-47d0-b738-0e1b747a817f tempest-VolumesTransfersV357Test-956505013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-43631f65-85a8-43b4-b87d-c3a1bbebb705 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:55:31 devstack sudo[95618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-43631f65-85a8-43b4-b87d-c3a1bbebb705 Jul 13 13:55:31 devstack sudo[95618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:55:31 devstack sudo[95607]: pam_unix(sudo:session): session closed for user root Jul 13 13:55:31 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-16b6f170-8858-49f9-bf8b-5e83e395e0dd tempest-VolumesActionsTest-1880950110 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-a52b84de-fb6a-46db-b2ae-b126c4a239c8" returned: 0 in 0.482s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:55:31 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-16b6f170-8858-49f9-bf8b-5e83e395e0dd tempest-VolumesActionsTest-1880950110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-a52b84de-fb6a-46db-b2ae-b126c4a239c8 /opt/stack/data/cinder/conversion/a52b84de-fb6a-46db-b2ae-b126c4a239c8.temp_image.6ed0cb7d-a9d6-48a1-8a69-67ddb802fad5g3wgfyzd.img {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:55:31 devstack sudo[95624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-a52b84de-fb6a-46db-b2ae-b126c4a239c8 /opt/stack/data/cinder/conversion/a52b84de-fb6a-46db-b2ae-b126c4a239c8.temp_image.6ed0cb7d-a9d6-48a1-8a69-67ddb802fad5g3wgfyzd.img Jul 13 13:55:31 devstack sudo[95624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:55:31 devstack sudo[95614]: pam_unix(sudo:session): session closed for user root Jul 13 13:55:31 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-488f6eba-8fce-4800-b34d-b679e6e2cdab tempest-VolumesServicesTestJSON-1981182976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-dfb4d1ad-93e4-4c33-b7ec-19129c3dece8" returned: 0 in 0.347s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:55:31 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-488f6eba-8fce-4800-b34d-b679e6e2cdab tempest-VolumesServicesTestJSON-1981182976 None] Lock "cinder-quobyte-dfb4d1ad-93e4-4c33-b7ec-19129c3dece8" released by "delete_volume" :: held 0.917s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 13:55:31 devstack sudo[95618]: pam_unix(sudo:session): session closed for user root Jul 13 13:55:31 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-488f6eba-8fce-4800-b34d-b679e6e2cdab tempest-VolumesServicesTestJSON-1981182976 None] Created reservations ['6eaf96fa-5f0d-4a62-8819-bdcc1438de42', 'c528b814-e0fb-42b4-8782-37b1b7a0089f', '923d7df0-14c5-4682-84df-aed4d0a76bf7', '51787c3a-e29d-487e-9444-14f3b925be0d'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 13:55:31 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-8a480de4-fc4c-47d0-b738-0e1b747a817f tempest-VolumesTransfersV357Test-956505013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-43631f65-85a8-43b4-b87d-c3a1bbebb705" returned: 0 in 0.325s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:55:31 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-8a480de4-fc4c-47d0-b738-0e1b747a817f tempest-VolumesTransfersV357Test-956505013 None] Lock "cinder-quobyte-43631f65-85a8-43b4-b87d-c3a1bbebb705" released by "delete_volume" :: held 0.793s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 13:55:31 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-488f6eba-8fce-4800-b34d-b679e6e2cdab tempest-VolumesServicesTestJSON-1981182976 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:55:31 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-488f6eba-8fce-4800-b34d-b679e6e2cdab tempest-VolumesServicesTestJSON-1981182976 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:55:31 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-488f6eba-8fce-4800-b34d-b679e6e2cdab tempest-VolumesServicesTestJSON-1981182976 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 13:55:31 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-488f6eba-8fce-4800-b34d-b679e6e2cdab tempest-VolumesServicesTestJSON-1981182976 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 13:55:31 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-488f6eba-8fce-4800-b34d-b679e6e2cdab tempest-VolumesServicesTestJSON-1981182976 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:55:31 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-488f6eba-8fce-4800-b34d-b679e6e2cdab tempest-VolumesServicesTestJSON-1981182976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:55:31 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-8a480de4-fc4c-47d0-b738-0e1b747a817f tempest-VolumesTransfersV357Test-956505013 None] Created reservations ['80c95e94-e4c8-44fe-9d29-c3df2746cc9f', 'bb3129a0-05d7-494d-9fe4-b45d721a7e7f', 'b99102ab-6733-497c-b11e-a34a07787473', '68870b53-b326-450f-9a54-fab7e11057f0'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 13:55:31 devstack sudo[95627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 Jul 13 13:55:31 devstack sudo[95627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:55:31 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-8a480de4-fc4c-47d0-b738-0e1b747a817f tempest-VolumesTransfersV357Test-956505013 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:55:31 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-8a480de4-fc4c-47d0-b738-0e1b747a817f tempest-VolumesTransfersV357Test-956505013 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:55:31 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-8a480de4-fc4c-47d0-b738-0e1b747a817f tempest-VolumesTransfersV357Test-956505013 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 13:55:31 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-8a480de4-fc4c-47d0-b738-0e1b747a817f tempest-VolumesTransfersV357Test-956505013 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 13:55:31 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-8a480de4-fc4c-47d0-b738-0e1b747a817f tempest-VolumesTransfersV357Test-956505013 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:55:31 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-8a480de4-fc4c-47d0-b738-0e1b747a817f tempest-VolumesTransfersV357Test-956505013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:55:31 devstack sudo[95641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 Jul 13 13:55:31 devstack sudo[95641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:55:32 devstack sudo[95627]: pam_unix(sudo:session): session closed for user root Jul 13 13:55:32 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-488f6eba-8fce-4800-b34d-b679e6e2cdab tempest-VolumesServicesTestJSON-1981182976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78" returned: 0 in 0.831s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:55:32 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-488f6eba-8fce-4800-b34d-b679e6e2cdab tempest-VolumesServicesTestJSON-1981182976 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 13:55:32 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-488f6eba-8fce-4800-b34d-b679e6e2cdab tempest-VolumesServicesTestJSON-1981182976 None] Deleted volume successfully. Jul 13 13:55:32 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-488f6eba-8fce-4800-b34d-b679e6e2cdab tempest-VolumesServicesTestJSON-1981182976 None] Lock "cinder-dfb4d1ad-93e4-4c33-b7ec-19129c3dece8-delete_volume" released by "delete_volume" :: held 2.177s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 13:55:32 devstack sudo[95641]: pam_unix(sudo:session): session closed for user root Jul 13 13:55:32 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-8a480de4-fc4c-47d0-b738-0e1b747a817f tempest-VolumesTransfersV357Test-956505013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78" returned: 0 in 1.092s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:55:32 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-8a480de4-fc4c-47d0-b738-0e1b747a817f tempest-VolumesTransfersV357Test-956505013 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 13:55:32 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-8a480de4-fc4c-47d0-b738-0e1b747a817f tempest-VolumesTransfersV357Test-956505013 None] Deleted volume successfully. Jul 13 13:55:32 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-8a480de4-fc4c-47d0-b738-0e1b747a817f tempest-VolumesTransfersV357Test-956505013 None] Lock "cinder-43631f65-85a8-43b4-b87d-c3a1bbebb705-delete_volume" released by "delete_volume" :: held 2.389s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 13:55:33 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-3417be66-1fef-4992-9bbb-cb6f06e987d5 tempest-VolumesTransfersV357Test-1520228763 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 13:55:33 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-3417be66-1fef-4992-9bbb-cb6f06e987d5 tempest-VolumesTransfersV357Test-1520228763 None] Flow 'volume_create_manager' (e28e8845-9cce-4acc-9f45-6391dca73e14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 13:55:33 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-3417be66-1fef-4992-9bbb-cb6f06e987d5 tempest-VolumesTransfersV357Test-1520228763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65d390bb-b966-4f09-b208-82befa2fe20a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:55:34 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-3417be66-1fef-4992-9bbb-cb6f06e987d5 tempest-VolumesTransfersV357Test-1520228763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65d390bb-b966-4f09-b208-82befa2fe20a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T11:55:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-809023411',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=570df5b5-6277-41fe-8d0e-22bc52ac3172,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8197d7ad1e7f450b8d31aeafb4e33090',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T11:55:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T11:55:34Z,use_quota=True,user_id='6024f627b40c445089fa10cbc0e66cd2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1147de8b-623b-426c-a13d-7fc824a80f67),volume_type_id=1147de8b-623b-426c-a13d-7fc824a80f67)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:55:34 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-3417be66-1fef-4992-9bbb-cb6f06e987d5 tempest-VolumesTransfersV357Test-1520228763 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc968046-5472-4e0a-b9d8-07c8a75d6c15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:55:34 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-3417be66-1fef-4992-9bbb-cb6f06e987d5 tempest-VolumesTransfersV357Test-1520228763 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc968046-5472-4e0a-b9d8-07c8a75d6c15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:55:34 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-3417be66-1fef-4992-9bbb-cb6f06e987d5 tempest-VolumesTransfersV357Test-1520228763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e9f5afc-1e25-4a51-bb8a-055fa25365d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:55:34 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-3417be66-1fef-4992-9bbb-cb6f06e987d5 tempest-VolumesTransfersV357Test-1520228763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e9f5afc-1e25-4a51-bb8a-055fa25365d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '570df5b5-6277-41fe-8d0e-22bc52ac3172', 'volume_name': 'volume-570df5b5-6277-41fe-8d0e-22bc52ac3172', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:55:34 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-3417be66-1fef-4992-9bbb-cb6f06e987d5 tempest-VolumesTransfersV357Test-1520228763 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d7fbcf9-4164-4788-a496-73810edc4c68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:55:34 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-3417be66-1fef-4992-9bbb-cb6f06e987d5 tempest-VolumesTransfersV357Test-1520228763 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d7fbcf9-4164-4788-a496-73810edc4c68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:55:34 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-3417be66-1fef-4992-9bbb-cb6f06e987d5 tempest-VolumesTransfersV357Test-1520228763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04c1d674-efea-4c62-8626-0c54a0bd1a6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:55:34 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-3417be66-1fef-4992-9bbb-cb6f06e987d5 tempest-VolumesTransfersV357Test-1520228763 None] Volume 570df5b5-6277-41fe-8d0e-22bc52ac3172: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-570df5b5-6277-41fe-8d0e-22bc52ac3172', 'volume_size': 1} Jul 13 13:55:34 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-3417be66-1fef-4992-9bbb-cb6f06e987d5 tempest-VolumesTransfersV357Test-1520228763 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:55:38 devstack sudo[95624]: pam_unix(sudo:session): session closed for user root Jul 13 13:55:38 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-16b6f170-8858-49f9-bf8b-5e83e395e0dd tempest-VolumesActionsTest-1880950110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-a52b84de-fb6a-46db-b2ae-b126c4a239c8 /opt/stack/data/cinder/conversion/a52b84de-fb6a-46db-b2ae-b126c4a239c8.temp_image.6ed0cb7d-a9d6-48a1-8a69-67ddb802fad5g3wgfyzd.img" returned: 0 in 7.542s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:55:38 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec30b7b7-2937-4457-87ac-db6e926f0f15]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 13:55:38 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-16b6f170-8858-49f9-bf8b-5e83e395e0dd tempest-VolumesActionsTest-1880950110 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-a52b84de-fb6a-46db-b2ae-b126c4a239c8 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:55:38 devstack sudo[95742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-a52b84de-fb6a-46db-b2ae-b126c4a239c8 Jul 13 13:55:38 devstack sudo[95742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:55:39 devstack sudo[95742]: pam_unix(sudo:session): session closed for user root Jul 13 13:55:39 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-16b6f170-8858-49f9-bf8b-5e83e395e0dd tempest-VolumesActionsTest-1880950110 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-a52b84de-fb6a-46db-b2ae-b126c4a239c8" returned: 0 in 0.623s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:55:39 devstack cinder-volume[87098]: DEBUG cinder.image.image_utils [None req-16b6f170-8858-49f9-bf8b-5e83e395e0dd tempest-VolumesActionsTest-1880950110 None] Image conversion details: src /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-a52b84de-fb6a-46db-b2ae-b126c4a239c8, size 1024.00 MB, duration 7.54 sec, destination /opt/stack/data/cinder/conversion/a52b84de-fb6a-46db-b2ae-b126c4a239c8.temp_image.6ed0cb7d-a9d6-48a1-8a69-67ddb802fad5g3wgfyzd.img {{(pid=87098) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 13 13:55:39 devstack cinder-volume[87098]: INFO cinder.image.image_utils [None req-16b6f170-8858-49f9-bf8b-5e83e395e0dd tempest-VolumesActionsTest-1880950110 None] Converted 1024.00 MB image at 135.73 MB/s Jul 13 13:55:39 devstack cinder-volume[87098]: DEBUG cinder.image.image_utils [None req-16b6f170-8858-49f9-bf8b-5e83e395e0dd tempest-VolumesActionsTest-1880950110 None] 6ed0cb7d-a9d6-48a1-8a69-67ddb802fad5 was raw, converting to qcow2 {{(pid=87098) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1179}} Jul 13 13:55:39 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[99e3edc3-b633-4626-b66a-b586cf85f389]: (4, 'raw') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 13:55:39 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-16b6f170-8858-49f9-bf8b-5e83e395e0dd tempest-VolumesActionsTest-1880950110 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/a52b84de-fb6a-46db-b2ae-b126c4a239c8.temp_image.6ed0cb7d-a9d6-48a1-8a69-67ddb802fad5g3wgfyzd.img {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:55:39 devstack sudo[95748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/a52b84de-fb6a-46db-b2ae-b126c4a239c8.temp_image.6ed0cb7d-a9d6-48a1-8a69-67ddb802fad5g3wgfyzd.img Jul 13 13:55:39 devstack sudo[95748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:55:39 devstack sudo[95748]: pam_unix(sudo:session): session closed for user root Jul 13 13:55:39 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-16b6f170-8858-49f9-bf8b-5e83e395e0dd tempest-VolumesActionsTest-1880950110 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/a52b84de-fb6a-46db-b2ae-b126c4a239c8.temp_image.6ed0cb7d-a9d6-48a1-8a69-67ddb802fad5g3wgfyzd.img" returned: 0 in 0.385s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:55:39 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-16b6f170-8858-49f9-bf8b-5e83e395e0dd tempest-VolumesActionsTest-1880950110 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/a52b84de-fb6a-46db-b2ae-b126c4a239c8.temp_image.6ed0cb7d-a9d6-48a1-8a69-67ddb802fad5g3wgfyzd.img {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:55:39 devstack sudo[95752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/a52b84de-fb6a-46db-b2ae-b126c4a239c8.temp_image.6ed0cb7d-a9d6-48a1-8a69-67ddb802fad5g3wgfyzd.img Jul 13 13:55:39 devstack sudo[95752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:55:40 devstack sudo[95752]: pam_unix(sudo:session): session closed for user root Jul 13 13:55:40 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-16b6f170-8858-49f9-bf8b-5e83e395e0dd tempest-VolumesActionsTest-1880950110 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/a52b84de-fb6a-46db-b2ae-b126c4a239c8.temp_image.6ed0cb7d-a9d6-48a1-8a69-67ddb802fad5g3wgfyzd.img" returned: 1 in 0.399s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:55:40 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-16b6f170-8858-49f9-bf8b-5e83e395e0dd tempest-VolumesActionsTest-1880950110 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/a52b84de-fb6a-46db-b2ae-b126c4a239c8.temp_image.6ed0cb7d-a9d6-48a1-8a69-67ddb802fad5g3wgfyzd.img' failed. Not Retrying. {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 13 13:55:40 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-16b6f170-8858-49f9-bf8b-5e83e395e0dd tempest-VolumesActionsTest-1880950110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/a52b84de-fb6a-46db-b2ae-b126c4a239c8.temp_image.6ed0cb7d-a9d6-48a1-8a69-67ddb802fad5g3wgfyzd.img /opt/stack/data/cinder/conversion/vol_upload_wd2vxyym {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:55:40 devstack sudo[95763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/a52b84de-fb6a-46db-b2ae-b126c4a239c8.temp_image.6ed0cb7d-a9d6-48a1-8a69-67ddb802fad5g3wgfyzd.img /opt/stack/data/cinder/conversion/vol_upload_wd2vxyym Jul 13 13:55:40 devstack sudo[95763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:55:40 devstack sudo[95763]: pam_unix(sudo:session): session closed for user root Jul 13 13:55:40 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-16b6f170-8858-49f9-bf8b-5e83e395e0dd tempest-VolumesActionsTest-1880950110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/a52b84de-fb6a-46db-b2ae-b126c4a239c8.temp_image.6ed0cb7d-a9d6-48a1-8a69-67ddb802fad5g3wgfyzd.img /opt/stack/data/cinder/conversion/vol_upload_wd2vxyym" returned: 0 in 0.306s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:55:40 devstack cinder-volume[87098]: DEBUG cinder.image.image_utils [None req-16b6f170-8858-49f9-bf8b-5e83e395e0dd tempest-VolumesActionsTest-1880950110 None] Image conversion details: src /opt/stack/data/cinder/conversion/a52b84de-fb6a-46db-b2ae-b126c4a239c8.temp_image.6ed0cb7d-a9d6-48a1-8a69-67ddb802fad5g3wgfyzd.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_wd2vxyym {{(pid=87098) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 13 13:55:40 devstack cinder-volume[87098]: INFO cinder.image.image_utils [None req-16b6f170-8858-49f9-bf8b-5e83e395e0dd tempest-VolumesActionsTest-1880950110 None] Converted 1024.00 MB image at 1024.00 MB/s Jul 13 13:55:40 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d1f3d9f-d4f2-457b-a13e-a65970b2b4bb]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 13:55:40 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-16b6f170-8858-49f9-bf8b-5e83e395e0dd tempest-VolumesActionsTest-1880950110 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_wd2vxyym {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:55:40 devstack sudo[95775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_wd2vxyym Jul 13 13:55:40 devstack sudo[95775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:55:40 devstack sudo[95775]: pam_unix(sudo:session): session closed for user root Jul 13 13:55:40 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-16b6f170-8858-49f9-bf8b-5e83e395e0dd tempest-VolumesActionsTest-1880950110 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_wd2vxyym" returned: 0 in 0.422s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:55:42 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-16b6f170-8858-49f9-bf8b-5e83e395e0dd tempest-VolumesActionsTest-1880950110 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 12.616s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:55:42 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-16b6f170-8858-49f9-bf8b-5e83e395e0dd tempest-VolumesActionsTest-1880950110 None] Uploaded volume to glance image-id: 6ed0cb7d-a9d6-48a1-8a69-67ddb802fad5. {{(pid=87098) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jul 13 13:55:42 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-3417be66-1fef-4992-9bbb-cb6f06e987d5 tempest-VolumesTransfersV357Test-1520228763 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.447s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:55:42 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-3417be66-1fef-4992-9bbb-cb6f06e987d5 tempest-VolumesTransfersV357Test-1520228763 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T11:55:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-809023411',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=570df5b5-6277-41fe-8d0e-22bc52ac3172,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8197d7ad1e7f450b8d31aeafb4e33090',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T11:55:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T11:55:34Z,use_quota=True,user_id='6024f627b40c445089fa10cbc0e66cd2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1147de8b-623b-426c-a13d-7fc824a80f67),volume_type_id=1147de8b-623b-426c-a13d-7fc824a80f67)}" {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 13 13:55:42 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-3417be66-1fef-4992-9bbb-cb6f06e987d5 tempest-VolumesTransfersV357Test-1520228763 None] Creating volume 570df5b5-6277-41fe-8d0e-22bc52ac3172 {{(pid=87098) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 13 13:55:42 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-3417be66-1fef-4992-9bbb-cb6f06e987d5 tempest-VolumesTransfersV357Test-1520228763 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:55:42 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-3417be66-1fef-4992-9bbb-cb6f06e987d5 tempest-VolumesTransfersV357Test-1520228763 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:55:42 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-3417be66-1fef-4992-9bbb-cb6f06e987d5 tempest-VolumesTransfersV357Test-1520228763 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 13:55:42 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-3417be66-1fef-4992-9bbb-cb6f06e987d5 tempest-VolumesTransfersV357Test-1520228763 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 13:55:42 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-3417be66-1fef-4992-9bbb-cb6f06e987d5 tempest-VolumesTransfersV357Test-1520228763 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:55:42 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-3417be66-1fef-4992-9bbb-cb6f06e987d5 tempest-VolumesTransfersV357Test-1520228763 None] Selected osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 13:55:42 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-3417be66-1fef-4992-9bbb-cb6f06e987d5 tempest-VolumesTransfersV357Test-1520228763 None] casted to osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 Jul 13 13:55:42 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-3417be66-1fef-4992-9bbb-cb6f06e987d5 tempest-VolumesTransfersV357Test-1520228763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-570df5b5-6277-41fe-8d0e-22bc52ac3172 1073741824 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:55:42 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-16b6f170-8858-49f9-bf8b-5e83e395e0dd tempest-VolumesActionsTest-1880950110 None] Copy volume to image completed successfully. Jul 13 13:55:42 devstack sudo[95780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-570df5b5-6277-41fe-8d0e-22bc52ac3172 1073741824 Jul 13 13:55:42 devstack sudo[95780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:55:43 devstack sudo[95780]: pam_unix(sudo:session): session closed for user root Jul 13 13:55:43 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-3417be66-1fef-4992-9bbb-cb6f06e987d5 tempest-VolumesTransfersV357Test-1520228763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-570df5b5-6277-41fe-8d0e-22bc52ac3172 1073741824" returned: 0 in 0.576s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:55:43 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-3417be66-1fef-4992-9bbb-cb6f06e987d5 tempest-VolumesTransfersV357Test-1520228763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-570df5b5-6277-41fe-8d0e-22bc52ac3172 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:55:43 devstack sudo[95786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-570df5b5-6277-41fe-8d0e-22bc52ac3172 Jul 13 13:55:43 devstack sudo[95786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:55:43 devstack sudo[95786]: pam_unix(sudo:session): session closed for user root Jul 13 13:55:43 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-3417be66-1fef-4992-9bbb-cb6f06e987d5 tempest-VolumesTransfersV357Test-1520228763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-570df5b5-6277-41fe-8d0e-22bc52ac3172" returned: 0 in 0.292s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:55:43 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-3417be66-1fef-4992-9bbb-cb6f06e987d5 tempest-VolumesTransfersV357Test-1520228763 None] <== create_volume: return (912ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'} {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 13 13:55:43 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-3417be66-1fef-4992-9bbb-cb6f06e987d5 tempest-VolumesTransfersV357Test-1520228763 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.916s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:55:43 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-3417be66-1fef-4992-9bbb-cb6f06e987d5 tempest-VolumesTransfersV357Test-1520228763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04c1d674-efea-4c62-8626-0c54a0bd1a6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-570df5b5-6277-41fe-8d0e-22bc52ac3172', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:55:43 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-3417be66-1fef-4992-9bbb-cb6f06e987d5 tempest-VolumesTransfersV357Test-1520228763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70faae04-08b4-4256-86e1-f765cf032b23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:55:43 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-3417be66-1fef-4992-9bbb-cb6f06e987d5 tempest-VolumesTransfersV357Test-1520228763 None] Volume volume-570df5b5-6277-41fe-8d0e-22bc52ac3172 (570df5b5-6277-41fe-8d0e-22bc52ac3172): created successfully Jul 13 13:55:43 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-3417be66-1fef-4992-9bbb-cb6f06e987d5 tempest-VolumesTransfersV357Test-1520228763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70faae04-08b4-4256-86e1-f765cf032b23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:55:43 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-3417be66-1fef-4992-9bbb-cb6f06e987d5 tempest-VolumesTransfersV357Test-1520228763 None] Flow 'volume_create_manager' (e28e8845-9cce-4acc-9f45-6391dca73e14) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 13:55:43 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-3417be66-1fef-4992-9bbb-cb6f06e987d5 tempest-VolumesTransfersV357Test-1520228763 None] Created volume successfully. Jul 13 13:55:43 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-9698deda-c144-492f-8ad6-757051d195fb tempest-VolumesActionsTest-1880950110 None] Acquiring lock "cinder-a52b84de-fb6a-46db-b2ae-b126c4a239c8-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 13:55:44 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-9698deda-c144-492f-8ad6-757051d195fb tempest-VolumesActionsTest-1880950110 None] Lock "cinder-a52b84de-fb6a-46db-b2ae-b126c4a239c8-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 13:55:44 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-b1d2b050-5c61-4ee4-8539-3026b785166d tempest-VolumeTypesAccessTest-851076711 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 13:55:44 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-b1d2b050-5c61-4ee4-8539-3026b785166d tempest-VolumeTypesAccessTest-851076711 None] Flow 'volume_create_manager' (1ca223a6-5084-453e-b28b-fbcff77dad33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 13:55:44 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-b1d2b050-5c61-4ee4-8539-3026b785166d tempest-VolumeTypesAccessTest-851076711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a48e3e04-d1e1-4332-be98-e1bdfd151a45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:55:44 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-b1d2b050-5c61-4ee4-8539-3026b785166d tempest-VolumeTypesAccessTest-851076711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a48e3e04-d1e1-4332-be98-e1bdfd151a45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T11:55:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1510401918',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=961d8b7b-defb-446a-8f71-fe848fbce9f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2bfb38751e7a4489b50044d112f294d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T11:55:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T11:55:44Z,use_quota=True,user_id='b86a1dfad191483d8f3421d24f51d154',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(885e4b26-7d71-4143-80c1-74ae7e621dbd),volume_type_id=885e4b26-7d71-4143-80c1-74ae7e621dbd)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:55:44 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-b1d2b050-5c61-4ee4-8539-3026b785166d tempest-VolumeTypesAccessTest-851076711 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c251ac94-fd51-4ead-ba8e-24e3c2ad4b03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:55:44 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-b1d2b050-5c61-4ee4-8539-3026b785166d tempest-VolumeTypesAccessTest-851076711 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c251ac94-fd51-4ead-ba8e-24e3c2ad4b03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:55:44 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-b1d2b050-5c61-4ee4-8539-3026b785166d tempest-VolumeTypesAccessTest-851076711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (adbdb293-3210-48bd-a5c9-ebc52055c070) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:55:44 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-b1d2b050-5c61-4ee4-8539-3026b785166d tempest-VolumeTypesAccessTest-851076711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (adbdb293-3210-48bd-a5c9-ebc52055c070) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '961d8b7b-defb-446a-8f71-fe848fbce9f2', 'volume_name': 'volume-961d8b7b-defb-446a-8f71-fe848fbce9f2', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:55:44 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-b1d2b050-5c61-4ee4-8539-3026b785166d tempest-VolumeTypesAccessTest-851076711 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a92fc5c1-47a3-4435-8d57-693b800dd7b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:55:44 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-b1d2b050-5c61-4ee4-8539-3026b785166d tempest-VolumeTypesAccessTest-851076711 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a92fc5c1-47a3-4435-8d57-693b800dd7b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:55:44 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-b1d2b050-5c61-4ee4-8539-3026b785166d tempest-VolumeTypesAccessTest-851076711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cdf7fa23-c9e0-46b6-b7c4-e8156c35e65b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:55:44 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-b1d2b050-5c61-4ee4-8539-3026b785166d tempest-VolumeTypesAccessTest-851076711 None] Volume 961d8b7b-defb-446a-8f71-fe848fbce9f2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-961d8b7b-defb-446a-8f71-fe848fbce9f2', 'volume_size': 1} Jul 13 13:55:44 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-b1d2b050-5c61-4ee4-8539-3026b785166d tempest-VolumeTypesAccessTest-851076711 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:55:44 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-b1d2b050-5c61-4ee4-8539-3026b785166d tempest-VolumeTypesAccessTest-851076711 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:55:44 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-b1d2b050-5c61-4ee4-8539-3026b785166d tempest-VolumeTypesAccessTest-851076711 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T11:55:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1510401918',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=961d8b7b-defb-446a-8f71-fe848fbce9f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2bfb38751e7a4489b50044d112f294d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T11:55:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T11:55:44Z,use_quota=True,user_id='b86a1dfad191483d8f3421d24f51d154',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(885e4b26-7d71-4143-80c1-74ae7e621dbd),volume_type_id=885e4b26-7d71-4143-80c1-74ae7e621dbd)}" {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 13 13:55:44 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-b1d2b050-5c61-4ee4-8539-3026b785166d tempest-VolumeTypesAccessTest-851076711 None] Creating volume 961d8b7b-defb-446a-8f71-fe848fbce9f2 {{(pid=87098) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 13 13:55:44 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-b1d2b050-5c61-4ee4-8539-3026b785166d tempest-VolumeTypesAccessTest-851076711 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:55:44 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-b1d2b050-5c61-4ee4-8539-3026b785166d tempest-VolumeTypesAccessTest-851076711 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:55:44 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-b1d2b050-5c61-4ee4-8539-3026b785166d tempest-VolumeTypesAccessTest-851076711 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 13:55:44 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-b1d2b050-5c61-4ee4-8539-3026b785166d tempest-VolumeTypesAccessTest-851076711 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 13:55:44 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-b1d2b050-5c61-4ee4-8539-3026b785166d tempest-VolumeTypesAccessTest-851076711 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:55:44 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-b1d2b050-5c61-4ee4-8539-3026b785166d tempest-VolumeTypesAccessTest-851076711 None] Selected osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 13:55:44 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-b1d2b050-5c61-4ee4-8539-3026b785166d tempest-VolumeTypesAccessTest-851076711 None] casted to osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 Jul 13 13:55:44 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-b1d2b050-5c61-4ee4-8539-3026b785166d tempest-VolumeTypesAccessTest-851076711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-961d8b7b-defb-446a-8f71-fe848fbce9f2 1073741824 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:55:44 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-9698deda-c144-492f-8ad6-757051d195fb tempest-VolumesActionsTest-1880950110 None] Acquiring lock "cinder-quobyte-a52b84de-fb6a-46db-b2ae-b126c4a239c8" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 13:55:44 devstack sudo[95789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-961d8b7b-defb-446a-8f71-fe848fbce9f2 1073741824 Jul 13 13:55:44 devstack sudo[95789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:55:44 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-9698deda-c144-492f-8ad6-757051d195fb tempest-VolumesActionsTest-1880950110 None] Lock "cinder-quobyte-a52b84de-fb6a-46db-b2ae-b126c4a239c8" acquired by "delete_volume" :: waited 0.015s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 13:55:44 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[a360bf33-e8f7-4039-ad67-0bb7416bb878]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 13:55:44 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-9698deda-c144-492f-8ad6-757051d195fb tempest-VolumesActionsTest-1880950110 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-a52b84de-fb6a-46db-b2ae-b126c4a239c8 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:55:44 devstack sudo[95791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-a52b84de-fb6a-46db-b2ae-b126c4a239c8 Jul 13 13:55:44 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-a86b172c-aac4-4a84-a44e-a630d2ce5624 tempest-VolumesTransfersV357Test-956505013 None] Acquiring lock "cinder-570df5b5-6277-41fe-8d0e-22bc52ac3172-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 13:55:44 devstack sudo[95791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:55:44 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-a86b172c-aac4-4a84-a44e-a630d2ce5624 tempest-VolumesTransfersV357Test-956505013 None] Lock "cinder-570df5b5-6277-41fe-8d0e-22bc52ac3172-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 13:55:44 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-a86b172c-aac4-4a84-a44e-a630d2ce5624 tempest-VolumesTransfersV357Test-956505013 None] Acquiring lock "cinder-quobyte-570df5b5-6277-41fe-8d0e-22bc52ac3172" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 13:55:44 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-a86b172c-aac4-4a84-a44e-a630d2ce5624 tempest-VolumesTransfersV357Test-956505013 None] Lock "cinder-quobyte-570df5b5-6277-41fe-8d0e-22bc52ac3172" acquired by "delete_volume" :: waited 0.029s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 13:55:44 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[792a93e5-a5e3-4846-8c92-3738b8282d13]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 13:55:44 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-a86b172c-aac4-4a84-a44e-a630d2ce5624 tempest-VolumesTransfersV357Test-956505013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-570df5b5-6277-41fe-8d0e-22bc52ac3172 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:55:44 devstack sudo[95796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-570df5b5-6277-41fe-8d0e-22bc52ac3172 Jul 13 13:55:44 devstack sudo[95796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:55:44 devstack sudo[95789]: pam_unix(sudo:session): session closed for user root Jul 13 13:55:44 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-b1d2b050-5c61-4ee4-8539-3026b785166d tempest-VolumeTypesAccessTest-851076711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-961d8b7b-defb-446a-8f71-fe848fbce9f2 1073741824" returned: 0 in 0.551s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:55:44 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-b1d2b050-5c61-4ee4-8539-3026b785166d tempest-VolumeTypesAccessTest-851076711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-961d8b7b-defb-446a-8f71-fe848fbce9f2 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:55:44 devstack sudo[95791]: pam_unix(sudo:session): session closed for user root Jul 13 13:55:44 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-9698deda-c144-492f-8ad6-757051d195fb tempest-VolumesActionsTest-1880950110 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-a52b84de-fb6a-46db-b2ae-b126c4a239c8" returned: 0 in 0.542s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:55:44 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-9698deda-c144-492f-8ad6-757051d195fb tempest-VolumesActionsTest-1880950110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-a52b84de-fb6a-46db-b2ae-b126c4a239c8 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:55:44 devstack sudo[95802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-961d8b7b-defb-446a-8f71-fe848fbce9f2 Jul 13 13:55:44 devstack sudo[95802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:55:44 devstack sudo[95803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-a52b84de-fb6a-46db-b2ae-b126c4a239c8 Jul 13 13:55:44 devstack sudo[95803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:55:45 devstack sudo[95796]: pam_unix(sudo:session): session closed for user root Jul 13 13:55:45 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-a86b172c-aac4-4a84-a44e-a630d2ce5624 tempest-VolumesTransfersV357Test-956505013 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-570df5b5-6277-41fe-8d0e-22bc52ac3172" returned: 0 in 0.514s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:55:45 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-a86b172c-aac4-4a84-a44e-a630d2ce5624 tempest-VolumesTransfersV357Test-956505013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-570df5b5-6277-41fe-8d0e-22bc52ac3172 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:55:45 devstack sudo[95811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-570df5b5-6277-41fe-8d0e-22bc52ac3172 Jul 13 13:55:45 devstack sudo[95811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:55:45 devstack sudo[95803]: pam_unix(sudo:session): session closed for user root Jul 13 13:55:45 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-9698deda-c144-492f-8ad6-757051d195fb tempest-VolumesActionsTest-1880950110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-a52b84de-fb6a-46db-b2ae-b126c4a239c8" returned: 0 in 0.311s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:55:45 devstack sudo[95802]: pam_unix(sudo:session): session closed for user root Jul 13 13:55:45 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-9698deda-c144-492f-8ad6-757051d195fb tempest-VolumesActionsTest-1880950110 None] Lock "cinder-quobyte-a52b84de-fb6a-46db-b2ae-b126c4a239c8" released by "delete_volume" :: held 0.912s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 13:55:45 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-b1d2b050-5c61-4ee4-8539-3026b785166d tempest-VolumeTypesAccessTest-851076711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-961d8b7b-defb-446a-8f71-fe848fbce9f2" returned: 0 in 0.373s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:55:45 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-b1d2b050-5c61-4ee4-8539-3026b785166d tempest-VolumeTypesAccessTest-851076711 None] <== create_volume: return (976ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'} {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 13 13:55:45 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-b1d2b050-5c61-4ee4-8539-3026b785166d tempest-VolumeTypesAccessTest-851076711 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.979s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:55:45 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-b1d2b050-5c61-4ee4-8539-3026b785166d tempest-VolumeTypesAccessTest-851076711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cdf7fa23-c9e0-46b6-b7c4-e8156c35e65b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-961d8b7b-defb-446a-8f71-fe848fbce9f2', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:55:45 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-b1d2b050-5c61-4ee4-8539-3026b785166d tempest-VolumeTypesAccessTest-851076711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42cb6d22-7eb9-4b7f-bd91-a55a7d1b7edb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:55:45 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-b1d2b050-5c61-4ee4-8539-3026b785166d tempest-VolumeTypesAccessTest-851076711 None] Volume volume-961d8b7b-defb-446a-8f71-fe848fbce9f2 (961d8b7b-defb-446a-8f71-fe848fbce9f2): created successfully Jul 13 13:55:45 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-b1d2b050-5c61-4ee4-8539-3026b785166d tempest-VolumeTypesAccessTest-851076711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42cb6d22-7eb9-4b7f-bd91-a55a7d1b7edb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:55:45 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-b1d2b050-5c61-4ee4-8539-3026b785166d tempest-VolumeTypesAccessTest-851076711 None] Flow 'volume_create_manager' (1ca223a6-5084-453e-b28b-fbcff77dad33) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 13:55:45 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-b1d2b050-5c61-4ee4-8539-3026b785166d tempest-VolumeTypesAccessTest-851076711 None] Created volume successfully. Jul 13 13:55:45 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-9698deda-c144-492f-8ad6-757051d195fb tempest-VolumesActionsTest-1880950110 None] Created reservations ['576cb78f-be9b-46cf-b6f5-629236a7330d', 'e842e403-33c0-4916-acac-16becf9fc746', 'e408e208-6b01-423c-973c-9121a7b4cead', '57cd1cb0-0217-4222-b071-96f9f05597dc'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 13:55:45 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-9698deda-c144-492f-8ad6-757051d195fb tempest-VolumesActionsTest-1880950110 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:55:45 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-9698deda-c144-492f-8ad6-757051d195fb tempest-VolumesActionsTest-1880950110 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:55:45 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-9698deda-c144-492f-8ad6-757051d195fb tempest-VolumesActionsTest-1880950110 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 13:55:45 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-9698deda-c144-492f-8ad6-757051d195fb tempest-VolumesActionsTest-1880950110 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 13:55:45 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-9698deda-c144-492f-8ad6-757051d195fb tempest-VolumesActionsTest-1880950110 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:55:45 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-9698deda-c144-492f-8ad6-757051d195fb tempest-VolumesActionsTest-1880950110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:55:45 devstack sudo[95811]: pam_unix(sudo:session): session closed for user root Jul 13 13:55:45 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-a86b172c-aac4-4a84-a44e-a630d2ce5624 tempest-VolumesTransfersV357Test-956505013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-570df5b5-6277-41fe-8d0e-22bc52ac3172" returned: 0 in 0.289s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:55:45 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-a86b172c-aac4-4a84-a44e-a630d2ce5624 tempest-VolumesTransfersV357Test-956505013 None] Lock "cinder-quobyte-570df5b5-6277-41fe-8d0e-22bc52ac3172" released by "delete_volume" :: held 0.849s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 13:55:45 devstack sudo[95815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 Jul 13 13:55:45 devstack sudo[95815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:55:45 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-a86b172c-aac4-4a84-a44e-a630d2ce5624 tempest-VolumesTransfersV357Test-956505013 None] Created reservations ['c9efeebd-c00a-4063-b7bd-cf724f759a1f', 'cd351891-0976-4fa0-a03d-3401e68477e2', '7c619f61-4d99-4c96-b5f2-bea0baed4f30', '159f65fd-5330-47c8-b3a0-e1548b08c74b'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 13:55:45 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-a86b172c-aac4-4a84-a44e-a630d2ce5624 tempest-VolumesTransfersV357Test-956505013 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:55:45 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-a86b172c-aac4-4a84-a44e-a630d2ce5624 tempest-VolumesTransfersV357Test-956505013 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:55:45 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-a86b172c-aac4-4a84-a44e-a630d2ce5624 tempest-VolumesTransfersV357Test-956505013 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 13:55:45 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-a86b172c-aac4-4a84-a44e-a630d2ce5624 tempest-VolumesTransfersV357Test-956505013 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 13:55:45 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-a86b172c-aac4-4a84-a44e-a630d2ce5624 tempest-VolumesTransfersV357Test-956505013 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:55:45 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-a86b172c-aac4-4a84-a44e-a630d2ce5624 tempest-VolumesTransfersV357Test-956505013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:55:45 devstack sudo[95817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 Jul 13 13:55:45 devstack sudo[95817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:55:45 devstack sudo[95815]: pam_unix(sudo:session): session closed for user root Jul 13 13:55:45 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-9698deda-c144-492f-8ad6-757051d195fb tempest-VolumesActionsTest-1880950110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78" returned: 0 in 0.320s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:55:45 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-9698deda-c144-492f-8ad6-757051d195fb tempest-VolumesActionsTest-1880950110 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 13:55:45 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-9698deda-c144-492f-8ad6-757051d195fb tempest-VolumesActionsTest-1880950110 None] Deleted volume successfully. Jul 13 13:55:45 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-9698deda-c144-492f-8ad6-757051d195fb tempest-VolumesActionsTest-1880950110 None] Lock "cinder-a52b84de-fb6a-46db-b2ae-b126c4a239c8-delete_volume" released by "delete_volume" :: held 1.660s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 13:55:45 devstack sudo[95817]: pam_unix(sudo:session): session closed for user root Jul 13 13:55:45 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-a86b172c-aac4-4a84-a44e-a630d2ce5624 tempest-VolumesTransfersV357Test-956505013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78" returned: 0 in 0.310s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:55:45 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-a86b172c-aac4-4a84-a44e-a630d2ce5624 tempest-VolumesTransfersV357Test-956505013 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 13:55:45 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-a86b172c-aac4-4a84-a44e-a630d2ce5624 tempest-VolumesTransfersV357Test-956505013 None] Deleted volume successfully. Jul 13 13:55:45 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-a86b172c-aac4-4a84-a44e-a630d2ce5624 tempest-VolumesTransfersV357Test-956505013 None] Lock "cinder-570df5b5-6277-41fe-8d0e-22bc52ac3172-delete_volume" released by "delete_volume" :: held 1.385s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 13:55:46 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-73cc2729-b840-43c6-aa15-490c067a355e tempest-VolumeTypesAccessTest-851076711 None] Acquiring lock "cinder-961d8b7b-defb-446a-8f71-fe848fbce9f2-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 13:55:46 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-73cc2729-b840-43c6-aa15-490c067a355e tempest-VolumeTypesAccessTest-851076711 None] Lock "cinder-961d8b7b-defb-446a-8f71-fe848fbce9f2-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 13:55:46 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-73cc2729-b840-43c6-aa15-490c067a355e tempest-VolumeTypesAccessTest-851076711 None] Acquiring lock "cinder-quobyte-961d8b7b-defb-446a-8f71-fe848fbce9f2" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 13:55:46 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-73cc2729-b840-43c6-aa15-490c067a355e tempest-VolumeTypesAccessTest-851076711 None] Lock "cinder-quobyte-961d8b7b-defb-446a-8f71-fe848fbce9f2" acquired by "delete_volume" :: waited 0.022s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 13:55:46 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[cedd1743-f7cd-46fc-8d99-8cd567c231bc]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 13:55:46 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-73cc2729-b840-43c6-aa15-490c067a355e tempest-VolumeTypesAccessTest-851076711 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-961d8b7b-defb-446a-8f71-fe848fbce9f2 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:55:46 devstack sudo[95821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-961d8b7b-defb-446a-8f71-fe848fbce9f2 Jul 13 13:55:46 devstack sudo[95821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:55:46 devstack sudo[95821]: pam_unix(sudo:session): session closed for user root Jul 13 13:55:46 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-73cc2729-b840-43c6-aa15-490c067a355e tempest-VolumeTypesAccessTest-851076711 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-961d8b7b-defb-446a-8f71-fe848fbce9f2" returned: 0 in 0.547s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:55:46 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-73cc2729-b840-43c6-aa15-490c067a355e tempest-VolumeTypesAccessTest-851076711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-961d8b7b-defb-446a-8f71-fe848fbce9f2 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:55:46 devstack sudo[95828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-961d8b7b-defb-446a-8f71-fe848fbce9f2 Jul 13 13:55:46 devstack sudo[95828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:55:47 devstack sudo[95828]: pam_unix(sudo:session): session closed for user root Jul 13 13:55:47 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-73cc2729-b840-43c6-aa15-490c067a355e tempest-VolumeTypesAccessTest-851076711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-961d8b7b-defb-446a-8f71-fe848fbce9f2" returned: 0 in 0.353s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:55:47 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-73cc2729-b840-43c6-aa15-490c067a355e tempest-VolumeTypesAccessTest-851076711 None] Lock "cinder-quobyte-961d8b7b-defb-446a-8f71-fe848fbce9f2" released by "delete_volume" :: held 0.970s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 13:55:47 devstack cinder-volume[87098]: WARNING cinder.quota [None req-73cc2729-b840-43c6-aa15-490c067a355e tempest-VolumeTypesAccessTest-851076711 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1434533555 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1434533555, it is now deprecated. Please use the default quota class for default quota. Jul 13 13:55:47 devstack cinder-volume[87098]: WARNING cinder.quota [None req-73cc2729-b840-43c6-aa15-490c067a355e tempest-VolumeTypesAccessTest-851076711 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1434533555 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1434533555, it is now deprecated. Please use the default quota class for default quota. Jul 13 13:55:47 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-73cc2729-b840-43c6-aa15-490c067a355e tempest-VolumeTypesAccessTest-851076711 None] Created reservations ['089f0c43-6422-4aec-9681-6f2baea61e82', '48d2c1f8-15b2-4a98-864a-9d51dee62ea5', 'a37ccd4f-9eb3-4e8c-806c-c6e7b9fef596', 'eb054a2f-03a8-489c-9264-9776583955e2'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 13:55:47 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-73cc2729-b840-43c6-aa15-490c067a355e tempest-VolumeTypesAccessTest-851076711 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:55:47 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-73cc2729-b840-43c6-aa15-490c067a355e tempest-VolumeTypesAccessTest-851076711 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:55:47 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-73cc2729-b840-43c6-aa15-490c067a355e tempest-VolumeTypesAccessTest-851076711 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 13:55:47 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-73cc2729-b840-43c6-aa15-490c067a355e tempest-VolumeTypesAccessTest-851076711 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 13:55:47 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-73cc2729-b840-43c6-aa15-490c067a355e tempest-VolumeTypesAccessTest-851076711 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:55:47 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-73cc2729-b840-43c6-aa15-490c067a355e tempest-VolumeTypesAccessTest-851076711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:55:47 devstack sudo[95831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 Jul 13 13:55:47 devstack sudo[95831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:55:47 devstack sudo[95831]: pam_unix(sudo:session): session closed for user root Jul 13 13:55:47 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-73cc2729-b840-43c6-aa15-490c067a355e tempest-VolumeTypesAccessTest-851076711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78" returned: 0 in 0.275s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:55:47 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-73cc2729-b840-43c6-aa15-490c067a355e tempest-VolumeTypesAccessTest-851076711 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 13:55:47 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-73cc2729-b840-43c6-aa15-490c067a355e tempest-VolumeTypesAccessTest-851076711 None] Deleted volume successfully. Jul 13 13:55:47 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-73cc2729-b840-43c6-aa15-490c067a355e tempest-VolumeTypesAccessTest-851076711 None] Lock "cinder-961d8b7b-defb-446a-8f71-fe848fbce9f2-delete_volume" released by "delete_volume" :: held 1.566s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 13:55:52 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-3d778f21-da46-4243-845c-4e92a18a9030 tempest-VolumesSnapshotListTestJSON-2079198915 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 13:55:52 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-3d778f21-da46-4243-845c-4e92a18a9030 tempest-VolumesSnapshotListTestJSON-2079198915 None] Flow 'volume_create_manager' (cba1dd92-8416-4ea7-a8e9-550b74dc463a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 13:55:52 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-3d778f21-da46-4243-845c-4e92a18a9030 tempest-VolumesSnapshotListTestJSON-2079198915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef6394fd-c72b-44bb-892b-001eb971d53d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:55:53 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-3d778f21-da46-4243-845c-4e92a18a9030 tempest-VolumesSnapshotListTestJSON-2079198915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef6394fd-c72b-44bb-892b-001eb971d53d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T11:55:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-67517739',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0f90412-6f60-4a82-852a-f8b8820e313f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67691a1260f943ed8a35e26f83842b96',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T11:55:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T11:55:53Z,use_quota=True,user_id='35887a230d7a4c77886269996d044672',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1147de8b-623b-426c-a13d-7fc824a80f67),volume_type_id=1147de8b-623b-426c-a13d-7fc824a80f67)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:55:53 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-3d778f21-da46-4243-845c-4e92a18a9030 tempest-VolumesSnapshotListTestJSON-2079198915 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3cb2f984-8d52-4cba-9864-edebdd8b9f1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:55:53 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-3d778f21-da46-4243-845c-4e92a18a9030 tempest-VolumesSnapshotListTestJSON-2079198915 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3cb2f984-8d52-4cba-9864-edebdd8b9f1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:55:53 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-3d778f21-da46-4243-845c-4e92a18a9030 tempest-VolumesSnapshotListTestJSON-2079198915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17c656eb-342a-48ef-941f-5217a7aecd89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:55:53 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-3d778f21-da46-4243-845c-4e92a18a9030 tempest-VolumesSnapshotListTestJSON-2079198915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17c656eb-342a-48ef-941f-5217a7aecd89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f0f90412-6f60-4a82-852a-f8b8820e313f', 'volume_name': 'volume-f0f90412-6f60-4a82-852a-f8b8820e313f', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:55:53 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-3d778f21-da46-4243-845c-4e92a18a9030 tempest-VolumesSnapshotListTestJSON-2079198915 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eec57daf-7b98-4bce-b1df-e2b7822342cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:55:53 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-3d778f21-da46-4243-845c-4e92a18a9030 tempest-VolumesSnapshotListTestJSON-2079198915 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eec57daf-7b98-4bce-b1df-e2b7822342cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:55:53 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-3d778f21-da46-4243-845c-4e92a18a9030 tempest-VolumesSnapshotListTestJSON-2079198915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22e7638a-05ae-4340-b7ec-3577911392c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:55:53 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-3d778f21-da46-4243-845c-4e92a18a9030 tempest-VolumesSnapshotListTestJSON-2079198915 None] Volume f0f90412-6f60-4a82-852a-f8b8820e313f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f0f90412-6f60-4a82-852a-f8b8820e313f', 'volume_size': 1} Jul 13 13:55:53 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-3d778f21-da46-4243-845c-4e92a18a9030 tempest-VolumesSnapshotListTestJSON-2079198915 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:55:53 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-3d778f21-da46-4243-845c-4e92a18a9030 tempest-VolumesSnapshotListTestJSON-2079198915 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:55:53 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-3d778f21-da46-4243-845c-4e92a18a9030 tempest-VolumesSnapshotListTestJSON-2079198915 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T11:55:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-67517739',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0f90412-6f60-4a82-852a-f8b8820e313f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67691a1260f943ed8a35e26f83842b96',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T11:55:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T11:55:53Z,use_quota=True,user_id='35887a230d7a4c77886269996d044672',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1147de8b-623b-426c-a13d-7fc824a80f67),volume_type_id=1147de8b-623b-426c-a13d-7fc824a80f67)}" {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 13 13:55:53 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-3d778f21-da46-4243-845c-4e92a18a9030 tempest-VolumesSnapshotListTestJSON-2079198915 None] Creating volume f0f90412-6f60-4a82-852a-f8b8820e313f {{(pid=87098) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 13 13:55:53 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-3d778f21-da46-4243-845c-4e92a18a9030 tempest-VolumesSnapshotListTestJSON-2079198915 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:55:53 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-3d778f21-da46-4243-845c-4e92a18a9030 tempest-VolumesSnapshotListTestJSON-2079198915 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:55:53 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-3d778f21-da46-4243-845c-4e92a18a9030 tempest-VolumesSnapshotListTestJSON-2079198915 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 13:55:53 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-3d778f21-da46-4243-845c-4e92a18a9030 tempest-VolumesSnapshotListTestJSON-2079198915 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 13:55:53 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-3d778f21-da46-4243-845c-4e92a18a9030 tempest-VolumesSnapshotListTestJSON-2079198915 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:55:53 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-3d778f21-da46-4243-845c-4e92a18a9030 tempest-VolumesSnapshotListTestJSON-2079198915 None] Selected osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 13:55:53 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-3d778f21-da46-4243-845c-4e92a18a9030 tempest-VolumesSnapshotListTestJSON-2079198915 None] casted to osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 Jul 13 13:55:53 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-3d778f21-da46-4243-845c-4e92a18a9030 tempest-VolumesSnapshotListTestJSON-2079198915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-f0f90412-6f60-4a82-852a-f8b8820e313f 1073741824 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:55:53 devstack sudo[95837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-f0f90412-6f60-4a82-852a-f8b8820e313f 1073741824 Jul 13 13:55:53 devstack sudo[95837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:55:53 devstack sudo[95837]: pam_unix(sudo:session): session closed for user root Jul 13 13:55:53 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-3d778f21-da46-4243-845c-4e92a18a9030 tempest-VolumesSnapshotListTestJSON-2079198915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-f0f90412-6f60-4a82-852a-f8b8820e313f 1073741824" returned: 0 in 0.616s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:55:53 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-3d778f21-da46-4243-845c-4e92a18a9030 tempest-VolumesSnapshotListTestJSON-2079198915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-f0f90412-6f60-4a82-852a-f8b8820e313f {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:55:53 devstack sudo[95843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-f0f90412-6f60-4a82-852a-f8b8820e313f Jul 13 13:55:53 devstack sudo[95843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:55:53 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-82f14080-3ee3-4ca5-8219-93da05bb37b1 tempest-VolumesCloneTest-833146978 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 13:55:53 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-82f14080-3ee3-4ca5-8219-93da05bb37b1 tempest-VolumesCloneTest-833146978 None] Flow 'volume_create_manager' (fc23b8f4-adf9-40b6-a06b-9396fbf56338) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 13:55:53 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-82f14080-3ee3-4ca5-8219-93da05bb37b1 tempest-VolumesCloneTest-833146978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67e83df9-092a-4011-99da-6395f5d1aa88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:55:53 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-82f14080-3ee3-4ca5-8219-93da05bb37b1 tempest-VolumesCloneTest-833146978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67e83df9-092a-4011-99da-6395f5d1aa88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T11:55:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1068156898',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79c70162-3aa3-4255-aa20-1f9d3ca8440f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4f6f5146da04eae8d39e9cd0e82de07',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T11:55:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T11:55:54Z,use_quota=True,user_id='7089faee90fe41dba327f110d57c0483',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1147de8b-623b-426c-a13d-7fc824a80f67),volume_type_id=1147de8b-623b-426c-a13d-7fc824a80f67)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:55:53 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-82f14080-3ee3-4ca5-8219-93da05bb37b1 tempest-VolumesCloneTest-833146978 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1ac5996-827a-4a0d-9950-268af0ec4a45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:55:53 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-82f14080-3ee3-4ca5-8219-93da05bb37b1 tempest-VolumesCloneTest-833146978 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1ac5996-827a-4a0d-9950-268af0ec4a45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:55:53 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-82f14080-3ee3-4ca5-8219-93da05bb37b1 tempest-VolumesCloneTest-833146978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13ff976e-73a9-4915-bc08-c10c08e54b68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:55:53 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-82f14080-3ee3-4ca5-8219-93da05bb37b1 tempest-VolumesCloneTest-833146978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13ff976e-73a9-4915-bc08-c10c08e54b68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '79c70162-3aa3-4255-aa20-1f9d3ca8440f', 'volume_name': 'volume-79c70162-3aa3-4255-aa20-1f9d3ca8440f', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:55:53 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-82f14080-3ee3-4ca5-8219-93da05bb37b1 tempest-VolumesCloneTest-833146978 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71ab7042-f05a-4182-8e00-232d4cdda908) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:55:53 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-82f14080-3ee3-4ca5-8219-93da05bb37b1 tempest-VolumesCloneTest-833146978 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71ab7042-f05a-4182-8e00-232d4cdda908) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:55:53 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-82f14080-3ee3-4ca5-8219-93da05bb37b1 tempest-VolumesCloneTest-833146978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70452847-779c-415f-bd82-6d07283894c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:55:53 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-82f14080-3ee3-4ca5-8219-93da05bb37b1 tempest-VolumesCloneTest-833146978 None] Volume 79c70162-3aa3-4255-aa20-1f9d3ca8440f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-79c70162-3aa3-4255-aa20-1f9d3ca8440f', 'volume_size': 1} Jul 13 13:55:53 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-82f14080-3ee3-4ca5-8219-93da05bb37b1 tempest-VolumesCloneTest-833146978 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:55:54 devstack sudo[95843]: pam_unix(sudo:session): session closed for user root Jul 13 13:55:54 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-3d778f21-da46-4243-845c-4e92a18a9030 tempest-VolumesSnapshotListTestJSON-2079198915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-f0f90412-6f60-4a82-852a-f8b8820e313f" returned: 0 in 0.349s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:55:54 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-3d778f21-da46-4243-845c-4e92a18a9030 tempest-VolumesSnapshotListTestJSON-2079198915 None] <== create_volume: return (1022ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'} {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 13 13:55:54 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-3d778f21-da46-4243-845c-4e92a18a9030 tempest-VolumesSnapshotListTestJSON-2079198915 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.025s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:55:54 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-82f14080-3ee3-4ca5-8219-93da05bb37b1 tempest-VolumesCloneTest-833146978 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.110s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:55:54 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-82f14080-3ee3-4ca5-8219-93da05bb37b1 tempest-VolumesCloneTest-833146978 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T11:55:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1068156898',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79c70162-3aa3-4255-aa20-1f9d3ca8440f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4f6f5146da04eae8d39e9cd0e82de07',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T11:55:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T11:55:54Z,use_quota=True,user_id='7089faee90fe41dba327f110d57c0483',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1147de8b-623b-426c-a13d-7fc824a80f67),volume_type_id=1147de8b-623b-426c-a13d-7fc824a80f67)}" {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 13 13:55:54 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-82f14080-3ee3-4ca5-8219-93da05bb37b1 tempest-VolumesCloneTest-833146978 None] Creating volume 79c70162-3aa3-4255-aa20-1f9d3ca8440f {{(pid=87098) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 13 13:55:54 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-82f14080-3ee3-4ca5-8219-93da05bb37b1 tempest-VolumesCloneTest-833146978 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:55:54 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-82f14080-3ee3-4ca5-8219-93da05bb37b1 tempest-VolumesCloneTest-833146978 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:55:54 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-82f14080-3ee3-4ca5-8219-93da05bb37b1 tempest-VolumesCloneTest-833146978 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 13:55:54 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-82f14080-3ee3-4ca5-8219-93da05bb37b1 tempest-VolumesCloneTest-833146978 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 13:55:54 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-82f14080-3ee3-4ca5-8219-93da05bb37b1 tempest-VolumesCloneTest-833146978 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:55:54 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-82f14080-3ee3-4ca5-8219-93da05bb37b1 tempest-VolumesCloneTest-833146978 None] Selected osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 13:55:54 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-82f14080-3ee3-4ca5-8219-93da05bb37b1 tempest-VolumesCloneTest-833146978 None] casted to osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 Jul 13 13:55:54 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-82f14080-3ee3-4ca5-8219-93da05bb37b1 tempest-VolumesCloneTest-833146978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-79c70162-3aa3-4255-aa20-1f9d3ca8440f 1073741824 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:55:54 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-3d778f21-da46-4243-845c-4e92a18a9030 tempest-VolumesSnapshotListTestJSON-2079198915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22e7638a-05ae-4340-b7ec-3577911392c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f0f90412-6f60-4a82-852a-f8b8820e313f', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:55:54 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-3d778f21-da46-4243-845c-4e92a18a9030 tempest-VolumesSnapshotListTestJSON-2079198915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92284a1c-395c-4e25-8319-7eeb5f180360) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:55:54 devstack sudo[95846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-79c70162-3aa3-4255-aa20-1f9d3ca8440f 1073741824 Jul 13 13:55:54 devstack sudo[95846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:55:54 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-3d778f21-da46-4243-845c-4e92a18a9030 tempest-VolumesSnapshotListTestJSON-2079198915 None] Volume volume-f0f90412-6f60-4a82-852a-f8b8820e313f (f0f90412-6f60-4a82-852a-f8b8820e313f): created successfully Jul 13 13:55:54 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-3d778f21-da46-4243-845c-4e92a18a9030 tempest-VolumesSnapshotListTestJSON-2079198915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92284a1c-395c-4e25-8319-7eeb5f180360) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:55:54 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-3d778f21-da46-4243-845c-4e92a18a9030 tempest-VolumesSnapshotListTestJSON-2079198915 None] Flow 'volume_create_manager' (cba1dd92-8416-4ea7-a8e9-550b74dc463a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 13:55:54 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-3d778f21-da46-4243-845c-4e92a18a9030 tempest-VolumesSnapshotListTestJSON-2079198915 None] Created volume successfully. Jul 13 13:55:54 devstack sudo[95846]: pam_unix(sudo:session): session closed for user root Jul 13 13:55:54 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-82f14080-3ee3-4ca5-8219-93da05bb37b1 tempest-VolumesCloneTest-833146978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-79c70162-3aa3-4255-aa20-1f9d3ca8440f 1073741824" returned: 0 in 0.446s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:55:54 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-82f14080-3ee3-4ca5-8219-93da05bb37b1 tempest-VolumesCloneTest-833146978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-79c70162-3aa3-4255-aa20-1f9d3ca8440f {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:55:54 devstack sudo[95852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-79c70162-3aa3-4255-aa20-1f9d3ca8440f Jul 13 13:55:54 devstack sudo[95852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:55:54 devstack sudo[95852]: pam_unix(sudo:session): session closed for user root Jul 13 13:55:54 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-82f14080-3ee3-4ca5-8219-93da05bb37b1 tempest-VolumesCloneTest-833146978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-79c70162-3aa3-4255-aa20-1f9d3ca8440f" returned: 0 in 0.256s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:55:54 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-82f14080-3ee3-4ca5-8219-93da05bb37b1 tempest-VolumesCloneTest-833146978 None] <== create_volume: return (741ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'} {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 13 13:55:54 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-82f14080-3ee3-4ca5-8219-93da05bb37b1 tempest-VolumesCloneTest-833146978 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.744s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:55:54 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-82f14080-3ee3-4ca5-8219-93da05bb37b1 tempest-VolumesCloneTest-833146978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70452847-779c-415f-bd82-6d07283894c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-79c70162-3aa3-4255-aa20-1f9d3ca8440f', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:55:54 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-82f14080-3ee3-4ca5-8219-93da05bb37b1 tempest-VolumesCloneTest-833146978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a9f64c1-993f-40c1-98b8-3521612914c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:55:54 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-82f14080-3ee3-4ca5-8219-93da05bb37b1 tempest-VolumesCloneTest-833146978 None] Volume volume-79c70162-3aa3-4255-aa20-1f9d3ca8440f (79c70162-3aa3-4255-aa20-1f9d3ca8440f): created successfully Jul 13 13:55:54 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-82f14080-3ee3-4ca5-8219-93da05bb37b1 tempest-VolumesCloneTest-833146978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a9f64c1-993f-40c1-98b8-3521612914c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:55:54 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-82f14080-3ee3-4ca5-8219-93da05bb37b1 tempest-VolumesCloneTest-833146978 None] Flow 'volume_create_manager' (fc23b8f4-adf9-40b6-a06b-9396fbf56338) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 13:55:54 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-82f14080-3ee3-4ca5-8219-93da05bb37b1 tempest-VolumesCloneTest-833146978 None] Created volume successfully. Jul 13 13:55:55 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-569da863-6493-4b3f-8a5c-14370f58d134 tempest-VolumesSnapshotListTestJSON-2079198915 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:55:55 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-569da863-6493-4b3f-8a5c-14370f58d134 tempest-VolumesSnapshotListTestJSON-2079198915 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:55:55 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-569da863-6493-4b3f-8a5c-14370f58d134 tempest-VolumesSnapshotListTestJSON-2079198915 None] Creating offline snapshot 9f45a9cc-1d93-4da8-9e63-c52e29ffb1ec of volume f0f90412-6f60-4a82-852a-f8b8820e313f {{(pid=87098) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 13 13:55:55 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[39cd26b9-21d2-4e05-84fe-e9c08e4ae057]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 13:55:55 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-569da863-6493-4b3f-8a5c-14370f58d134 tempest-VolumesSnapshotListTestJSON-2079198915 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-f0f90412-6f60-4a82-852a-f8b8820e313f {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:55:55 devstack sudo[95855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-f0f90412-6f60-4a82-852a-f8b8820e313f Jul 13 13:55:55 devstack sudo[95855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:55:55 devstack sudo[95855]: pam_unix(sudo:session): session closed for user root Jul 13 13:55:55 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-569da863-6493-4b3f-8a5c-14370f58d134 tempest-VolumesSnapshotListTestJSON-2079198915 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-f0f90412-6f60-4a82-852a-f8b8820e313f" returned: 0 in 0.379s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:55:55 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-569da863-6493-4b3f-8a5c-14370f58d134 tempest-VolumesSnapshotListTestJSON-2079198915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-f0f90412-6f60-4a82-852a-f8b8820e313f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-f0f90412-6f60-4a82-852a-f8b8820e313f.9f45a9cc-1d93-4da8-9e63-c52e29ffb1ec 1G {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:55:55 devstack sudo[95860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-f0f90412-6f60-4a82-852a-f8b8820e313f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-f0f90412-6f60-4a82-852a-f8b8820e313f.9f45a9cc-1d93-4da8-9e63-c52e29ffb1ec 1G Jul 13 13:55:55 devstack sudo[95860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:55:56 devstack sudo[95860]: pam_unix(sudo:session): session closed for user root Jul 13 13:55:56 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-569da863-6493-4b3f-8a5c-14370f58d134 tempest-VolumesSnapshotListTestJSON-2079198915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-f0f90412-6f60-4a82-852a-f8b8820e313f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-f0f90412-6f60-4a82-852a-f8b8820e313f.9f45a9cc-1d93-4da8-9e63-c52e29ffb1ec 1G" returned: 0 in 0.449s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:55:56 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-569da863-6493-4b3f-8a5c-14370f58d134 tempest-VolumesSnapshotListTestJSON-2079198915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f0f90412-6f60-4a82-852a-f8b8820e313f -F qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-f0f90412-6f60-4a82-852a-f8b8820e313f.9f45a9cc-1d93-4da8-9e63-c52e29ffb1ec {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:55:56 devstack sudo[95866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f0f90412-6f60-4a82-852a-f8b8820e313f -F qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-f0f90412-6f60-4a82-852a-f8b8820e313f.9f45a9cc-1d93-4da8-9e63-c52e29ffb1ec Jul 13 13:55:56 devstack sudo[95866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:55:56 devstack sudo[95866]: pam_unix(sudo:session): session closed for user root Jul 13 13:55:56 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-569da863-6493-4b3f-8a5c-14370f58d134 tempest-VolumesSnapshotListTestJSON-2079198915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f0f90412-6f60-4a82-852a-f8b8820e313f -F qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-f0f90412-6f60-4a82-852a-f8b8820e313f.9f45a9cc-1d93-4da8-9e63-c52e29ffb1ec" returned: 0 in 0.353s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:55:56 devstack cinder-volume[87098]: WARNING cinder.volume.drivers.remotefs [None req-569da863-6493-4b3f-8a5c-14370f58d134 tempest-VolumesSnapshotListTestJSON-2079198915 None] /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-f0f90412-6f60-4a82-852a-f8b8820e313f.9f45a9cc-1d93-4da8-9e63-c52e29ffb1ec is being set with open permissions: ugo+rw Jul 13 13:55:56 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-569da863-6493-4b3f-8a5c-14370f58d134 tempest-VolumesSnapshotListTestJSON-2079198915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-f0f90412-6f60-4a82-852a-f8b8820e313f.9f45a9cc-1d93-4da8-9e63-c52e29ffb1ec {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:55:56 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-67275848-9165-40da-81c0-8f51510aef8e tempest-VolumesCloneTest-833146978 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 13:55:56 devstack sudo[95871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-f0f90412-6f60-4a82-852a-f8b8820e313f.9f45a9cc-1d93-4da8-9e63-c52e29ffb1ec Jul 13 13:55:56 devstack sudo[95871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:55:56 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-67275848-9165-40da-81c0-8f51510aef8e tempest-VolumesCloneTest-833146978 None] Flow 'volume_create_manager' (9574a015-1365-43d1-9e7d-9b940491cddb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 13:55:56 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-67275848-9165-40da-81c0-8f51510aef8e tempest-VolumesCloneTest-833146978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d332d6fa-4958-4af0-aaae-4a312970d9b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:55:56 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-67275848-9165-40da-81c0-8f51510aef8e tempest-VolumesCloneTest-833146978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d332d6fa-4958-4af0-aaae-4a312970d9b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T11:55:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-2017836629',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67ff4cf6-b483-4ba3-9592-800c87858f2d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4f6f5146da04eae8d39e9cd0e82de07',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T11:55:56Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=79c70162-3aa3-4255-aa20-1f9d3ca8440f,status='creating',terminated_at=None,updated_at=2026-07-13T11:55:56Z,use_quota=True,user_id='7089faee90fe41dba327f110d57c0483',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1147de8b-623b-426c-a13d-7fc824a80f67),volume_type_id=1147de8b-623b-426c-a13d-7fc824a80f67)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:55:56 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-67275848-9165-40da-81c0-8f51510aef8e tempest-VolumesCloneTest-833146978 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3eb65f91-104c-40d1-90d8-b2052d1bcfbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:55:56 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-67275848-9165-40da-81c0-8f51510aef8e tempest-VolumesCloneTest-833146978 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3eb65f91-104c-40d1-90d8-b2052d1bcfbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:55:56 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-67275848-9165-40da-81c0-8f51510aef8e tempest-VolumesCloneTest-833146978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eaf43e0e-952f-4681-a539-aca62b99b931) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:55:56 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-67275848-9165-40da-81c0-8f51510aef8e tempest-VolumesCloneTest-833146978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eaf43e0e-952f-4681-a539-aca62b99b931) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '67ff4cf6-b483-4ba3-9592-800c87858f2d', 'volume_name': 'volume-67ff4cf6-b483-4ba3-9592-800c87858f2d', 'volume_size': 2, 'source_volid': '79c70162-3aa3-4255-aa20-1f9d3ca8440f', 'source_volstatus': 'available'}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:55:56 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-67275848-9165-40da-81c0-8f51510aef8e tempest-VolumesCloneTest-833146978 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a77de0b2-d35f-4cc4-a733-89972a3efb54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:55:56 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-67275848-9165-40da-81c0-8f51510aef8e tempest-VolumesCloneTest-833146978 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a77de0b2-d35f-4cc4-a733-89972a3efb54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:55:56 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-67275848-9165-40da-81c0-8f51510aef8e tempest-VolumesCloneTest-833146978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c4590e2-c70f-4e1d-9702-24180481a720) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:55:56 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-67275848-9165-40da-81c0-8f51510aef8e tempest-VolumesCloneTest-833146978 None] Volume 67ff4cf6-b483-4ba3-9592-800c87858f2d: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-67ff4cf6-b483-4ba3-9592-800c87858f2d', 'volume_size': 2, 'source_volid': '79c70162-3aa3-4255-aa20-1f9d3ca8440f', 'source_volstatus': 'available'} Jul 13 13:55:56 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-67275848-9165-40da-81c0-8f51510aef8e tempest-VolumesCloneTest-833146978 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:55:56 devstack sudo[95871]: pam_unix(sudo:session): session closed for user root Jul 13 13:55:56 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-569da863-6493-4b3f-8a5c-14370f58d134 tempest-VolumesSnapshotListTestJSON-2079198915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-f0f90412-6f60-4a82-852a-f8b8820e313f.9f45a9cc-1d93-4da8-9e63-c52e29ffb1ec" returned: 0 in 0.283s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:55:56 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-569da863-6493-4b3f-8a5c-14370f58d134 tempest-VolumesSnapshotListTestJSON-2079198915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-f0f90412-6f60-4a82-852a-f8b8820e313f.info {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:55:56 devstack sudo[95875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-f0f90412-6f60-4a82-852a-f8b8820e313f.info Jul 13 13:55:56 devstack sudo[95875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:55:57 devstack sudo[95875]: pam_unix(sudo:session): session closed for user root Jul 13 13:55:57 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-569da863-6493-4b3f-8a5c-14370f58d134 tempest-VolumesSnapshotListTestJSON-2079198915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-f0f90412-6f60-4a82-852a-f8b8820e313f.info" returned: 0 in 0.276s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:55:57 devstack cinder-volume[87098]: WARNING cinder.volume.drivers.remotefs [None req-569da863-6493-4b3f-8a5c-14370f58d134 tempest-VolumesSnapshotListTestJSON-2079198915 None] /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-f0f90412-6f60-4a82-852a-f8b8820e313f.info is being set with open permissions: ugo+rw Jul 13 13:55:57 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-569da863-6493-4b3f-8a5c-14370f58d134 tempest-VolumesSnapshotListTestJSON-2079198915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-f0f90412-6f60-4a82-852a-f8b8820e313f.info {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:55:57 devstack sudo[95878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-f0f90412-6f60-4a82-852a-f8b8820e313f.info Jul 13 13:55:57 devstack sudo[95878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:55:57 devstack sudo[95878]: pam_unix(sudo:session): session closed for user root Jul 13 13:55:57 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-569da863-6493-4b3f-8a5c-14370f58d134 tempest-VolumesSnapshotListTestJSON-2079198915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-f0f90412-6f60-4a82-852a-f8b8820e313f.info" returned: 0 in 0.260s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:55:57 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-569da863-6493-4b3f-8a5c-14370f58d134 tempest-VolumesSnapshotListTestJSON-2079198915 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.116s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:55:57 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-67275848-9165-40da-81c0-8f51510aef8e tempest-VolumesCloneTest-833146978 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.741s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:55:57 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-67275848-9165-40da-81c0-8f51510aef8e tempest-VolumesCloneTest-833146978 None] Cloning volume 79c70162-3aa3-4255-aa20-1f9d3ca8440f to volume 67ff4cf6-b483-4ba3-9592-800c87858f2d Jul 13 13:55:57 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-569da863-6493-4b3f-8a5c-14370f58d134 tempest-VolumesSnapshotListTestJSON-2079198915 None] Create snapshot completed successfully Jul 13 13:55:57 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-67275848-9165-40da-81c0-8f51510aef8e tempest-VolumesCloneTest-833146978 None] Creating offline snapshot c77ed9cf-0a3d-4cb8-a550-45fc8d47563f of volume 79c70162-3aa3-4255-aa20-1f9d3ca8440f {{(pid=87098) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 13 13:55:57 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e2c8155-fdf2-4edd-89a0-832f7042cb60]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 13:55:57 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-67275848-9165-40da-81c0-8f51510aef8e tempest-VolumesCloneTest-833146978 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-79c70162-3aa3-4255-aa20-1f9d3ca8440f {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:55:57 devstack sudo[95881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-79c70162-3aa3-4255-aa20-1f9d3ca8440f Jul 13 13:55:57 devstack sudo[95881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:55:57 devstack sudo[95881]: pam_unix(sudo:session): session closed for user root Jul 13 13:55:57 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-67275848-9165-40da-81c0-8f51510aef8e tempest-VolumesCloneTest-833146978 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-79c70162-3aa3-4255-aa20-1f9d3ca8440f" returned: 0 in 0.437s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:55:57 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-67275848-9165-40da-81c0-8f51510aef8e tempest-VolumesCloneTest-833146978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-79c70162-3aa3-4255-aa20-1f9d3ca8440f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-79c70162-3aa3-4255-aa20-1f9d3ca8440f.c77ed9cf-0a3d-4cb8-a550-45fc8d47563f 1G {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:55:57 devstack sudo[95886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-79c70162-3aa3-4255-aa20-1f9d3ca8440f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-79c70162-3aa3-4255-aa20-1f9d3ca8440f.c77ed9cf-0a3d-4cb8-a550-45fc8d47563f 1G Jul 13 13:55:57 devstack sudo[95886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:55:58 devstack sudo[95886]: pam_unix(sudo:session): session closed for user root Jul 13 13:55:58 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-67275848-9165-40da-81c0-8f51510aef8e tempest-VolumesCloneTest-833146978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-79c70162-3aa3-4255-aa20-1f9d3ca8440f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-79c70162-3aa3-4255-aa20-1f9d3ca8440f.c77ed9cf-0a3d-4cb8-a550-45fc8d47563f 1G" returned: 0 in 0.495s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:55:58 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-67275848-9165-40da-81c0-8f51510aef8e tempest-VolumesCloneTest-833146978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-79c70162-3aa3-4255-aa20-1f9d3ca8440f -F qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-79c70162-3aa3-4255-aa20-1f9d3ca8440f.c77ed9cf-0a3d-4cb8-a550-45fc8d47563f {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:55:58 devstack sudo[95894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-79c70162-3aa3-4255-aa20-1f9d3ca8440f -F qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-79c70162-3aa3-4255-aa20-1f9d3ca8440f.c77ed9cf-0a3d-4cb8-a550-45fc8d47563f Jul 13 13:55:58 devstack sudo[95894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:55:58 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-e5f4015a-4073-4e4c-8082-bac8952ad315 tempest-VolumesSnapshotListTestJSON-2079198915 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:55:58 devstack sudo[95894]: pam_unix(sudo:session): session closed for user root Jul 13 13:55:58 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-67275848-9165-40da-81c0-8f51510aef8e tempest-VolumesCloneTest-833146978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-79c70162-3aa3-4255-aa20-1f9d3ca8440f -F qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-79c70162-3aa3-4255-aa20-1f9d3ca8440f.c77ed9cf-0a3d-4cb8-a550-45fc8d47563f" returned: 0 in 0.489s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:55:58 devstack cinder-volume[87098]: WARNING cinder.volume.drivers.remotefs [None req-67275848-9165-40da-81c0-8f51510aef8e tempest-VolumesCloneTest-833146978 None] /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-79c70162-3aa3-4255-aa20-1f9d3ca8440f.c77ed9cf-0a3d-4cb8-a550-45fc8d47563f is being set with open permissions: ugo+rw Jul 13 13:55:58 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-67275848-9165-40da-81c0-8f51510aef8e tempest-VolumesCloneTest-833146978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-79c70162-3aa3-4255-aa20-1f9d3ca8440f.c77ed9cf-0a3d-4cb8-a550-45fc8d47563f {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:55:58 devstack sudo[95900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-79c70162-3aa3-4255-aa20-1f9d3ca8440f.c77ed9cf-0a3d-4cb8-a550-45fc8d47563f Jul 13 13:55:58 devstack sudo[95900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:55:59 devstack sudo[95900]: pam_unix(sudo:session): session closed for user root Jul 13 13:55:59 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-67275848-9165-40da-81c0-8f51510aef8e tempest-VolumesCloneTest-833146978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-79c70162-3aa3-4255-aa20-1f9d3ca8440f.c77ed9cf-0a3d-4cb8-a550-45fc8d47563f" returned: 0 in 0.316s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:55:59 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-67275848-9165-40da-81c0-8f51510aef8e tempest-VolumesCloneTest-833146978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-79c70162-3aa3-4255-aa20-1f9d3ca8440f.info {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:55:59 devstack sudo[95904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-79c70162-3aa3-4255-aa20-1f9d3ca8440f.info Jul 13 13:55:59 devstack sudo[95904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:55:59 devstack sudo[95904]: pam_unix(sudo:session): session closed for user root Jul 13 13:55:59 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-67275848-9165-40da-81c0-8f51510aef8e tempest-VolumesCloneTest-833146978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-79c70162-3aa3-4255-aa20-1f9d3ca8440f.info" returned: 0 in 0.362s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:55:59 devstack cinder-volume[87098]: WARNING cinder.volume.drivers.remotefs [None req-67275848-9165-40da-81c0-8f51510aef8e tempest-VolumesCloneTest-833146978 None] /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-79c70162-3aa3-4255-aa20-1f9d3ca8440f.info is being set with open permissions: ugo+rw Jul 13 13:55:59 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-67275848-9165-40da-81c0-8f51510aef8e tempest-VolumesCloneTest-833146978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-79c70162-3aa3-4255-aa20-1f9d3ca8440f.info {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:55:59 devstack sudo[95923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-79c70162-3aa3-4255-aa20-1f9d3ca8440f.info Jul 13 13:55:59 devstack sudo[95923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:55:59 devstack sudo[95923]: pam_unix(sudo:session): session closed for user root Jul 13 13:55:59 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-67275848-9165-40da-81c0-8f51510aef8e tempest-VolumesCloneTest-833146978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-79c70162-3aa3-4255-aa20-1f9d3ca8440f.info" returned: 0 in 0.324s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:55:59 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-67275848-9165-40da-81c0-8f51510aef8e tempest-VolumesCloneTest-833146978 None] Acquiring lock "cinder-quobyte-67ff4cf6-b483-4ba3-9592-800c87858f2d" by "_copy_volume_from_snapshot" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 13:55:59 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-67275848-9165-40da-81c0-8f51510aef8e tempest-VolumesCloneTest-833146978 None] Lock "cinder-quobyte-67ff4cf6-b483-4ba3-9592-800c87858f2d" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 13:55:59 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-67275848-9165-40da-81c0-8f51510aef8e tempest-VolumesCloneTest-833146978 None] snapshot: c77ed9cf-0a3d-4cb8-a550-45fc8d47563f, volume: 67ff4cf6-b483-4ba3-9592-800c87858f2d, {{(pid=87098) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 13 13:55:59 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-67275848-9165-40da-81c0-8f51510aef8e tempest-VolumesCloneTest-833146978 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:55:59 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-67275848-9165-40da-81c0-8f51510aef8e tempest-VolumesCloneTest-833146978 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:55:59 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-67275848-9165-40da-81c0-8f51510aef8e tempest-VolumesCloneTest-833146978 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 13:55:59 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-67275848-9165-40da-81c0-8f51510aef8e tempest-VolumesCloneTest-833146978 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 13:55:59 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-67275848-9165-40da-81c0-8f51510aef8e tempest-VolumesCloneTest-833146978 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:55:59 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[d52ebefc-e666-4b20-8d07-f47cdabba14e]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 13:55:59 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-67275848-9165-40da-81c0-8f51510aef8e tempest-VolumesCloneTest-833146978 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-79c70162-3aa3-4255-aa20-1f9d3ca8440f.c77ed9cf-0a3d-4cb8-a550-45fc8d47563f {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:56:00 devstack sudo[95930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-79c70162-3aa3-4255-aa20-1f9d3ca8440f.c77ed9cf-0a3d-4cb8-a550-45fc8d47563f Jul 13 13:56:00 devstack sudo[95930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:56:00 devstack sudo[95930]: pam_unix(sudo:session): session closed for user root Jul 13 13:56:00 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-67275848-9165-40da-81c0-8f51510aef8e tempest-VolumesCloneTest-833146978 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-79c70162-3aa3-4255-aa20-1f9d3ca8440f.c77ed9cf-0a3d-4cb8-a550-45fc8d47563f" returned: 0 in 0.490s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:56:00 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-67275848-9165-40da-81c0-8f51510aef8e tempest-VolumesCloneTest-833146978 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-79c70162-3aa3-4255-aa20-1f9d3ca8440f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87098) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 13 13:56:00 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-67275848-9165-40da-81c0-8f51510aef8e tempest-VolumesCloneTest-833146978 None] will copy from snapshot at /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-79c70162-3aa3-4255-aa20-1f9d3ca8440f {{(pid=87098) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 13 13:56:00 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-67275848-9165-40da-81c0-8f51510aef8e tempest-VolumesCloneTest-833146978 None] Creating direct copy from snapshot {{(pid=87098) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 13 13:56:00 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[512fe9f0-9c4e-4a26-b1c2-e1519fad2c78]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 13:56:00 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-67275848-9165-40da-81c0-8f51510aef8e tempest-VolumesCloneTest-833146978 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-79c70162-3aa3-4255-aa20-1f9d3ca8440f {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:56:00 devstack sudo[95937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-79c70162-3aa3-4255-aa20-1f9d3ca8440f Jul 13 13:56:00 devstack sudo[95937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:56:00 devstack sudo[95937]: pam_unix(sudo:session): session closed for user root Jul 13 13:56:00 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-67275848-9165-40da-81c0-8f51510aef8e tempest-VolumesCloneTest-833146978 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-79c70162-3aa3-4255-aa20-1f9d3ca8440f" returned: 0 in 0.496s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:56:00 devstack cinder-volume[87098]: DEBUG cinder.utils [None req-67275848-9165-40da-81c0-8f51510aef8e tempest-VolumesCloneTest-833146978 None] Path /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-67ff4cf6-b483-4ba3-9592-800c87858f2d not found in is_blk_device check {{(pid=87098) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 13 13:56:00 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-67275848-9165-40da-81c0-8f51510aef8e tempest-VolumesCloneTest-833146978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-79c70162-3aa3-4255-aa20-1f9d3ca8440f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-67ff4cf6-b483-4ba3-9592-800c87858f2d {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:56:00 devstack sudo[95944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-79c70162-3aa3-4255-aa20-1f9d3ca8440f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-67ff4cf6-b483-4ba3-9592-800c87858f2d Jul 13 13:56:00 devstack sudo[95944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:56:06 devstack sudo[95944]: pam_unix(sudo:session): session closed for user root Jul 13 13:56:06 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-67275848-9165-40da-81c0-8f51510aef8e tempest-VolumesCloneTest-833146978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-79c70162-3aa3-4255-aa20-1f9d3ca8440f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-67ff4cf6-b483-4ba3-9592-800c87858f2d" returned: 0 in 5.853s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:56:06 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f471d56-c576-4117-bc1f-da9b120710ec]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 13:56:06 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-67275848-9165-40da-81c0-8f51510aef8e tempest-VolumesCloneTest-833146978 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-79c70162-3aa3-4255-aa20-1f9d3ca8440f {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:56:06 devstack sudo[95994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-79c70162-3aa3-4255-aa20-1f9d3ca8440f Jul 13 13:56:06 devstack sudo[95994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:56:07 devstack sudo[95994]: pam_unix(sudo:session): session closed for user root Jul 13 13:56:07 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-67275848-9165-40da-81c0-8f51510aef8e tempest-VolumesCloneTest-833146978 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-79c70162-3aa3-4255-aa20-1f9d3ca8440f" returned: 0 in 0.627s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:56:07 devstack cinder-volume[87098]: DEBUG cinder.image.image_utils [None req-67275848-9165-40da-81c0-8f51510aef8e tempest-VolumesCloneTest-833146978 None] Image conversion details: src /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-79c70162-3aa3-4255-aa20-1f9d3ca8440f, size 1024.00 MB, duration 5.85 sec, destination /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-67ff4cf6-b483-4ba3-9592-800c87858f2d {{(pid=87098) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 13 13:56:07 devstack cinder-volume[87098]: INFO cinder.image.image_utils [None req-67275848-9165-40da-81c0-8f51510aef8e tempest-VolumesCloneTest-833146978 None] Converted 1024.00 MB image at 174.91 MB/s Jul 13 13:56:07 devstack cinder-volume[87098]: WARNING cinder.volume.drivers.remotefs [None req-67275848-9165-40da-81c0-8f51510aef8e tempest-VolumesCloneTest-833146978 None] /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-67ff4cf6-b483-4ba3-9592-800c87858f2d is being set with open permissions: ugo+rw Jul 13 13:56:07 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-67275848-9165-40da-81c0-8f51510aef8e tempest-VolumesCloneTest-833146978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-67ff4cf6-b483-4ba3-9592-800c87858f2d {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:56:07 devstack sudo[95999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-67ff4cf6-b483-4ba3-9592-800c87858f2d Jul 13 13:56:07 devstack sudo[95999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:56:07 devstack sudo[95999]: pam_unix(sudo:session): session closed for user root Jul 13 13:56:07 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-67275848-9165-40da-81c0-8f51510aef8e tempest-VolumesCloneTest-833146978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-67ff4cf6-b483-4ba3-9592-800c87858f2d" returned: 0 in 0.255s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:56:07 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-67275848-9165-40da-81c0-8f51510aef8e tempest-VolumesCloneTest-833146978 None] Lock "cinder-quobyte-67ff4cf6-b483-4ba3-9592-800c87858f2d" released by "_copy_volume_from_snapshot" :: held 7.821s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 13:56:07 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-67275848-9165-40da-81c0-8f51510aef8e tempest-VolumesCloneTest-833146978 None] Acquiring lock "cinder-quobyte-c77ed9cf-0a3d-4cb8-a550-45fc8d47563f" by "_delete_snapshot" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 13:56:07 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-67275848-9165-40da-81c0-8f51510aef8e tempest-VolumesCloneTest-833146978 None] Lock "cinder-quobyte-c77ed9cf-0a3d-4cb8-a550-45fc8d47563f" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 13:56:07 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-67275848-9165-40da-81c0-8f51510aef8e tempest-VolumesCloneTest-833146978 None] Deleting offline snapshot c77ed9cf-0a3d-4cb8-a550-45fc8d47563f of volume 79c70162-3aa3-4255-aa20-1f9d3ca8440f {{(pid=87098) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 13 13:56:07 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-67275848-9165-40da-81c0-8f51510aef8e tempest-VolumesCloneTest-833146978 None] snapshot_file for this snap is: volume-79c70162-3aa3-4255-aa20-1f9d3ca8440f.c77ed9cf-0a3d-4cb8-a550-45fc8d47563f {{(pid=87098) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 13 13:56:07 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[52f824e0-d3f3-4f3e-a029-fa709e42e7bb]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 13:56:07 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-67275848-9165-40da-81c0-8f51510aef8e tempest-VolumesCloneTest-833146978 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-79c70162-3aa3-4255-aa20-1f9d3ca8440f.c77ed9cf-0a3d-4cb8-a550-45fc8d47563f {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:56:07 devstack sudo[96002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-79c70162-3aa3-4255-aa20-1f9d3ca8440f.c77ed9cf-0a3d-4cb8-a550-45fc8d47563f Jul 13 13:56:07 devstack sudo[96002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:56:08 devstack sudo[96002]: pam_unix(sudo:session): session closed for user root Jul 13 13:56:08 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-67275848-9165-40da-81c0-8f51510aef8e tempest-VolumesCloneTest-833146978 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-79c70162-3aa3-4255-aa20-1f9d3ca8440f.c77ed9cf-0a3d-4cb8-a550-45fc8d47563f" returned: 0 in 0.405s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:56:08 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-67275848-9165-40da-81c0-8f51510aef8e tempest-VolumesCloneTest-833146978 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-79c70162-3aa3-4255-aa20-1f9d3ca8440f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87098) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 13 13:56:08 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[153ce0f7-89a2-4093-a796-034ad93ad022]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 13:56:08 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-67275848-9165-40da-81c0-8f51510aef8e tempest-VolumesCloneTest-833146978 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-79c70162-3aa3-4255-aa20-1f9d3ca8440f {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:56:08 devstack sudo[96007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-79c70162-3aa3-4255-aa20-1f9d3ca8440f Jul 13 13:56:08 devstack sudo[96007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:56:08 devstack sudo[96007]: pam_unix(sudo:session): session closed for user root Jul 13 13:56:08 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-67275848-9165-40da-81c0-8f51510aef8e tempest-VolumesCloneTest-833146978 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-79c70162-3aa3-4255-aa20-1f9d3ca8440f" returned: 0 in 0.426s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:56:08 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-67275848-9165-40da-81c0-8f51510aef8e tempest-VolumesCloneTest-833146978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-79c70162-3aa3-4255-aa20-1f9d3ca8440f.c77ed9cf-0a3d-4cb8-a550-45fc8d47563f {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:56:08 devstack sudo[96012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-79c70162-3aa3-4255-aa20-1f9d3ca8440f.c77ed9cf-0a3d-4cb8-a550-45fc8d47563f Jul 13 13:56:08 devstack sudo[96012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:56:09 devstack cinder-volume[87098]: DEBUG dbcounter [-] [87098] Writing DB stats cinder:SELECT=46,cinder:UPDATE=60,cinder:DELETE=5,cinder:INSERT=17 {{(pid=87098) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 13 13:56:09 devstack sudo[96012]: pam_unix(sudo:session): session closed for user root Jul 13 13:56:09 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-67275848-9165-40da-81c0-8f51510aef8e tempest-VolumesCloneTest-833146978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-79c70162-3aa3-4255-aa20-1f9d3ca8440f.c77ed9cf-0a3d-4cb8-a550-45fc8d47563f" returned: 0 in 0.543s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:56:09 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-67275848-9165-40da-81c0-8f51510aef8e tempest-VolumesCloneTest-833146978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-79c70162-3aa3-4255-aa20-1f9d3ca8440f.c77ed9cf-0a3d-4cb8-a550-45fc8d47563f {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:56:09 devstack sudo[96021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-79c70162-3aa3-4255-aa20-1f9d3ca8440f.c77ed9cf-0a3d-4cb8-a550-45fc8d47563f Jul 13 13:56:09 devstack sudo[96021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:56:09 devstack sudo[96021]: pam_unix(sudo:session): session closed for user root Jul 13 13:56:09 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-67275848-9165-40da-81c0-8f51510aef8e tempest-VolumesCloneTest-833146978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-79c70162-3aa3-4255-aa20-1f9d3ca8440f.c77ed9cf-0a3d-4cb8-a550-45fc8d47563f" returned: 0 in 0.304s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:56:09 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-67275848-9165-40da-81c0-8f51510aef8e tempest-VolumesCloneTest-833146978 None] Lock "cinder-quobyte-c77ed9cf-0a3d-4cb8-a550-45fc8d47563f" released by "_delete_snapshot" :: held 1.806s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 13:56:09 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-67275848-9165-40da-81c0-8f51510aef8e tempest-VolumesCloneTest-833146978 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 12.295s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:56:09 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-e5f4015a-4073-4e4c-8082-bac8952ad315 tempest-VolumesSnapshotListTestJSON-2079198915 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 10.913s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:56:09 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-e5f4015a-4073-4e4c-8082-bac8952ad315 tempest-VolumesSnapshotListTestJSON-2079198915 None] Creating offline snapshot 4855e641-f25b-46dc-a5e8-1e24fe394f11 of volume f0f90412-6f60-4a82-852a-f8b8820e313f {{(pid=87098) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 13 13:56:09 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-67275848-9165-40da-81c0-8f51510aef8e tempest-VolumesCloneTest-833146978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c4590e2-c70f-4e1d-9702-24180481a720) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-67ff4cf6-b483-4ba3-9592-800c87858f2d', 'volume_size': 2, 'source_volid': '79c70162-3aa3-4255-aa20-1f9d3ca8440f', 'source_volstatus': 'available'}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:56:09 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-67275848-9165-40da-81c0-8f51510aef8e tempest-VolumesCloneTest-833146978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55bd3d48-82e8-4acf-b9b8-607f8534cd49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:56:09 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[02f94bfd-1bde-433e-93b2-4d1c25052d56]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 13:56:09 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-e5f4015a-4073-4e4c-8082-bac8952ad315 tempest-VolumesSnapshotListTestJSON-2079198915 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-f0f90412-6f60-4a82-852a-f8b8820e313f.9f45a9cc-1d93-4da8-9e63-c52e29ffb1ec {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:56:09 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-67275848-9165-40da-81c0-8f51510aef8e tempest-VolumesCloneTest-833146978 None] Volume volume-67ff4cf6-b483-4ba3-9592-800c87858f2d (67ff4cf6-b483-4ba3-9592-800c87858f2d): created successfully Jul 13 13:56:09 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-67275848-9165-40da-81c0-8f51510aef8e tempest-VolumesCloneTest-833146978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55bd3d48-82e8-4acf-b9b8-607f8534cd49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:56:09 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-67275848-9165-40da-81c0-8f51510aef8e tempest-VolumesCloneTest-833146978 None] Flow 'volume_create_manager' (9574a015-1365-43d1-9e7d-9b940491cddb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 13:56:09 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-67275848-9165-40da-81c0-8f51510aef8e tempest-VolumesCloneTest-833146978 None] Created volume successfully. Jul 13 13:56:09 devstack sudo[96024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-f0f90412-6f60-4a82-852a-f8b8820e313f.9f45a9cc-1d93-4da8-9e63-c52e29ffb1ec Jul 13 13:56:09 devstack sudo[96024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:56:10 devstack sudo[96024]: pam_unix(sudo:session): session closed for user root Jul 13 13:56:10 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-e5f4015a-4073-4e4c-8082-bac8952ad315 tempest-VolumesSnapshotListTestJSON-2079198915 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-f0f90412-6f60-4a82-852a-f8b8820e313f.9f45a9cc-1d93-4da8-9e63-c52e29ffb1ec" returned: 0 in 0.479s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:56:10 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-e5f4015a-4073-4e4c-8082-bac8952ad315 tempest-VolumesSnapshotListTestJSON-2079198915 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f0f90412-6f60-4a82-852a-f8b8820e313f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87098) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 13 13:56:10 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-e5f4015a-4073-4e4c-8082-bac8952ad315 tempest-VolumesSnapshotListTestJSON-2079198915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-f0f90412-6f60-4a82-852a-f8b8820e313f.9f45a9cc-1d93-4da8-9e63-c52e29ffb1ec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-f0f90412-6f60-4a82-852a-f8b8820e313f.4855e641-f25b-46dc-a5e8-1e24fe394f11 1G {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:56:10 devstack sudo[96029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-f0f90412-6f60-4a82-852a-f8b8820e313f.9f45a9cc-1d93-4da8-9e63-c52e29ffb1ec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-f0f90412-6f60-4a82-852a-f8b8820e313f.4855e641-f25b-46dc-a5e8-1e24fe394f11 1G Jul 13 13:56:10 devstack sudo[96029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:56:10 devstack sudo[96029]: pam_unix(sudo:session): session closed for user root Jul 13 13:56:10 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-e5f4015a-4073-4e4c-8082-bac8952ad315 tempest-VolumesSnapshotListTestJSON-2079198915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-f0f90412-6f60-4a82-852a-f8b8820e313f.9f45a9cc-1d93-4da8-9e63-c52e29ffb1ec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-f0f90412-6f60-4a82-852a-f8b8820e313f.4855e641-f25b-46dc-a5e8-1e24fe394f11 1G" returned: 0 in 0.665s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:56:10 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-e5f4015a-4073-4e4c-8082-bac8952ad315 tempest-VolumesSnapshotListTestJSON-2079198915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f0f90412-6f60-4a82-852a-f8b8820e313f.9f45a9cc-1d93-4da8-9e63-c52e29ffb1ec -F qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-f0f90412-6f60-4a82-852a-f8b8820e313f.4855e641-f25b-46dc-a5e8-1e24fe394f11 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:56:10 devstack sudo[96038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f0f90412-6f60-4a82-852a-f8b8820e313f.9f45a9cc-1d93-4da8-9e63-c52e29ffb1ec -F qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-f0f90412-6f60-4a82-852a-f8b8820e313f.4855e641-f25b-46dc-a5e8-1e24fe394f11 Jul 13 13:56:10 devstack sudo[96038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:56:11 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-766b6251-0328-4674-b417-8f5ff481b69d tempest-VolumesCloneTest-833146978 None] Acquiring lock "cinder-67ff4cf6-b483-4ba3-9592-800c87858f2d-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 13:56:11 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-766b6251-0328-4674-b417-8f5ff481b69d tempest-VolumesCloneTest-833146978 None] Lock "cinder-67ff4cf6-b483-4ba3-9592-800c87858f2d-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 13:56:11 devstack sudo[96038]: pam_unix(sudo:session): session closed for user root Jul 13 13:56:11 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-e5f4015a-4073-4e4c-8082-bac8952ad315 tempest-VolumesSnapshotListTestJSON-2079198915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f0f90412-6f60-4a82-852a-f8b8820e313f.9f45a9cc-1d93-4da8-9e63-c52e29ffb1ec -F qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-f0f90412-6f60-4a82-852a-f8b8820e313f.4855e641-f25b-46dc-a5e8-1e24fe394f11" returned: 0 in 0.416s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:56:11 devstack cinder-volume[87098]: WARNING cinder.volume.drivers.remotefs [None req-e5f4015a-4073-4e4c-8082-bac8952ad315 tempest-VolumesSnapshotListTestJSON-2079198915 None] /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-f0f90412-6f60-4a82-852a-f8b8820e313f.4855e641-f25b-46dc-a5e8-1e24fe394f11 is being set with open permissions: ugo+rw Jul 13 13:56:11 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-e5f4015a-4073-4e4c-8082-bac8952ad315 tempest-VolumesSnapshotListTestJSON-2079198915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-f0f90412-6f60-4a82-852a-f8b8820e313f.4855e641-f25b-46dc-a5e8-1e24fe394f11 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:56:11 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-766b6251-0328-4674-b417-8f5ff481b69d tempest-VolumesCloneTest-833146978 None] Acquiring lock "cinder-quobyte-67ff4cf6-b483-4ba3-9592-800c87858f2d" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 13:56:11 devstack sudo[96052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-f0f90412-6f60-4a82-852a-f8b8820e313f.4855e641-f25b-46dc-a5e8-1e24fe394f11 Jul 13 13:56:11 devstack sudo[96052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:56:11 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-766b6251-0328-4674-b417-8f5ff481b69d tempest-VolumesCloneTest-833146978 None] Lock "cinder-quobyte-67ff4cf6-b483-4ba3-9592-800c87858f2d" acquired by "delete_volume" :: waited 0.041s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 13:56:11 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[90beffb1-3c2b-4978-8b8a-5ca401bf8282]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 13:56:11 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-766b6251-0328-4674-b417-8f5ff481b69d tempest-VolumesCloneTest-833146978 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-67ff4cf6-b483-4ba3-9592-800c87858f2d {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:56:11 devstack sudo[96054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-67ff4cf6-b483-4ba3-9592-800c87858f2d Jul 13 13:56:11 devstack sudo[96054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:56:11 devstack sudo[96052]: pam_unix(sudo:session): session closed for user root Jul 13 13:56:11 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-e5f4015a-4073-4e4c-8082-bac8952ad315 tempest-VolumesSnapshotListTestJSON-2079198915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-f0f90412-6f60-4a82-852a-f8b8820e313f.4855e641-f25b-46dc-a5e8-1e24fe394f11" returned: 0 in 0.500s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:56:11 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-e5f4015a-4073-4e4c-8082-bac8952ad315 tempest-VolumesSnapshotListTestJSON-2079198915 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.249s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:56:11 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-e5f4015a-4073-4e4c-8082-bac8952ad315 tempest-VolumesSnapshotListTestJSON-2079198915 None] Create snapshot completed successfully Jul 13 13:56:11 devstack sudo[96054]: pam_unix(sudo:session): session closed for user root Jul 13 13:56:11 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-766b6251-0328-4674-b417-8f5ff481b69d tempest-VolumesCloneTest-833146978 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-67ff4cf6-b483-4ba3-9592-800c87858f2d" returned: 0 in 0.513s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:56:11 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-766b6251-0328-4674-b417-8f5ff481b69d tempest-VolumesCloneTest-833146978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-67ff4cf6-b483-4ba3-9592-800c87858f2d {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:56:11 devstack sudo[96066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-67ff4cf6-b483-4ba3-9592-800c87858f2d Jul 13 13:56:11 devstack sudo[96066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:56:12 devstack sudo[96066]: pam_unix(sudo:session): session closed for user root Jul 13 13:56:12 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-766b6251-0328-4674-b417-8f5ff481b69d tempest-VolumesCloneTest-833146978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-67ff4cf6-b483-4ba3-9592-800c87858f2d" returned: 0 in 0.282s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:56:12 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-766b6251-0328-4674-b417-8f5ff481b69d tempest-VolumesCloneTest-833146978 None] Lock "cinder-quobyte-67ff4cf6-b483-4ba3-9592-800c87858f2d" released by "delete_volume" :: held 0.867s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 13:56:12 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-766b6251-0328-4674-b417-8f5ff481b69d tempest-VolumesCloneTest-833146978 None] Created reservations ['df109633-0918-4624-bb00-30d504988d42', '752aa0e7-30b9-4bf2-a4ed-a54204dfc6ec', '81bd0531-55ee-4ccd-9711-8f8b2a7dd1c7', '9f983a8e-959e-4821-ab3d-9a41ff297481'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 13:56:12 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-766b6251-0328-4674-b417-8f5ff481b69d tempest-VolumesCloneTest-833146978 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:56:12 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-766b6251-0328-4674-b417-8f5ff481b69d tempest-VolumesCloneTest-833146978 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:56:12 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-766b6251-0328-4674-b417-8f5ff481b69d tempest-VolumesCloneTest-833146978 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 13:56:12 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-766b6251-0328-4674-b417-8f5ff481b69d tempest-VolumesCloneTest-833146978 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 13:56:12 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-766b6251-0328-4674-b417-8f5ff481b69d tempest-VolumesCloneTest-833146978 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:56:12 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-766b6251-0328-4674-b417-8f5ff481b69d tempest-VolumesCloneTest-833146978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:56:12 devstack sudo[96069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 Jul 13 13:56:12 devstack sudo[96069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:56:12 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-e6ab1d16-130e-4207-81bf-944b18aed17a tempest-VolumesCloneTest-833146978 None] Acquiring lock "cinder-79c70162-3aa3-4255-aa20-1f9d3ca8440f-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 13:56:12 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-e6ab1d16-130e-4207-81bf-944b18aed17a tempest-VolumesCloneTest-833146978 None] Lock "cinder-79c70162-3aa3-4255-aa20-1f9d3ca8440f-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 13:56:12 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-e6ab1d16-130e-4207-81bf-944b18aed17a tempest-VolumesCloneTest-833146978 None] Acquiring lock "cinder-quobyte-79c70162-3aa3-4255-aa20-1f9d3ca8440f" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 13:56:12 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-e6ab1d16-130e-4207-81bf-944b18aed17a tempest-VolumesCloneTest-833146978 None] Lock "cinder-quobyte-79c70162-3aa3-4255-aa20-1f9d3ca8440f" acquired by "delete_volume" :: waited 0.022s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 13:56:12 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[5be942ec-2577-41f9-8644-bcf3b61559cc]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 13:56:12 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-e6ab1d16-130e-4207-81bf-944b18aed17a tempest-VolumesCloneTest-833146978 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-79c70162-3aa3-4255-aa20-1f9d3ca8440f {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:56:12 devstack sudo[96069]: pam_unix(sudo:session): session closed for user root Jul 13 13:56:12 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-766b6251-0328-4674-b417-8f5ff481b69d tempest-VolumesCloneTest-833146978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78" returned: 0 in 0.429s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:56:12 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-766b6251-0328-4674-b417-8f5ff481b69d tempest-VolumesCloneTest-833146978 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 13:56:12 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-766b6251-0328-4674-b417-8f5ff481b69d tempest-VolumesCloneTest-833146978 None] Deleted volume successfully. Jul 13 13:56:12 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-766b6251-0328-4674-b417-8f5ff481b69d tempest-VolumesCloneTest-833146978 None] Lock "cinder-67ff4cf6-b483-4ba3-9592-800c87858f2d-delete_volume" released by "delete_volume" :: held 1.638s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 13:56:12 devstack sudo[96072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-79c70162-3aa3-4255-aa20-1f9d3ca8440f Jul 13 13:56:12 devstack sudo[96072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:56:13 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-4d9f037b-1f3c-4e56-8ba3-cd7220b0c2bf tempest-VolumesSnapshotListTestJSON-2079198915 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:56:13 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-4d9f037b-1f3c-4e56-8ba3-cd7220b0c2bf tempest-VolumesSnapshotListTestJSON-2079198915 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:56:13 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-4d9f037b-1f3c-4e56-8ba3-cd7220b0c2bf tempest-VolumesSnapshotListTestJSON-2079198915 None] Creating offline snapshot 6ee01174-3a3d-4252-affc-4d82422505e8 of volume f0f90412-6f60-4a82-852a-f8b8820e313f {{(pid=87098) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 13 13:56:13 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e18cb44-1053-4db4-9731-1ac9a40e9c79]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 13:56:13 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-4d9f037b-1f3c-4e56-8ba3-cd7220b0c2bf tempest-VolumesSnapshotListTestJSON-2079198915 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-f0f90412-6f60-4a82-852a-f8b8820e313f.4855e641-f25b-46dc-a5e8-1e24fe394f11 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:56:13 devstack sudo[96074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-f0f90412-6f60-4a82-852a-f8b8820e313f.4855e641-f25b-46dc-a5e8-1e24fe394f11 Jul 13 13:56:13 devstack sudo[96072]: pam_unix(sudo:session): session closed for user root Jul 13 13:56:13 devstack sudo[96074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:56:13 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-e6ab1d16-130e-4207-81bf-944b18aed17a tempest-VolumesCloneTest-833146978 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-79c70162-3aa3-4255-aa20-1f9d3ca8440f" returned: 0 in 0.508s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:56:13 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-e6ab1d16-130e-4207-81bf-944b18aed17a tempest-VolumesCloneTest-833146978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-79c70162-3aa3-4255-aa20-1f9d3ca8440f {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:56:13 devstack sudo[96079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-79c70162-3aa3-4255-aa20-1f9d3ca8440f Jul 13 13:56:13 devstack sudo[96079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:56:13 devstack sudo[96079]: pam_unix(sudo:session): session closed for user root Jul 13 13:56:13 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-e6ab1d16-130e-4207-81bf-944b18aed17a tempest-VolumesCloneTest-833146978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-79c70162-3aa3-4255-aa20-1f9d3ca8440f" returned: 0 in 0.326s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:56:13 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-e6ab1d16-130e-4207-81bf-944b18aed17a tempest-VolumesCloneTest-833146978 None] Lock "cinder-quobyte-79c70162-3aa3-4255-aa20-1f9d3ca8440f" released by "delete_volume" :: held 0.959s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 13:56:13 devstack sudo[96074]: pam_unix(sudo:session): session closed for user root Jul 13 13:56:13 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-4d9f037b-1f3c-4e56-8ba3-cd7220b0c2bf tempest-VolumesSnapshotListTestJSON-2079198915 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-f0f90412-6f60-4a82-852a-f8b8820e313f.4855e641-f25b-46dc-a5e8-1e24fe394f11" returned: 0 in 0.529s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:56:13 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-4d9f037b-1f3c-4e56-8ba3-cd7220b0c2bf tempest-VolumesSnapshotListTestJSON-2079198915 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f0f90412-6f60-4a82-852a-f8b8820e313f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87098) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 13 13:56:13 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-4d9f037b-1f3c-4e56-8ba3-cd7220b0c2bf tempest-VolumesSnapshotListTestJSON-2079198915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-f0f90412-6f60-4a82-852a-f8b8820e313f.4855e641-f25b-46dc-a5e8-1e24fe394f11,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-f0f90412-6f60-4a82-852a-f8b8820e313f.6ee01174-3a3d-4252-affc-4d82422505e8 1G {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:56:13 devstack sudo[96086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-f0f90412-6f60-4a82-852a-f8b8820e313f.4855e641-f25b-46dc-a5e8-1e24fe394f11,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-f0f90412-6f60-4a82-852a-f8b8820e313f.6ee01174-3a3d-4252-affc-4d82422505e8 1G Jul 13 13:56:13 devstack sudo[96086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:56:13 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-e6ab1d16-130e-4207-81bf-944b18aed17a tempest-VolumesCloneTest-833146978 None] Created reservations ['86965ef0-3684-4015-b8ac-1fc9170cfe8a', 'aff4411d-7f6f-4b80-9cdd-fc4c7b6da009', '85463ed9-a792-4931-9eef-aa408a9ef5ef', '8b7a9406-ec31-47a9-a0d3-3db7cf90792e'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 13:56:13 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-e6ab1d16-130e-4207-81bf-944b18aed17a tempest-VolumesCloneTest-833146978 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:56:13 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-e6ab1d16-130e-4207-81bf-944b18aed17a tempest-VolumesCloneTest-833146978 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:56:13 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-e6ab1d16-130e-4207-81bf-944b18aed17a tempest-VolumesCloneTest-833146978 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 13:56:13 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-e6ab1d16-130e-4207-81bf-944b18aed17a tempest-VolumesCloneTest-833146978 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 13:56:13 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-e6ab1d16-130e-4207-81bf-944b18aed17a tempest-VolumesCloneTest-833146978 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:56:13 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-e6ab1d16-130e-4207-81bf-944b18aed17a tempest-VolumesCloneTest-833146978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:56:13 devstack sudo[96088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 Jul 13 13:56:13 devstack sudo[96088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:56:14 devstack sudo[96088]: pam_unix(sudo:session): session closed for user root Jul 13 13:56:14 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-e6ab1d16-130e-4207-81bf-944b18aed17a tempest-VolumesCloneTest-833146978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78" returned: 0 in 0.349s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:56:14 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-e6ab1d16-130e-4207-81bf-944b18aed17a tempest-VolumesCloneTest-833146978 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 13:56:14 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-e6ab1d16-130e-4207-81bf-944b18aed17a tempest-VolumesCloneTest-833146978 None] Deleted volume successfully. Jul 13 13:56:14 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-e6ab1d16-130e-4207-81bf-944b18aed17a tempest-VolumesCloneTest-833146978 None] Lock "cinder-79c70162-3aa3-4255-aa20-1f9d3ca8440f-delete_volume" released by "delete_volume" :: held 1.795s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 13:56:14 devstack sudo[96086]: pam_unix(sudo:session): session closed for user root Jul 13 13:56:14 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-4d9f037b-1f3c-4e56-8ba3-cd7220b0c2bf tempest-VolumesSnapshotListTestJSON-2079198915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-f0f90412-6f60-4a82-852a-f8b8820e313f.4855e641-f25b-46dc-a5e8-1e24fe394f11,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-f0f90412-6f60-4a82-852a-f8b8820e313f.6ee01174-3a3d-4252-affc-4d82422505e8 1G" returned: 0 in 0.834s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:56:14 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-4d9f037b-1f3c-4e56-8ba3-cd7220b0c2bf tempest-VolumesSnapshotListTestJSON-2079198915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f0f90412-6f60-4a82-852a-f8b8820e313f.4855e641-f25b-46dc-a5e8-1e24fe394f11 -F qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-f0f90412-6f60-4a82-852a-f8b8820e313f.6ee01174-3a3d-4252-affc-4d82422505e8 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:56:14 devstack sudo[96111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f0f90412-6f60-4a82-852a-f8b8820e313f.4855e641-f25b-46dc-a5e8-1e24fe394f11 -F qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-f0f90412-6f60-4a82-852a-f8b8820e313f.6ee01174-3a3d-4252-affc-4d82422505e8 Jul 13 13:56:14 devstack sudo[96111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:56:15 devstack sudo[96111]: pam_unix(sudo:session): session closed for user root Jul 13 13:56:15 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-4d9f037b-1f3c-4e56-8ba3-cd7220b0c2bf tempest-VolumesSnapshotListTestJSON-2079198915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f0f90412-6f60-4a82-852a-f8b8820e313f.4855e641-f25b-46dc-a5e8-1e24fe394f11 -F qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-f0f90412-6f60-4a82-852a-f8b8820e313f.6ee01174-3a3d-4252-affc-4d82422505e8" returned: 0 in 0.691s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:56:15 devstack cinder-volume[87098]: WARNING cinder.volume.drivers.remotefs [None req-4d9f037b-1f3c-4e56-8ba3-cd7220b0c2bf tempest-VolumesSnapshotListTestJSON-2079198915 None] /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-f0f90412-6f60-4a82-852a-f8b8820e313f.6ee01174-3a3d-4252-affc-4d82422505e8 is being set with open permissions: ugo+rw Jul 13 13:56:15 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-4d9f037b-1f3c-4e56-8ba3-cd7220b0c2bf tempest-VolumesSnapshotListTestJSON-2079198915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-f0f90412-6f60-4a82-852a-f8b8820e313f.6ee01174-3a3d-4252-affc-4d82422505e8 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:56:15 devstack sudo[96157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-f0f90412-6f60-4a82-852a-f8b8820e313f.6ee01174-3a3d-4252-affc-4d82422505e8 Jul 13 13:56:15 devstack sudo[96157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:56:15 devstack sudo[96157]: pam_unix(sudo:session): session closed for user root Jul 13 13:56:15 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-4d9f037b-1f3c-4e56-8ba3-cd7220b0c2bf tempest-VolumesSnapshotListTestJSON-2079198915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-f0f90412-6f60-4a82-852a-f8b8820e313f.6ee01174-3a3d-4252-affc-4d82422505e8" returned: 0 in 0.576s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:56:15 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-4d9f037b-1f3c-4e56-8ba3-cd7220b0c2bf tempest-VolumesSnapshotListTestJSON-2079198915 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.764s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:56:15 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-4d9f037b-1f3c-4e56-8ba3-cd7220b0c2bf tempest-VolumesSnapshotListTestJSON-2079198915 None] Create snapshot completed successfully Jul 13 13:56:17 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-8293077c-826c-4cbd-bb6f-45d9e87bb252 tempest-VolumesSnapshotListTestJSON-2079198915 None] Acquiring lock "cinder-6ee01174-3a3d-4252-affc-4d82422505e8-delete_snapshot" by "delete_snapshot" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 13:56:17 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-8293077c-826c-4cbd-bb6f-45d9e87bb252 tempest-VolumesSnapshotListTestJSON-2079198915 None] Lock "cinder-6ee01174-3a3d-4252-affc-4d82422505e8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.042s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 13:56:17 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-8293077c-826c-4cbd-bb6f-45d9e87bb252 tempest-VolumesSnapshotListTestJSON-2079198915 None] Acquiring lock "cinder-quobyte-f0f90412-6f60-4a82-852a-f8b8820e313f" by "delete_snapshot" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 13:56:17 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-8293077c-826c-4cbd-bb6f-45d9e87bb252 tempest-VolumesSnapshotListTestJSON-2079198915 None] Lock "cinder-quobyte-f0f90412-6f60-4a82-852a-f8b8820e313f" acquired by "delete_snapshot" :: waited 0.048s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 13:56:17 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-8293077c-826c-4cbd-bb6f-45d9e87bb252 tempest-VolumesSnapshotListTestJSON-2079198915 None] Acquiring lock "cinder-quobyte-6ee01174-3a3d-4252-affc-4d82422505e8" by "_delete_snapshot" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 13:56:17 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-8293077c-826c-4cbd-bb6f-45d9e87bb252 tempest-VolumesSnapshotListTestJSON-2079198915 None] Lock "cinder-quobyte-6ee01174-3a3d-4252-affc-4d82422505e8" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 13:56:17 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-8293077c-826c-4cbd-bb6f-45d9e87bb252 tempest-VolumesSnapshotListTestJSON-2079198915 None] Deleting offline snapshot 6ee01174-3a3d-4252-affc-4d82422505e8 of volume f0f90412-6f60-4a82-852a-f8b8820e313f {{(pid=87098) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 13 13:56:18 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-8293077c-826c-4cbd-bb6f-45d9e87bb252 tempest-VolumesSnapshotListTestJSON-2079198915 None] snapshot_file for this snap is: volume-f0f90412-6f60-4a82-852a-f8b8820e313f.6ee01174-3a3d-4252-affc-4d82422505e8 {{(pid=87098) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 13 13:56:18 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[25b71df7-5852-4f04-b05a-01020a55e54f]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 13:56:18 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-8293077c-826c-4cbd-bb6f-45d9e87bb252 tempest-VolumesSnapshotListTestJSON-2079198915 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-f0f90412-6f60-4a82-852a-f8b8820e313f.6ee01174-3a3d-4252-affc-4d82422505e8 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:56:18 devstack sudo[96174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-f0f90412-6f60-4a82-852a-f8b8820e313f.6ee01174-3a3d-4252-affc-4d82422505e8 Jul 13 13:56:18 devstack sudo[96174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:56:18 devstack sudo[96174]: pam_unix(sudo:session): session closed for user root Jul 13 13:56:18 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-8293077c-826c-4cbd-bb6f-45d9e87bb252 tempest-VolumesSnapshotListTestJSON-2079198915 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-f0f90412-6f60-4a82-852a-f8b8820e313f.6ee01174-3a3d-4252-affc-4d82422505e8" returned: 0 in 0.816s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:56:18 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-8293077c-826c-4cbd-bb6f-45d9e87bb252 tempest-VolumesSnapshotListTestJSON-2079198915 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f0f90412-6f60-4a82-852a-f8b8820e313f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87098) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 13 13:56:18 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[7de8cbde-662c-4181-85e1-791ada7def36]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 13:56:18 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-8293077c-826c-4cbd-bb6f-45d9e87bb252 tempest-VolumesSnapshotListTestJSON-2079198915 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-f0f90412-6f60-4a82-852a-f8b8820e313f.4855e641-f25b-46dc-a5e8-1e24fe394f11 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:56:19 devstack sudo[96187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-f0f90412-6f60-4a82-852a-f8b8820e313f.4855e641-f25b-46dc-a5e8-1e24fe394f11 Jul 13 13:56:19 devstack sudo[96187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:56:19 devstack sudo[96187]: pam_unix(sudo:session): session closed for user root Jul 13 13:56:19 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-8293077c-826c-4cbd-bb6f-45d9e87bb252 tempest-VolumesSnapshotListTestJSON-2079198915 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-f0f90412-6f60-4a82-852a-f8b8820e313f.4855e641-f25b-46dc-a5e8-1e24fe394f11" returned: 0 in 0.523s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:56:19 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-8293077c-826c-4cbd-bb6f-45d9e87bb252 tempest-VolumesSnapshotListTestJSON-2079198915 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f0f90412-6f60-4a82-852a-f8b8820e313f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87098) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 13 13:56:19 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-8293077c-826c-4cbd-bb6f-45d9e87bb252 tempest-VolumesSnapshotListTestJSON-2079198915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-f0f90412-6f60-4a82-852a-f8b8820e313f.6ee01174-3a3d-4252-affc-4d82422505e8 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:56:19 devstack sudo[96192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-f0f90412-6f60-4a82-852a-f8b8820e313f.6ee01174-3a3d-4252-affc-4d82422505e8 Jul 13 13:56:19 devstack sudo[96192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:56:20 devstack sudo[96192]: pam_unix(sudo:session): session closed for user root Jul 13 13:56:20 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-8293077c-826c-4cbd-bb6f-45d9e87bb252 tempest-VolumesSnapshotListTestJSON-2079198915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-f0f90412-6f60-4a82-852a-f8b8820e313f.6ee01174-3a3d-4252-affc-4d82422505e8" returned: 0 in 0.902s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:56:20 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-8293077c-826c-4cbd-bb6f-45d9e87bb252 tempest-VolumesSnapshotListTestJSON-2079198915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-f0f90412-6f60-4a82-852a-f8b8820e313f.6ee01174-3a3d-4252-affc-4d82422505e8 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:56:20 devstack sudo[96197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-f0f90412-6f60-4a82-852a-f8b8820e313f.6ee01174-3a3d-4252-affc-4d82422505e8 Jul 13 13:56:20 devstack sudo[96197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:56:20 devstack sudo[96197]: pam_unix(sudo:session): session closed for user root Jul 13 13:56:20 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-8293077c-826c-4cbd-bb6f-45d9e87bb252 tempest-VolumesSnapshotListTestJSON-2079198915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-f0f90412-6f60-4a82-852a-f8b8820e313f.6ee01174-3a3d-4252-affc-4d82422505e8" returned: 0 in 0.415s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:56:20 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-8293077c-826c-4cbd-bb6f-45d9e87bb252 tempest-VolumesSnapshotListTestJSON-2079198915 None] Lock "cinder-quobyte-6ee01174-3a3d-4252-affc-4d82422505e8" released by "_delete_snapshot" :: held 2.840s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 13:56:20 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-8293077c-826c-4cbd-bb6f-45d9e87bb252 tempest-VolumesSnapshotListTestJSON-2079198915 None] Lock "cinder-quobyte-f0f90412-6f60-4a82-852a-f8b8820e313f" released by "delete_snapshot" :: held 2.886s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 13:56:20 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-8293077c-826c-4cbd-bb6f-45d9e87bb252 tempest-VolumesSnapshotListTestJSON-2079198915 None] Created reservations ['2879b72c-e388-4380-9673-b3f5f1e63165', '7b008872-f314-4000-a736-ed7b8940f3d8', '41a0a063-b1e2-45b8-a1c7-faf5970b2122', 'de89ef2e-6486-41da-b4ba-39c26fbddbe4'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 13:56:21 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-8293077c-826c-4cbd-bb6f-45d9e87bb252 tempest-VolumesSnapshotListTestJSON-2079198915 None] Delete snapshot completed successfully. Jul 13 13:56:21 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-8293077c-826c-4cbd-bb6f-45d9e87bb252 tempest-VolumesSnapshotListTestJSON-2079198915 None] Lock "cinder-6ee01174-3a3d-4252-affc-4d82422505e8-delete_snapshot" released by "delete_snapshot" :: held 3.116s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 13:56:21 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-64b7395e-0aef-453c-8e2d-e51d6c0cd4ab tempest-VolumesSnapshotListTestJSON-2079198915 None] Acquiring lock "cinder-4855e641-f25b-46dc-a5e8-1e24fe394f11-delete_snapshot" by "delete_snapshot" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 13:56:21 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-64b7395e-0aef-453c-8e2d-e51d6c0cd4ab tempest-VolumesSnapshotListTestJSON-2079198915 None] Lock "cinder-4855e641-f25b-46dc-a5e8-1e24fe394f11-delete_snapshot" acquired by "delete_snapshot" :: waited 0.046s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 13:56:21 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-64b7395e-0aef-453c-8e2d-e51d6c0cd4ab tempest-VolumesSnapshotListTestJSON-2079198915 None] Acquiring lock "cinder-quobyte-f0f90412-6f60-4a82-852a-f8b8820e313f" by "delete_snapshot" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 13:56:21 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-64b7395e-0aef-453c-8e2d-e51d6c0cd4ab tempest-VolumesSnapshotListTestJSON-2079198915 None] Lock "cinder-quobyte-f0f90412-6f60-4a82-852a-f8b8820e313f" acquired by "delete_snapshot" :: waited 0.036s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 13:56:21 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-64b7395e-0aef-453c-8e2d-e51d6c0cd4ab tempest-VolumesSnapshotListTestJSON-2079198915 None] Acquiring lock "cinder-quobyte-4855e641-f25b-46dc-a5e8-1e24fe394f11" by "_delete_snapshot" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 13:56:21 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-64b7395e-0aef-453c-8e2d-e51d6c0cd4ab tempest-VolumesSnapshotListTestJSON-2079198915 None] Lock "cinder-quobyte-4855e641-f25b-46dc-a5e8-1e24fe394f11" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 13:56:21 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-64b7395e-0aef-453c-8e2d-e51d6c0cd4ab tempest-VolumesSnapshotListTestJSON-2079198915 None] Deleting offline snapshot 4855e641-f25b-46dc-a5e8-1e24fe394f11 of volume f0f90412-6f60-4a82-852a-f8b8820e313f {{(pid=87098) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 13 13:56:21 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-64b7395e-0aef-453c-8e2d-e51d6c0cd4ab tempest-VolumesSnapshotListTestJSON-2079198915 None] snapshot_file for this snap is: volume-f0f90412-6f60-4a82-852a-f8b8820e313f.4855e641-f25b-46dc-a5e8-1e24fe394f11 {{(pid=87098) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 13 13:56:21 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[5873dc88-0473-41d6-9b97-5d457ea6e134]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 13:56:21 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-64b7395e-0aef-453c-8e2d-e51d6c0cd4ab tempest-VolumesSnapshotListTestJSON-2079198915 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-f0f90412-6f60-4a82-852a-f8b8820e313f.4855e641-f25b-46dc-a5e8-1e24fe394f11 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:56:21 devstack sudo[96201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-f0f90412-6f60-4a82-852a-f8b8820e313f.4855e641-f25b-46dc-a5e8-1e24fe394f11 Jul 13 13:56:21 devstack sudo[96201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:56:22 devstack sudo[96201]: pam_unix(sudo:session): session closed for user root Jul 13 13:56:22 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-64b7395e-0aef-453c-8e2d-e51d6c0cd4ab tempest-VolumesSnapshotListTestJSON-2079198915 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-f0f90412-6f60-4a82-852a-f8b8820e313f.4855e641-f25b-46dc-a5e8-1e24fe394f11" returned: 0 in 0.714s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:56:22 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-64b7395e-0aef-453c-8e2d-e51d6c0cd4ab tempest-VolumesSnapshotListTestJSON-2079198915 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f0f90412-6f60-4a82-852a-f8b8820e313f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87098) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 13 13:56:22 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f944268-0e92-4715-8b20-7a463ddce9be]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 13:56:22 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-64b7395e-0aef-453c-8e2d-e51d6c0cd4ab tempest-VolumesSnapshotListTestJSON-2079198915 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-f0f90412-6f60-4a82-852a-f8b8820e313f.9f45a9cc-1d93-4da8-9e63-c52e29ffb1ec {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:56:22 devstack cinder-volume[87098]: DEBUG dbcounter [-] [87098] Writing DB stats cinder:UPDATE=87,cinder:SELECT=74,cinder:INSERT=19,cinder:DELETE=8 {{(pid=87098) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 13 13:56:22 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-d3d595e3-5b14-487e-bc55-e6095fbf0b38 tempest-VolumesCloneNegativeTest-1858761002 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 13:56:22 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-d3d595e3-5b14-487e-bc55-e6095fbf0b38 tempest-VolumesCloneNegativeTest-1858761002 None] Flow 'volume_create_manager' (7115da86-d378-4f14-88c4-e8d4b4d9ad8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 13:56:22 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-d3d595e3-5b14-487e-bc55-e6095fbf0b38 tempest-VolumesCloneNegativeTest-1858761002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d95554e6-9387-4a1e-8aae-18b4ddeaee0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:56:22 devstack sudo[96207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-f0f90412-6f60-4a82-852a-f8b8820e313f.9f45a9cc-1d93-4da8-9e63-c52e29ffb1ec Jul 13 13:56:22 devstack sudo[96207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:56:22 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-d3d595e3-5b14-487e-bc55-e6095fbf0b38 tempest-VolumesCloneNegativeTest-1858761002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d95554e6-9387-4a1e-8aae-18b4ddeaee0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T11:56:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-540686251',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f3e7ab5-5c0a-4c0b-b5cf-db7544d7144e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21e4efbf5496469c874646bb39ac9c79',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T11:56:22Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T11:56:22Z,use_quota=True,user_id='56cb3fcee699431cb6ec7f97dc54642d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1147de8b-623b-426c-a13d-7fc824a80f67),volume_type_id=1147de8b-623b-426c-a13d-7fc824a80f67)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:56:22 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-d3d595e3-5b14-487e-bc55-e6095fbf0b38 tempest-VolumesCloneNegativeTest-1858761002 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (463fe860-93e8-4ee6-8295-73ac593db4a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:56:22 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-d3d595e3-5b14-487e-bc55-e6095fbf0b38 tempest-VolumesCloneNegativeTest-1858761002 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (463fe860-93e8-4ee6-8295-73ac593db4a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:56:22 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-d3d595e3-5b14-487e-bc55-e6095fbf0b38 tempest-VolumesCloneNegativeTest-1858761002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7990233-7841-42c3-86c9-f4e7216784de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:56:22 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-d3d595e3-5b14-487e-bc55-e6095fbf0b38 tempest-VolumesCloneNegativeTest-1858761002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7990233-7841-42c3-86c9-f4e7216784de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8f3e7ab5-5c0a-4c0b-b5cf-db7544d7144e', 'volume_name': 'volume-8f3e7ab5-5c0a-4c0b-b5cf-db7544d7144e', 'volume_size': 2}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:56:22 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-d3d595e3-5b14-487e-bc55-e6095fbf0b38 tempest-VolumesCloneNegativeTest-1858761002 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a71fe94-fbaa-4f75-9bff-64d8ec1902fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:56:22 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-d3d595e3-5b14-487e-bc55-e6095fbf0b38 tempest-VolumesCloneNegativeTest-1858761002 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a71fe94-fbaa-4f75-9bff-64d8ec1902fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:56:22 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-d3d595e3-5b14-487e-bc55-e6095fbf0b38 tempest-VolumesCloneNegativeTest-1858761002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e68e8eb3-9bd0-4f55-b244-b5c05f9e64dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:56:22 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-d3d595e3-5b14-487e-bc55-e6095fbf0b38 tempest-VolumesCloneNegativeTest-1858761002 None] Volume 8f3e7ab5-5c0a-4c0b-b5cf-db7544d7144e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8f3e7ab5-5c0a-4c0b-b5cf-db7544d7144e', 'volume_size': 2} Jul 13 13:56:22 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-d3d595e3-5b14-487e-bc55-e6095fbf0b38 tempest-VolumesCloneNegativeTest-1858761002 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:56:22 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-d3d595e3-5b14-487e-bc55-e6095fbf0b38 tempest-VolumesCloneNegativeTest-1858761002 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:56:22 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-d3d595e3-5b14-487e-bc55-e6095fbf0b38 tempest-VolumesCloneNegativeTest-1858761002 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T11:56:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-540686251',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f3e7ab5-5c0a-4c0b-b5cf-db7544d7144e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21e4efbf5496469c874646bb39ac9c79',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T11:56:22Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T11:56:22Z,use_quota=True,user_id='56cb3fcee699431cb6ec7f97dc54642d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1147de8b-623b-426c-a13d-7fc824a80f67),volume_type_id=1147de8b-623b-426c-a13d-7fc824a80f67)}" {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 13 13:56:22 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-d3d595e3-5b14-487e-bc55-e6095fbf0b38 tempest-VolumesCloneNegativeTest-1858761002 None] Creating volume 8f3e7ab5-5c0a-4c0b-b5cf-db7544d7144e {{(pid=87098) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 13 13:56:22 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-d3d595e3-5b14-487e-bc55-e6095fbf0b38 tempest-VolumesCloneNegativeTest-1858761002 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:56:22 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-d3d595e3-5b14-487e-bc55-e6095fbf0b38 tempest-VolumesCloneNegativeTest-1858761002 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:56:22 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-d3d595e3-5b14-487e-bc55-e6095fbf0b38 tempest-VolumesCloneNegativeTest-1858761002 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 13:56:22 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-d3d595e3-5b14-487e-bc55-e6095fbf0b38 tempest-VolumesCloneNegativeTest-1858761002 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 13:56:22 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-d3d595e3-5b14-487e-bc55-e6095fbf0b38 tempest-VolumesCloneNegativeTest-1858761002 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:56:22 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-d3d595e3-5b14-487e-bc55-e6095fbf0b38 tempest-VolumesCloneNegativeTest-1858761002 None] Selected osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 13:56:22 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-d3d595e3-5b14-487e-bc55-e6095fbf0b38 tempest-VolumesCloneNegativeTest-1858761002 None] casted to osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 Jul 13 13:56:22 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-d3d595e3-5b14-487e-bc55-e6095fbf0b38 tempest-VolumesCloneNegativeTest-1858761002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-8f3e7ab5-5c0a-4c0b-b5cf-db7544d7144e 2147483648 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:56:22 devstack sudo[96209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-8f3e7ab5-5c0a-4c0b-b5cf-db7544d7144e 2147483648 Jul 13 13:56:22 devstack sudo[96209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:56:22 devstack sudo[96207]: pam_unix(sudo:session): session closed for user root Jul 13 13:56:22 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-64b7395e-0aef-453c-8e2d-e51d6c0cd4ab tempest-VolumesSnapshotListTestJSON-2079198915 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-f0f90412-6f60-4a82-852a-f8b8820e313f.9f45a9cc-1d93-4da8-9e63-c52e29ffb1ec" returned: 0 in 0.495s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:56:22 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-64b7395e-0aef-453c-8e2d-e51d6c0cd4ab tempest-VolumesSnapshotListTestJSON-2079198915 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f0f90412-6f60-4a82-852a-f8b8820e313f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87098) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 13 13:56:22 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-64b7395e-0aef-453c-8e2d-e51d6c0cd4ab tempest-VolumesSnapshotListTestJSON-2079198915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-f0f90412-6f60-4a82-852a-f8b8820e313f.4855e641-f25b-46dc-a5e8-1e24fe394f11 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:56:22 devstack sudo[96214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-f0f90412-6f60-4a82-852a-f8b8820e313f.4855e641-f25b-46dc-a5e8-1e24fe394f11 Jul 13 13:56:22 devstack sudo[96214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:56:23 devstack sudo[96214]: pam_unix(sudo:session): session closed for user root Jul 13 13:56:23 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-64b7395e-0aef-453c-8e2d-e51d6c0cd4ab tempest-VolumesSnapshotListTestJSON-2079198915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-f0f90412-6f60-4a82-852a-f8b8820e313f.4855e641-f25b-46dc-a5e8-1e24fe394f11" returned: 0 in 0.530s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:56:23 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-64b7395e-0aef-453c-8e2d-e51d6c0cd4ab tempest-VolumesSnapshotListTestJSON-2079198915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-f0f90412-6f60-4a82-852a-f8b8820e313f.4855e641-f25b-46dc-a5e8-1e24fe394f11 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:56:23 devstack sudo[96209]: pam_unix(sudo:session): session closed for user root Jul 13 13:56:23 devstack sudo[96223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-f0f90412-6f60-4a82-852a-f8b8820e313f.4855e641-f25b-46dc-a5e8-1e24fe394f11 Jul 13 13:56:23 devstack sudo[96223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:56:23 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-d3d595e3-5b14-487e-bc55-e6095fbf0b38 tempest-VolumesCloneNegativeTest-1858761002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-8f3e7ab5-5c0a-4c0b-b5cf-db7544d7144e 2147483648" returned: 0 in 0.797s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:56:23 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-d3d595e3-5b14-487e-bc55-e6095fbf0b38 tempest-VolumesCloneNegativeTest-1858761002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-8f3e7ab5-5c0a-4c0b-b5cf-db7544d7144e {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:56:23 devstack sudo[96225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-8f3e7ab5-5c0a-4c0b-b5cf-db7544d7144e Jul 13 13:56:23 devstack sudo[96225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:56:23 devstack sudo[96223]: pam_unix(sudo:session): session closed for user root Jul 13 13:56:23 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-64b7395e-0aef-453c-8e2d-e51d6c0cd4ab tempest-VolumesSnapshotListTestJSON-2079198915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-f0f90412-6f60-4a82-852a-f8b8820e313f.4855e641-f25b-46dc-a5e8-1e24fe394f11" returned: 0 in 0.319s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:56:23 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-64b7395e-0aef-453c-8e2d-e51d6c0cd4ab tempest-VolumesSnapshotListTestJSON-2079198915 None] Lock "cinder-quobyte-4855e641-f25b-46dc-a5e8-1e24fe394f11" released by "_delete_snapshot" :: held 2.216s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 13:56:23 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-64b7395e-0aef-453c-8e2d-e51d6c0cd4ab tempest-VolumesSnapshotListTestJSON-2079198915 None] Lock "cinder-quobyte-f0f90412-6f60-4a82-852a-f8b8820e313f" released by "delete_snapshot" :: held 2.276s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 13:56:23 devstack sudo[96225]: pam_unix(sudo:session): session closed for user root Jul 13 13:56:23 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-d3d595e3-5b14-487e-bc55-e6095fbf0b38 tempest-VolumesCloneNegativeTest-1858761002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-8f3e7ab5-5c0a-4c0b-b5cf-db7544d7144e" returned: 0 in 0.405s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:56:23 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-d3d595e3-5b14-487e-bc55-e6095fbf0b38 tempest-VolumesCloneNegativeTest-1858761002 None] <== create_volume: return (1268ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'} {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 13 13:56:23 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-d3d595e3-5b14-487e-bc55-e6095fbf0b38 tempest-VolumesCloneNegativeTest-1858761002 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.274s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:56:23 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-d3d595e3-5b14-487e-bc55-e6095fbf0b38 tempest-VolumesCloneNegativeTest-1858761002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e68e8eb3-9bd0-4f55-b244-b5c05f9e64dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8f3e7ab5-5c0a-4c0b-b5cf-db7544d7144e', 'volume_size': 2}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:56:23 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-d3d595e3-5b14-487e-bc55-e6095fbf0b38 tempest-VolumesCloneNegativeTest-1858761002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06e811d8-5e71-4ff3-ac56-6e59562f20e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:56:23 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-64b7395e-0aef-453c-8e2d-e51d6c0cd4ab tempest-VolumesSnapshotListTestJSON-2079198915 None] Created reservations ['ed777fd6-fed2-4610-ab7e-eb546370a305', 'c63ba18e-ff8f-414c-aa0b-b5cf059ea263', '95375f07-07e7-443a-b5eb-5cceeda2b4d4', 'cdd6eb27-bb22-4652-be70-f9d1ece3992e'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 13:56:23 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-d3d595e3-5b14-487e-bc55-e6095fbf0b38 tempest-VolumesCloneNegativeTest-1858761002 None] Volume volume-8f3e7ab5-5c0a-4c0b-b5cf-db7544d7144e (8f3e7ab5-5c0a-4c0b-b5cf-db7544d7144e): created successfully Jul 13 13:56:23 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-d3d595e3-5b14-487e-bc55-e6095fbf0b38 tempest-VolumesCloneNegativeTest-1858761002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06e811d8-5e71-4ff3-ac56-6e59562f20e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:56:23 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-d3d595e3-5b14-487e-bc55-e6095fbf0b38 tempest-VolumesCloneNegativeTest-1858761002 None] Flow 'volume_create_manager' (7115da86-d378-4f14-88c4-e8d4b4d9ad8a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 13:56:23 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-d3d595e3-5b14-487e-bc55-e6095fbf0b38 tempest-VolumesCloneNegativeTest-1858761002 None] Created volume successfully. Jul 13 13:56:23 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-64b7395e-0aef-453c-8e2d-e51d6c0cd4ab tempest-VolumesSnapshotListTestJSON-2079198915 None] Delete snapshot completed successfully. Jul 13 13:56:23 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-64b7395e-0aef-453c-8e2d-e51d6c0cd4ab tempest-VolumesSnapshotListTestJSON-2079198915 None] Lock "cinder-4855e641-f25b-46dc-a5e8-1e24fe394f11-delete_snapshot" released by "delete_snapshot" :: held 2.598s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 13:56:24 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-61258400-8143-4d69-b582-46daabd919a0 tempest-VolumesCloneNegativeTest-1858761002 None] Acquiring lock "cinder-8f3e7ab5-5c0a-4c0b-b5cf-db7544d7144e-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 13:56:24 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-61258400-8143-4d69-b582-46daabd919a0 tempest-VolumesCloneNegativeTest-1858761002 None] Lock "cinder-8f3e7ab5-5c0a-4c0b-b5cf-db7544d7144e-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 13:56:24 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-61258400-8143-4d69-b582-46daabd919a0 tempest-VolumesCloneNegativeTest-1858761002 None] Acquiring lock "cinder-quobyte-8f3e7ab5-5c0a-4c0b-b5cf-db7544d7144e" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 13:56:24 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-61258400-8143-4d69-b582-46daabd919a0 tempest-VolumesCloneNegativeTest-1858761002 None] Lock "cinder-quobyte-8f3e7ab5-5c0a-4c0b-b5cf-db7544d7144e" acquired by "delete_volume" :: waited 0.024s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 13:56:24 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-843331bc-5e60-4911-a10b-ef33f23f9b24 tempest-VolumesSnapshotListTestJSON-2079198915 None] Acquiring lock "cinder-9f45a9cc-1d93-4da8-9e63-c52e29ffb1ec-delete_snapshot" by "delete_snapshot" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 13:56:24 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[13e9ed5a-fd00-460e-a2c4-535a8cd55683]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 13:56:24 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-61258400-8143-4d69-b582-46daabd919a0 tempest-VolumesCloneNegativeTest-1858761002 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-8f3e7ab5-5c0a-4c0b-b5cf-db7544d7144e {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:56:24 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-843331bc-5e60-4911-a10b-ef33f23f9b24 tempest-VolumesSnapshotListTestJSON-2079198915 None] Lock "cinder-9f45a9cc-1d93-4da8-9e63-c52e29ffb1ec-delete_snapshot" acquired by "delete_snapshot" :: waited 0.047s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 13:56:24 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-843331bc-5e60-4911-a10b-ef33f23f9b24 tempest-VolumesSnapshotListTestJSON-2079198915 None] Acquiring lock "cinder-quobyte-f0f90412-6f60-4a82-852a-f8b8820e313f" by "delete_snapshot" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 13:56:24 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-843331bc-5e60-4911-a10b-ef33f23f9b24 tempest-VolumesSnapshotListTestJSON-2079198915 None] Lock "cinder-quobyte-f0f90412-6f60-4a82-852a-f8b8820e313f" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 13:56:24 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-843331bc-5e60-4911-a10b-ef33f23f9b24 tempest-VolumesSnapshotListTestJSON-2079198915 None] Acquiring lock "cinder-quobyte-9f45a9cc-1d93-4da8-9e63-c52e29ffb1ec" by "_delete_snapshot" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 13:56:24 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-843331bc-5e60-4911-a10b-ef33f23f9b24 tempest-VolumesSnapshotListTestJSON-2079198915 None] Lock "cinder-quobyte-9f45a9cc-1d93-4da8-9e63-c52e29ffb1ec" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 13:56:24 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-843331bc-5e60-4911-a10b-ef33f23f9b24 tempest-VolumesSnapshotListTestJSON-2079198915 None] Deleting offline snapshot 9f45a9cc-1d93-4da8-9e63-c52e29ffb1ec of volume f0f90412-6f60-4a82-852a-f8b8820e313f {{(pid=87098) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 13 13:56:24 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-843331bc-5e60-4911-a10b-ef33f23f9b24 tempest-VolumesSnapshotListTestJSON-2079198915 None] snapshot_file for this snap is: volume-f0f90412-6f60-4a82-852a-f8b8820e313f.9f45a9cc-1d93-4da8-9e63-c52e29ffb1ec {{(pid=87098) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 13 13:56:24 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bfd0981-f87a-49f3-8770-fdf4bf9f24d6]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 13:56:24 devstack sudo[96229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-8f3e7ab5-5c0a-4c0b-b5cf-db7544d7144e Jul 13 13:56:24 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-843331bc-5e60-4911-a10b-ef33f23f9b24 tempest-VolumesSnapshotListTestJSON-2079198915 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-f0f90412-6f60-4a82-852a-f8b8820e313f.9f45a9cc-1d93-4da8-9e63-c52e29ffb1ec {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:56:24 devstack sudo[96229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:56:24 devstack sudo[96231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-f0f90412-6f60-4a82-852a-f8b8820e313f.9f45a9cc-1d93-4da8-9e63-c52e29ffb1ec Jul 13 13:56:24 devstack sudo[96231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:56:25 devstack sudo[96229]: pam_unix(sudo:session): session closed for user root Jul 13 13:56:25 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-61258400-8143-4d69-b582-46daabd919a0 tempest-VolumesCloneNegativeTest-1858761002 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-8f3e7ab5-5c0a-4c0b-b5cf-db7544d7144e" returned: 0 in 0.442s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:56:25 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-61258400-8143-4d69-b582-46daabd919a0 tempest-VolumesCloneNegativeTest-1858761002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-8f3e7ab5-5c0a-4c0b-b5cf-db7544d7144e {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:56:25 devstack sudo[96236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-8f3e7ab5-5c0a-4c0b-b5cf-db7544d7144e Jul 13 13:56:25 devstack sudo[96236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:56:25 devstack sudo[96231]: pam_unix(sudo:session): session closed for user root Jul 13 13:56:25 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-843331bc-5e60-4911-a10b-ef33f23f9b24 tempest-VolumesSnapshotListTestJSON-2079198915 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-f0f90412-6f60-4a82-852a-f8b8820e313f.9f45a9cc-1d93-4da8-9e63-c52e29ffb1ec" returned: 0 in 0.456s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:56:25 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-843331bc-5e60-4911-a10b-ef33f23f9b24 tempest-VolumesSnapshotListTestJSON-2079198915 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f0f90412-6f60-4a82-852a-f8b8820e313f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87098) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 13 13:56:25 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b89272b-a8d0-41d7-9880-5647d0df97ff]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 13:56:25 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-843331bc-5e60-4911-a10b-ef33f23f9b24 tempest-VolumesSnapshotListTestJSON-2079198915 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-f0f90412-6f60-4a82-852a-f8b8820e313f {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:56:25 devstack sudo[96241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-f0f90412-6f60-4a82-852a-f8b8820e313f Jul 13 13:56:25 devstack sudo[96241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:56:25 devstack sudo[96236]: pam_unix(sudo:session): session closed for user root Jul 13 13:56:25 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-61258400-8143-4d69-b582-46daabd919a0 tempest-VolumesCloneNegativeTest-1858761002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-8f3e7ab5-5c0a-4c0b-b5cf-db7544d7144e" returned: 0 in 0.347s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:56:25 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-61258400-8143-4d69-b582-46daabd919a0 tempest-VolumesCloneNegativeTest-1858761002 None] Lock "cinder-quobyte-8f3e7ab5-5c0a-4c0b-b5cf-db7544d7144e" released by "delete_volume" :: held 0.856s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 13:56:25 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-61258400-8143-4d69-b582-46daabd919a0 tempest-VolumesCloneNegativeTest-1858761002 None] Created reservations ['a82e651a-cef1-44f8-975c-338197099c10', 'da05b90e-f1cd-47d2-9c43-4707192572f9', 'b6e66f44-8bfd-4d19-89c4-e92d0d3537c6', '6864ce7d-a3f9-45c7-b91e-834b66548d73'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 13:56:25 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-61258400-8143-4d69-b582-46daabd919a0 tempest-VolumesCloneNegativeTest-1858761002 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:56:25 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-61258400-8143-4d69-b582-46daabd919a0 tempest-VolumesCloneNegativeTest-1858761002 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:56:25 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-61258400-8143-4d69-b582-46daabd919a0 tempest-VolumesCloneNegativeTest-1858761002 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 13:56:25 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-61258400-8143-4d69-b582-46daabd919a0 tempest-VolumesCloneNegativeTest-1858761002 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 13:56:25 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-61258400-8143-4d69-b582-46daabd919a0 tempest-VolumesCloneNegativeTest-1858761002 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:56:25 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-61258400-8143-4d69-b582-46daabd919a0 tempest-VolumesCloneNegativeTest-1858761002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:56:25 devstack sudo[96246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 Jul 13 13:56:25 devstack sudo[96246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:56:26 devstack sudo[96241]: pam_unix(sudo:session): session closed for user root Jul 13 13:56:26 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-843331bc-5e60-4911-a10b-ef33f23f9b24 tempest-VolumesSnapshotListTestJSON-2079198915 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-f0f90412-6f60-4a82-852a-f8b8820e313f" returned: 0 in 0.750s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:56:26 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-843331bc-5e60-4911-a10b-ef33f23f9b24 tempest-VolumesSnapshotListTestJSON-2079198915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-f0f90412-6f60-4a82-852a-f8b8820e313f.9f45a9cc-1d93-4da8-9e63-c52e29ffb1ec {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:56:26 devstack sudo[96249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-f0f90412-6f60-4a82-852a-f8b8820e313f.9f45a9cc-1d93-4da8-9e63-c52e29ffb1ec Jul 13 13:56:26 devstack sudo[96249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:56:26 devstack sudo[96246]: pam_unix(sudo:session): session closed for user root Jul 13 13:56:26 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-61258400-8143-4d69-b582-46daabd919a0 tempest-VolumesCloneNegativeTest-1858761002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78" returned: 0 in 0.337s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:56:26 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-61258400-8143-4d69-b582-46daabd919a0 tempest-VolumesCloneNegativeTest-1858761002 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 13:56:26 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-61258400-8143-4d69-b582-46daabd919a0 tempest-VolumesCloneNegativeTest-1858761002 None] Deleted volume successfully. Jul 13 13:56:26 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-61258400-8143-4d69-b582-46daabd919a0 tempest-VolumesCloneNegativeTest-1858761002 None] Lock "cinder-8f3e7ab5-5c0a-4c0b-b5cf-db7544d7144e-delete_volume" released by "delete_volume" :: held 1.743s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 13:56:26 devstack sudo[96249]: pam_unix(sudo:session): session closed for user root Jul 13 13:56:26 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-843331bc-5e60-4911-a10b-ef33f23f9b24 tempest-VolumesSnapshotListTestJSON-2079198915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-f0f90412-6f60-4a82-852a-f8b8820e313f.9f45a9cc-1d93-4da8-9e63-c52e29ffb1ec" returned: 0 in 0.729s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:56:26 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-843331bc-5e60-4911-a10b-ef33f23f9b24 tempest-VolumesSnapshotListTestJSON-2079198915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-f0f90412-6f60-4a82-852a-f8b8820e313f.9f45a9cc-1d93-4da8-9e63-c52e29ffb1ec {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:56:26 devstack sudo[96256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-f0f90412-6f60-4a82-852a-f8b8820e313f.9f45a9cc-1d93-4da8-9e63-c52e29ffb1ec Jul 13 13:56:26 devstack sudo[96256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:56:27 devstack sudo[96256]: pam_unix(sudo:session): session closed for user root Jul 13 13:56:27 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-843331bc-5e60-4911-a10b-ef33f23f9b24 tempest-VolumesSnapshotListTestJSON-2079198915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-f0f90412-6f60-4a82-852a-f8b8820e313f.9f45a9cc-1d93-4da8-9e63-c52e29ffb1ec" returned: 0 in 0.404s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:56:27 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-843331bc-5e60-4911-a10b-ef33f23f9b24 tempest-VolumesSnapshotListTestJSON-2079198915 None] Lock "cinder-quobyte-9f45a9cc-1d93-4da8-9e63-c52e29ffb1ec" released by "_delete_snapshot" :: held 2.499s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 13:56:27 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-843331bc-5e60-4911-a10b-ef33f23f9b24 tempest-VolumesSnapshotListTestJSON-2079198915 None] Lock "cinder-quobyte-f0f90412-6f60-4a82-852a-f8b8820e313f" released by "delete_snapshot" :: held 2.538s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 13:56:27 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-843331bc-5e60-4911-a10b-ef33f23f9b24 tempest-VolumesSnapshotListTestJSON-2079198915 None] Created reservations ['c3d83cda-3232-4e14-8fc0-41231508ac45', '85fab2ec-cd97-4dfb-be38-a1bd088be85b', '347d87a4-5a28-4c04-aa6a-687d5873883d', '6246c69f-ba04-486e-a46b-1ba9bc82da96'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 13:56:27 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-843331bc-5e60-4911-a10b-ef33f23f9b24 tempest-VolumesSnapshotListTestJSON-2079198915 None] Delete snapshot completed successfully. Jul 13 13:56:27 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-843331bc-5e60-4911-a10b-ef33f23f9b24 tempest-VolumesSnapshotListTestJSON-2079198915 None] Lock "cinder-9f45a9cc-1d93-4da8-9e63-c52e29ffb1ec-delete_snapshot" released by "delete_snapshot" :: held 2.763s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 13:56:28 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-62fa70a3-530a-40c6-80b8-0f446bd45b27 tempest-VolumesSnapshotListTestJSON-2079198915 None] Acquiring lock "cinder-f0f90412-6f60-4a82-852a-f8b8820e313f-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 13:56:28 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-62fa70a3-530a-40c6-80b8-0f446bd45b27 tempest-VolumesSnapshotListTestJSON-2079198915 None] Lock "cinder-f0f90412-6f60-4a82-852a-f8b8820e313f-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 13:56:28 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-62fa70a3-530a-40c6-80b8-0f446bd45b27 tempest-VolumesSnapshotListTestJSON-2079198915 None] Acquiring lock "cinder-quobyte-f0f90412-6f60-4a82-852a-f8b8820e313f" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 13:56:28 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-62fa70a3-530a-40c6-80b8-0f446bd45b27 tempest-VolumesSnapshotListTestJSON-2079198915 None] Lock "cinder-quobyte-f0f90412-6f60-4a82-852a-f8b8820e313f" acquired by "delete_volume" :: waited 0.026s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 13:56:28 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[9652e54c-464e-4ce4-93f0-0ffdf55c48cc]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 13:56:28 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-62fa70a3-530a-40c6-80b8-0f446bd45b27 tempest-VolumesSnapshotListTestJSON-2079198915 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-f0f90412-6f60-4a82-852a-f8b8820e313f {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:56:28 devstack sudo[96259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-f0f90412-6f60-4a82-852a-f8b8820e313f Jul 13 13:56:28 devstack sudo[96259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:56:28 devstack sudo[96259]: pam_unix(sudo:session): session closed for user root Jul 13 13:56:28 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-62fa70a3-530a-40c6-80b8-0f446bd45b27 tempest-VolumesSnapshotListTestJSON-2079198915 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-f0f90412-6f60-4a82-852a-f8b8820e313f" returned: 0 in 0.628s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:56:28 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-62fa70a3-530a-40c6-80b8-0f446bd45b27 tempest-VolumesSnapshotListTestJSON-2079198915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-f0f90412-6f60-4a82-852a-f8b8820e313f {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:56:28 devstack sudo[96286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-f0f90412-6f60-4a82-852a-f8b8820e313f Jul 13 13:56:28 devstack sudo[96286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:56:29 devstack cinder-volume[87098]: DEBUG oslo_service.periodic_task [None req-727a1692-ea28-4a77-b327-0d94e8f01efb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87098) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 13 13:56:29 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-727a1692-ea28-4a77-b327-0d94e8f01efb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:56:29 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-727a1692-ea28-4a77-b327-0d94e8f01efb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:56:29 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-727a1692-ea28-4a77-b327-0d94e8f01efb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 13:56:29 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-727a1692-ea28-4a77-b327-0d94e8f01efb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 13:56:29 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-727a1692-ea28-4a77-b327-0d94e8f01efb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:56:29 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-727a1692-ea28-4a77-b327-0d94e8f01efb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:56:29 devstack sudo[96288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 Jul 13 13:56:29 devstack sudo[96288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:56:29 devstack sudo[96286]: pam_unix(sudo:session): session closed for user root Jul 13 13:56:29 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-62fa70a3-530a-40c6-80b8-0f446bd45b27 tempest-VolumesSnapshotListTestJSON-2079198915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-f0f90412-6f60-4a82-852a-f8b8820e313f" returned: 0 in 0.381s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:56:29 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-62fa70a3-530a-40c6-80b8-0f446bd45b27 tempest-VolumesSnapshotListTestJSON-2079198915 None] Lock "cinder-quobyte-f0f90412-6f60-4a82-852a-f8b8820e313f" released by "delete_volume" :: held 1.118s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 13:56:29 devstack sudo[96288]: pam_unix(sudo:session): session closed for user root Jul 13 13:56:29 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-727a1692-ea28-4a77-b327-0d94e8f01efb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78" returned: 0 in 0.361s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:56:29 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-727a1692-ea28-4a77-b327-0d94e8f01efb None None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 13:56:29 devstack cinder-volume[87098]: DEBUG oslo_service.periodic_task [None req-727a1692-ea28-4a77-b327-0d94e8f01efb None None] Running periodic task VolumeManager._thread_info {{(pid=87098) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 13 13:56:29 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-727a1692-ea28-4a77-b327-0d94e8f01efb None None] thread count: 28 {{(pid=87098) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 13 13:56:29 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-727a1692-ea28-4a77-b327-0d94e8f01efb None None] thread info: [<_MainThread(MainThread, started 127988054597760)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87098) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 13 13:56:29 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-62fa70a3-530a-40c6-80b8-0f446bd45b27 tempest-VolumesSnapshotListTestJSON-2079198915 None] Created reservations ['13c651f4-35a4-4d35-a723-59a82896055c', '9e34be2d-dc83-4328-bdf7-0dea44f0ac84', '70735f9e-26aa-4cc6-89e9-7e37dec74f92', '82332d30-9aaa-4caa-9b63-b24ad5dc212b'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 13:56:29 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-62fa70a3-530a-40c6-80b8-0f446bd45b27 tempest-VolumesSnapshotListTestJSON-2079198915 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:56:29 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-62fa70a3-530a-40c6-80b8-0f446bd45b27 tempest-VolumesSnapshotListTestJSON-2079198915 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:56:29 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-62fa70a3-530a-40c6-80b8-0f446bd45b27 tempest-VolumesSnapshotListTestJSON-2079198915 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 13:56:29 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-62fa70a3-530a-40c6-80b8-0f446bd45b27 tempest-VolumesSnapshotListTestJSON-2079198915 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 13:56:29 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-62fa70a3-530a-40c6-80b8-0f446bd45b27 tempest-VolumesSnapshotListTestJSON-2079198915 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:56:29 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-62fa70a3-530a-40c6-80b8-0f446bd45b27 tempest-VolumesSnapshotListTestJSON-2079198915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:56:29 devstack sudo[96292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 Jul 13 13:56:29 devstack sudo[96292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:56:29 devstack sudo[96292]: pam_unix(sudo:session): session closed for user root Jul 13 13:56:29 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-62fa70a3-530a-40c6-80b8-0f446bd45b27 tempest-VolumesSnapshotListTestJSON-2079198915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78" returned: 0 in 0.278s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:56:29 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-62fa70a3-530a-40c6-80b8-0f446bd45b27 tempest-VolumesSnapshotListTestJSON-2079198915 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 13:56:29 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-62fa70a3-530a-40c6-80b8-0f446bd45b27 tempest-VolumesSnapshotListTestJSON-2079198915 None] Deleted volume successfully. Jul 13 13:56:29 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-62fa70a3-530a-40c6-80b8-0f446bd45b27 tempest-VolumesSnapshotListTestJSON-2079198915 None] Lock "cinder-f0f90412-6f60-4a82-852a-f8b8820e313f-delete_volume" released by "delete_volume" :: held 1.700s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 13:56:30 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-99c284c1-daeb-41c8-8678-6bec909fcab5 tempest-VolumesExtendTest-2088231311 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 13:56:30 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-99c284c1-daeb-41c8-8678-6bec909fcab5 tempest-VolumesExtendTest-2088231311 None] Flow 'volume_create_manager' (e5fa2b69-766e-47b8-a2c7-66a975d23bdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 13:56:30 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-99c284c1-daeb-41c8-8678-6bec909fcab5 tempest-VolumesExtendTest-2088231311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7043af32-f93e-4700-a3d6-9a4576a5843b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:56:30 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-99c284c1-daeb-41c8-8678-6bec909fcab5 tempest-VolumesExtendTest-2088231311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7043af32-f93e-4700-a3d6-9a4576a5843b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T11:56:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-2026949087',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e22e7f37-c1c5-4cb3-9c93-aa445878b11b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9490e79373844d7baac213a3e1e0a9fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T11:56:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T11:56:31Z,use_quota=True,user_id='b7e125c64eea41cea8636d3dc7d1b63c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1147de8b-623b-426c-a13d-7fc824a80f67),volume_type_id=1147de8b-623b-426c-a13d-7fc824a80f67)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:56:30 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-99c284c1-daeb-41c8-8678-6bec909fcab5 tempest-VolumesExtendTest-2088231311 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (408d8c50-6a5d-4d7d-aead-967a61913f81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:56:30 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-99c284c1-daeb-41c8-8678-6bec909fcab5 tempest-VolumesExtendTest-2088231311 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (408d8c50-6a5d-4d7d-aead-967a61913f81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:56:30 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-99c284c1-daeb-41c8-8678-6bec909fcab5 tempest-VolumesExtendTest-2088231311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (141e0819-7677-47bb-869c-6e115a7378bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:56:30 devstack cinder-volume[87098]: DEBUG cinder.image.glance [None req-99c284c1-daeb-41c8-8678-6bec909fcab5 tempest-VolumesExtendTest-2088231311 None] Creating Keystone auth plugin from conf {{(pid=87098) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 13 13:56:31 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-99c284c1-daeb-41c8-8678-6bec909fcab5 tempest-VolumesExtendTest-2088231311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (141e0819-7677-47bb-869c-6e115a7378bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'e22e7f37-c1c5-4cb3-9c93-aa445878b11b', 'volume_name': 'volume-e22e7f37-c1c5-4cb3-9c93-aa445878b11b', 'volume_size': 1, 'image_id': 'def20bd7-001f-4245-a717-37b9a4cc8574', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/def20bd7-001f-4245-a717-37b9a4cc8574', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '2181cd3fc958400682584829a80e727e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'def20bd7-001f-4245-a717-37b9a4cc8574', 'created_at': datetime.datetime(2026, 7, 13, 11, 42, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 13, 11, 42, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/def20bd7-001f-4245-a717-37b9a4cc8574/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:56:31 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-99c284c1-daeb-41c8-8678-6bec909fcab5 tempest-VolumesExtendTest-2088231311 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4936aab-bd37-4b5a-b024-f51cb5a7fc90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:56:31 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-99c284c1-daeb-41c8-8678-6bec909fcab5 tempest-VolumesExtendTest-2088231311 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4936aab-bd37-4b5a-b024-f51cb5a7fc90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:56:31 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-99c284c1-daeb-41c8-8678-6bec909fcab5 tempest-VolumesExtendTest-2088231311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63b88ad6-f904-406f-9c7f-6e598656d08b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:56:31 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-99c284c1-daeb-41c8-8678-6bec909fcab5 tempest-VolumesExtendTest-2088231311 None] Volume e22e7f37-c1c5-4cb3-9c93-aa445878b11b: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-e22e7f37-c1c5-4cb3-9c93-aa445878b11b', 'volume_size': 1, 'image_id': 'def20bd7-001f-4245-a717-37b9a4cc8574', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/def20bd7-001f-4245-a717-37b9a4cc8574', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '2181cd3fc958400682584829a80e727e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'def20bd7-001f-4245-a717-37b9a4cc8574', 'created_at': datetime.datetime(2026, 7, 13, 11, 42, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 13, 11, 42, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/def20bd7-001f-4245-a717-37b9a4cc8574/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 13 13:56:31 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-99c284c1-daeb-41c8-8678-6bec909fcab5 tempest-VolumesExtendTest-2088231311 None] Trying to clone e22e7f37-c1c5-4cb3-9c93-aa445878b11b from image def20bd7-001f-4245-a717-37b9a4cc8574 at location (None, [{'url': 'file:///opt/stack/data/glance/images/def20bd7-001f-4245-a717-37b9a4cc8574', 'metadata': {}}]). {{(pid=87098) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 13 13:56:31 devstack cinder-volume[87098]: DEBUG cinder.image.image_utils [None req-99c284c1-daeb-41c8-8678-6bec909fcab5 tempest-VolumesExtendTest-2088231311 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_def20bd7-001f-4245-a717-37b9a4cc8574_puis4mk9devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87098) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 13 13:56:31 devstack cinder-volume[87098]: INFO cinder.image.image_utils [None req-99c284c1-daeb-41c8-8678-6bec909fcab5 tempest-VolumesExtendTest-2088231311 None] Image download 20.69 MB at 20.69 MB/s Jul 13 13:56:31 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ce8b54c-f482-4a76-b4e0-3f0ce86a12c0]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 13:56:31 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-99c284c1-daeb-41c8-8678-6bec909fcab5 tempest-VolumesExtendTest-2088231311 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_def20bd7-001f-4245-a717-37b9a4cc8574_puis4mk9devstack@QuobyteHD {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:56:31 devstack sudo[96296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_def20bd7-001f-4245-a717-37b9a4cc8574_puis4mk9devstack@QuobyteHD Jul 13 13:56:31 devstack sudo[96296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:56:32 devstack sudo[96296]: pam_unix(sudo:session): session closed for user root Jul 13 13:56:32 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-99c284c1-daeb-41c8-8678-6bec909fcab5 tempest-VolumesExtendTest-2088231311 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_def20bd7-001f-4245-a717-37b9a4cc8574_puis4mk9devstack@QuobyteHD" returned: 0 in 0.482s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:56:32 devstack cinder-volume[87098]: DEBUG cinder.image.image_utils [None req-99c284c1-daeb-41c8-8678-6bec909fcab5 tempest-VolumesExtendTest-2088231311 None] Temporary image def20bd7-001f-4245-a717-37b9a4cc8574 is fetched for user b7e125c64eea41cea8636d3dc7d1b63c. {{(pid=87098) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 13 13:56:32 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[baaa28af-42f5-4014-bf75-12fa278e9fb3]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 13:56:32 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-99c284c1-daeb-41c8-8678-6bec909fcab5 tempest-VolumesExtendTest-2088231311 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_def20bd7-001f-4245-a717-37b9a4cc8574_puis4mk9devstack@QuobyteHD {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:56:32 devstack sudo[96301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_def20bd7-001f-4245-a717-37b9a4cc8574_puis4mk9devstack@QuobyteHD Jul 13 13:56:32 devstack sudo[96301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:56:32 devstack sudo[96301]: pam_unix(sudo:session): session closed for user root Jul 13 13:56:32 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-99c284c1-daeb-41c8-8678-6bec909fcab5 tempest-VolumesExtendTest-2088231311 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_def20bd7-001f-4245-a717-37b9a4cc8574_puis4mk9devstack@QuobyteHD" returned: 0 in 0.448s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:56:32 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-99c284c1-daeb-41c8-8678-6bec909fcab5 tempest-VolumesExtendTest-2088231311 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:56:32 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-99c284c1-daeb-41c8-8678-6bec909fcab5 tempest-VolumesExtendTest-2088231311 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:56:32 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-99c284c1-daeb-41c8-8678-6bec909fcab5 tempest-VolumesExtendTest-2088231311 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T11:56:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-2026949087',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e22e7f37-c1c5-4cb3-9c93-aa445878b11b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9490e79373844d7baac213a3e1e0a9fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T11:56:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T11:56:31Z,use_quota=True,user_id='b7e125c64eea41cea8636d3dc7d1b63c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1147de8b-623b-426c-a13d-7fc824a80f67),volume_type_id=1147de8b-623b-426c-a13d-7fc824a80f67)}" {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 13 13:56:32 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-99c284c1-daeb-41c8-8678-6bec909fcab5 tempest-VolumesExtendTest-2088231311 None] Creating volume e22e7f37-c1c5-4cb3-9c93-aa445878b11b {{(pid=87098) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 13 13:56:32 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-99c284c1-daeb-41c8-8678-6bec909fcab5 tempest-VolumesExtendTest-2088231311 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:56:32 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-99c284c1-daeb-41c8-8678-6bec909fcab5 tempest-VolumesExtendTest-2088231311 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:56:32 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-99c284c1-daeb-41c8-8678-6bec909fcab5 tempest-VolumesExtendTest-2088231311 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 13:56:32 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-99c284c1-daeb-41c8-8678-6bec909fcab5 tempest-VolumesExtendTest-2088231311 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 13:56:32 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-99c284c1-daeb-41c8-8678-6bec909fcab5 tempest-VolumesExtendTest-2088231311 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:56:32 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-99c284c1-daeb-41c8-8678-6bec909fcab5 tempest-VolumesExtendTest-2088231311 None] Selected osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 13:56:32 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-99c284c1-daeb-41c8-8678-6bec909fcab5 tempest-VolumesExtendTest-2088231311 None] casted to osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 Jul 13 13:56:32 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-99c284c1-daeb-41c8-8678-6bec909fcab5 tempest-VolumesExtendTest-2088231311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-e22e7f37-c1c5-4cb3-9c93-aa445878b11b 1073741824 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:56:32 devstack sudo[96307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-e22e7f37-c1c5-4cb3-9c93-aa445878b11b 1073741824 Jul 13 13:56:32 devstack sudo[96307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:56:33 devstack sudo[96307]: pam_unix(sudo:session): session closed for user root Jul 13 13:56:33 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-99c284c1-daeb-41c8-8678-6bec909fcab5 tempest-VolumesExtendTest-2088231311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-e22e7f37-c1c5-4cb3-9c93-aa445878b11b 1073741824" returned: 0 in 0.605s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:56:33 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-99c284c1-daeb-41c8-8678-6bec909fcab5 tempest-VolumesExtendTest-2088231311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-e22e7f37-c1c5-4cb3-9c93-aa445878b11b {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:56:33 devstack sudo[96313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-e22e7f37-c1c5-4cb3-9c93-aa445878b11b Jul 13 13:56:33 devstack sudo[96313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:56:33 devstack sudo[96313]: pam_unix(sudo:session): session closed for user root Jul 13 13:56:33 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-99c284c1-daeb-41c8-8678-6bec909fcab5 tempest-VolumesExtendTest-2088231311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-e22e7f37-c1c5-4cb3-9c93-aa445878b11b" returned: 0 in 0.339s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:56:33 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-99c284c1-daeb-41c8-8678-6bec909fcab5 tempest-VolumesExtendTest-2088231311 None] <== create_volume: return (1017ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'} {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 13 13:56:33 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-99c284c1-daeb-41c8-8678-6bec909fcab5 tempest-VolumesExtendTest-2088231311 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.024s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:56:33 devstack cinder-volume[87098]: DEBUG cinder.volume.volume_utils [None req-99c284c1-daeb-41c8-8678-6bec909fcab5 tempest-VolumesExtendTest-2088231311 None] Attempting download of def20bd7-001f-4245-a717-37b9a4cc8574 ((None, [{'url': 'file:///opt/stack/data/glance/images/def20bd7-001f-4245-a717-37b9a4cc8574', 'metadata': {}}])) to volume e22e7f37-c1c5-4cb3-9c93-aa445878b11b. {{(pid=87098) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 13 13:56:33 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[3af3d90f-2e46-4b39-956a-fea416bb4d58]: (4, 'raw') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 13:56:33 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-99c284c1-daeb-41c8-8678-6bec909fcab5 tempest-VolumesExtendTest-2088231311 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_def20bd7-001f-4245-a717-37b9a4cc8574_sj_6gxaw {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:56:33 devstack sudo[96316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_def20bd7-001f-4245-a717-37b9a4cc8574_sj_6gxaw Jul 13 13:56:33 devstack sudo[96316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:56:34 devstack sudo[96316]: pam_unix(sudo:session): session closed for user root Jul 13 13:56:34 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-99c284c1-daeb-41c8-8678-6bec909fcab5 tempest-VolumesExtendTest-2088231311 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_def20bd7-001f-4245-a717-37b9a4cc8574_sj_6gxaw" returned: 0 in 0.390s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:56:34 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-99c284c1-daeb-41c8-8678-6bec909fcab5 tempest-VolumesExtendTest-2088231311 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_def20bd7-001f-4245-a717-37b9a4cc8574_sj_6gxaw {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:56:34 devstack sudo[96320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_def20bd7-001f-4245-a717-37b9a4cc8574_sj_6gxaw Jul 13 13:56:34 devstack sudo[96320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:56:34 devstack sudo[96320]: pam_unix(sudo:session): session closed for user root Jul 13 13:56:34 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-99c284c1-daeb-41c8-8678-6bec909fcab5 tempest-VolumesExtendTest-2088231311 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_def20bd7-001f-4245-a717-37b9a4cc8574_sj_6gxaw" returned: 1 in 0.475s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:56:34 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-99c284c1-daeb-41c8-8678-6bec909fcab5 tempest-VolumesExtendTest-2088231311 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_def20bd7-001f-4245-a717-37b9a4cc8574_sj_6gxaw' failed. Not Retrying. {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 13 13:56:34 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[7aef7b58-78ab-4a14-9d30-dd266d0582f1]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 13:56:34 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-99c284c1-daeb-41c8-8678-6bec909fcab5 tempest-VolumesExtendTest-2088231311 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_def20bd7-001f-4245-a717-37b9a4cc8574_puis4mk9devstack@QuobyteHD {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:56:34 devstack sudo[96327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_def20bd7-001f-4245-a717-37b9a4cc8574_puis4mk9devstack@QuobyteHD Jul 13 13:56:34 devstack sudo[96327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:56:35 devstack sudo[96327]: pam_unix(sudo:session): session closed for user root Jul 13 13:56:35 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-99c284c1-daeb-41c8-8678-6bec909fcab5 tempest-VolumesExtendTest-2088231311 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_def20bd7-001f-4245-a717-37b9a4cc8574_puis4mk9devstack@QuobyteHD" returned: 0 in 0.409s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:56:35 devstack cinder-volume[87098]: DEBUG cinder.image.image_utils [None req-99c284c1-daeb-41c8-8678-6bec909fcab5 tempest-VolumesExtendTest-2088231311 None] def20bd7-001f-4245-a717-37b9a4cc8574 was qcow2, converting to raw {{(pid=87098) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 13 13:56:35 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-99c284c1-daeb-41c8-8678-6bec909fcab5 tempest-VolumesExtendTest-2088231311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_def20bd7-001f-4245-a717-37b9a4cc8574_puis4mk9devstack@QuobyteHD /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-e22e7f37-c1c5-4cb3-9c93-aa445878b11b {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:56:35 devstack sudo[96332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_def20bd7-001f-4245-a717-37b9a4cc8574_puis4mk9devstack@QuobyteHD /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-e22e7f37-c1c5-4cb3-9c93-aa445878b11b Jul 13 13:56:35 devstack sudo[96332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:56:37 devstack sudo[96332]: pam_unix(sudo:session): session closed for user root Jul 13 13:56:37 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-99c284c1-daeb-41c8-8678-6bec909fcab5 tempest-VolumesExtendTest-2088231311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_def20bd7-001f-4245-a717-37b9a4cc8574_puis4mk9devstack@QuobyteHD /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-e22e7f37-c1c5-4cb3-9c93-aa445878b11b" returned: 0 in 2.477s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:56:37 devstack cinder-volume[87098]: DEBUG cinder.image.image_utils [None req-99c284c1-daeb-41c8-8678-6bec909fcab5 tempest-VolumesExtendTest-2088231311 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_def20bd7-001f-4245-a717-37b9a4cc8574_puis4mk9devstack@QuobyteHD, size 112.00 MB, duration 2.48 sec, destination /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-e22e7f37-c1c5-4cb3-9c93-aa445878b11b {{(pid=87098) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 13 13:56:37 devstack cinder-volume[87098]: INFO cinder.image.image_utils [None req-99c284c1-daeb-41c8-8678-6bec909fcab5 tempest-VolumesExtendTest-2088231311 None] Converted 112.00 MB image at 45.15 MB/s Jul 13 13:56:37 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-99c284c1-daeb-41c8-8678-6bec909fcab5 tempest-VolumesExtendTest-2088231311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-e22e7f37-c1c5-4cb3-9c93-aa445878b11b 1G {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:56:37 devstack sudo[96357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-e22e7f37-c1c5-4cb3-9c93-aa445878b11b 1G Jul 13 13:56:37 devstack sudo[96357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:56:38 devstack sudo[96357]: pam_unix(sudo:session): session closed for user root Jul 13 13:56:38 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-99c284c1-daeb-41c8-8678-6bec909fcab5 tempest-VolumesExtendTest-2088231311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-e22e7f37-c1c5-4cb3-9c93-aa445878b11b 1G" returned: 0 in 0.391s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:56:38 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[2baff4ce-8f23-4aa7-a7df-81e97ec9e4f1]: (4, 'raw') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 13:56:38 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-99c284c1-daeb-41c8-8678-6bec909fcab5 tempest-VolumesExtendTest-2088231311 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-e22e7f37-c1c5-4cb3-9c93-aa445878b11b {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:56:38 devstack sudo[96362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-e22e7f37-c1c5-4cb3-9c93-aa445878b11b Jul 13 13:56:38 devstack sudo[96362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:56:38 devstack sudo[96362]: pam_unix(sudo:session): session closed for user root Jul 13 13:56:38 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-99c284c1-daeb-41c8-8678-6bec909fcab5 tempest-VolumesExtendTest-2088231311 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-e22e7f37-c1c5-4cb3-9c93-aa445878b11b" returned: 0 in 0.492s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:56:38 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-99c284c1-daeb-41c8-8678-6bec909fcab5 tempest-VolumesExtendTest-2088231311 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-e22e7f37-c1c5-4cb3-9c93-aa445878b11b {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:56:38 devstack sudo[96366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-e22e7f37-c1c5-4cb3-9c93-aa445878b11b Jul 13 13:56:38 devstack sudo[96366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:56:39 devstack sudo[96366]: pam_unix(sudo:session): session closed for user root Jul 13 13:56:39 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-99c284c1-daeb-41c8-8678-6bec909fcab5 tempest-VolumesExtendTest-2088231311 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-e22e7f37-c1c5-4cb3-9c93-aa445878b11b" returned: 1 in 0.562s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:56:39 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-99c284c1-daeb-41c8-8678-6bec909fcab5 tempest-VolumesExtendTest-2088231311 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-e22e7f37-c1c5-4cb3-9c93-aa445878b11b' failed. Not Retrying. {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 13 13:56:39 devstack cinder-volume[87098]: DEBUG cinder.volume.volume_utils [None req-99c284c1-daeb-41c8-8678-6bec909fcab5 tempest-VolumesExtendTest-2088231311 None] Downloaded image def20bd7-001f-4245-a717-37b9a4cc8574 ((None, [{'url': 'file:///opt/stack/data/glance/images/def20bd7-001f-4245-a717-37b9a4cc8574', 'metadata': {}}])) to volume e22e7f37-c1c5-4cb3-9c93-aa445878b11b successfully. {{(pid=87098) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 13 13:56:39 devstack cinder-volume[87098]: DEBUG cinder.image.image_utils [None req-99c284c1-daeb-41c8-8678-6bec909fcab5 tempest-VolumesExtendTest-2088231311 None] Temporary image def20bd7-001f-4245-a717-37b9a4cc8574 for user b7e125c64eea41cea8636d3dc7d1b63c is deleted. {{(pid=87098) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 13 13:56:39 devstack cinder-volume[87098]: DEBUG cinder.volume.volume_utils [None req-99c284c1-daeb-41c8-8678-6bec909fcab5 tempest-VolumesExtendTest-2088231311 None] Marking volume e22e7f37-c1c5-4cb3-9c93-aa445878b11b as bootable. {{(pid=87098) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 13 13:56:39 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-99c284c1-daeb-41c8-8678-6bec909fcab5 tempest-VolumesExtendTest-2088231311 None] Copying metadata from image def20bd7-001f-4245-a717-37b9a4cc8574 to e22e7f37-c1c5-4cb3-9c93-aa445878b11b. {{(pid=87098) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 13 13:56:39 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-99c284c1-daeb-41c8-8678-6bec909fcab5 tempest-VolumesExtendTest-2088231311 None] Creating volume glance metadata for volume e22e7f37-c1c5-4cb3-9c93-aa445878b11b backed by image def20bd7-001f-4245-a717-37b9a4cc8574 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'def20bd7-001f-4245-a717-37b9a4cc8574', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87098) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 13 13:56:39 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-99c284c1-daeb-41c8-8678-6bec909fcab5 tempest-VolumesExtendTest-2088231311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63b88ad6-f904-406f-9c7f-6e598656d08b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e22e7f37-c1c5-4cb3-9c93-aa445878b11b', 'volume_size': 1, 'image_id': 'def20bd7-001f-4245-a717-37b9a4cc8574', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/def20bd7-001f-4245-a717-37b9a4cc8574', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '2181cd3fc958400682584829a80e727e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'def20bd7-001f-4245-a717-37b9a4cc8574', 'created_at': datetime.datetime(2026, 7, 13, 11, 42, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 13, 11, 42, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/def20bd7-001f-4245-a717-37b9a4cc8574/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:56:39 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-99c284c1-daeb-41c8-8678-6bec909fcab5 tempest-VolumesExtendTest-2088231311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8645be7-a560-46bc-bf3e-6537634b7c0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:56:39 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-99c284c1-daeb-41c8-8678-6bec909fcab5 tempest-VolumesExtendTest-2088231311 None] Volume volume-e22e7f37-c1c5-4cb3-9c93-aa445878b11b (e22e7f37-c1c5-4cb3-9c93-aa445878b11b): created successfully Jul 13 13:56:39 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-99c284c1-daeb-41c8-8678-6bec909fcab5 tempest-VolumesExtendTest-2088231311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8645be7-a560-46bc-bf3e-6537634b7c0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:56:39 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-99c284c1-daeb-41c8-8678-6bec909fcab5 tempest-VolumesExtendTest-2088231311 None] Flow 'volume_create_manager' (e5fa2b69-766e-47b8-a2c7-66a975d23bdb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 13:56:39 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-99c284c1-daeb-41c8-8678-6bec909fcab5 tempest-VolumesExtendTest-2088231311 None] Created volume successfully. Jul 13 13:56:40 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-35ba127c-bc4f-426a-a98c-bd8a5319470c tempest-VolumesExtendTest-2088231311 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:56:40 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-35ba127c-bc4f-426a-a98c-bd8a5319470c tempest-VolumesExtendTest-2088231311 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:56:40 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[70949000-9a0f-4412-b09d-592bb296a040]: (4, 'raw') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 13:56:40 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-35ba127c-bc4f-426a-a98c-bd8a5319470c tempest-VolumesExtendTest-2088231311 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-e22e7f37-c1c5-4cb3-9c93-aa445878b11b {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:56:41 devstack sudo[96435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-e22e7f37-c1c5-4cb3-9c93-aa445878b11b Jul 13 13:56:41 devstack sudo[96435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:56:41 devstack sudo[96435]: pam_unix(sudo:session): session closed for user root Jul 13 13:56:41 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-35ba127c-bc4f-426a-a98c-bd8a5319470c tempest-VolumesExtendTest-2088231311 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-e22e7f37-c1c5-4cb3-9c93-aa445878b11b" returned: 0 in 0.664s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:56:41 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-35ba127c-bc4f-426a-a98c-bd8a5319470c tempest-VolumesExtendTest-2088231311 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-e22e7f37-c1c5-4cb3-9c93-aa445878b11b {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:56:41 devstack sudo[96446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-e22e7f37-c1c5-4cb3-9c93-aa445878b11b Jul 13 13:56:41 devstack sudo[96446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:56:42 devstack sudo[96446]: pam_unix(sudo:session): session closed for user root Jul 13 13:56:42 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-35ba127c-bc4f-426a-a98c-bd8a5319470c tempest-VolumesExtendTest-2088231311 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-e22e7f37-c1c5-4cb3-9c93-aa445878b11b" returned: 1 in 0.693s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:56:42 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-35ba127c-bc4f-426a-a98c-bd8a5319470c tempest-VolumesExtendTest-2088231311 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-e22e7f37-c1c5-4cb3-9c93-aa445878b11b' failed. Not Retrying. {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 13 13:56:42 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-35ba127c-bc4f-426a-a98c-bd8a5319470c tempest-VolumesExtendTest-2088231311 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-e22e7f37-c1c5-4cb3-9c93-aa445878b11b 2G {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:56:42 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-35ba127c-bc4f-426a-a98c-bd8a5319470c tempest-VolumesExtendTest-2088231311 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-e22e7f37-c1c5-4cb3-9c93-aa445878b11b 2G" returned: 0 in 0.166s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:56:42 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-35ba127c-bc4f-426a-a98c-bd8a5319470c tempest-VolumesExtendTest-2088231311 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.621s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:56:42 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-35ba127c-bc4f-426a-a98c-bd8a5319470c tempest-VolumesExtendTest-2088231311 None] Extend volume completed successfully. Jul 13 13:56:42 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-a7b7db67-2965-48e8-bf64-78b7a1b8216b tempest-AttachVolumeTestJSON-2118030158 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 13:56:42 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-a7b7db67-2965-48e8-bf64-78b7a1b8216b tempest-AttachVolumeTestJSON-2118030158 None] Flow 'volume_create_manager' (d51d934d-44bf-4ff8-8650-9a9e255bb9c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 13:56:42 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-a7b7db67-2965-48e8-bf64-78b7a1b8216b tempest-AttachVolumeTestJSON-2118030158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39d649c7-94cd-45a1-a9b6-ff2d2ff0b197) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:56:42 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-a7b7db67-2965-48e8-bf64-78b7a1b8216b tempest-AttachVolumeTestJSON-2118030158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39d649c7-94cd-45a1-a9b6-ff2d2ff0b197) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T11:56:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1472802360',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36d3b495-7663-427a-bc0c-393ad3afc75a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87e8b6519220410eabbdd6d9ce4eeaa0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T11:56:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T11:56:43Z,use_quota=True,user_id='24581d52b8074543a263e3dfca61f079',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1147de8b-623b-426c-a13d-7fc824a80f67),volume_type_id=1147de8b-623b-426c-a13d-7fc824a80f67)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:56:42 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-a7b7db67-2965-48e8-bf64-78b7a1b8216b tempest-AttachVolumeTestJSON-2118030158 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c327a74-e978-4aee-989a-4eb9a6265722) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:56:42 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-a7b7db67-2965-48e8-bf64-78b7a1b8216b tempest-AttachVolumeTestJSON-2118030158 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c327a74-e978-4aee-989a-4eb9a6265722) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:56:42 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-a7b7db67-2965-48e8-bf64-78b7a1b8216b tempest-AttachVolumeTestJSON-2118030158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a288f7f-4a59-409a-8560-4166365c16a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:56:42 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-a7b7db67-2965-48e8-bf64-78b7a1b8216b tempest-AttachVolumeTestJSON-2118030158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a288f7f-4a59-409a-8560-4166365c16a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '36d3b495-7663-427a-bc0c-393ad3afc75a', 'volume_name': 'volume-36d3b495-7663-427a-bc0c-393ad3afc75a', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:56:42 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-a7b7db67-2965-48e8-bf64-78b7a1b8216b tempest-AttachVolumeTestJSON-2118030158 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eec3b6bd-f41e-4d4e-be25-8e38ed3e66f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:56:42 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-a7b7db67-2965-48e8-bf64-78b7a1b8216b tempest-AttachVolumeTestJSON-2118030158 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eec3b6bd-f41e-4d4e-be25-8e38ed3e66f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:56:42 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-a7b7db67-2965-48e8-bf64-78b7a1b8216b tempest-AttachVolumeTestJSON-2118030158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0841915-8260-4d4e-b5c8-bbe5ee09e1fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:56:42 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-a7b7db67-2965-48e8-bf64-78b7a1b8216b tempest-AttachVolumeTestJSON-2118030158 None] Volume 36d3b495-7663-427a-bc0c-393ad3afc75a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-36d3b495-7663-427a-bc0c-393ad3afc75a', 'volume_size': 1} Jul 13 13:56:42 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-a7b7db67-2965-48e8-bf64-78b7a1b8216b tempest-AttachVolumeTestJSON-2118030158 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:56:42 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-a7b7db67-2965-48e8-bf64-78b7a1b8216b tempest-AttachVolumeTestJSON-2118030158 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:56:42 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-a7b7db67-2965-48e8-bf64-78b7a1b8216b tempest-AttachVolumeTestJSON-2118030158 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T11:56:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1472802360',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36d3b495-7663-427a-bc0c-393ad3afc75a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87e8b6519220410eabbdd6d9ce4eeaa0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T11:56:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T11:56:43Z,use_quota=True,user_id='24581d52b8074543a263e3dfca61f079',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1147de8b-623b-426c-a13d-7fc824a80f67),volume_type_id=1147de8b-623b-426c-a13d-7fc824a80f67)}" {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 13 13:56:42 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-a7b7db67-2965-48e8-bf64-78b7a1b8216b tempest-AttachVolumeTestJSON-2118030158 None] Creating volume 36d3b495-7663-427a-bc0c-393ad3afc75a {{(pid=87098) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 13 13:56:42 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-a7b7db67-2965-48e8-bf64-78b7a1b8216b tempest-AttachVolumeTestJSON-2118030158 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:56:42 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-a7b7db67-2965-48e8-bf64-78b7a1b8216b tempest-AttachVolumeTestJSON-2118030158 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:56:42 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-a7b7db67-2965-48e8-bf64-78b7a1b8216b tempest-AttachVolumeTestJSON-2118030158 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 13:56:42 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-a7b7db67-2965-48e8-bf64-78b7a1b8216b tempest-AttachVolumeTestJSON-2118030158 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 13:56:42 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-a7b7db67-2965-48e8-bf64-78b7a1b8216b tempest-AttachVolumeTestJSON-2118030158 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:56:42 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-a7b7db67-2965-48e8-bf64-78b7a1b8216b tempest-AttachVolumeTestJSON-2118030158 None] Selected osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 13:56:42 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-a7b7db67-2965-48e8-bf64-78b7a1b8216b tempest-AttachVolumeTestJSON-2118030158 None] casted to osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 Jul 13 13:56:42 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-a7b7db67-2965-48e8-bf64-78b7a1b8216b tempest-AttachVolumeTestJSON-2118030158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-36d3b495-7663-427a-bc0c-393ad3afc75a 1073741824 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:56:42 devstack sudo[96460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-36d3b495-7663-427a-bc0c-393ad3afc75a 1073741824 Jul 13 13:56:42 devstack sudo[96460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:56:43 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-b1f3b876-c24f-408c-86bf-fb8b4cc3c638 tempest-VolumesExtendTest-2088231311 None] Acquiring lock "cinder-e22e7f37-c1c5-4cb3-9c93-aa445878b11b-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 13:56:43 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-b1f3b876-c24f-408c-86bf-fb8b4cc3c638 tempest-VolumesExtendTest-2088231311 None] Lock "cinder-e22e7f37-c1c5-4cb3-9c93-aa445878b11b-delete_volume" acquired by "delete_volume" :: waited 0.079s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 13:56:43 devstack sudo[96460]: pam_unix(sudo:session): session closed for user root Jul 13 13:56:43 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-a7b7db67-2965-48e8-bf64-78b7a1b8216b tempest-AttachVolumeTestJSON-2118030158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-36d3b495-7663-427a-bc0c-393ad3afc75a 1073741824" returned: 0 in 1.135s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:56:43 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-b1f3b876-c24f-408c-86bf-fb8b4cc3c638 tempest-VolumesExtendTest-2088231311 None] Acquiring lock "cinder-quobyte-e22e7f37-c1c5-4cb3-9c93-aa445878b11b" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 13:56:43 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-b1f3b876-c24f-408c-86bf-fb8b4cc3c638 tempest-VolumesExtendTest-2088231311 None] Lock "cinder-quobyte-e22e7f37-c1c5-4cb3-9c93-aa445878b11b" acquired by "delete_volume" :: waited 0.119s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 13:56:44 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-a7b7db67-2965-48e8-bf64-78b7a1b8216b tempest-AttachVolumeTestJSON-2118030158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-36d3b495-7663-427a-bc0c-393ad3afc75a {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:56:44 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[927266b3-133b-42ea-be9e-a20149418db6]: (4, 'raw') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 13:56:44 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-b1f3b876-c24f-408c-86bf-fb8b4cc3c638 tempest-VolumesExtendTest-2088231311 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-e22e7f37-c1c5-4cb3-9c93-aa445878b11b {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:56:44 devstack sudo[96477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-36d3b495-7663-427a-bc0c-393ad3afc75a Jul 13 13:56:44 devstack sudo[96477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:56:44 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca8a8263-78c1-4117-9ffa-6457ad9de52d tempest-VolumesActionsTest-265384025 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 13:56:44 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-ca8a8263-78c1-4117-9ffa-6457ad9de52d tempest-VolumesActionsTest-265384025 None] Flow 'volume_create_manager' (c3ca1263-4bfc-4c2b-83db-2e72a47b488b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 13:56:44 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-ca8a8263-78c1-4117-9ffa-6457ad9de52d tempest-VolumesActionsTest-265384025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb30ca25-68a6-40b5-a8bf-548b51eefe0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:56:44 devstack sudo[96478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-e22e7f37-c1c5-4cb3-9c93-aa445878b11b Jul 13 13:56:44 devstack sudo[96478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:56:44 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-ca8a8263-78c1-4117-9ffa-6457ad9de52d tempest-VolumesActionsTest-265384025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb30ca25-68a6-40b5-a8bf-548b51eefe0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T11:56:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1104719890',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c8300c7-d32e-4ebc-b438-1aba2975a5c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='768408e2746a45718eb8a6046266a7b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T11:56:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T11:56:44Z,use_quota=True,user_id='05fb2b2e905c4534abb5765cc1b8c871',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1147de8b-623b-426c-a13d-7fc824a80f67),volume_type_id=1147de8b-623b-426c-a13d-7fc824a80f67)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:56:44 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-ca8a8263-78c1-4117-9ffa-6457ad9de52d tempest-VolumesActionsTest-265384025 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02193dd4-b7ed-465e-92bf-4a44cf065baf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:56:44 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-ca8a8263-78c1-4117-9ffa-6457ad9de52d tempest-VolumesActionsTest-265384025 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02193dd4-b7ed-465e-92bf-4a44cf065baf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:56:44 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-ca8a8263-78c1-4117-9ffa-6457ad9de52d tempest-VolumesActionsTest-265384025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b75a942-c427-49e8-912d-51d2fae45567) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:56:44 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-ca8a8263-78c1-4117-9ffa-6457ad9de52d tempest-VolumesActionsTest-265384025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b75a942-c427-49e8-912d-51d2fae45567) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4c8300c7-d32e-4ebc-b438-1aba2975a5c5', 'volume_name': 'volume-4c8300c7-d32e-4ebc-b438-1aba2975a5c5', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:56:44 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-ca8a8263-78c1-4117-9ffa-6457ad9de52d tempest-VolumesActionsTest-265384025 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a65f6fe-d3dd-4aa3-9f5c-e89382c6a6eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:56:44 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-ca8a8263-78c1-4117-9ffa-6457ad9de52d tempest-VolumesActionsTest-265384025 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a65f6fe-d3dd-4aa3-9f5c-e89382c6a6eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:56:44 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-ca8a8263-78c1-4117-9ffa-6457ad9de52d tempest-VolumesActionsTest-265384025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef9d8793-73bf-4ca1-ab4e-1bde89b3c05a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:56:44 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-ca8a8263-78c1-4117-9ffa-6457ad9de52d tempest-VolumesActionsTest-265384025 None] Volume 4c8300c7-d32e-4ebc-b438-1aba2975a5c5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4c8300c7-d32e-4ebc-b438-1aba2975a5c5', 'volume_size': 1} Jul 13 13:56:44 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-ca8a8263-78c1-4117-9ffa-6457ad9de52d tempest-VolumesActionsTest-265384025 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:56:44 devstack sudo[96477]: pam_unix(sudo:session): session closed for user root Jul 13 13:56:44 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-a7b7db67-2965-48e8-bf64-78b7a1b8216b tempest-AttachVolumeTestJSON-2118030158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-36d3b495-7663-427a-bc0c-393ad3afc75a" returned: 0 in 0.634s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:56:44 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-a7b7db67-2965-48e8-bf64-78b7a1b8216b tempest-AttachVolumeTestJSON-2118030158 None] <== create_volume: return (2009ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'} {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 13 13:56:44 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-a7b7db67-2965-48e8-bf64-78b7a1b8216b tempest-AttachVolumeTestJSON-2118030158 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.012s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:56:44 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-ca8a8263-78c1-4117-9ffa-6457ad9de52d tempest-VolumesActionsTest-265384025 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.226s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:56:44 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-ca8a8263-78c1-4117-9ffa-6457ad9de52d tempest-VolumesActionsTest-265384025 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T11:56:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1104719890',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c8300c7-d32e-4ebc-b438-1aba2975a5c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='768408e2746a45718eb8a6046266a7b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T11:56:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T11:56:44Z,use_quota=True,user_id='05fb2b2e905c4534abb5765cc1b8c871',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1147de8b-623b-426c-a13d-7fc824a80f67),volume_type_id=1147de8b-623b-426c-a13d-7fc824a80f67)}" {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 13 13:56:44 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-ca8a8263-78c1-4117-9ffa-6457ad9de52d tempest-VolumesActionsTest-265384025 None] Creating volume 4c8300c7-d32e-4ebc-b438-1aba2975a5c5 {{(pid=87098) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 13 13:56:44 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-ca8a8263-78c1-4117-9ffa-6457ad9de52d tempest-VolumesActionsTest-265384025 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:56:44 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-ca8a8263-78c1-4117-9ffa-6457ad9de52d tempest-VolumesActionsTest-265384025 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:56:44 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-ca8a8263-78c1-4117-9ffa-6457ad9de52d tempest-VolumesActionsTest-265384025 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 13:56:44 devstack sudo[96478]: pam_unix(sudo:session): session closed for user root Jul 13 13:56:44 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-ca8a8263-78c1-4117-9ffa-6457ad9de52d tempest-VolumesActionsTest-265384025 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 13:56:44 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-ca8a8263-78c1-4117-9ffa-6457ad9de52d tempest-VolumesActionsTest-265384025 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:56:44 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-ca8a8263-78c1-4117-9ffa-6457ad9de52d tempest-VolumesActionsTest-265384025 None] Selected osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 13:56:44 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-ca8a8263-78c1-4117-9ffa-6457ad9de52d tempest-VolumesActionsTest-265384025 None] casted to osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 Jul 13 13:56:44 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-ca8a8263-78c1-4117-9ffa-6457ad9de52d tempest-VolumesActionsTest-265384025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-4c8300c7-d32e-4ebc-b438-1aba2975a5c5 1073741824 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:56:44 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-b1f3b876-c24f-408c-86bf-fb8b4cc3c638 tempest-VolumesExtendTest-2088231311 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-e22e7f37-c1c5-4cb3-9c93-aa445878b11b" returned: 0 in 0.636s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:56:44 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-b1f3b876-c24f-408c-86bf-fb8b4cc3c638 tempest-VolumesExtendTest-2088231311 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-e22e7f37-c1c5-4cb3-9c93-aa445878b11b {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:56:44 devstack sudo[96484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-4c8300c7-d32e-4ebc-b438-1aba2975a5c5 1073741824 Jul 13 13:56:44 devstack sudo[96484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:56:44 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-a7b7db67-2965-48e8-bf64-78b7a1b8216b tempest-AttachVolumeTestJSON-2118030158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0841915-8260-4d4e-b5c8-bbe5ee09e1fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-36d3b495-7663-427a-bc0c-393ad3afc75a', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:56:44 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-a7b7db67-2965-48e8-bf64-78b7a1b8216b tempest-AttachVolumeTestJSON-2118030158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29f94581-0375-4062-a581-26cfa56c8939) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:56:44 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-a7b7db67-2965-48e8-bf64-78b7a1b8216b tempest-AttachVolumeTestJSON-2118030158 None] Volume volume-36d3b495-7663-427a-bc0c-393ad3afc75a (36d3b495-7663-427a-bc0c-393ad3afc75a): created successfully Jul 13 13:56:44 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-a7b7db67-2965-48e8-bf64-78b7a1b8216b tempest-AttachVolumeTestJSON-2118030158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29f94581-0375-4062-a581-26cfa56c8939) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:56:44 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-a7b7db67-2965-48e8-bf64-78b7a1b8216b tempest-AttachVolumeTestJSON-2118030158 None] Flow 'volume_create_manager' (d51d934d-44bf-4ff8-8650-9a9e255bb9c6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 13:56:44 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-a7b7db67-2965-48e8-bf64-78b7a1b8216b tempest-AttachVolumeTestJSON-2118030158 None] Created volume successfully. Jul 13 13:56:44 devstack sudo[96485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-e22e7f37-c1c5-4cb3-9c93-aa445878b11b Jul 13 13:56:44 devstack sudo[96485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:56:45 devstack sudo[96485]: pam_unix(sudo:session): session closed for user root Jul 13 13:56:45 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-b1f3b876-c24f-408c-86bf-fb8b4cc3c638 tempest-VolumesExtendTest-2088231311 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-e22e7f37-c1c5-4cb3-9c93-aa445878b11b" returned: 1 in 0.586s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:56:45 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-b1f3b876-c24f-408c-86bf-fb8b4cc3c638 tempest-VolumesExtendTest-2088231311 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-e22e7f37-c1c5-4cb3-9c93-aa445878b11b' failed. Not Retrying. {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 13 13:56:45 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-b1f3b876-c24f-408c-86bf-fb8b4cc3c638 tempest-VolumesExtendTest-2088231311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-e22e7f37-c1c5-4cb3-9c93-aa445878b11b {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:56:45 devstack sudo[96495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-e22e7f37-c1c5-4cb3-9c93-aa445878b11b Jul 13 13:56:45 devstack sudo[96495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:56:45 devstack sudo[96484]: pam_unix(sudo:session): session closed for user root Jul 13 13:56:45 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-ca8a8263-78c1-4117-9ffa-6457ad9de52d tempest-VolumesActionsTest-265384025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-4c8300c7-d32e-4ebc-b438-1aba2975a5c5 1073741824" returned: 0 in 0.778s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:56:45 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-ca8a8263-78c1-4117-9ffa-6457ad9de52d tempest-VolumesActionsTest-265384025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-4c8300c7-d32e-4ebc-b438-1aba2975a5c5 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:56:45 devstack sudo[96497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-4c8300c7-d32e-4ebc-b438-1aba2975a5c5 Jul 13 13:56:45 devstack sudo[96497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:56:45 devstack sudo[96495]: pam_unix(sudo:session): session closed for user root Jul 13 13:56:45 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-b1f3b876-c24f-408c-86bf-fb8b4cc3c638 tempest-VolumesExtendTest-2088231311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-e22e7f37-c1c5-4cb3-9c93-aa445878b11b" returned: 0 in 0.431s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:56:45 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-b1f3b876-c24f-408c-86bf-fb8b4cc3c638 tempest-VolumesExtendTest-2088231311 None] Lock "cinder-quobyte-e22e7f37-c1c5-4cb3-9c93-aa445878b11b" released by "delete_volume" :: held 1.821s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 13:56:45 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-b1f3b876-c24f-408c-86bf-fb8b4cc3c638 tempest-VolumesExtendTest-2088231311 None] Created reservations ['9eaa9a6a-cb87-4725-bce8-bb969ac16c98', 'e9b0e109-a7d2-4172-a921-7383472483fb', '2c7dc5d3-de7e-4a1e-9645-3d87f4381ee7', '79870380-ae84-43c3-83bb-1fe359ecc8da'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 13:56:45 devstack sudo[96497]: pam_unix(sudo:session): session closed for user root Jul 13 13:56:45 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-ca8a8263-78c1-4117-9ffa-6457ad9de52d tempest-VolumesActionsTest-265384025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-4c8300c7-d32e-4ebc-b438-1aba2975a5c5" returned: 0 in 0.366s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:56:45 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-ca8a8263-78c1-4117-9ffa-6457ad9de52d tempest-VolumesActionsTest-265384025 None] <== create_volume: return (1209ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'} {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 13 13:56:45 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-ca8a8263-78c1-4117-9ffa-6457ad9de52d tempest-VolumesActionsTest-265384025 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.213s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:56:45 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-ca8a8263-78c1-4117-9ffa-6457ad9de52d tempest-VolumesActionsTest-265384025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef9d8793-73bf-4ca1-ab4e-1bde89b3c05a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4c8300c7-d32e-4ebc-b438-1aba2975a5c5', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:56:45 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-ca8a8263-78c1-4117-9ffa-6457ad9de52d tempest-VolumesActionsTest-265384025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd87202c-7e88-4b84-af83-87d379e5bf86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:56:45 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-ca8a8263-78c1-4117-9ffa-6457ad9de52d tempest-VolumesActionsTest-265384025 None] Volume volume-4c8300c7-d32e-4ebc-b438-1aba2975a5c5 (4c8300c7-d32e-4ebc-b438-1aba2975a5c5): created successfully Jul 13 13:56:45 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-ca8a8263-78c1-4117-9ffa-6457ad9de52d tempest-VolumesActionsTest-265384025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd87202c-7e88-4b84-af83-87d379e5bf86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:56:45 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-ca8a8263-78c1-4117-9ffa-6457ad9de52d tempest-VolumesActionsTest-265384025 None] Flow 'volume_create_manager' (c3ca1263-4bfc-4c2b-83db-2e72a47b488b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 13:56:46 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-ca8a8263-78c1-4117-9ffa-6457ad9de52d tempest-VolumesActionsTest-265384025 None] Created volume successfully. Jul 13 13:56:46 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-b1f3b876-c24f-408c-86bf-fb8b4cc3c638 tempest-VolumesExtendTest-2088231311 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:56:46 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-b1f3b876-c24f-408c-86bf-fb8b4cc3c638 tempest-VolumesExtendTest-2088231311 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:56:46 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-b1f3b876-c24f-408c-86bf-fb8b4cc3c638 tempest-VolumesExtendTest-2088231311 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 13:56:46 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-b1f3b876-c24f-408c-86bf-fb8b4cc3c638 tempest-VolumesExtendTest-2088231311 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 13:56:46 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-b1f3b876-c24f-408c-86bf-fb8b4cc3c638 tempest-VolumesExtendTest-2088231311 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:56:46 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-b1f3b876-c24f-408c-86bf-fb8b4cc3c638 tempest-VolumesExtendTest-2088231311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:56:46 devstack sudo[96501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 Jul 13 13:56:46 devstack sudo[96501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:56:46 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-6e04e03c-478c-476c-ab0a-19bda15d3d93 tempest-VolumesActionsTest-265384025 None] Acquiring lock "cinder-4c8300c7-d32e-4ebc-b438-1aba2975a5c5" by "attach_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 13:56:46 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-6e04e03c-478c-476c-ab0a-19bda15d3d93 tempest-VolumesActionsTest-265384025 None] Lock "cinder-4c8300c7-d32e-4ebc-b438-1aba2975a5c5" acquired by "attach_volume" :: waited 0.067s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 13:56:46 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-6e04e03c-478c-476c-ab0a-19bda15d3d93 tempest-VolumesActionsTest-265384025 None] Attaching volume 4c8300c7-d32e-4ebc-b438-1aba2975a5c5 to instance a6b6f64c-e341-486d-9afa-315251a53d32 at mountpoint /dev/vdb on host None. Jul 13 13:56:46 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-6e04e03c-478c-476c-ab0a-19bda15d3d93 tempest-VolumesActionsTest-265384025 None] Attach volume completed successfully. Jul 13 13:56:46 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-6e04e03c-478c-476c-ab0a-19bda15d3d93 tempest-VolumesActionsTest-265384025 None] Lock "cinder-4c8300c7-d32e-4ebc-b438-1aba2975a5c5" released by "attach_volume" :: held 0.227s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 13:56:46 devstack sudo[96501]: pam_unix(sudo:session): session closed for user root Jul 13 13:56:46 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-b1f3b876-c24f-408c-86bf-fb8b4cc3c638 tempest-VolumesExtendTest-2088231311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78" returned: 0 in 0.582s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:56:46 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-b1f3b876-c24f-408c-86bf-fb8b4cc3c638 tempest-VolumesExtendTest-2088231311 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 13:56:46 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-b1f3b876-c24f-408c-86bf-fb8b4cc3c638 tempest-VolumesExtendTest-2088231311 None] Deleted volume successfully. Jul 13 13:56:46 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-b1f3b876-c24f-408c-86bf-fb8b4cc3c638 tempest-VolumesExtendTest-2088231311 None] Lock "cinder-e22e7f37-c1c5-4cb3-9c93-aa445878b11b-delete_volume" released by "delete_volume" :: held 3.111s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 13:56:47 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-c3d270c7-e9a1-4f10-a66e-5f2c4c26b349 tempest-VolumesExtendTest-2088231311 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 13:56:47 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-c3d270c7-e9a1-4f10-a66e-5f2c4c26b349 tempest-VolumesExtendTest-2088231311 None] Flow 'volume_create_manager' (1637a2cc-1cea-45c9-b54e-51e6df949e14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 13:56:47 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-c3d270c7-e9a1-4f10-a66e-5f2c4c26b349 tempest-VolumesExtendTest-2088231311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db9eeae8-3f7b-456a-bbf4-4785c0287de5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:56:47 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-c3d270c7-e9a1-4f10-a66e-5f2c4c26b349 tempest-VolumesExtendTest-2088231311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db9eeae8-3f7b-456a-bbf4-4785c0287de5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T11:56:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-392784529',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d8170b0-715b-4e96-9d18-dee4403742d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9490e79373844d7baac213a3e1e0a9fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T11:56:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T11:56:47Z,use_quota=True,user_id='b7e125c64eea41cea8636d3dc7d1b63c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1147de8b-623b-426c-a13d-7fc824a80f67),volume_type_id=1147de8b-623b-426c-a13d-7fc824a80f67)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:56:47 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-c3d270c7-e9a1-4f10-a66e-5f2c4c26b349 tempest-VolumesExtendTest-2088231311 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b5b0d77-c82e-43c3-8b7c-0f894fff74e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:56:47 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-c3d270c7-e9a1-4f10-a66e-5f2c4c26b349 tempest-VolumesExtendTest-2088231311 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b5b0d77-c82e-43c3-8b7c-0f894fff74e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:56:47 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-c3d270c7-e9a1-4f10-a66e-5f2c4c26b349 tempest-VolumesExtendTest-2088231311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d375780-e730-4680-8535-637a21903b6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:56:47 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-c3d270c7-e9a1-4f10-a66e-5f2c4c26b349 tempest-VolumesExtendTest-2088231311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d375780-e730-4680-8535-637a21903b6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3d8170b0-715b-4e96-9d18-dee4403742d3', 'volume_name': 'volume-3d8170b0-715b-4e96-9d18-dee4403742d3', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:56:47 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-c3d270c7-e9a1-4f10-a66e-5f2c4c26b349 tempest-VolumesExtendTest-2088231311 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52a223b8-a227-478a-8db6-9ce564992f2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:56:47 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-c3d270c7-e9a1-4f10-a66e-5f2c4c26b349 tempest-VolumesExtendTest-2088231311 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52a223b8-a227-478a-8db6-9ce564992f2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:56:47 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-c3d270c7-e9a1-4f10-a66e-5f2c4c26b349 tempest-VolumesExtendTest-2088231311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd7bfb68-7638-4589-926a-e14eb7d77689) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:56:47 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-c3d270c7-e9a1-4f10-a66e-5f2c4c26b349 tempest-VolumesExtendTest-2088231311 None] Volume 3d8170b0-715b-4e96-9d18-dee4403742d3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3d8170b0-715b-4e96-9d18-dee4403742d3', 'volume_size': 1} Jul 13 13:56:47 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-c3d270c7-e9a1-4f10-a66e-5f2c4c26b349 tempest-VolumesExtendTest-2088231311 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:56:47 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-c3d270c7-e9a1-4f10-a66e-5f2c4c26b349 tempest-VolumesExtendTest-2088231311 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:56:47 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-c3d270c7-e9a1-4f10-a66e-5f2c4c26b349 tempest-VolumesExtendTest-2088231311 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T11:56:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-392784529',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d8170b0-715b-4e96-9d18-dee4403742d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9490e79373844d7baac213a3e1e0a9fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T11:56:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T11:56:47Z,use_quota=True,user_id='b7e125c64eea41cea8636d3dc7d1b63c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1147de8b-623b-426c-a13d-7fc824a80f67),volume_type_id=1147de8b-623b-426c-a13d-7fc824a80f67)}" {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 13 13:56:47 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-c3d270c7-e9a1-4f10-a66e-5f2c4c26b349 tempest-VolumesExtendTest-2088231311 None] Creating volume 3d8170b0-715b-4e96-9d18-dee4403742d3 {{(pid=87098) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 13 13:56:47 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-c3d270c7-e9a1-4f10-a66e-5f2c4c26b349 tempest-VolumesExtendTest-2088231311 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:56:47 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-c3d270c7-e9a1-4f10-a66e-5f2c4c26b349 tempest-VolumesExtendTest-2088231311 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:56:47 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-c3d270c7-e9a1-4f10-a66e-5f2c4c26b349 tempest-VolumesExtendTest-2088231311 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 13:56:47 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-c3d270c7-e9a1-4f10-a66e-5f2c4c26b349 tempest-VolumesExtendTest-2088231311 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 13:56:47 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-c3d270c7-e9a1-4f10-a66e-5f2c4c26b349 tempest-VolumesExtendTest-2088231311 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:56:47 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-c3d270c7-e9a1-4f10-a66e-5f2c4c26b349 tempest-VolumesExtendTest-2088231311 None] Selected osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 13:56:47 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-c3d270c7-e9a1-4f10-a66e-5f2c4c26b349 tempest-VolumesExtendTest-2088231311 None] casted to osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 Jul 13 13:56:47 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-c3d270c7-e9a1-4f10-a66e-5f2c4c26b349 tempest-VolumesExtendTest-2088231311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-3d8170b0-715b-4e96-9d18-dee4403742d3 1073741824 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:56:47 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-52ce4fae-7a3e-429e-8db9-64535536abc3 tempest-VolumesActionsTest-1849404092 None] Terminate volume connection completed successfully. Jul 13 13:56:47 devstack sudo[96508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-3d8170b0-715b-4e96-9d18-dee4403742d3 1073741824 Jul 13 13:56:47 devstack sudo[96508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:56:47 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-52ce4fae-7a3e-429e-8db9-64535536abc3 tempest-VolumesActionsTest-1849404092 None] Acquiring lock "cinder-4c8300c7-d32e-4ebc-b438-1aba2975a5c5-detach_volume" by "detach_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 13:56:47 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-52ce4fae-7a3e-429e-8db9-64535536abc3 tempest-VolumesActionsTest-1849404092 None] Lock "cinder-4c8300c7-d32e-4ebc-b438-1aba2975a5c5-detach_volume" acquired by "detach_volume" :: waited 0.048s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 13:56:47 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-52ce4fae-7a3e-429e-8db9-64535536abc3 tempest-VolumesActionsTest-1849404092 None] Detaching volume 4c8300c7-d32e-4ebc-b438-1aba2975a5c5 from instance a6b6f64c-e341-486d-9afa-315251a53d32. Jul 13 13:56:47 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-52ce4fae-7a3e-429e-8db9-64535536abc3 tempest-VolumesActionsTest-1849404092 None] Detach volume completed successfully. Jul 13 13:56:47 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-52ce4fae-7a3e-429e-8db9-64535536abc3 tempest-VolumesActionsTest-1849404092 None] Lock "cinder-4c8300c7-d32e-4ebc-b438-1aba2975a5c5-detach_volume" released by "detach_volume" :: held 0.223s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 13:56:48 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-53f1eb9e-2214-475f-9eb6-491b674a265f tempest-VolumesActionsTest-265384025 None] Acquiring lock "cinder-4c8300c7-d32e-4ebc-b438-1aba2975a5c5-detach_volume" by "detach_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 13:56:48 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-53f1eb9e-2214-475f-9eb6-491b674a265f tempest-VolumesActionsTest-265384025 None] Lock "cinder-4c8300c7-d32e-4ebc-b438-1aba2975a5c5-detach_volume" acquired by "detach_volume" :: waited 0.043s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 13:56:48 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-53f1eb9e-2214-475f-9eb6-491b674a265f tempest-VolumesActionsTest-265384025 None] Volume detach called, but volume not attached. Jul 13 13:56:48 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-53f1eb9e-2214-475f-9eb6-491b674a265f tempest-VolumesActionsTest-265384025 None] Lock "cinder-4c8300c7-d32e-4ebc-b438-1aba2975a5c5-detach_volume" released by "detach_volume" :: held 0.070s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 13:56:48 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [req-38db0840-2186-432e-abd7-5d78ec4c4cfa req-80a39d6a-50c5-48ca-bb39-3503023816d4 tempest-AttachVolumeTestJSON-2118030158 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:56:48 devstack sudo[96508]: pam_unix(sudo:session): session closed for user root Jul 13 13:56:48 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-c3d270c7-e9a1-4f10-a66e-5f2c4c26b349 tempest-VolumesExtendTest-2088231311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-3d8170b0-715b-4e96-9d18-dee4403742d3 1073741824" returned: 0 in 0.879s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:56:48 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-c3d270c7-e9a1-4f10-a66e-5f2c4c26b349 tempest-VolumesExtendTest-2088231311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-3d8170b0-715b-4e96-9d18-dee4403742d3 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:56:48 devstack sudo[96522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-3d8170b0-715b-4e96-9d18-dee4403742d3 Jul 13 13:56:48 devstack sudo[96522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:56:48 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-0822ab07-cea2-40ca-a387-d16bd65bb7d7 tempest-VolumesActionsTest-265384025 None] Acquiring lock "cinder-4c8300c7-d32e-4ebc-b438-1aba2975a5c5-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 13:56:48 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-0822ab07-cea2-40ca-a387-d16bd65bb7d7 tempest-VolumesActionsTest-265384025 None] Lock "cinder-4c8300c7-d32e-4ebc-b438-1aba2975a5c5-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 13:56:48 devstack sudo[96522]: pam_unix(sudo:session): session closed for user root Jul 13 13:56:48 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-0822ab07-cea2-40ca-a387-d16bd65bb7d7 tempest-VolumesActionsTest-265384025 None] Acquiring lock "cinder-quobyte-4c8300c7-d32e-4ebc-b438-1aba2975a5c5" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 13:56:48 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-c3d270c7-e9a1-4f10-a66e-5f2c4c26b349 tempest-VolumesExtendTest-2088231311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-3d8170b0-715b-4e96-9d18-dee4403742d3" returned: 0 in 0.391s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:56:48 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-c3d270c7-e9a1-4f10-a66e-5f2c4c26b349 tempest-VolumesExtendTest-2088231311 None] <== create_volume: return (1341ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'} {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 13 13:56:48 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-c3d270c7-e9a1-4f10-a66e-5f2c4c26b349 tempest-VolumesExtendTest-2088231311 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.349s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:56:48 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [req-38db0840-2186-432e-abd7-5d78ec4c4cfa req-80a39d6a-50c5-48ca-bb39-3503023816d4 tempest-AttachVolumeTestJSON-2118030158 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.494s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:56:48 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-0822ab07-cea2-40ca-a387-d16bd65bb7d7 tempest-VolumesActionsTest-265384025 None] Lock "cinder-quobyte-4c8300c7-d32e-4ebc-b438-1aba2975a5c5" acquired by "delete_volume" :: waited 0.062s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 13:56:48 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-c3d270c7-e9a1-4f10-a66e-5f2c4c26b349 tempest-VolumesExtendTest-2088231311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd7bfb68-7638-4589-926a-e14eb7d77689) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3d8170b0-715b-4e96-9d18-dee4403742d3', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:56:48 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-c3d270c7-e9a1-4f10-a66e-5f2c4c26b349 tempest-VolumesExtendTest-2088231311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (962a32c0-d00f-4217-85ba-ff69ce2dced2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:56:48 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cefea27-d219-40d8-a979-feafcfc70424]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 13:56:48 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-0822ab07-cea2-40ca-a387-d16bd65bb7d7 tempest-VolumesActionsTest-265384025 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-4c8300c7-d32e-4ebc-b438-1aba2975a5c5 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:56:48 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[3944b3de-8268-4f5d-82fc-295dcd3d559a]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 13:56:48 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [req-38db0840-2186-432e-abd7-5d78ec4c4cfa req-80a39d6a-50c5-48ca-bb39-3503023816d4 tempest-AttachVolumeTestJSON-2118030158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-36d3b495-7663-427a-bc0c-393ad3afc75a {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:56:48 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-c3d270c7-e9a1-4f10-a66e-5f2c4c26b349 tempest-VolumesExtendTest-2088231311 None] Volume volume-3d8170b0-715b-4e96-9d18-dee4403742d3 (3d8170b0-715b-4e96-9d18-dee4403742d3): created successfully Jul 13 13:56:48 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-c3d270c7-e9a1-4f10-a66e-5f2c4c26b349 tempest-VolumesExtendTest-2088231311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (962a32c0-d00f-4217-85ba-ff69ce2dced2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:56:48 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-c3d270c7-e9a1-4f10-a66e-5f2c4c26b349 tempest-VolumesExtendTest-2088231311 None] Flow 'volume_create_manager' (1637a2cc-1cea-45c9-b54e-51e6df949e14) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 13:56:48 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-c3d270c7-e9a1-4f10-a66e-5f2c4c26b349 tempest-VolumesExtendTest-2088231311 None] Created volume successfully. Jul 13 13:56:48 devstack sudo[96525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-4c8300c7-d32e-4ebc-b438-1aba2975a5c5 Jul 13 13:56:48 devstack sudo[96525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:56:49 devstack sudo[96526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-36d3b495-7663-427a-bc0c-393ad3afc75a Jul 13 13:56:49 devstack sudo[96526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:56:49 devstack sudo[96526]: pam_unix(sudo:session): session closed for user root Jul 13 13:56:49 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [req-38db0840-2186-432e-abd7-5d78ec4c4cfa req-80a39d6a-50c5-48ca-bb39-3503023816d4 tempest-AttachVolumeTestJSON-2118030158 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-36d3b495-7663-427a-bc0c-393ad3afc75a" returned: 0 in 0.637s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:56:49 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [req-38db0840-2186-432e-abd7-5d78ec4c4cfa req-80a39d6a-50c5-48ca-bb39-3503023816d4 tempest-AttachVolumeTestJSON-2118030158 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.728s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:56:49 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [req-38db0840-2186-432e-abd7-5d78ec4c4cfa req-80a39d6a-50c5-48ca-bb39-3503023816d4 tempest-AttachVolumeTestJSON-2118030158 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654', 'name': 'volume-36d3b495-7663-427a-bc0c-393ad3afc75a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e7965955-f0ee-40ad-ae6f-4a9d34593288', 'enforce_multipath': True} {{(pid=87098) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 13 13:56:49 devstack cinder-volume[87098]: INFO cinder.volume.manager [req-38db0840-2186-432e-abd7-5d78ec4c4cfa req-80a39d6a-50c5-48ca-bb39-3503023816d4 tempest-AttachVolumeTestJSON-2118030158 None] attachment_update completed successfully. Jul 13 13:56:49 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-477430d6-a20d-4767-8fec-9b5a25707611 tempest-VolumesExtendTest-2088231311 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:56:49 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-477430d6-a20d-4767-8fec-9b5a25707611 tempest-VolumesExtendTest-2088231311 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:56:49 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-477430d6-a20d-4767-8fec-9b5a25707611 tempest-VolumesExtendTest-2088231311 None] Creating offline snapshot c541d9a2-130f-443e-8e9a-e70e306b33b6 of volume 3d8170b0-715b-4e96-9d18-dee4403742d3 {{(pid=87098) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 13 13:56:49 devstack sudo[96525]: pam_unix(sudo:session): session closed for user root Jul 13 13:56:49 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-0822ab07-cea2-40ca-a387-d16bd65bb7d7 tempest-VolumesActionsTest-265384025 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-4c8300c7-d32e-4ebc-b438-1aba2975a5c5" returned: 0 in 1.014s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:56:49 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-0822ab07-cea2-40ca-a387-d16bd65bb7d7 tempest-VolumesActionsTest-265384025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-4c8300c7-d32e-4ebc-b438-1aba2975a5c5 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:56:49 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ee9bccd-21f4-4574-a173-4ef0acbb703f]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 13:56:49 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-477430d6-a20d-4767-8fec-9b5a25707611 tempest-VolumesExtendTest-2088231311 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-3d8170b0-715b-4e96-9d18-dee4403742d3 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:56:49 devstack sudo[96535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-4c8300c7-d32e-4ebc-b438-1aba2975a5c5 Jul 13 13:56:49 devstack sudo[96535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:56:50 devstack sudo[96537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-3d8170b0-715b-4e96-9d18-dee4403742d3 Jul 13 13:56:50 devstack sudo[96537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:56:50 devstack sudo[96535]: pam_unix(sudo:session): session closed for user root Jul 13 13:56:50 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-0822ab07-cea2-40ca-a387-d16bd65bb7d7 tempest-VolumesActionsTest-265384025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-4c8300c7-d32e-4ebc-b438-1aba2975a5c5" returned: 0 in 0.561s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:56:50 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-0822ab07-cea2-40ca-a387-d16bd65bb7d7 tempest-VolumesActionsTest-265384025 None] Lock "cinder-quobyte-4c8300c7-d32e-4ebc-b438-1aba2975a5c5" released by "delete_volume" :: held 1.651s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 13:56:50 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-0822ab07-cea2-40ca-a387-d16bd65bb7d7 tempest-VolumesActionsTest-265384025 None] Created reservations ['e8187e1d-c7aa-4783-88bd-a8d242ad25e4', '8dbfdd7c-973a-4464-a64c-7dba0c1e3810', '2ecc37d4-b9cb-4a64-b23b-6781cdececd5', '9412b994-3c16-4fb2-9a63-89f754627dad'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 13:56:50 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-0822ab07-cea2-40ca-a387-d16bd65bb7d7 tempest-VolumesActionsTest-265384025 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:56:50 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-0822ab07-cea2-40ca-a387-d16bd65bb7d7 tempest-VolumesActionsTest-265384025 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:56:50 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-0822ab07-cea2-40ca-a387-d16bd65bb7d7 tempest-VolumesActionsTest-265384025 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 13:56:50 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-0822ab07-cea2-40ca-a387-d16bd65bb7d7 tempest-VolumesActionsTest-265384025 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 13:56:50 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-0822ab07-cea2-40ca-a387-d16bd65bb7d7 tempest-VolumesActionsTest-265384025 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:56:50 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-0822ab07-cea2-40ca-a387-d16bd65bb7d7 tempest-VolumesActionsTest-265384025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:56:50 devstack sudo[96921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 Jul 13 13:56:50 devstack sudo[96921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:56:50 devstack sudo[96537]: pam_unix(sudo:session): session closed for user root Jul 13 13:56:50 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-477430d6-a20d-4767-8fec-9b5a25707611 tempest-VolumesExtendTest-2088231311 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-3d8170b0-715b-4e96-9d18-dee4403742d3" returned: 0 in 1.053s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:56:50 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-477430d6-a20d-4767-8fec-9b5a25707611 tempest-VolumesExtendTest-2088231311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-3d8170b0-715b-4e96-9d18-dee4403742d3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-3d8170b0-715b-4e96-9d18-dee4403742d3.c541d9a2-130f-443e-8e9a-e70e306b33b6 1G {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:56:50 devstack sudo[96927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-3d8170b0-715b-4e96-9d18-dee4403742d3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-3d8170b0-715b-4e96-9d18-dee4403742d3.c541d9a2-130f-443e-8e9a-e70e306b33b6 1G Jul 13 13:56:50 devstack sudo[96927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:56:51 devstack sudo[96921]: pam_unix(sudo:session): session closed for user root Jul 13 13:56:51 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-0822ab07-cea2-40ca-a387-d16bd65bb7d7 tempest-VolumesActionsTest-265384025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78" returned: 0 in 0.478s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:56:51 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-0822ab07-cea2-40ca-a387-d16bd65bb7d7 tempest-VolumesActionsTest-265384025 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 13:56:51 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-0822ab07-cea2-40ca-a387-d16bd65bb7d7 tempest-VolumesActionsTest-265384025 None] Deleted volume successfully. Jul 13 13:56:51 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-0822ab07-cea2-40ca-a387-d16bd65bb7d7 tempest-VolumesActionsTest-265384025 None] Lock "cinder-4c8300c7-d32e-4ebc-b438-1aba2975a5c5-delete_volume" released by "delete_volume" :: held 2.771s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 13:56:51 devstack sudo[96927]: pam_unix(sudo:session): session closed for user root Jul 13 13:56:51 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-477430d6-a20d-4767-8fec-9b5a25707611 tempest-VolumesExtendTest-2088231311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-3d8170b0-715b-4e96-9d18-dee4403742d3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-3d8170b0-715b-4e96-9d18-dee4403742d3.c541d9a2-130f-443e-8e9a-e70e306b33b6 1G" returned: 0 in 0.973s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:56:51 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-477430d6-a20d-4767-8fec-9b5a25707611 tempest-VolumesExtendTest-2088231311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3d8170b0-715b-4e96-9d18-dee4403742d3 -F qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-3d8170b0-715b-4e96-9d18-dee4403742d3.c541d9a2-130f-443e-8e9a-e70e306b33b6 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:56:51 devstack sudo[96947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3d8170b0-715b-4e96-9d18-dee4403742d3 -F qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-3d8170b0-715b-4e96-9d18-dee4403742d3.c541d9a2-130f-443e-8e9a-e70e306b33b6 Jul 13 13:56:51 devstack sudo[96947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:56:52 devstack sudo[96947]: pam_unix(sudo:session): session closed for user root Jul 13 13:56:52 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-477430d6-a20d-4767-8fec-9b5a25707611 tempest-VolumesExtendTest-2088231311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3d8170b0-715b-4e96-9d18-dee4403742d3 -F qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-3d8170b0-715b-4e96-9d18-dee4403742d3.c541d9a2-130f-443e-8e9a-e70e306b33b6" returned: 0 in 0.424s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:56:52 devstack cinder-volume[87098]: WARNING cinder.volume.drivers.remotefs [None req-477430d6-a20d-4767-8fec-9b5a25707611 tempest-VolumesExtendTest-2088231311 None] /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-3d8170b0-715b-4e96-9d18-dee4403742d3.c541d9a2-130f-443e-8e9a-e70e306b33b6 is being set with open permissions: ugo+rw Jul 13 13:56:52 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-477430d6-a20d-4767-8fec-9b5a25707611 tempest-VolumesExtendTest-2088231311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-3d8170b0-715b-4e96-9d18-dee4403742d3.c541d9a2-130f-443e-8e9a-e70e306b33b6 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:56:52 devstack sudo[96959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-3d8170b0-715b-4e96-9d18-dee4403742d3.c541d9a2-130f-443e-8e9a-e70e306b33b6 Jul 13 13:56:52 devstack sudo[96959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:56:52 devstack sudo[96959]: pam_unix(sudo:session): session closed for user root Jul 13 13:56:52 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-477430d6-a20d-4767-8fec-9b5a25707611 tempest-VolumesExtendTest-2088231311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-3d8170b0-715b-4e96-9d18-dee4403742d3.c541d9a2-130f-443e-8e9a-e70e306b33b6" returned: 0 in 0.365s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:56:52 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-477430d6-a20d-4767-8fec-9b5a25707611 tempest-VolumesExtendTest-2088231311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-3d8170b0-715b-4e96-9d18-dee4403742d3.info {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:56:52 devstack sudo[96962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-3d8170b0-715b-4e96-9d18-dee4403742d3.info Jul 13 13:56:52 devstack sudo[96962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:56:53 devstack sudo[96962]: pam_unix(sudo:session): session closed for user root Jul 13 13:56:53 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-477430d6-a20d-4767-8fec-9b5a25707611 tempest-VolumesExtendTest-2088231311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-3d8170b0-715b-4e96-9d18-dee4403742d3.info" returned: 0 in 0.368s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:56:53 devstack cinder-volume[87098]: WARNING cinder.volume.drivers.remotefs [None req-477430d6-a20d-4767-8fec-9b5a25707611 tempest-VolumesExtendTest-2088231311 None] /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-3d8170b0-715b-4e96-9d18-dee4403742d3.info is being set with open permissions: ugo+rw Jul 13 13:56:53 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-477430d6-a20d-4767-8fec-9b5a25707611 tempest-VolumesExtendTest-2088231311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-3d8170b0-715b-4e96-9d18-dee4403742d3.info {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:56:53 devstack sudo[96967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-3d8170b0-715b-4e96-9d18-dee4403742d3.info Jul 13 13:56:53 devstack sudo[96967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:56:53 devstack sudo[96967]: pam_unix(sudo:session): session closed for user root Jul 13 13:56:53 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-477430d6-a20d-4767-8fec-9b5a25707611 tempest-VolumesExtendTest-2088231311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-3d8170b0-715b-4e96-9d18-dee4403742d3.info" returned: 0 in 0.419s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:56:53 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-477430d6-a20d-4767-8fec-9b5a25707611 tempest-VolumesExtendTest-2088231311 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.814s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:56:53 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-477430d6-a20d-4767-8fec-9b5a25707611 tempest-VolumesExtendTest-2088231311 None] Create snapshot completed successfully Jul 13 13:56:53 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-af90314d-0dd6-4fe2-9ace-a16addb776c4 tempest-AttachVolumeTestJSON-2118030158 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 13:56:53 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-af90314d-0dd6-4fe2-9ace-a16addb776c4 tempest-AttachVolumeTestJSON-2118030158 None] Flow 'volume_create_manager' (39cdb0d9-0a07-427e-a231-47c0a470e0ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 13:56:53 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-af90314d-0dd6-4fe2-9ace-a16addb776c4 tempest-AttachVolumeTestJSON-2118030158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f47fd6f0-a078-4d78-b582-33ce3bc47d36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:56:53 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-af90314d-0dd6-4fe2-9ace-a16addb776c4 tempest-AttachVolumeTestJSON-2118030158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f47fd6f0-a078-4d78-b582-33ce3bc47d36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T11:56:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-470826567',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84a960d0-d14b-4386-adcb-75754a165d17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87e8b6519220410eabbdd6d9ce4eeaa0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T11:56:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T11:56:53Z,use_quota=True,user_id='24581d52b8074543a263e3dfca61f079',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1147de8b-623b-426c-a13d-7fc824a80f67),volume_type_id=1147de8b-623b-426c-a13d-7fc824a80f67)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:56:53 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-af90314d-0dd6-4fe2-9ace-a16addb776c4 tempest-AttachVolumeTestJSON-2118030158 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f24ca7fa-fd51-4e4a-8ec5-8a890bb649b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:56:53 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-af90314d-0dd6-4fe2-9ace-a16addb776c4 tempest-AttachVolumeTestJSON-2118030158 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f24ca7fa-fd51-4e4a-8ec5-8a890bb649b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:56:53 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-af90314d-0dd6-4fe2-9ace-a16addb776c4 tempest-AttachVolumeTestJSON-2118030158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f2db6d7-a265-407b-a54f-9ea83977ad86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:56:53 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-af90314d-0dd6-4fe2-9ace-a16addb776c4 tempest-AttachVolumeTestJSON-2118030158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f2db6d7-a265-407b-a54f-9ea83977ad86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '84a960d0-d14b-4386-adcb-75754a165d17', 'volume_name': 'volume-84a960d0-d14b-4386-adcb-75754a165d17', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:56:53 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-af90314d-0dd6-4fe2-9ace-a16addb776c4 tempest-AttachVolumeTestJSON-2118030158 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (632bc914-a3d3-4a43-a94b-99378afe71de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:56:53 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-af90314d-0dd6-4fe2-9ace-a16addb776c4 tempest-AttachVolumeTestJSON-2118030158 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (632bc914-a3d3-4a43-a94b-99378afe71de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:56:53 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-af90314d-0dd6-4fe2-9ace-a16addb776c4 tempest-AttachVolumeTestJSON-2118030158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59df4cd6-330b-4802-b5be-0d76d9094dbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:56:53 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-af90314d-0dd6-4fe2-9ace-a16addb776c4 tempest-AttachVolumeTestJSON-2118030158 None] Volume 84a960d0-d14b-4386-adcb-75754a165d17: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-84a960d0-d14b-4386-adcb-75754a165d17', 'volume_size': 1} Jul 13 13:56:53 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-af90314d-0dd6-4fe2-9ace-a16addb776c4 tempest-AttachVolumeTestJSON-2118030158 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:56:53 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-af90314d-0dd6-4fe2-9ace-a16addb776c4 tempest-AttachVolumeTestJSON-2118030158 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:56:53 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-af90314d-0dd6-4fe2-9ace-a16addb776c4 tempest-AttachVolumeTestJSON-2118030158 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T11:56:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-470826567',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84a960d0-d14b-4386-adcb-75754a165d17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87e8b6519220410eabbdd6d9ce4eeaa0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T11:56:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T11:56:53Z,use_quota=True,user_id='24581d52b8074543a263e3dfca61f079',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1147de8b-623b-426c-a13d-7fc824a80f67),volume_type_id=1147de8b-623b-426c-a13d-7fc824a80f67)}" {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 13 13:56:53 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-af90314d-0dd6-4fe2-9ace-a16addb776c4 tempest-AttachVolumeTestJSON-2118030158 None] Creating volume 84a960d0-d14b-4386-adcb-75754a165d17 {{(pid=87098) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 13 13:56:53 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-af90314d-0dd6-4fe2-9ace-a16addb776c4 tempest-AttachVolumeTestJSON-2118030158 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:56:53 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-af90314d-0dd6-4fe2-9ace-a16addb776c4 tempest-AttachVolumeTestJSON-2118030158 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:56:53 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-af90314d-0dd6-4fe2-9ace-a16addb776c4 tempest-AttachVolumeTestJSON-2118030158 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 13:56:53 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-af90314d-0dd6-4fe2-9ace-a16addb776c4 tempest-AttachVolumeTestJSON-2118030158 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 13:56:53 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-af90314d-0dd6-4fe2-9ace-a16addb776c4 tempest-AttachVolumeTestJSON-2118030158 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:56:53 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-af90314d-0dd6-4fe2-9ace-a16addb776c4 tempest-AttachVolumeTestJSON-2118030158 None] Selected osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 13:56:53 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-af90314d-0dd6-4fe2-9ace-a16addb776c4 tempest-AttachVolumeTestJSON-2118030158 None] casted to osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 Jul 13 13:56:53 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-af90314d-0dd6-4fe2-9ace-a16addb776c4 tempest-AttachVolumeTestJSON-2118030158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-84a960d0-d14b-4386-adcb-75754a165d17 1073741824 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:56:53 devstack sudo[96970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-84a960d0-d14b-4386-adcb-75754a165d17 1073741824 Jul 13 13:56:53 devstack sudo[96970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:56:54 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-e31e202b-b8ec-4d99-a90a-636c1f03e48e tempest-VolumesExtendTest-2088231311 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:56:54 devstack sudo[96970]: pam_unix(sudo:session): session closed for user root Jul 13 13:56:54 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-af90314d-0dd6-4fe2-9ace-a16addb776c4 tempest-AttachVolumeTestJSON-2118030158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-84a960d0-d14b-4386-adcb-75754a165d17 1073741824" returned: 0 in 0.570s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:56:54 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-af90314d-0dd6-4fe2-9ace-a16addb776c4 tempest-AttachVolumeTestJSON-2118030158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-84a960d0-d14b-4386-adcb-75754a165d17 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:56:54 devstack sudo[96976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-84a960d0-d14b-4386-adcb-75754a165d17 Jul 13 13:56:54 devstack sudo[96976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:56:54 devstack sudo[96976]: pam_unix(sudo:session): session closed for user root Jul 13 13:56:54 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-af90314d-0dd6-4fe2-9ace-a16addb776c4 tempest-AttachVolumeTestJSON-2118030158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-84a960d0-d14b-4386-adcb-75754a165d17" returned: 0 in 0.339s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:56:54 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-af90314d-0dd6-4fe2-9ace-a16addb776c4 tempest-AttachVolumeTestJSON-2118030158 None] <== create_volume: return (957ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'} {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 13 13:56:54 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-af90314d-0dd6-4fe2-9ace-a16addb776c4 tempest-AttachVolumeTestJSON-2118030158 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.960s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:56:54 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-e31e202b-b8ec-4d99-a90a-636c1f03e48e tempest-VolumesExtendTest-2088231311 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.534s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:56:54 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[97d03d7f-2f56-48c8-8fd6-62362a52331c]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 13:56:54 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-e31e202b-b8ec-4d99-a90a-636c1f03e48e tempest-VolumesExtendTest-2088231311 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-3d8170b0-715b-4e96-9d18-dee4403742d3 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:56:54 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-af90314d-0dd6-4fe2-9ace-a16addb776c4 tempest-AttachVolumeTestJSON-2118030158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59df4cd6-330b-4802-b5be-0d76d9094dbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-84a960d0-d14b-4386-adcb-75754a165d17', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:56:54 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-af90314d-0dd6-4fe2-9ace-a16addb776c4 tempest-AttachVolumeTestJSON-2118030158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b65799be-f8de-4c6b-bbe2-27383eb2b501) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:56:54 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-af90314d-0dd6-4fe2-9ace-a16addb776c4 tempest-AttachVolumeTestJSON-2118030158 None] Volume volume-84a960d0-d14b-4386-adcb-75754a165d17 (84a960d0-d14b-4386-adcb-75754a165d17): created successfully Jul 13 13:56:54 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-af90314d-0dd6-4fe2-9ace-a16addb776c4 tempest-AttachVolumeTestJSON-2118030158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b65799be-f8de-4c6b-bbe2-27383eb2b501) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:56:54 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-af90314d-0dd6-4fe2-9ace-a16addb776c4 tempest-AttachVolumeTestJSON-2118030158 None] Flow 'volume_create_manager' (39cdb0d9-0a07-427e-a231-47c0a470e0ae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 13:56:54 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-af90314d-0dd6-4fe2-9ace-a16addb776c4 tempest-AttachVolumeTestJSON-2118030158 None] Created volume successfully. Jul 13 13:56:54 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-b009537b-af66-4342-a5c3-fe3ef9087ed5 tempest-VolumesActionsTest-265384025 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 13:56:54 devstack sudo[96979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-3d8170b0-715b-4e96-9d18-dee4403742d3 Jul 13 13:56:54 devstack sudo[96979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:56:54 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-b009537b-af66-4342-a5c3-fe3ef9087ed5 tempest-VolumesActionsTest-265384025 None] Flow 'volume_create_manager' (5e80acac-df7a-4d0b-8484-8eccf5f3ad1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 13:56:54 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-b009537b-af66-4342-a5c3-fe3ef9087ed5 tempest-VolumesActionsTest-265384025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd295fff-901d-40e3-ae45-b55e1a59bf13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:56:54 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-b009537b-af66-4342-a5c3-fe3ef9087ed5 tempest-VolumesActionsTest-265384025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd295fff-901d-40e3-ae45-b55e1a59bf13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T11:56:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2002909545',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0fe690f2-4b03-4532-ae05-18833f08b629,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='768408e2746a45718eb8a6046266a7b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T11:56:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T11:56:55Z,use_quota=True,user_id='05fb2b2e905c4534abb5765cc1b8c871',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1147de8b-623b-426c-a13d-7fc824a80f67),volume_type_id=1147de8b-623b-426c-a13d-7fc824a80f67)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:56:54 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-b009537b-af66-4342-a5c3-fe3ef9087ed5 tempest-VolumesActionsTest-265384025 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40a2bf61-a698-4eab-97fe-ca045afbc1f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:56:54 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-b009537b-af66-4342-a5c3-fe3ef9087ed5 tempest-VolumesActionsTest-265384025 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40a2bf61-a698-4eab-97fe-ca045afbc1f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:56:54 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-b009537b-af66-4342-a5c3-fe3ef9087ed5 tempest-VolumesActionsTest-265384025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92be5623-f60f-4751-bf7e-c1643d0efd85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:56:54 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-b009537b-af66-4342-a5c3-fe3ef9087ed5 tempest-VolumesActionsTest-265384025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92be5623-f60f-4751-bf7e-c1643d0efd85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0fe690f2-4b03-4532-ae05-18833f08b629', 'volume_name': 'volume-0fe690f2-4b03-4532-ae05-18833f08b629', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:56:54 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-b009537b-af66-4342-a5c3-fe3ef9087ed5 tempest-VolumesActionsTest-265384025 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fdbab89c-142e-43d6-92f4-c85629205d21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:56:54 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-b009537b-af66-4342-a5c3-fe3ef9087ed5 tempest-VolumesActionsTest-265384025 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fdbab89c-142e-43d6-92f4-c85629205d21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:56:54 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-b009537b-af66-4342-a5c3-fe3ef9087ed5 tempest-VolumesActionsTest-265384025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2cf85907-c06c-4120-a70e-15de6663403b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:56:54 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-b009537b-af66-4342-a5c3-fe3ef9087ed5 tempest-VolumesActionsTest-265384025 None] Volume 0fe690f2-4b03-4532-ae05-18833f08b629: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0fe690f2-4b03-4532-ae05-18833f08b629', 'volume_size': 1} Jul 13 13:56:54 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-b009537b-af66-4342-a5c3-fe3ef9087ed5 tempest-VolumesActionsTest-265384025 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:56:55 devstack sudo[96979]: pam_unix(sudo:session): session closed for user root Jul 13 13:56:55 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-e31e202b-b8ec-4d99-a90a-636c1f03e48e tempest-VolumesExtendTest-2088231311 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-3d8170b0-715b-4e96-9d18-dee4403742d3" returned: 0 in 0.404s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:56:55 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-e31e202b-b8ec-4d99-a90a-636c1f03e48e tempest-VolumesExtendTest-2088231311 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-3d8170b0-715b-4e96-9d18-dee4403742d3.c541d9a2-130f-443e-8e9a-e70e306b33b6 2G {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:56:55 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-e31e202b-b8ec-4d99-a90a-636c1f03e48e tempest-VolumesExtendTest-2088231311 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-3d8170b0-715b-4e96-9d18-dee4403742d3.c541d9a2-130f-443e-8e9a-e70e306b33b6 2G" returned: 0 in 0.154s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:56:55 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-e31e202b-b8ec-4d99-a90a-636c1f03e48e tempest-VolumesExtendTest-2088231311 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.594s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:56:55 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-b009537b-af66-4342-a5c3-fe3ef9087ed5 tempest-VolumesActionsTest-265384025 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.379s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:56:55 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-b009537b-af66-4342-a5c3-fe3ef9087ed5 tempest-VolumesActionsTest-265384025 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T11:56:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2002909545',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0fe690f2-4b03-4532-ae05-18833f08b629,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='768408e2746a45718eb8a6046266a7b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T11:56:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T11:56:55Z,use_quota=True,user_id='05fb2b2e905c4534abb5765cc1b8c871',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1147de8b-623b-426c-a13d-7fc824a80f67),volume_type_id=1147de8b-623b-426c-a13d-7fc824a80f67)}" {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 13 13:56:55 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-b009537b-af66-4342-a5c3-fe3ef9087ed5 tempest-VolumesActionsTest-265384025 None] Creating volume 0fe690f2-4b03-4532-ae05-18833f08b629 {{(pid=87098) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 13 13:56:55 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-b009537b-af66-4342-a5c3-fe3ef9087ed5 tempest-VolumesActionsTest-265384025 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:56:55 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-b009537b-af66-4342-a5c3-fe3ef9087ed5 tempest-VolumesActionsTest-265384025 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:56:55 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-b009537b-af66-4342-a5c3-fe3ef9087ed5 tempest-VolumesActionsTest-265384025 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 13:56:55 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-b009537b-af66-4342-a5c3-fe3ef9087ed5 tempest-VolumesActionsTest-265384025 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 13:56:55 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-b009537b-af66-4342-a5c3-fe3ef9087ed5 tempest-VolumesActionsTest-265384025 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:56:55 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-b009537b-af66-4342-a5c3-fe3ef9087ed5 tempest-VolumesActionsTest-265384025 None] Selected osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 13:56:55 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-b009537b-af66-4342-a5c3-fe3ef9087ed5 tempest-VolumesActionsTest-265384025 None] casted to osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 Jul 13 13:56:55 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-b009537b-af66-4342-a5c3-fe3ef9087ed5 tempest-VolumesActionsTest-265384025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-0fe690f2-4b03-4532-ae05-18833f08b629 1073741824 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:56:55 devstack sudo[96989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-0fe690f2-4b03-4532-ae05-18833f08b629 1073741824 Jul 13 13:56:55 devstack sudo[96989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:56:55 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-e31e202b-b8ec-4d99-a90a-636c1f03e48e tempest-VolumesExtendTest-2088231311 None] Extend volume completed successfully. Jul 13 13:56:55 devstack sudo[96989]: pam_unix(sudo:session): session closed for user root Jul 13 13:56:55 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-b009537b-af66-4342-a5c3-fe3ef9087ed5 tempest-VolumesActionsTest-265384025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-0fe690f2-4b03-4532-ae05-18833f08b629 1073741824" returned: 0 in 0.539s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:56:55 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-b009537b-af66-4342-a5c3-fe3ef9087ed5 tempest-VolumesActionsTest-265384025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-0fe690f2-4b03-4532-ae05-18833f08b629 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:56:55 devstack sudo[96997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-0fe690f2-4b03-4532-ae05-18833f08b629 Jul 13 13:56:55 devstack sudo[96997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:56:56 devstack sudo[96997]: pam_unix(sudo:session): session closed for user root Jul 13 13:56:56 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-b009537b-af66-4342-a5c3-fe3ef9087ed5 tempest-VolumesActionsTest-265384025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-0fe690f2-4b03-4532-ae05-18833f08b629" returned: 0 in 0.274s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:56:56 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-b009537b-af66-4342-a5c3-fe3ef9087ed5 tempest-VolumesActionsTest-265384025 None] <== create_volume: return (868ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'} {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 13 13:56:56 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-b009537b-af66-4342-a5c3-fe3ef9087ed5 tempest-VolumesActionsTest-265384025 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.871s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:56:56 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-b009537b-af66-4342-a5c3-fe3ef9087ed5 tempest-VolumesActionsTest-265384025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2cf85907-c06c-4120-a70e-15de6663403b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0fe690f2-4b03-4532-ae05-18833f08b629', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:56:56 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-b009537b-af66-4342-a5c3-fe3ef9087ed5 tempest-VolumesActionsTest-265384025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b96ee46-bd37-4c05-ad95-854d1b640f20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:56:56 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-b009537b-af66-4342-a5c3-fe3ef9087ed5 tempest-VolumesActionsTest-265384025 None] Volume volume-0fe690f2-4b03-4532-ae05-18833f08b629 (0fe690f2-4b03-4532-ae05-18833f08b629): created successfully Jul 13 13:56:56 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-b009537b-af66-4342-a5c3-fe3ef9087ed5 tempest-VolumesActionsTest-265384025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b96ee46-bd37-4c05-ad95-854d1b640f20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:56:56 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-b009537b-af66-4342-a5c3-fe3ef9087ed5 tempest-VolumesActionsTest-265384025 None] Flow 'volume_create_manager' (5e80acac-df7a-4d0b-8484-8eccf5f3ad1d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 13:56:56 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-b009537b-af66-4342-a5c3-fe3ef9087ed5 tempest-VolumesActionsTest-265384025 None] Created volume successfully. Jul 13 13:56:56 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-6a47fee2-81a7-411b-b501-ff5479b958b9 tempest-VolumesExtendTest-2088231311 None] Acquiring lock "cinder-c541d9a2-130f-443e-8e9a-e70e306b33b6-delete_snapshot" by "delete_snapshot" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 13:56:56 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-6a47fee2-81a7-411b-b501-ff5479b958b9 tempest-VolumesExtendTest-2088231311 None] Lock "cinder-c541d9a2-130f-443e-8e9a-e70e306b33b6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 13:56:56 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-6a47fee2-81a7-411b-b501-ff5479b958b9 tempest-VolumesExtendTest-2088231311 None] Acquiring lock "cinder-quobyte-3d8170b0-715b-4e96-9d18-dee4403742d3" by "delete_snapshot" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 13:56:56 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-6a47fee2-81a7-411b-b501-ff5479b958b9 tempest-VolumesExtendTest-2088231311 None] Lock "cinder-quobyte-3d8170b0-715b-4e96-9d18-dee4403742d3" acquired by "delete_snapshot" :: waited 0.070s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 13:56:56 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-6a47fee2-81a7-411b-b501-ff5479b958b9 tempest-VolumesExtendTest-2088231311 None] Acquiring lock "cinder-quobyte-c541d9a2-130f-443e-8e9a-e70e306b33b6" by "_delete_snapshot" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 13:56:56 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-6a47fee2-81a7-411b-b501-ff5479b958b9 tempest-VolumesExtendTest-2088231311 None] Lock "cinder-quobyte-c541d9a2-130f-443e-8e9a-e70e306b33b6" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 13:56:56 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-6a47fee2-81a7-411b-b501-ff5479b958b9 tempest-VolumesExtendTest-2088231311 None] Deleting offline snapshot c541d9a2-130f-443e-8e9a-e70e306b33b6 of volume 3d8170b0-715b-4e96-9d18-dee4403742d3 {{(pid=87098) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 13 13:56:56 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-6a47fee2-81a7-411b-b501-ff5479b958b9 tempest-VolumesExtendTest-2088231311 None] snapshot_file for this snap is: volume-3d8170b0-715b-4e96-9d18-dee4403742d3.c541d9a2-130f-443e-8e9a-e70e306b33b6 {{(pid=87098) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 13 13:56:56 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e82f7f9-af76-42ef-a663-5172860dbdba]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 13:56:56 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-6a47fee2-81a7-411b-b501-ff5479b958b9 tempest-VolumesExtendTest-2088231311 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-3d8170b0-715b-4e96-9d18-dee4403742d3.c541d9a2-130f-443e-8e9a-e70e306b33b6 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:56:56 devstack sudo[97009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-3d8170b0-715b-4e96-9d18-dee4403742d3.c541d9a2-130f-443e-8e9a-e70e306b33b6 Jul 13 13:56:56 devstack sudo[97009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:56:56 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [req-fee8e397-b5b3-4f58-a302-6540d5edf1ec req-c9dd4bdf-64d2-4cff-9370-8e3e115bdb1c tempest-AttachVolumeTestJSON-2118030158 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:56:56 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [req-fee8e397-b5b3-4f58-a302-6540d5edf1ec req-c9dd4bdf-64d2-4cff-9370-8e3e115bdb1c tempest-AttachVolumeTestJSON-2118030158 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:56:56 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a9739dc-f09a-4d74-8cfd-4b9a05078ae2]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 13:56:56 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [req-fee8e397-b5b3-4f58-a302-6540d5edf1ec req-c9dd4bdf-64d2-4cff-9370-8e3e115bdb1c tempest-AttachVolumeTestJSON-2118030158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-84a960d0-d14b-4386-adcb-75754a165d17 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:56:56 devstack sudo[97011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-84a960d0-d14b-4386-adcb-75754a165d17 Jul 13 13:56:56 devstack sudo[97011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:56:57 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-eba3404e-b0a1-46b1-a06e-b23173ebf5f2 tempest-VolumesActionsTest-1849404092 None] Acquiring lock "cinder-0fe690f2-4b03-4532-ae05-18833f08b629-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 13:56:57 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-eba3404e-b0a1-46b1-a06e-b23173ebf5f2 tempest-VolumesActionsTest-1849404092 None] Lock "cinder-0fe690f2-4b03-4532-ae05-18833f08b629-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 13:56:57 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-eba3404e-b0a1-46b1-a06e-b23173ebf5f2 tempest-VolumesActionsTest-1849404092 None] Acquiring lock "cinder-quobyte-0fe690f2-4b03-4532-ae05-18833f08b629" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 13:56:57 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-eba3404e-b0a1-46b1-a06e-b23173ebf5f2 tempest-VolumesActionsTest-1849404092 None] Lock "cinder-quobyte-0fe690f2-4b03-4532-ae05-18833f08b629" acquired by "delete_volume" :: waited 0.020s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 13:56:57 devstack sudo[97009]: pam_unix(sudo:session): session closed for user root Jul 13 13:56:57 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf119dfe-6624-48de-99ef-dfc66088f54f]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 13:56:57 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-6a47fee2-81a7-411b-b501-ff5479b958b9 tempest-VolumesExtendTest-2088231311 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-3d8170b0-715b-4e96-9d18-dee4403742d3.c541d9a2-130f-443e-8e9a-e70e306b33b6" returned: 0 in 0.540s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:56:57 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-eba3404e-b0a1-46b1-a06e-b23173ebf5f2 tempest-VolumesActionsTest-1849404092 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-0fe690f2-4b03-4532-ae05-18833f08b629 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:56:57 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-6a47fee2-81a7-411b-b501-ff5479b958b9 tempest-VolumesExtendTest-2088231311 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3d8170b0-715b-4e96-9d18-dee4403742d3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87098) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 13 13:56:57 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[f42e32b7-f763-43ad-b61d-efd85619c141]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 13:56:57 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-6a47fee2-81a7-411b-b501-ff5479b958b9 tempest-VolumesExtendTest-2088231311 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-3d8170b0-715b-4e96-9d18-dee4403742d3 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:56:57 devstack sudo[97016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-0fe690f2-4b03-4532-ae05-18833f08b629 Jul 13 13:56:57 devstack sudo[97016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:56:57 devstack sudo[97011]: pam_unix(sudo:session): session closed for user root Jul 13 13:56:57 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [req-fee8e397-b5b3-4f58-a302-6540d5edf1ec req-c9dd4bdf-64d2-4cff-9370-8e3e115bdb1c tempest-AttachVolumeTestJSON-2118030158 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-84a960d0-d14b-4386-adcb-75754a165d17" returned: 0 in 0.478s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:56:57 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [req-fee8e397-b5b3-4f58-a302-6540d5edf1ec req-c9dd4bdf-64d2-4cff-9370-8e3e115bdb1c tempest-AttachVolumeTestJSON-2118030158 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.511s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:56:57 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [req-fee8e397-b5b3-4f58-a302-6540d5edf1ec req-c9dd4bdf-64d2-4cff-9370-8e3e115bdb1c tempest-AttachVolumeTestJSON-2118030158 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654', 'name': 'volume-84a960d0-d14b-4386-adcb-75754a165d17', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '60d58be3-3eb1-438a-8079-902e11a0967e', 'enforce_multipath': True} {{(pid=87098) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 13 13:56:57 devstack sudo[97018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-3d8170b0-715b-4e96-9d18-dee4403742d3 Jul 13 13:56:57 devstack sudo[97018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:56:57 devstack cinder-volume[87098]: INFO cinder.volume.manager [req-fee8e397-b5b3-4f58-a302-6540d5edf1ec req-c9dd4bdf-64d2-4cff-9370-8e3e115bdb1c tempest-AttachVolumeTestJSON-2118030158 None] attachment_update completed successfully. Jul 13 13:56:57 devstack sudo[97016]: pam_unix(sudo:session): session closed for user root Jul 13 13:56:57 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-eba3404e-b0a1-46b1-a06e-b23173ebf5f2 tempest-VolumesActionsTest-1849404092 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-0fe690f2-4b03-4532-ae05-18833f08b629" returned: 0 in 0.639s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:56:57 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-eba3404e-b0a1-46b1-a06e-b23173ebf5f2 tempest-VolumesActionsTest-1849404092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-0fe690f2-4b03-4532-ae05-18833f08b629 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:56:57 devstack sudo[97031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-0fe690f2-4b03-4532-ae05-18833f08b629 Jul 13 13:56:57 devstack sudo[97018]: pam_unix(sudo:session): session closed for user root Jul 13 13:56:57 devstack sudo[97031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:56:57 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-6a47fee2-81a7-411b-b501-ff5479b958b9 tempest-VolumesExtendTest-2088231311 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-3d8170b0-715b-4e96-9d18-dee4403742d3" returned: 0 in 0.637s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:56:57 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-6a47fee2-81a7-411b-b501-ff5479b958b9 tempest-VolumesExtendTest-2088231311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-3d8170b0-715b-4e96-9d18-dee4403742d3.c541d9a2-130f-443e-8e9a-e70e306b33b6 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:56:57 devstack sudo[97033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-3d8170b0-715b-4e96-9d18-dee4403742d3.c541d9a2-130f-443e-8e9a-e70e306b33b6 Jul 13 13:56:57 devstack sudo[97033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:56:58 devstack sudo[97031]: pam_unix(sudo:session): session closed for user root Jul 13 13:56:58 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-eba3404e-b0a1-46b1-a06e-b23173ebf5f2 tempest-VolumesActionsTest-1849404092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-0fe690f2-4b03-4532-ae05-18833f08b629" returned: 0 in 0.402s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:56:58 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-eba3404e-b0a1-46b1-a06e-b23173ebf5f2 tempest-VolumesActionsTest-1849404092 None] Lock "cinder-quobyte-0fe690f2-4b03-4532-ae05-18833f08b629" released by "delete_volume" :: held 1.107s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 13:56:58 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-eba3404e-b0a1-46b1-a06e-b23173ebf5f2 tempest-VolumesActionsTest-1849404092 None] Created reservations ['ac0da54b-00fd-4fd5-b7bc-226550eb34bb', 'b2ad45f5-0f52-4431-b12f-6e5e61107099', '4d9dafa9-b1af-4c7f-8780-61bf9f2c46c1', '642c30cb-bb85-4905-93fc-7718626d644f'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 13:56:58 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-eba3404e-b0a1-46b1-a06e-b23173ebf5f2 tempest-VolumesActionsTest-1849404092 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:56:58 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-eba3404e-b0a1-46b1-a06e-b23173ebf5f2 tempest-VolumesActionsTest-1849404092 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:56:58 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-eba3404e-b0a1-46b1-a06e-b23173ebf5f2 tempest-VolumesActionsTest-1849404092 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 13:56:58 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-eba3404e-b0a1-46b1-a06e-b23173ebf5f2 tempest-VolumesActionsTest-1849404092 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 13:56:58 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-eba3404e-b0a1-46b1-a06e-b23173ebf5f2 tempest-VolumesActionsTest-1849404092 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:56:58 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-eba3404e-b0a1-46b1-a06e-b23173ebf5f2 tempest-VolumesActionsTest-1849404092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:56:58 devstack sudo[97040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 Jul 13 13:56:58 devstack sudo[97040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:56:58 devstack sudo[97033]: pam_unix(sudo:session): session closed for user root Jul 13 13:56:58 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-6a47fee2-81a7-411b-b501-ff5479b958b9 tempest-VolumesExtendTest-2088231311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-3d8170b0-715b-4e96-9d18-dee4403742d3.c541d9a2-130f-443e-8e9a-e70e306b33b6" returned: 0 in 0.673s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:56:58 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-6a47fee2-81a7-411b-b501-ff5479b958b9 tempest-VolumesExtendTest-2088231311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-3d8170b0-715b-4e96-9d18-dee4403742d3.c541d9a2-130f-443e-8e9a-e70e306b33b6 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:56:58 devstack sudo[97042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-3d8170b0-715b-4e96-9d18-dee4403742d3.c541d9a2-130f-443e-8e9a-e70e306b33b6 Jul 13 13:56:58 devstack sudo[97042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:56:58 devstack sudo[97040]: pam_unix(sudo:session): session closed for user root Jul 13 13:56:58 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-eba3404e-b0a1-46b1-a06e-b23173ebf5f2 tempest-VolumesActionsTest-1849404092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78" returned: 0 in 0.424s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:56:58 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-eba3404e-b0a1-46b1-a06e-b23173ebf5f2 tempest-VolumesActionsTest-1849404092 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 13:56:58 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-eba3404e-b0a1-46b1-a06e-b23173ebf5f2 tempest-VolumesActionsTest-1849404092 None] Deleted volume successfully. Jul 13 13:56:58 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-eba3404e-b0a1-46b1-a06e-b23173ebf5f2 tempest-VolumesActionsTest-1849404092 None] Lock "cinder-0fe690f2-4b03-4532-ae05-18833f08b629-delete_volume" released by "delete_volume" :: held 1.857s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 13:56:58 devstack sudo[97042]: pam_unix(sudo:session): session closed for user root Jul 13 13:56:58 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-6a47fee2-81a7-411b-b501-ff5479b958b9 tempest-VolumesExtendTest-2088231311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-3d8170b0-715b-4e96-9d18-dee4403742d3.c541d9a2-130f-443e-8e9a-e70e306b33b6" returned: 0 in 0.395s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:56:58 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-6a47fee2-81a7-411b-b501-ff5479b958b9 tempest-VolumesExtendTest-2088231311 None] Lock "cinder-quobyte-c541d9a2-130f-443e-8e9a-e70e306b33b6" released by "_delete_snapshot" :: held 2.396s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 13:56:59 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-6a47fee2-81a7-411b-b501-ff5479b958b9 tempest-VolumesExtendTest-2088231311 None] Lock "cinder-quobyte-3d8170b0-715b-4e96-9d18-dee4403742d3" released by "delete_snapshot" :: held 2.422s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 13:56:59 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-6a47fee2-81a7-411b-b501-ff5479b958b9 tempest-VolumesExtendTest-2088231311 None] Created reservations ['4e5d6258-4942-462b-9418-3f52aac34298', '9e25eaab-7405-4bd8-902d-0f2bba46793e', 'c5e5c1cb-b5f8-4a1c-adae-ac66a2a2be18', '466fcf9f-de66-4779-ba7d-c7066f704fa0'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 13:56:59 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-6a47fee2-81a7-411b-b501-ff5479b958b9 tempest-VolumesExtendTest-2088231311 None] Delete snapshot completed successfully. Jul 13 13:56:59 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-6a47fee2-81a7-411b-b501-ff5479b958b9 tempest-VolumesExtendTest-2088231311 None] Lock "cinder-c541d9a2-130f-443e-8e9a-e70e306b33b6-delete_snapshot" released by "delete_snapshot" :: held 2.656s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 13:56:59 devstack cinder-volume[87098]: INFO cinder.volume.manager [req-7faeab53-5ae0-47b6-9e7d-80433e6bee00 req-ab131e7b-2451-4c74-97a2-c103d5f4517d tempest-AttachVolumeTestJSON-2118030158 None] Terminate volume connection completed successfully. Jul 13 13:56:59 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [req-7faeab53-5ae0-47b6-9e7d-80433e6bee00 req-ab131e7b-2451-4c74-97a2-c103d5f4517d tempest-AttachVolumeTestJSON-2118030158 None] Deleting attachment e7965955-f0ee-40ad-ae6f-4a9d34593288. {{(pid=87098) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 13 13:57:00 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-a89eb5b1-9ff6-45b1-8bc9-838847b4b175 tempest-VolumesExtendTest-2088231311 None] Acquiring lock "cinder-3d8170b0-715b-4e96-9d18-dee4403742d3-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 13:57:00 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-a89eb5b1-9ff6-45b1-8bc9-838847b4b175 tempest-VolumesExtendTest-2088231311 None] Lock "cinder-3d8170b0-715b-4e96-9d18-dee4403742d3-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 13:57:00 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-a89eb5b1-9ff6-45b1-8bc9-838847b4b175 tempest-VolumesExtendTest-2088231311 None] Acquiring lock "cinder-quobyte-3d8170b0-715b-4e96-9d18-dee4403742d3" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 13:57:00 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-a89eb5b1-9ff6-45b1-8bc9-838847b4b175 tempest-VolumesExtendTest-2088231311 None] Lock "cinder-quobyte-3d8170b0-715b-4e96-9d18-dee4403742d3" acquired by "delete_volume" :: waited 0.025s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 13:57:00 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-c4c9dbc3-e325-4300-9d1c-f1d6cbbe0b89 tempest-VolumesActionsTest-265384025 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 13:57:00 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-c4c9dbc3-e325-4300-9d1c-f1d6cbbe0b89 tempest-VolumesActionsTest-265384025 None] Flow 'volume_create_manager' (37188b5a-41af-4b8e-b8cc-cdfdce9184d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 13:57:00 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-c4c9dbc3-e325-4300-9d1c-f1d6cbbe0b89 tempest-VolumesActionsTest-265384025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9b2e565-2b37-42da-8bd8-0dea95e971c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:57:00 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2cdc517-b74d-4cca-acd8-c0fbc0c057a7]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 13:57:00 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-a89eb5b1-9ff6-45b1-8bc9-838847b4b175 tempest-VolumesExtendTest-2088231311 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-3d8170b0-715b-4e96-9d18-dee4403742d3 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:57:00 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-c4c9dbc3-e325-4300-9d1c-f1d6cbbe0b89 tempest-VolumesActionsTest-265384025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9b2e565-2b37-42da-8bd8-0dea95e971c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T11:57:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-824210401',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9579a7f0-c532-4569-ad4a-ff77fa6dbcbc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='768408e2746a45718eb8a6046266a7b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T11:57:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T11:57:00Z,use_quota=True,user_id='05fb2b2e905c4534abb5765cc1b8c871',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1147de8b-623b-426c-a13d-7fc824a80f67),volume_type_id=1147de8b-623b-426c-a13d-7fc824a80f67)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:57:00 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-c4c9dbc3-e325-4300-9d1c-f1d6cbbe0b89 tempest-VolumesActionsTest-265384025 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00b8466d-c899-43b1-9138-49a936d1e777) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:57:00 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-c4c9dbc3-e325-4300-9d1c-f1d6cbbe0b89 tempest-VolumesActionsTest-265384025 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00b8466d-c899-43b1-9138-49a936d1e777) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:57:00 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-c4c9dbc3-e325-4300-9d1c-f1d6cbbe0b89 tempest-VolumesActionsTest-265384025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59dd6738-b6fd-4315-9df9-49e485ede641) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:57:00 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-c4c9dbc3-e325-4300-9d1c-f1d6cbbe0b89 tempest-VolumesActionsTest-265384025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59dd6738-b6fd-4315-9df9-49e485ede641) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9579a7f0-c532-4569-ad4a-ff77fa6dbcbc', 'volume_name': 'volume-9579a7f0-c532-4569-ad4a-ff77fa6dbcbc', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:57:00 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-c4c9dbc3-e325-4300-9d1c-f1d6cbbe0b89 tempest-VolumesActionsTest-265384025 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (606c632f-1533-4636-a703-769ea48d5e47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:57:00 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-c4c9dbc3-e325-4300-9d1c-f1d6cbbe0b89 tempest-VolumesActionsTest-265384025 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (606c632f-1533-4636-a703-769ea48d5e47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:57:00 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-c4c9dbc3-e325-4300-9d1c-f1d6cbbe0b89 tempest-VolumesActionsTest-265384025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b93ae014-0bfe-4fc8-b370-fb422ef21436) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:57:00 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-c4c9dbc3-e325-4300-9d1c-f1d6cbbe0b89 tempest-VolumesActionsTest-265384025 None] Volume 9579a7f0-c532-4569-ad4a-ff77fa6dbcbc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9579a7f0-c532-4569-ad4a-ff77fa6dbcbc', 'volume_size': 1} Jul 13 13:57:00 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-c4c9dbc3-e325-4300-9d1c-f1d6cbbe0b89 tempest-VolumesActionsTest-265384025 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:57:00 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-c4c9dbc3-e325-4300-9d1c-f1d6cbbe0b89 tempest-VolumesActionsTest-265384025 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:57:00 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-c4c9dbc3-e325-4300-9d1c-f1d6cbbe0b89 tempest-VolumesActionsTest-265384025 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T11:57:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-824210401',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9579a7f0-c532-4569-ad4a-ff77fa6dbcbc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='768408e2746a45718eb8a6046266a7b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T11:57:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T11:57:00Z,use_quota=True,user_id='05fb2b2e905c4534abb5765cc1b8c871',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1147de8b-623b-426c-a13d-7fc824a80f67),volume_type_id=1147de8b-623b-426c-a13d-7fc824a80f67)}" {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 13 13:57:00 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-c4c9dbc3-e325-4300-9d1c-f1d6cbbe0b89 tempest-VolumesActionsTest-265384025 None] Creating volume 9579a7f0-c532-4569-ad4a-ff77fa6dbcbc {{(pid=87098) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 13 13:57:00 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-c4c9dbc3-e325-4300-9d1c-f1d6cbbe0b89 tempest-VolumesActionsTest-265384025 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:57:00 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-c4c9dbc3-e325-4300-9d1c-f1d6cbbe0b89 tempest-VolumesActionsTest-265384025 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:57:00 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-c4c9dbc3-e325-4300-9d1c-f1d6cbbe0b89 tempest-VolumesActionsTest-265384025 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 13:57:00 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-c4c9dbc3-e325-4300-9d1c-f1d6cbbe0b89 tempest-VolumesActionsTest-265384025 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 13:57:00 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-c4c9dbc3-e325-4300-9d1c-f1d6cbbe0b89 tempest-VolumesActionsTest-265384025 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:57:00 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-c4c9dbc3-e325-4300-9d1c-f1d6cbbe0b89 tempest-VolumesActionsTest-265384025 None] Selected osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 13:57:00 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-c4c9dbc3-e325-4300-9d1c-f1d6cbbe0b89 tempest-VolumesActionsTest-265384025 None] casted to osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 Jul 13 13:57:00 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-c4c9dbc3-e325-4300-9d1c-f1d6cbbe0b89 tempest-VolumesActionsTest-265384025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-9579a7f0-c532-4569-ad4a-ff77fa6dbcbc 1073741824 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:57:00 devstack sudo[97053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-9579a7f0-c532-4569-ad4a-ff77fa6dbcbc 1073741824 Jul 13 13:57:00 devstack sudo[97053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:57:00 devstack sudo[97052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-3d8170b0-715b-4e96-9d18-dee4403742d3 Jul 13 13:57:00 devstack sudo[97052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:57:00 devstack sudo[97052]: pam_unix(sudo:session): session closed for user root Jul 13 13:57:00 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-a89eb5b1-9ff6-45b1-8bc9-838847b4b175 tempest-VolumesExtendTest-2088231311 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-3d8170b0-715b-4e96-9d18-dee4403742d3" returned: 0 in 0.522s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:57:00 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-a89eb5b1-9ff6-45b1-8bc9-838847b4b175 tempest-VolumesExtendTest-2088231311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-3d8170b0-715b-4e96-9d18-dee4403742d3 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:57:00 devstack sudo[97063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-3d8170b0-715b-4e96-9d18-dee4403742d3 Jul 13 13:57:00 devstack sudo[97063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:57:01 devstack sudo[97053]: pam_unix(sudo:session): session closed for user root Jul 13 13:57:01 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-c4c9dbc3-e325-4300-9d1c-f1d6cbbe0b89 tempest-VolumesActionsTest-265384025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-9579a7f0-c532-4569-ad4a-ff77fa6dbcbc 1073741824" returned: 0 in 0.820s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:57:01 devstack sudo[97063]: pam_unix(sudo:session): session closed for user root Jul 13 13:57:01 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-a89eb5b1-9ff6-45b1-8bc9-838847b4b175 tempest-VolumesExtendTest-2088231311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-3d8170b0-715b-4e96-9d18-dee4403742d3" returned: 0 in 0.458s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:57:01 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-a89eb5b1-9ff6-45b1-8bc9-838847b4b175 tempest-VolumesExtendTest-2088231311 None] Lock "cinder-quobyte-3d8170b0-715b-4e96-9d18-dee4403742d3" released by "delete_volume" :: held 1.132s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 13:57:01 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-c4c9dbc3-e325-4300-9d1c-f1d6cbbe0b89 tempest-VolumesActionsTest-265384025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-9579a7f0-c532-4569-ad4a-ff77fa6dbcbc {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:57:01 devstack sudo[97067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-9579a7f0-c532-4569-ad4a-ff77fa6dbcbc Jul 13 13:57:01 devstack sudo[97067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:57:01 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-a89eb5b1-9ff6-45b1-8bc9-838847b4b175 tempest-VolumesExtendTest-2088231311 None] Created reservations ['4c6dcd6d-6119-4400-b688-1e6009b6e746', '8c0a600c-3002-449a-9ac8-22986adaa3b3', '9e2a8259-bbbc-4b57-ac86-1ebd0a60f85e', '00de6104-4420-403a-ac54-3d32aa8c806f'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 13:57:01 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-a89eb5b1-9ff6-45b1-8bc9-838847b4b175 tempest-VolumesExtendTest-2088231311 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:57:01 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-a89eb5b1-9ff6-45b1-8bc9-838847b4b175 tempest-VolumesExtendTest-2088231311 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:57:01 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-a89eb5b1-9ff6-45b1-8bc9-838847b4b175 tempest-VolumesExtendTest-2088231311 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 13:57:01 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-a89eb5b1-9ff6-45b1-8bc9-838847b4b175 tempest-VolumesExtendTest-2088231311 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 13:57:01 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-a89eb5b1-9ff6-45b1-8bc9-838847b4b175 tempest-VolumesExtendTest-2088231311 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:57:01 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-a89eb5b1-9ff6-45b1-8bc9-838847b4b175 tempest-VolumesExtendTest-2088231311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:57:01 devstack sudo[97071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 Jul 13 13:57:01 devstack sudo[97071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:57:01 devstack cinder-volume[87098]: INFO cinder.volume.manager [req-901511a5-f925-4dbd-ac89-1409419f2943 req-34b4aa14-dab7-4d38-bdbd-b778ae489947 tempest-AttachVolumeTestJSON-2118030158 None] Terminate volume connection completed successfully. Jul 13 13:57:01 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [req-901511a5-f925-4dbd-ac89-1409419f2943 req-34b4aa14-dab7-4d38-bdbd-b778ae489947 tempest-AttachVolumeTestJSON-2118030158 None] Deleting attachment 60d58be3-3eb1-438a-8079-902e11a0967e. {{(pid=87098) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 13 13:57:01 devstack sudo[97067]: pam_unix(sudo:session): session closed for user root Jul 13 13:57:01 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-c4c9dbc3-e325-4300-9d1c-f1d6cbbe0b89 tempest-VolumesActionsTest-265384025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-9579a7f0-c532-4569-ad4a-ff77fa6dbcbc" returned: 0 in 0.417s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:57:01 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-c4c9dbc3-e325-4300-9d1c-f1d6cbbe0b89 tempest-VolumesActionsTest-265384025 None] <== create_volume: return (1397ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'} {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 13 13:57:01 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-c4c9dbc3-e325-4300-9d1c-f1d6cbbe0b89 tempest-VolumesActionsTest-265384025 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.400s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:57:01 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-c4c9dbc3-e325-4300-9d1c-f1d6cbbe0b89 tempest-VolumesActionsTest-265384025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b93ae014-0bfe-4fc8-b370-fb422ef21436) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9579a7f0-c532-4569-ad4a-ff77fa6dbcbc', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:57:01 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-c4c9dbc3-e325-4300-9d1c-f1d6cbbe0b89 tempest-VolumesActionsTest-265384025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a68043bc-8515-4e85-9aad-f70a4ed59c60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:57:01 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-c4c9dbc3-e325-4300-9d1c-f1d6cbbe0b89 tempest-VolumesActionsTest-265384025 None] Volume volume-9579a7f0-c532-4569-ad4a-ff77fa6dbcbc (9579a7f0-c532-4569-ad4a-ff77fa6dbcbc): created successfully Jul 13 13:57:01 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-c4c9dbc3-e325-4300-9d1c-f1d6cbbe0b89 tempest-VolumesActionsTest-265384025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a68043bc-8515-4e85-9aad-f70a4ed59c60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:57:01 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-c4c9dbc3-e325-4300-9d1c-f1d6cbbe0b89 tempest-VolumesActionsTest-265384025 None] Flow 'volume_create_manager' (37188b5a-41af-4b8e-b8cc-cdfdce9184d9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 13:57:01 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-c4c9dbc3-e325-4300-9d1c-f1d6cbbe0b89 tempest-VolumesActionsTest-265384025 None] Created volume successfully. Jul 13 13:57:01 devstack sudo[97071]: pam_unix(sudo:session): session closed for user root Jul 13 13:57:01 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-a89eb5b1-9ff6-45b1-8bc9-838847b4b175 tempest-VolumesExtendTest-2088231311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78" returned: 0 in 0.361s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:57:01 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-a89eb5b1-9ff6-45b1-8bc9-838847b4b175 tempest-VolumesExtendTest-2088231311 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 13:57:01 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-a89eb5b1-9ff6-45b1-8bc9-838847b4b175 tempest-VolumesExtendTest-2088231311 None] Deleted volume successfully. Jul 13 13:57:01 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-a89eb5b1-9ff6-45b1-8bc9-838847b4b175 tempest-VolumesExtendTest-2088231311 None] Lock "cinder-3d8170b0-715b-4e96-9d18-dee4403742d3-delete_volume" released by "delete_volume" :: held 1.857s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 13:57:02 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-71bc94d8-5150-45fc-aa9e-197979d57654 tempest-VolumesActionsTest-1849404092 None] Acquiring lock "cinder-9579a7f0-c532-4569-ad4a-ff77fa6dbcbc-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 13:57:02 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-71bc94d8-5150-45fc-aa9e-197979d57654 tempest-VolumesActionsTest-1849404092 None] Lock "cinder-9579a7f0-c532-4569-ad4a-ff77fa6dbcbc-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 13:57:02 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-71bc94d8-5150-45fc-aa9e-197979d57654 tempest-VolumesActionsTest-1849404092 None] Acquiring lock "cinder-quobyte-9579a7f0-c532-4569-ad4a-ff77fa6dbcbc" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 13:57:02 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-71bc94d8-5150-45fc-aa9e-197979d57654 tempest-VolumesActionsTest-1849404092 None] Lock "cinder-quobyte-9579a7f0-c532-4569-ad4a-ff77fa6dbcbc" acquired by "delete_volume" :: waited 0.043s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 13:57:02 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[909f0d8f-af30-419f-9007-fd8ff647107f]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 13:57:02 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-71bc94d8-5150-45fc-aa9e-197979d57654 tempest-VolumesActionsTest-1849404092 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-9579a7f0-c532-4569-ad4a-ff77fa6dbcbc {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:57:02 devstack sudo[97100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-9579a7f0-c532-4569-ad4a-ff77fa6dbcbc Jul 13 13:57:02 devstack sudo[97100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:57:03 devstack sudo[97100]: pam_unix(sudo:session): session closed for user root Jul 13 13:57:03 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-71bc94d8-5150-45fc-aa9e-197979d57654 tempest-VolumesActionsTest-1849404092 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-9579a7f0-c532-4569-ad4a-ff77fa6dbcbc" returned: 0 in 0.630s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:57:03 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-71bc94d8-5150-45fc-aa9e-197979d57654 tempest-VolumesActionsTest-1849404092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-9579a7f0-c532-4569-ad4a-ff77fa6dbcbc {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:57:03 devstack sudo[97105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-9579a7f0-c532-4569-ad4a-ff77fa6dbcbc Jul 13 13:57:03 devstack sudo[97105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:57:03 devstack sudo[97105]: pam_unix(sudo:session): session closed for user root Jul 13 13:57:03 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-71bc94d8-5150-45fc-aa9e-197979d57654 tempest-VolumesActionsTest-1849404092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-9579a7f0-c532-4569-ad4a-ff77fa6dbcbc" returned: 0 in 0.603s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:57:03 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-71bc94d8-5150-45fc-aa9e-197979d57654 tempest-VolumesActionsTest-1849404092 None] Lock "cinder-quobyte-9579a7f0-c532-4569-ad4a-ff77fa6dbcbc" released by "delete_volume" :: held 1.301s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 13:57:03 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-71bc94d8-5150-45fc-aa9e-197979d57654 tempest-VolumesActionsTest-1849404092 None] Created reservations ['1911c266-04ad-4af5-9745-bf000503b489', '600d5965-8202-4701-95d3-0694747cbbb8', '79d51a6b-f334-49de-a326-039bb09b0c9f', '07f25b47-82a3-468a-906c-472036f81d94'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 13:57:04 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-71bc94d8-5150-45fc-aa9e-197979d57654 tempest-VolumesActionsTest-1849404092 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:57:04 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-71bc94d8-5150-45fc-aa9e-197979d57654 tempest-VolumesActionsTest-1849404092 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:57:04 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-71bc94d8-5150-45fc-aa9e-197979d57654 tempest-VolumesActionsTest-1849404092 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 13:57:04 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-71bc94d8-5150-45fc-aa9e-197979d57654 tempest-VolumesActionsTest-1849404092 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 13:57:04 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-71bc94d8-5150-45fc-aa9e-197979d57654 tempest-VolumesActionsTest-1849404092 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:57:04 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-71bc94d8-5150-45fc-aa9e-197979d57654 tempest-VolumesActionsTest-1849404092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:57:04 devstack sudo[97127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 Jul 13 13:57:04 devstack sudo[97127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:57:04 devstack sudo[97127]: pam_unix(sudo:session): session closed for user root Jul 13 13:57:04 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-71bc94d8-5150-45fc-aa9e-197979d57654 tempest-VolumesActionsTest-1849404092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78" returned: 0 in 0.308s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:57:04 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-71bc94d8-5150-45fc-aa9e-197979d57654 tempest-VolumesActionsTest-1849404092 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 13:57:04 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-71bc94d8-5150-45fc-aa9e-197979d57654 tempest-VolumesActionsTest-1849404092 None] Deleted volume successfully. Jul 13 13:57:04 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-71bc94d8-5150-45fc-aa9e-197979d57654 tempest-VolumesActionsTest-1849404092 None] Lock "cinder-9579a7f0-c532-4569-ad4a-ff77fa6dbcbc-delete_volume" released by "delete_volume" :: held 2.048s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 13:57:05 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-a8c2e573-468f-48e8-8dff-8bb23d7f97e2 tempest-VolumesActionsTest-265384025 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 13:57:05 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-a8c2e573-468f-48e8-8dff-8bb23d7f97e2 tempest-VolumesActionsTest-265384025 None] Flow 'volume_create_manager' (bb457cb5-55a4-4a34-9dde-d99ddefaf414) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 13:57:05 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-a8c2e573-468f-48e8-8dff-8bb23d7f97e2 tempest-VolumesActionsTest-265384025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (713dcf84-4bb6-494c-a6a6-79622a8693e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:57:05 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-a8c2e573-468f-48e8-8dff-8bb23d7f97e2 tempest-VolumesActionsTest-265384025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (713dcf84-4bb6-494c-a6a6-79622a8693e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T11:57:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1027324811',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1cd8f0c2-a52e-49fb-b0f6-ba29e5616f9b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='768408e2746a45718eb8a6046266a7b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T11:57:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T11:57:06Z,use_quota=True,user_id='05fb2b2e905c4534abb5765cc1b8c871',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1147de8b-623b-426c-a13d-7fc824a80f67),volume_type_id=1147de8b-623b-426c-a13d-7fc824a80f67)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:57:05 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-a8c2e573-468f-48e8-8dff-8bb23d7f97e2 tempest-VolumesActionsTest-265384025 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a2aed39-2b74-485f-b730-95ab46e5205a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:57:05 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-a8c2e573-468f-48e8-8dff-8bb23d7f97e2 tempest-VolumesActionsTest-265384025 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a2aed39-2b74-485f-b730-95ab46e5205a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:57:05 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-a8c2e573-468f-48e8-8dff-8bb23d7f97e2 tempest-VolumesActionsTest-265384025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df9162cc-e635-47c6-b756-f7ac16306ba5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:57:05 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-a8c2e573-468f-48e8-8dff-8bb23d7f97e2 tempest-VolumesActionsTest-265384025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df9162cc-e635-47c6-b756-f7ac16306ba5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1cd8f0c2-a52e-49fb-b0f6-ba29e5616f9b', 'volume_name': 'volume-1cd8f0c2-a52e-49fb-b0f6-ba29e5616f9b', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:57:05 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-a8c2e573-468f-48e8-8dff-8bb23d7f97e2 tempest-VolumesActionsTest-265384025 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8fad0bcf-e65d-4f9b-89dd-e0bcabde3c54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:57:05 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-a8c2e573-468f-48e8-8dff-8bb23d7f97e2 tempest-VolumesActionsTest-265384025 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8fad0bcf-e65d-4f9b-89dd-e0bcabde3c54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:57:05 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-a8c2e573-468f-48e8-8dff-8bb23d7f97e2 tempest-VolumesActionsTest-265384025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0fd3bcf8-cf9c-4bbb-9a5e-d73f13ae3065) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:57:05 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-a8c2e573-468f-48e8-8dff-8bb23d7f97e2 tempest-VolumesActionsTest-265384025 None] Volume 1cd8f0c2-a52e-49fb-b0f6-ba29e5616f9b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1cd8f0c2-a52e-49fb-b0f6-ba29e5616f9b', 'volume_size': 1} Jul 13 13:57:05 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-a8c2e573-468f-48e8-8dff-8bb23d7f97e2 tempest-VolumesActionsTest-265384025 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:57:05 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-a8c2e573-468f-48e8-8dff-8bb23d7f97e2 tempest-VolumesActionsTest-265384025 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:57:05 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-a8c2e573-468f-48e8-8dff-8bb23d7f97e2 tempest-VolumesActionsTest-265384025 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T11:57:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1027324811',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1cd8f0c2-a52e-49fb-b0f6-ba29e5616f9b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='768408e2746a45718eb8a6046266a7b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T11:57:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T11:57:06Z,use_quota=True,user_id='05fb2b2e905c4534abb5765cc1b8c871',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1147de8b-623b-426c-a13d-7fc824a80f67),volume_type_id=1147de8b-623b-426c-a13d-7fc824a80f67)}" {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 13 13:57:05 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-a8c2e573-468f-48e8-8dff-8bb23d7f97e2 tempest-VolumesActionsTest-265384025 None] Creating volume 1cd8f0c2-a52e-49fb-b0f6-ba29e5616f9b {{(pid=87098) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 13 13:57:05 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-a8c2e573-468f-48e8-8dff-8bb23d7f97e2 tempest-VolumesActionsTest-265384025 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:57:05 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-a8c2e573-468f-48e8-8dff-8bb23d7f97e2 tempest-VolumesActionsTest-265384025 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:57:05 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-a8c2e573-468f-48e8-8dff-8bb23d7f97e2 tempest-VolumesActionsTest-265384025 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 13:57:05 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-a8c2e573-468f-48e8-8dff-8bb23d7f97e2 tempest-VolumesActionsTest-265384025 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 13:57:05 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-a8c2e573-468f-48e8-8dff-8bb23d7f97e2 tempest-VolumesActionsTest-265384025 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:57:05 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-a8c2e573-468f-48e8-8dff-8bb23d7f97e2 tempest-VolumesActionsTest-265384025 None] Selected osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 13:57:05 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-a8c2e573-468f-48e8-8dff-8bb23d7f97e2 tempest-VolumesActionsTest-265384025 None] casted to osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 Jul 13 13:57:05 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-a8c2e573-468f-48e8-8dff-8bb23d7f97e2 tempest-VolumesActionsTest-265384025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-1cd8f0c2-a52e-49fb-b0f6-ba29e5616f9b 1073741824 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:57:05 devstack sudo[97134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-1cd8f0c2-a52e-49fb-b0f6-ba29e5616f9b 1073741824 Jul 13 13:57:05 devstack sudo[97134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:57:06 devstack sudo[97134]: pam_unix(sudo:session): session closed for user root Jul 13 13:57:06 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-a8c2e573-468f-48e8-8dff-8bb23d7f97e2 tempest-VolumesActionsTest-265384025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-1cd8f0c2-a52e-49fb-b0f6-ba29e5616f9b 1073741824" returned: 0 in 0.683s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:57:06 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-a8c2e573-468f-48e8-8dff-8bb23d7f97e2 tempest-VolumesActionsTest-265384025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-1cd8f0c2-a52e-49fb-b0f6-ba29e5616f9b {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:57:06 devstack sudo[97175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-1cd8f0c2-a52e-49fb-b0f6-ba29e5616f9b Jul 13 13:57:06 devstack sudo[97175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:57:07 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-9e4584b1-9d1d-4fa4-b117-53875cb90110 tempest-VolumesGetTest-148886235 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 13:57:07 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-9e4584b1-9d1d-4fa4-b117-53875cb90110 tempest-VolumesGetTest-148886235 None] Flow 'volume_create_manager' (f41a0a96-d011-4849-ac68-8dbe7330ae30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 13:57:07 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-9e4584b1-9d1d-4fa4-b117-53875cb90110 tempest-VolumesGetTest-148886235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d9c7312-6f5a-47a6-b0ab-40cde0ea81b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:57:07 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-9e4584b1-9d1d-4fa4-b117-53875cb90110 tempest-VolumesGetTest-148886235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d9c7312-6f5a-47a6-b0ab-40cde0ea81b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T11:57:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1034357169',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3bcd0822-ea00-45e7-a195-2e78d2e5c20f,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='fce5cc7d83924cda908696f4e23b92f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T11:57:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T11:57:07Z,use_quota=True,user_id='9b36f110e7f84651be59cde67a7b41e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1147de8b-623b-426c-a13d-7fc824a80f67),volume_type_id=1147de8b-623b-426c-a13d-7fc824a80f67)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:57:07 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-9e4584b1-9d1d-4fa4-b117-53875cb90110 tempest-VolumesGetTest-148886235 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0bb1772b-c922-4110-a660-f2cd979b3da1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:57:07 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-9e4584b1-9d1d-4fa4-b117-53875cb90110 tempest-VolumesGetTest-148886235 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0bb1772b-c922-4110-a660-f2cd979b3da1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:57:07 devstack sudo[97175]: pam_unix(sudo:session): session closed for user root Jul 13 13:57:07 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-9e4584b1-9d1d-4fa4-b117-53875cb90110 tempest-VolumesGetTest-148886235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7fb67f7e-b79b-449f-8d21-bf83194da797) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:57:07 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-9e4584b1-9d1d-4fa4-b117-53875cb90110 tempest-VolumesGetTest-148886235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7fb67f7e-b79b-449f-8d21-bf83194da797) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3bcd0822-ea00-45e7-a195-2e78d2e5c20f', 'volume_name': 'volume-3bcd0822-ea00-45e7-a195-2e78d2e5c20f', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:57:07 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-9e4584b1-9d1d-4fa4-b117-53875cb90110 tempest-VolumesGetTest-148886235 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef5e42ba-013b-48a1-849a-38cc84e95108) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:57:07 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-9e4584b1-9d1d-4fa4-b117-53875cb90110 tempest-VolumesGetTest-148886235 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef5e42ba-013b-48a1-849a-38cc84e95108) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:57:07 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-9e4584b1-9d1d-4fa4-b117-53875cb90110 tempest-VolumesGetTest-148886235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59c8307f-2e34-45ed-b597-82991cf2641a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:57:07 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-9e4584b1-9d1d-4fa4-b117-53875cb90110 tempest-VolumesGetTest-148886235 None] Volume 3bcd0822-ea00-45e7-a195-2e78d2e5c20f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3bcd0822-ea00-45e7-a195-2e78d2e5c20f', 'volume_size': 1} Jul 13 13:57:07 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-9e4584b1-9d1d-4fa4-b117-53875cb90110 tempest-VolumesGetTest-148886235 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:57:07 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-a8c2e573-468f-48e8-8dff-8bb23d7f97e2 tempest-VolumesActionsTest-265384025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-1cd8f0c2-a52e-49fb-b0f6-ba29e5616f9b" returned: 0 in 0.594s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:57:07 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-a8c2e573-468f-48e8-8dff-8bb23d7f97e2 tempest-VolumesActionsTest-265384025 None] <== create_volume: return (1354ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'} {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 13 13:57:07 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-a8c2e573-468f-48e8-8dff-8bb23d7f97e2 tempest-VolumesActionsTest-265384025 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.357s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:57:07 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-9e4584b1-9d1d-4fa4-b117-53875cb90110 tempest-VolumesGetTest-148886235 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.006s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:57:07 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-9e4584b1-9d1d-4fa4-b117-53875cb90110 tempest-VolumesGetTest-148886235 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T11:57:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1034357169',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3bcd0822-ea00-45e7-a195-2e78d2e5c20f,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='fce5cc7d83924cda908696f4e23b92f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T11:57:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T11:57:07Z,use_quota=True,user_id='9b36f110e7f84651be59cde67a7b41e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1147de8b-623b-426c-a13d-7fc824a80f67),volume_type_id=1147de8b-623b-426c-a13d-7fc824a80f67)}" {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 13 13:57:07 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-9e4584b1-9d1d-4fa4-b117-53875cb90110 tempest-VolumesGetTest-148886235 None] Creating volume 3bcd0822-ea00-45e7-a195-2e78d2e5c20f {{(pid=87098) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 13 13:57:07 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-9e4584b1-9d1d-4fa4-b117-53875cb90110 tempest-VolumesGetTest-148886235 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:57:07 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-9e4584b1-9d1d-4fa4-b117-53875cb90110 tempest-VolumesGetTest-148886235 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:57:07 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-9e4584b1-9d1d-4fa4-b117-53875cb90110 tempest-VolumesGetTest-148886235 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 13:57:07 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-9e4584b1-9d1d-4fa4-b117-53875cb90110 tempest-VolumesGetTest-148886235 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 13:57:07 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-9e4584b1-9d1d-4fa4-b117-53875cb90110 tempest-VolumesGetTest-148886235 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:57:07 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-9e4584b1-9d1d-4fa4-b117-53875cb90110 tempest-VolumesGetTest-148886235 None] Selected osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 13:57:07 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-9e4584b1-9d1d-4fa4-b117-53875cb90110 tempest-VolumesGetTest-148886235 None] casted to osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 Jul 13 13:57:07 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-9e4584b1-9d1d-4fa4-b117-53875cb90110 tempest-VolumesGetTest-148886235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-3bcd0822-ea00-45e7-a195-2e78d2e5c20f 1073741824 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:57:07 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-a8c2e573-468f-48e8-8dff-8bb23d7f97e2 tempest-VolumesActionsTest-265384025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0fd3bcf8-cf9c-4bbb-9a5e-d73f13ae3065) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1cd8f0c2-a52e-49fb-b0f6-ba29e5616f9b', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:57:07 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-a8c2e573-468f-48e8-8dff-8bb23d7f97e2 tempest-VolumesActionsTest-265384025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0d326f1-e84d-4de3-9d42-3470d609176d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:57:07 devstack sudo[97178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-3bcd0822-ea00-45e7-a195-2e78d2e5c20f 1073741824 Jul 13 13:57:07 devstack sudo[97178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:57:07 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-a8c2e573-468f-48e8-8dff-8bb23d7f97e2 tempest-VolumesActionsTest-265384025 None] Volume volume-1cd8f0c2-a52e-49fb-b0f6-ba29e5616f9b (1cd8f0c2-a52e-49fb-b0f6-ba29e5616f9b): created successfully Jul 13 13:57:07 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-a8c2e573-468f-48e8-8dff-8bb23d7f97e2 tempest-VolumesActionsTest-265384025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0d326f1-e84d-4de3-9d42-3470d609176d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:57:07 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-a8c2e573-468f-48e8-8dff-8bb23d7f97e2 tempest-VolumesActionsTest-265384025 None] Flow 'volume_create_manager' (bb457cb5-55a4-4a34-9dde-d99ddefaf414) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 13:57:07 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-a8c2e573-468f-48e8-8dff-8bb23d7f97e2 tempest-VolumesActionsTest-265384025 None] Created volume successfully. Jul 13 13:57:07 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-192aba6f-5508-4591-b500-e050adcb80df tempest-AttachVolumeTestJSON-2118030158 None] Acquiring lock "cinder-84a960d0-d14b-4386-adcb-75754a165d17-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 13:57:07 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-192aba6f-5508-4591-b500-e050adcb80df tempest-AttachVolumeTestJSON-2118030158 None] Lock "cinder-84a960d0-d14b-4386-adcb-75754a165d17-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 13:57:07 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-192aba6f-5508-4591-b500-e050adcb80df tempest-AttachVolumeTestJSON-2118030158 None] Acquiring lock "cinder-quobyte-84a960d0-d14b-4386-adcb-75754a165d17" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 13:57:07 devstack sudo[97178]: pam_unix(sudo:session): session closed for user root Jul 13 13:57:07 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-192aba6f-5508-4591-b500-e050adcb80df tempest-AttachVolumeTestJSON-2118030158 None] Lock "cinder-quobyte-84a960d0-d14b-4386-adcb-75754a165d17" acquired by "delete_volume" :: waited 0.024s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 13:57:07 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-9e4584b1-9d1d-4fa4-b117-53875cb90110 tempest-VolumesGetTest-148886235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-3bcd0822-ea00-45e7-a195-2e78d2e5c20f 1073741824" returned: 0 in 0.664s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:57:07 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[038e0cf5-4b16-4e1c-a306-0e7c73fcb9de]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 13:57:07 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-192aba6f-5508-4591-b500-e050adcb80df tempest-AttachVolumeTestJSON-2118030158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-84a960d0-d14b-4386-adcb-75754a165d17 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:57:07 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-9e4584b1-9d1d-4fa4-b117-53875cb90110 tempest-VolumesGetTest-148886235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-3bcd0822-ea00-45e7-a195-2e78d2e5c20f {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:57:08 devstack sudo[97188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-3bcd0822-ea00-45e7-a195-2e78d2e5c20f Jul 13 13:57:08 devstack sudo[97188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:57:08 devstack sudo[97187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-84a960d0-d14b-4386-adcb-75754a165d17 Jul 13 13:57:08 devstack sudo[97187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:57:08 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-c87c1239-fd2a-4937-a2ce-2237d7285522 tempest-VolumesActionsTest-1849404092 None] Acquiring lock "cinder-1cd8f0c2-a52e-49fb-b0f6-ba29e5616f9b-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 13:57:08 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-c87c1239-fd2a-4937-a2ce-2237d7285522 tempest-VolumesActionsTest-1849404092 None] Lock "cinder-1cd8f0c2-a52e-49fb-b0f6-ba29e5616f9b-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 13:57:08 devstack sudo[97188]: pam_unix(sudo:session): session closed for user root Jul 13 13:57:08 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-c87c1239-fd2a-4937-a2ce-2237d7285522 tempest-VolumesActionsTest-1849404092 None] Acquiring lock "cinder-quobyte-1cd8f0c2-a52e-49fb-b0f6-ba29e5616f9b" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 13:57:08 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-9e4584b1-9d1d-4fa4-b117-53875cb90110 tempest-VolumesGetTest-148886235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-3bcd0822-ea00-45e7-a195-2e78d2e5c20f" returned: 0 in 0.319s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:57:08 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-9e4584b1-9d1d-4fa4-b117-53875cb90110 tempest-VolumesGetTest-148886235 None] <== create_volume: return (1043ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'} {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 13 13:57:08 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-9e4584b1-9d1d-4fa4-b117-53875cb90110 tempest-VolumesGetTest-148886235 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.046s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:57:08 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-9e4584b1-9d1d-4fa4-b117-53875cb90110 tempest-VolumesGetTest-148886235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59c8307f-2e34-45ed-b597-82991cf2641a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3bcd0822-ea00-45e7-a195-2e78d2e5c20f', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:57:08 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-9e4584b1-9d1d-4fa4-b117-53875cb90110 tempest-VolumesGetTest-148886235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8a2c829-9577-4b74-bf41-619a498a8c5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:57:08 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-c87c1239-fd2a-4937-a2ce-2237d7285522 tempest-VolumesActionsTest-1849404092 None] Lock "cinder-quobyte-1cd8f0c2-a52e-49fb-b0f6-ba29e5616f9b" acquired by "delete_volume" :: waited 0.040s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 13:57:08 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-9e4584b1-9d1d-4fa4-b117-53875cb90110 tempest-VolumesGetTest-148886235 None] Volume volume-3bcd0822-ea00-45e7-a195-2e78d2e5c20f (3bcd0822-ea00-45e7-a195-2e78d2e5c20f): created successfully Jul 13 13:57:08 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-9e4584b1-9d1d-4fa4-b117-53875cb90110 tempest-VolumesGetTest-148886235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8a2c829-9577-4b74-bf41-619a498a8c5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:57:08 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-9e4584b1-9d1d-4fa4-b117-53875cb90110 tempest-VolumesGetTest-148886235 None] Flow 'volume_create_manager' (f41a0a96-d011-4849-ac68-8dbe7330ae30) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 13:57:08 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4c2c42d-517c-40af-bf54-56ea540d8a55]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 13:57:08 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-c87c1239-fd2a-4937-a2ce-2237d7285522 tempest-VolumesActionsTest-1849404092 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-1cd8f0c2-a52e-49fb-b0f6-ba29e5616f9b {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:57:08 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-9e4584b1-9d1d-4fa4-b117-53875cb90110 tempest-VolumesGetTest-148886235 None] Created volume successfully. Jul 13 13:57:08 devstack sudo[97187]: pam_unix(sudo:session): session closed for user root Jul 13 13:57:08 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-192aba6f-5508-4591-b500-e050adcb80df tempest-AttachVolumeTestJSON-2118030158 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-84a960d0-d14b-4386-adcb-75754a165d17" returned: 0 in 0.481s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:57:08 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-192aba6f-5508-4591-b500-e050adcb80df tempest-AttachVolumeTestJSON-2118030158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-84a960d0-d14b-4386-adcb-75754a165d17 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:57:08 devstack sudo[97197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-84a960d0-d14b-4386-adcb-75754a165d17 Jul 13 13:57:08 devstack sudo[97197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:57:08 devstack sudo[97195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-1cd8f0c2-a52e-49fb-b0f6-ba29e5616f9b Jul 13 13:57:08 devstack sudo[97195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:57:08 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-12c01e32-a40f-4d67-86c3-f53c723ca2f0 tempest-TestInstancesWithCinderVolumes-1739256037 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 13:57:08 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-12c01e32-a40f-4d67-86c3-f53c723ca2f0 tempest-TestInstancesWithCinderVolumes-1739256037 None] Flow 'volume_create_manager' (353a16cb-36cb-466c-bf96-255854ca1691) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 13:57:08 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-12c01e32-a40f-4d67-86c3-f53c723ca2f0 tempest-TestInstancesWithCinderVolumes-1739256037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd1fc63b-26c1-4ca7-b48a-2f9c68e213fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:57:08 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-12c01e32-a40f-4d67-86c3-f53c723ca2f0 tempest-TestInstancesWithCinderVolumes-1739256037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd1fc63b-26c1-4ca7-b48a-2f9c68e213fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T11:57:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1337514884',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72998338-69fb-46f0-b04c-890de1054fb9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe824dc7c0ac4dd887f18f7c50c376f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T11:57:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T11:57:09Z,use_quota=True,user_id='51b5f237c78f487cb2a632a8ef7348d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c702fd8-46bb-4d85-9b01-99a093068c1e),volume_type_id=7c702fd8-46bb-4d85-9b01-99a093068c1e)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:57:08 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-12c01e32-a40f-4d67-86c3-f53c723ca2f0 tempest-TestInstancesWithCinderVolumes-1739256037 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f12d1db6-4eda-43ea-abd9-99117ccf4d8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:57:08 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-12c01e32-a40f-4d67-86c3-f53c723ca2f0 tempest-TestInstancesWithCinderVolumes-1739256037 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f12d1db6-4eda-43ea-abd9-99117ccf4d8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:57:08 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-12c01e32-a40f-4d67-86c3-f53c723ca2f0 tempest-TestInstancesWithCinderVolumes-1739256037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8cc371da-55a0-4dfd-b6bb-9872d95de1cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:57:08 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-12c01e32-a40f-4d67-86c3-f53c723ca2f0 tempest-TestInstancesWithCinderVolumes-1739256037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8cc371da-55a0-4dfd-b6bb-9872d95de1cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '72998338-69fb-46f0-b04c-890de1054fb9', 'volume_name': 'volume-72998338-69fb-46f0-b04c-890de1054fb9', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:57:08 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-12c01e32-a40f-4d67-86c3-f53c723ca2f0 tempest-TestInstancesWithCinderVolumes-1739256037 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c3ede7a-aeda-4644-ba18-0f830c6eda3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:57:08 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-12c01e32-a40f-4d67-86c3-f53c723ca2f0 tempest-TestInstancesWithCinderVolumes-1739256037 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c3ede7a-aeda-4644-ba18-0f830c6eda3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:57:08 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-12c01e32-a40f-4d67-86c3-f53c723ca2f0 tempest-TestInstancesWithCinderVolumes-1739256037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d61eda46-78d4-446a-980e-6888ebccb080) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:57:08 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-12c01e32-a40f-4d67-86c3-f53c723ca2f0 tempest-TestInstancesWithCinderVolumes-1739256037 None] Volume 72998338-69fb-46f0-b04c-890de1054fb9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-72998338-69fb-46f0-b04c-890de1054fb9', 'volume_size': 1} Jul 13 13:57:08 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-12c01e32-a40f-4d67-86c3-f53c723ca2f0 tempest-TestInstancesWithCinderVolumes-1739256037 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:57:08 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-12c01e32-a40f-4d67-86c3-f53c723ca2f0 tempest-TestInstancesWithCinderVolumes-1739256037 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:57:08 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-12c01e32-a40f-4d67-86c3-f53c723ca2f0 tempest-TestInstancesWithCinderVolumes-1739256037 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T11:57:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1337514884',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72998338-69fb-46f0-b04c-890de1054fb9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe824dc7c0ac4dd887f18f7c50c376f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T11:57:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T11:57:09Z,use_quota=True,user_id='51b5f237c78f487cb2a632a8ef7348d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c702fd8-46bb-4d85-9b01-99a093068c1e),volume_type_id=7c702fd8-46bb-4d85-9b01-99a093068c1e)}" {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 13 13:57:08 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-12c01e32-a40f-4d67-86c3-f53c723ca2f0 tempest-TestInstancesWithCinderVolumes-1739256037 None] Creating volume 72998338-69fb-46f0-b04c-890de1054fb9 {{(pid=87098) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 13 13:57:08 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-12c01e32-a40f-4d67-86c3-f53c723ca2f0 tempest-TestInstancesWithCinderVolumes-1739256037 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:57:08 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-12c01e32-a40f-4d67-86c3-f53c723ca2f0 tempest-TestInstancesWithCinderVolumes-1739256037 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:57:08 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-12c01e32-a40f-4d67-86c3-f53c723ca2f0 tempest-TestInstancesWithCinderVolumes-1739256037 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 13:57:08 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-12c01e32-a40f-4d67-86c3-f53c723ca2f0 tempest-TestInstancesWithCinderVolumes-1739256037 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 13:57:08 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-12c01e32-a40f-4d67-86c3-f53c723ca2f0 tempest-TestInstancesWithCinderVolumes-1739256037 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:57:08 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-12c01e32-a40f-4d67-86c3-f53c723ca2f0 tempest-TestInstancesWithCinderVolumes-1739256037 None] Selected osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 13:57:08 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-12c01e32-a40f-4d67-86c3-f53c723ca2f0 tempest-TestInstancesWithCinderVolumes-1739256037 None] casted to osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 Jul 13 13:57:08 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-12c01e32-a40f-4d67-86c3-f53c723ca2f0 tempest-TestInstancesWithCinderVolumes-1739256037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-72998338-69fb-46f0-b04c-890de1054fb9 1073741824 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:57:08 devstack sudo[97200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-72998338-69fb-46f0-b04c-890de1054fb9 1073741824 Jul 13 13:57:08 devstack sudo[97200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:57:08 devstack sudo[97197]: pam_unix(sudo:session): session closed for user root Jul 13 13:57:08 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-192aba6f-5508-4591-b500-e050adcb80df tempest-AttachVolumeTestJSON-2118030158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-84a960d0-d14b-4386-adcb-75754a165d17" returned: 0 in 0.364s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:57:08 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-192aba6f-5508-4591-b500-e050adcb80df tempest-AttachVolumeTestJSON-2118030158 None] Lock "cinder-quobyte-84a960d0-d14b-4386-adcb-75754a165d17" released by "delete_volume" :: held 0.910s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 13:57:08 devstack sudo[97195]: pam_unix(sudo:session): session closed for user root Jul 13 13:57:08 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-c87c1239-fd2a-4937-a2ce-2237d7285522 tempest-VolumesActionsTest-1849404092 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-1cd8f0c2-a52e-49fb-b0f6-ba29e5616f9b" returned: 0 in 0.510s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:57:08 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-c87c1239-fd2a-4937-a2ce-2237d7285522 tempest-VolumesActionsTest-1849404092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-1cd8f0c2-a52e-49fb-b0f6-ba29e5616f9b {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:57:08 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-192aba6f-5508-4591-b500-e050adcb80df tempest-AttachVolumeTestJSON-2118030158 None] Created reservations ['7495dd13-7618-4fb9-8727-4eb90c726583', '41b29340-6820-4db1-ac5c-c0d17e68ef48', 'eda32256-fc47-419f-8ed9-3bf4e0300b09', '943df2a2-e7e8-4734-9ab9-b5f738ba3487'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 13:57:08 devstack sudo[97206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-1cd8f0c2-a52e-49fb-b0f6-ba29e5616f9b Jul 13 13:57:08 devstack sudo[97206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:57:09 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-192aba6f-5508-4591-b500-e050adcb80df tempest-AttachVolumeTestJSON-2118030158 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:57:09 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-192aba6f-5508-4591-b500-e050adcb80df tempest-AttachVolumeTestJSON-2118030158 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:57:09 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-192aba6f-5508-4591-b500-e050adcb80df tempest-AttachVolumeTestJSON-2118030158 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 13:57:09 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-192aba6f-5508-4591-b500-e050adcb80df tempest-AttachVolumeTestJSON-2118030158 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 13:57:09 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-192aba6f-5508-4591-b500-e050adcb80df tempest-AttachVolumeTestJSON-2118030158 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:57:09 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-192aba6f-5508-4591-b500-e050adcb80df tempest-AttachVolumeTestJSON-2118030158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:57:09 devstack sudo[97208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 Jul 13 13:57:09 devstack sudo[97208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:57:09 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-a4361345-caba-4e36-8ac5-00f5af24c56c tempest-TestInstancesWithCinderVolumes-1739256037 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 13:57:09 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-a4361345-caba-4e36-8ac5-00f5af24c56c tempest-TestInstancesWithCinderVolumes-1739256037 None] Flow 'volume_create_manager' (f9786ad9-f623-45f2-a69f-dbfe4e718f80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 13:57:09 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-a4361345-caba-4e36-8ac5-00f5af24c56c tempest-TestInstancesWithCinderVolumes-1739256037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8dfa51a2-b456-433c-bef5-946d2dc07a70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:57:09 devstack cinder-volume[87098]: DEBUG dbcounter [-] [87098] Writing DB stats cinder:UPDATE=158,cinder:INSERT=45,cinder:SELECT=131,cinder:DELETE=11 {{(pid=87098) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 13 13:57:09 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-a4361345-caba-4e36-8ac5-00f5af24c56c tempest-TestInstancesWithCinderVolumes-1739256037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8dfa51a2-b456-433c-bef5-946d2dc07a70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T11:57:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-531154197',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5dd52277-9ad3-4db1-816d-e77beb61b8d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe824dc7c0ac4dd887f18f7c50c376f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T11:57:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T11:57:09Z,use_quota=True,user_id='51b5f237c78f487cb2a632a8ef7348d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59442932-f8f4-4952-b217-28b78efd3f63),volume_type_id=59442932-f8f4-4952-b217-28b78efd3f63)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:57:09 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-a4361345-caba-4e36-8ac5-00f5af24c56c tempest-TestInstancesWithCinderVolumes-1739256037 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dbd86cbf-2adc-4d2f-a617-d501bfeba289) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:57:09 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-a4361345-caba-4e36-8ac5-00f5af24c56c tempest-TestInstancesWithCinderVolumes-1739256037 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dbd86cbf-2adc-4d2f-a617-d501bfeba289) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:57:09 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-a4361345-caba-4e36-8ac5-00f5af24c56c tempest-TestInstancesWithCinderVolumes-1739256037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (130d443a-2ee2-4fd4-b6af-886937264a2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:57:09 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-a4361345-caba-4e36-8ac5-00f5af24c56c tempest-TestInstancesWithCinderVolumes-1739256037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (130d443a-2ee2-4fd4-b6af-886937264a2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5dd52277-9ad3-4db1-816d-e77beb61b8d4', 'volume_name': 'volume-5dd52277-9ad3-4db1-816d-e77beb61b8d4', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:57:09 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-a4361345-caba-4e36-8ac5-00f5af24c56c tempest-TestInstancesWithCinderVolumes-1739256037 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28fa8c73-d9ca-4df4-9936-a6c5c17b228d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:57:09 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-a4361345-caba-4e36-8ac5-00f5af24c56c tempest-TestInstancesWithCinderVolumes-1739256037 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28fa8c73-d9ca-4df4-9936-a6c5c17b228d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:57:09 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-a4361345-caba-4e36-8ac5-00f5af24c56c tempest-TestInstancesWithCinderVolumes-1739256037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d28a783-f93b-4f04-a497-67b138967424) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:57:09 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-a4361345-caba-4e36-8ac5-00f5af24c56c tempest-TestInstancesWithCinderVolumes-1739256037 None] Volume 5dd52277-9ad3-4db1-816d-e77beb61b8d4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5dd52277-9ad3-4db1-816d-e77beb61b8d4', 'volume_size': 1} Jul 13 13:57:09 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-a4361345-caba-4e36-8ac5-00f5af24c56c tempest-TestInstancesWithCinderVolumes-1739256037 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:57:09 devstack sudo[97206]: pam_unix(sudo:session): session closed for user root Jul 13 13:57:09 devstack sudo[97208]: pam_unix(sudo:session): session closed for user root Jul 13 13:57:09 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-c87c1239-fd2a-4937-a2ce-2237d7285522 tempest-VolumesActionsTest-1849404092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-1cd8f0c2-a52e-49fb-b0f6-ba29e5616f9b" returned: 0 in 0.498s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:57:09 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-192aba6f-5508-4591-b500-e050adcb80df tempest-AttachVolumeTestJSON-2118030158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78" returned: 0 in 0.358s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:57:09 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-192aba6f-5508-4591-b500-e050adcb80df tempest-AttachVolumeTestJSON-2118030158 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 13:57:09 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-192aba6f-5508-4591-b500-e050adcb80df tempest-AttachVolumeTestJSON-2118030158 None] Deleted volume successfully. Jul 13 13:57:09 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-c87c1239-fd2a-4937-a2ce-2237d7285522 tempest-VolumesActionsTest-1849404092 None] Lock "cinder-quobyte-1cd8f0c2-a52e-49fb-b0f6-ba29e5616f9b" released by "delete_volume" :: held 1.084s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 13:57:09 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-192aba6f-5508-4591-b500-e050adcb80df tempest-AttachVolumeTestJSON-2118030158 None] Lock "cinder-84a960d0-d14b-4386-adcb-75754a165d17-delete_volume" released by "delete_volume" :: held 1.609s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 13:57:09 devstack sudo[97200]: pam_unix(sudo:session): session closed for user root Jul 13 13:57:09 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-12c01e32-a40f-4d67-86c3-f53c723ca2f0 tempest-TestInstancesWithCinderVolumes-1739256037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-72998338-69fb-46f0-b04c-890de1054fb9 1073741824" returned: 0 in 0.797s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:57:09 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-c87c1239-fd2a-4937-a2ce-2237d7285522 tempest-VolumesActionsTest-1849404092 None] Created reservations ['69036138-645b-4fb6-b5e5-117822c334e4', '2a1d39b4-85b1-4f06-ade6-dff2d56a6159', '38f1b2a1-fb5e-4193-969f-62e7bb39f755', 'd45cec2f-e88f-4302-9486-fb169da9fa0c'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 13:57:09 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-12c01e32-a40f-4d67-86c3-f53c723ca2f0 tempest-TestInstancesWithCinderVolumes-1739256037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-72998338-69fb-46f0-b04c-890de1054fb9 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:57:09 devstack sudo[97215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-72998338-69fb-46f0-b04c-890de1054fb9 Jul 13 13:57:09 devstack sudo[97215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:57:09 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-c87c1239-fd2a-4937-a2ce-2237d7285522 tempest-VolumesActionsTest-1849404092 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:57:09 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-c87c1239-fd2a-4937-a2ce-2237d7285522 tempest-VolumesActionsTest-1849404092 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:57:09 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-c87c1239-fd2a-4937-a2ce-2237d7285522 tempest-VolumesActionsTest-1849404092 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 13:57:09 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-c87c1239-fd2a-4937-a2ce-2237d7285522 tempest-VolumesActionsTest-1849404092 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 13:57:09 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-c87c1239-fd2a-4937-a2ce-2237d7285522 tempest-VolumesActionsTest-1849404092 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:57:09 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-c87c1239-fd2a-4937-a2ce-2237d7285522 tempest-VolumesActionsTest-1849404092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:57:09 devstack sudo[97217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 Jul 13 13:57:09 devstack sudo[97217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:57:09 devstack sudo[97215]: pam_unix(sudo:session): session closed for user root Jul 13 13:57:09 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-12c01e32-a40f-4d67-86c3-f53c723ca2f0 tempest-TestInstancesWithCinderVolumes-1739256037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-72998338-69fb-46f0-b04c-890de1054fb9" returned: 0 in 0.346s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:57:09 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-12c01e32-a40f-4d67-86c3-f53c723ca2f0 tempest-TestInstancesWithCinderVolumes-1739256037 None] <== create_volume: return (1203ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'} {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 13 13:57:09 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-12c01e32-a40f-4d67-86c3-f53c723ca2f0 tempest-TestInstancesWithCinderVolumes-1739256037 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.206s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:57:09 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-a4361345-caba-4e36-8ac5-00f5af24c56c tempest-TestInstancesWithCinderVolumes-1739256037 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.540s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:57:09 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-a4361345-caba-4e36-8ac5-00f5af24c56c tempest-TestInstancesWithCinderVolumes-1739256037 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T11:57:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-531154197',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5dd52277-9ad3-4db1-816d-e77beb61b8d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe824dc7c0ac4dd887f18f7c50c376f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T11:57:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T11:57:09Z,use_quota=True,user_id='51b5f237c78f487cb2a632a8ef7348d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59442932-f8f4-4952-b217-28b78efd3f63),volume_type_id=59442932-f8f4-4952-b217-28b78efd3f63)}" {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 13 13:57:09 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-a4361345-caba-4e36-8ac5-00f5af24c56c tempest-TestInstancesWithCinderVolumes-1739256037 None] Creating volume 5dd52277-9ad3-4db1-816d-e77beb61b8d4 {{(pid=87098) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 13 13:57:09 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-a4361345-caba-4e36-8ac5-00f5af24c56c tempest-TestInstancesWithCinderVolumes-1739256037 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:57:09 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-a4361345-caba-4e36-8ac5-00f5af24c56c tempest-TestInstancesWithCinderVolumes-1739256037 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:57:09 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-a4361345-caba-4e36-8ac5-00f5af24c56c tempest-TestInstancesWithCinderVolumes-1739256037 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 13:57:09 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-a4361345-caba-4e36-8ac5-00f5af24c56c tempest-TestInstancesWithCinderVolumes-1739256037 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 13:57:09 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-a4361345-caba-4e36-8ac5-00f5af24c56c tempest-TestInstancesWithCinderVolumes-1739256037 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:57:09 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-a4361345-caba-4e36-8ac5-00f5af24c56c tempest-TestInstancesWithCinderVolumes-1739256037 None] Selected osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 13:57:09 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-a4361345-caba-4e36-8ac5-00f5af24c56c tempest-TestInstancesWithCinderVolumes-1739256037 None] casted to osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 Jul 13 13:57:09 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-a4361345-caba-4e36-8ac5-00f5af24c56c tempest-TestInstancesWithCinderVolumes-1739256037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-5dd52277-9ad3-4db1-816d-e77beb61b8d4 1073741824 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:57:09 devstack sudo[97220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-5dd52277-9ad3-4db1-816d-e77beb61b8d4 1073741824 Jul 13 13:57:09 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-12c01e32-a40f-4d67-86c3-f53c723ca2f0 tempest-TestInstancesWithCinderVolumes-1739256037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d61eda46-78d4-446a-980e-6888ebccb080) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-72998338-69fb-46f0-b04c-890de1054fb9', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:57:09 devstack sudo[97220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:57:09 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-12c01e32-a40f-4d67-86c3-f53c723ca2f0 tempest-TestInstancesWithCinderVolumes-1739256037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14ec6748-e27a-4bff-b856-30b6d99cf3ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:57:09 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-12c01e32-a40f-4d67-86c3-f53c723ca2f0 tempest-TestInstancesWithCinderVolumes-1739256037 None] Volume volume-72998338-69fb-46f0-b04c-890de1054fb9 (72998338-69fb-46f0-b04c-890de1054fb9): created successfully Jul 13 13:57:09 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-12c01e32-a40f-4d67-86c3-f53c723ca2f0 tempest-TestInstancesWithCinderVolumes-1739256037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14ec6748-e27a-4bff-b856-30b6d99cf3ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:57:10 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-12c01e32-a40f-4d67-86c3-f53c723ca2f0 tempest-TestInstancesWithCinderVolumes-1739256037 None] Flow 'volume_create_manager' (353a16cb-36cb-466c-bf96-255854ca1691) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 13:57:10 devstack sudo[97217]: pam_unix(sudo:session): session closed for user root Jul 13 13:57:10 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-c87c1239-fd2a-4937-a2ce-2237d7285522 tempest-VolumesActionsTest-1849404092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78" returned: 0 in 0.398s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:57:10 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-c87c1239-fd2a-4937-a2ce-2237d7285522 tempest-VolumesActionsTest-1849404092 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 13:57:10 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-c87c1239-fd2a-4937-a2ce-2237d7285522 tempest-VolumesActionsTest-1849404092 None] Deleted volume successfully. Jul 13 13:57:10 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-12c01e32-a40f-4d67-86c3-f53c723ca2f0 tempest-TestInstancesWithCinderVolumes-1739256037 None] Created volume successfully. Jul 13 13:57:10 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-f262b70f-5598-4c19-8f1c-2b414152e183 tempest-TestInstancesWithCinderVolumes-1739256037 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 13:57:10 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-f262b70f-5598-4c19-8f1c-2b414152e183 tempest-TestInstancesWithCinderVolumes-1739256037 None] Flow 'volume_create_manager' (e2f3a888-e9a3-4f9a-af4e-51f555a4bf26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 13:57:10 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-f262b70f-5598-4c19-8f1c-2b414152e183 tempest-TestInstancesWithCinderVolumes-1739256037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea95b254-c16b-4544-ad97-4ddef01fdd05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:57:10 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-c87c1239-fd2a-4937-a2ce-2237d7285522 tempest-VolumesActionsTest-1849404092 None] Lock "cinder-1cd8f0c2-a52e-49fb-b0f6-ba29e5616f9b-delete_volume" released by "delete_volume" :: held 1.874s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 13:57:10 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-f262b70f-5598-4c19-8f1c-2b414152e183 tempest-TestInstancesWithCinderVolumes-1739256037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea95b254-c16b-4544-ad97-4ddef01fdd05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T11:57:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-169716418',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e16a6c11-4674-4833-9c5e-c793a8d36a58,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe824dc7c0ac4dd887f18f7c50c376f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T11:57:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T11:57:10Z,use_quota=True,user_id='51b5f237c78f487cb2a632a8ef7348d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c1574b4-b927-4a19-8dbe-da40446c8168),volume_type_id=8c1574b4-b927-4a19-8dbe-da40446c8168)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:57:10 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-f262b70f-5598-4c19-8f1c-2b414152e183 tempest-TestInstancesWithCinderVolumes-1739256037 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3de88d4b-2646-454b-b039-36ef31d0a5b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:57:10 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-f262b70f-5598-4c19-8f1c-2b414152e183 tempest-TestInstancesWithCinderVolumes-1739256037 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3de88d4b-2646-454b-b039-36ef31d0a5b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:57:10 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-f262b70f-5598-4c19-8f1c-2b414152e183 tempest-TestInstancesWithCinderVolumes-1739256037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8422ae7-bb6b-4fb2-af47-fb3853c7d94c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:57:10 devstack cinder-volume[87098]: DEBUG cinder.image.glance [None req-f262b70f-5598-4c19-8f1c-2b414152e183 tempest-TestInstancesWithCinderVolumes-1739256037 None] Creating Keystone auth plugin from conf {{(pid=87098) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 13 13:57:10 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-a33e5f54-07a8-4c3b-b055-c931464e81be tempest-AttachVolumeTestJSON-2118030158 None] Acquiring lock "cinder-36d3b495-7663-427a-bc0c-393ad3afc75a-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 13:57:10 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-a33e5f54-07a8-4c3b-b055-c931464e81be tempest-AttachVolumeTestJSON-2118030158 None] Lock "cinder-36d3b495-7663-427a-bc0c-393ad3afc75a-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 13:57:10 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-a33e5f54-07a8-4c3b-b055-c931464e81be tempest-AttachVolumeTestJSON-2118030158 None] Acquiring lock "cinder-quobyte-36d3b495-7663-427a-bc0c-393ad3afc75a" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 13:57:10 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-a33e5f54-07a8-4c3b-b055-c931464e81be tempest-AttachVolumeTestJSON-2118030158 None] Lock "cinder-quobyte-36d3b495-7663-427a-bc0c-393ad3afc75a" acquired by "delete_volume" :: waited 0.020s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 13:57:10 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[40e3b639-4ba8-46f1-b1d1-8ddc2072d58d]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 13:57:10 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-a33e5f54-07a8-4c3b-b055-c931464e81be tempest-AttachVolumeTestJSON-2118030158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-36d3b495-7663-427a-bc0c-393ad3afc75a {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:57:10 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-c6004e8b-5772-40af-96a2-b3cb0895573c tempest-VolumesGetTest-148886235 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 13:57:10 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-c6004e8b-5772-40af-96a2-b3cb0895573c tempest-VolumesGetTest-148886235 None] Flow 'volume_create_manager' (60421ac8-ac0f-4718-ac00-cb1197d6cd39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 13:57:10 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-c6004e8b-5772-40af-96a2-b3cb0895573c tempest-VolumesGetTest-148886235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3492aed7-7f2a-42d9-8ee3-801cbcbf753b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:57:10 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-c6004e8b-5772-40af-96a2-b3cb0895573c tempest-VolumesGetTest-148886235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3492aed7-7f2a-42d9-8ee3-801cbcbf753b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T11:57:10Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-258535738',display_name='tempest-VolumesGetTest-Volume-1379957806',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88957f43-3d5e-42ff-88ac-f1b565537c8a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fce5cc7d83924cda908696f4e23b92f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T11:57:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T11:57:10Z,use_quota=True,user_id='9b36f110e7f84651be59cde67a7b41e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1147de8b-623b-426c-a13d-7fc824a80f67),volume_type_id=1147de8b-623b-426c-a13d-7fc824a80f67)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:57:10 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-c6004e8b-5772-40af-96a2-b3cb0895573c tempest-VolumesGetTest-148886235 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46c71f67-fbb4-4f68-b138-94085f03b163) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:57:10 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-c6004e8b-5772-40af-96a2-b3cb0895573c tempest-VolumesGetTest-148886235 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46c71f67-fbb4-4f68-b138-94085f03b163) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:57:10 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-c6004e8b-5772-40af-96a2-b3cb0895573c tempest-VolumesGetTest-148886235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ce58e08-c1e1-4366-bbf6-74fb40b0b6b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:57:10 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-c6004e8b-5772-40af-96a2-b3cb0895573c tempest-VolumesGetTest-148886235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ce58e08-c1e1-4366-bbf6-74fb40b0b6b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '88957f43-3d5e-42ff-88ac-f1b565537c8a', 'volume_name': 'volume-88957f43-3d5e-42ff-88ac-f1b565537c8a', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:57:10 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-c6004e8b-5772-40af-96a2-b3cb0895573c tempest-VolumesGetTest-148886235 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c084496-5e66-4988-81dd-dbc24ff455f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:57:10 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-c6004e8b-5772-40af-96a2-b3cb0895573c tempest-VolumesGetTest-148886235 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c084496-5e66-4988-81dd-dbc24ff455f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:57:10 devstack sudo[97225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-36d3b495-7663-427a-bc0c-393ad3afc75a Jul 13 13:57:10 devstack sudo[97225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:57:10 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-c6004e8b-5772-40af-96a2-b3cb0895573c tempest-VolumesGetTest-148886235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e6f0afa-6378-4b17-9c24-88c20784a8a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:57:10 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-c6004e8b-5772-40af-96a2-b3cb0895573c tempest-VolumesGetTest-148886235 None] Volume 88957f43-3d5e-42ff-88ac-f1b565537c8a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-88957f43-3d5e-42ff-88ac-f1b565537c8a', 'volume_size': 1} Jul 13 13:57:10 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-c6004e8b-5772-40af-96a2-b3cb0895573c tempest-VolumesGetTest-148886235 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:57:10 devstack sudo[97220]: pam_unix(sudo:session): session closed for user root Jul 13 13:57:10 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-a4361345-caba-4e36-8ac5-00f5af24c56c tempest-TestInstancesWithCinderVolumes-1739256037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-5dd52277-9ad3-4db1-816d-e77beb61b8d4 1073741824" returned: 0 in 0.662s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:57:10 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-a4361345-caba-4e36-8ac5-00f5af24c56c tempest-TestInstancesWithCinderVolumes-1739256037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-5dd52277-9ad3-4db1-816d-e77beb61b8d4 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:57:10 devstack sudo[97231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-5dd52277-9ad3-4db1-816d-e77beb61b8d4 Jul 13 13:57:10 devstack sudo[97231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:57:10 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-f262b70f-5598-4c19-8f1c-2b414152e183 tempest-TestInstancesWithCinderVolumes-1739256037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8422ae7-bb6b-4fb2-af47-fb3853c7d94c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'e16a6c11-4674-4833-9c5e-c793a8d36a58', 'volume_name': 'volume-e16a6c11-4674-4833-9c5e-c793a8d36a58', 'volume_size': 1, 'image_id': '5051b5e5-c857-4b44-8332-f584efd78830', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5051b5e5-c857-4b44-8332-f584efd78830', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1237164917', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'fe824dc7c0ac4dd887f18f7c50c376f0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5051b5e5-c857-4b44-8332-f584efd78830', 'created_at': datetime.datetime(2026, 7, 13, 11, 57, 5, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 13, 11, 57, 7, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5051b5e5-c857-4b44-8332-f584efd78830/file', 'properties': {}}, 'image_service': }' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:57:10 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-f262b70f-5598-4c19-8f1c-2b414152e183 tempest-TestInstancesWithCinderVolumes-1739256037 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc4a2eeb-87af-4013-b7d2-404d6fbcd57a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:57:10 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-f262b70f-5598-4c19-8f1c-2b414152e183 tempest-TestInstancesWithCinderVolumes-1739256037 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc4a2eeb-87af-4013-b7d2-404d6fbcd57a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:57:10 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-f262b70f-5598-4c19-8f1c-2b414152e183 tempest-TestInstancesWithCinderVolumes-1739256037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e2161ed-28d8-4097-988e-18b3be427031) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:57:10 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-f262b70f-5598-4c19-8f1c-2b414152e183 tempest-TestInstancesWithCinderVolumes-1739256037 None] Volume e16a6c11-4674-4833-9c5e-c793a8d36a58: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-e16a6c11-4674-4833-9c5e-c793a8d36a58', 'volume_size': 1, 'image_id': '5051b5e5-c857-4b44-8332-f584efd78830', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5051b5e5-c857-4b44-8332-f584efd78830', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1237164917', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'fe824dc7c0ac4dd887f18f7c50c376f0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5051b5e5-c857-4b44-8332-f584efd78830', 'created_at': datetime.datetime(2026, 7, 13, 11, 57, 5, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 13, 11, 57, 7, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5051b5e5-c857-4b44-8332-f584efd78830/file', 'properties': {}}, 'image_service': } Jul 13 13:57:10 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-f262b70f-5598-4c19-8f1c-2b414152e183 tempest-TestInstancesWithCinderVolumes-1739256037 None] Trying to clone e16a6c11-4674-4833-9c5e-c793a8d36a58 from image 5051b5e5-c857-4b44-8332-f584efd78830 at location (None, [{'url': 'file:///opt/stack/data/glance/images/5051b5e5-c857-4b44-8332-f584efd78830', 'metadata': {}}]). {{(pid=87098) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 13 13:57:10 devstack sudo[97225]: pam_unix(sudo:session): session closed for user root Jul 13 13:57:10 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-a33e5f54-07a8-4c3b-b055-c931464e81be tempest-AttachVolumeTestJSON-2118030158 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-36d3b495-7663-427a-bc0c-393ad3afc75a" returned: 0 in 0.454s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:57:10 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-a33e5f54-07a8-4c3b-b055-c931464e81be tempest-AttachVolumeTestJSON-2118030158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-36d3b495-7663-427a-bc0c-393ad3afc75a {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:57:10 devstack sudo[97235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-36d3b495-7663-427a-bc0c-393ad3afc75a Jul 13 13:57:10 devstack sudo[97235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:57:10 devstack sudo[97231]: pam_unix(sudo:session): session closed for user root Jul 13 13:57:10 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-a4361345-caba-4e36-8ac5-00f5af24c56c tempest-TestInstancesWithCinderVolumes-1739256037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-5dd52277-9ad3-4db1-816d-e77beb61b8d4" returned: 0 in 0.327s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:57:10 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-a4361345-caba-4e36-8ac5-00f5af24c56c tempest-TestInstancesWithCinderVolumes-1739256037 None] <== create_volume: return (1051ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'} {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 13 13:57:10 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-a4361345-caba-4e36-8ac5-00f5af24c56c tempest-TestInstancesWithCinderVolumes-1739256037 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.054s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:57:10 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-c6004e8b-5772-40af-96a2-b3cb0895573c tempest-VolumesGetTest-148886235 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.542s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:57:10 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-c6004e8b-5772-40af-96a2-b3cb0895573c tempest-VolumesGetTest-148886235 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T11:57:10Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-258535738',display_name='tempest-VolumesGetTest-Volume-1379957806',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88957f43-3d5e-42ff-88ac-f1b565537c8a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fce5cc7d83924cda908696f4e23b92f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T11:57:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T11:57:10Z,use_quota=True,user_id='9b36f110e7f84651be59cde67a7b41e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1147de8b-623b-426c-a13d-7fc824a80f67),volume_type_id=1147de8b-623b-426c-a13d-7fc824a80f67)}" {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 13 13:57:10 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-c6004e8b-5772-40af-96a2-b3cb0895573c tempest-VolumesGetTest-148886235 None] Creating volume 88957f43-3d5e-42ff-88ac-f1b565537c8a {{(pid=87098) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 13 13:57:10 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-c6004e8b-5772-40af-96a2-b3cb0895573c tempest-VolumesGetTest-148886235 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:57:10 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-c6004e8b-5772-40af-96a2-b3cb0895573c tempest-VolumesGetTest-148886235 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:57:10 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-c6004e8b-5772-40af-96a2-b3cb0895573c tempest-VolumesGetTest-148886235 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 13:57:10 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-c6004e8b-5772-40af-96a2-b3cb0895573c tempest-VolumesGetTest-148886235 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 13:57:10 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-c6004e8b-5772-40af-96a2-b3cb0895573c tempest-VolumesGetTest-148886235 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:57:10 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-c6004e8b-5772-40af-96a2-b3cb0895573c tempest-VolumesGetTest-148886235 None] Selected osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 13:57:10 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-c6004e8b-5772-40af-96a2-b3cb0895573c tempest-VolumesGetTest-148886235 None] casted to osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 Jul 13 13:57:10 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-c6004e8b-5772-40af-96a2-b3cb0895573c tempest-VolumesGetTest-148886235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-88957f43-3d5e-42ff-88ac-f1b565537c8a 1073741824 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:57:11 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-a4361345-caba-4e36-8ac5-00f5af24c56c tempest-TestInstancesWithCinderVolumes-1739256037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d28a783-f93b-4f04-a497-67b138967424) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5dd52277-9ad3-4db1-816d-e77beb61b8d4', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:57:11 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-a4361345-caba-4e36-8ac5-00f5af24c56c tempest-TestInstancesWithCinderVolumes-1739256037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e689e2f4-d515-45c9-b84a-8daf2a05b38f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:57:11 devstack sudo[97238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-88957f43-3d5e-42ff-88ac-f1b565537c8a 1073741824 Jul 13 13:57:11 devstack sudo[97238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:57:11 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-a4361345-caba-4e36-8ac5-00f5af24c56c tempest-TestInstancesWithCinderVolumes-1739256037 None] Volume volume-5dd52277-9ad3-4db1-816d-e77beb61b8d4 (5dd52277-9ad3-4db1-816d-e77beb61b8d4): created successfully Jul 13 13:57:11 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-a4361345-caba-4e36-8ac5-00f5af24c56c tempest-TestInstancesWithCinderVolumes-1739256037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e689e2f4-d515-45c9-b84a-8daf2a05b38f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:57:11 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-a4361345-caba-4e36-8ac5-00f5af24c56c tempest-TestInstancesWithCinderVolumes-1739256037 None] Flow 'volume_create_manager' (f9786ad9-f623-45f2-a69f-dbfe4e718f80) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 13:57:11 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-a4361345-caba-4e36-8ac5-00f5af24c56c tempest-TestInstancesWithCinderVolumes-1739256037 None] Created volume successfully. Jul 13 13:57:11 devstack sudo[97235]: pam_unix(sudo:session): session closed for user root Jul 13 13:57:11 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-a33e5f54-07a8-4c3b-b055-c931464e81be tempest-AttachVolumeTestJSON-2118030158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-36d3b495-7663-427a-bc0c-393ad3afc75a" returned: 0 in 0.375s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:57:11 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-a33e5f54-07a8-4c3b-b055-c931464e81be tempest-AttachVolumeTestJSON-2118030158 None] Lock "cinder-quobyte-36d3b495-7663-427a-bc0c-393ad3afc75a" released by "delete_volume" :: held 0.899s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 13:57:11 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-a33e5f54-07a8-4c3b-b055-c931464e81be tempest-AttachVolumeTestJSON-2118030158 None] Created reservations ['58062703-f1d0-4e8a-a477-521b1541494c', 'a7ef90e7-b8c9-453a-8b85-323ec6d35bd7', '675a6823-e6ce-465b-879c-578f94fd9e92', '50c5394e-d44c-4524-b8bc-7fbcc96ef0dd'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 13:57:11 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-1d36bdcd-f0dd-40a2-850d-0d8d34a83e72 tempest-VolumesActionsTest-265384025 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 13:57:11 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-1d36bdcd-f0dd-40a2-850d-0d8d34a83e72 tempest-VolumesActionsTest-265384025 None] Flow 'volume_create_manager' (13da4203-cd7c-4b09-9cb0-5344d56f1663) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 13:57:11 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-1d36bdcd-f0dd-40a2-850d-0d8d34a83e72 tempest-VolumesActionsTest-265384025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a964cb3e-f2a5-49e8-aa54-1044b5ec78a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:57:11 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-1d36bdcd-f0dd-40a2-850d-0d8d34a83e72 tempest-VolumesActionsTest-265384025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a964cb3e-f2a5-49e8-aa54-1044b5ec78a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T11:57:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1727898669',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15d4f8a5-a158-404e-91f2-6bf10ab5dc87,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='768408e2746a45718eb8a6046266a7b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T11:57:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T11:57:11Z,use_quota=True,user_id='05fb2b2e905c4534abb5765cc1b8c871',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1147de8b-623b-426c-a13d-7fc824a80f67),volume_type_id=1147de8b-623b-426c-a13d-7fc824a80f67)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:57:11 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-1d36bdcd-f0dd-40a2-850d-0d8d34a83e72 tempest-VolumesActionsTest-265384025 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0da2eb6-b892-4657-a7e2-4e023e1d9186) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:57:11 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-1d36bdcd-f0dd-40a2-850d-0d8d34a83e72 tempest-VolumesActionsTest-265384025 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0da2eb6-b892-4657-a7e2-4e023e1d9186) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:57:11 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-1d36bdcd-f0dd-40a2-850d-0d8d34a83e72 tempest-VolumesActionsTest-265384025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51e6410b-70c1-4753-bd15-e5b22dc039b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:57:11 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-1d36bdcd-f0dd-40a2-850d-0d8d34a83e72 tempest-VolumesActionsTest-265384025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51e6410b-70c1-4753-bd15-e5b22dc039b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '15d4f8a5-a158-404e-91f2-6bf10ab5dc87', 'volume_name': 'volume-15d4f8a5-a158-404e-91f2-6bf10ab5dc87', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:57:11 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-1d36bdcd-f0dd-40a2-850d-0d8d34a83e72 tempest-VolumesActionsTest-265384025 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cca943fc-8f73-4f67-a332-a6a9c38d2ad1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:57:11 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-1d36bdcd-f0dd-40a2-850d-0d8d34a83e72 tempest-VolumesActionsTest-265384025 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cca943fc-8f73-4f67-a332-a6a9c38d2ad1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:57:11 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-1d36bdcd-f0dd-40a2-850d-0d8d34a83e72 tempest-VolumesActionsTest-265384025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83106e9f-76c8-438a-b567-0b3bf2ad12d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:57:11 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-1d36bdcd-f0dd-40a2-850d-0d8d34a83e72 tempest-VolumesActionsTest-265384025 None] Volume 15d4f8a5-a158-404e-91f2-6bf10ab5dc87: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-15d4f8a5-a158-404e-91f2-6bf10ab5dc87', 'volume_size': 1} Jul 13 13:57:11 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-1d36bdcd-f0dd-40a2-850d-0d8d34a83e72 tempest-VolumesActionsTest-265384025 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:57:11 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-a33e5f54-07a8-4c3b-b055-c931464e81be tempest-AttachVolumeTestJSON-2118030158 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:57:11 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-a33e5f54-07a8-4c3b-b055-c931464e81be tempest-AttachVolumeTestJSON-2118030158 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:57:11 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-a33e5f54-07a8-4c3b-b055-c931464e81be tempest-AttachVolumeTestJSON-2118030158 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 13:57:11 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-a33e5f54-07a8-4c3b-b055-c931464e81be tempest-AttachVolumeTestJSON-2118030158 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 13:57:11 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-a33e5f54-07a8-4c3b-b055-c931464e81be tempest-AttachVolumeTestJSON-2118030158 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:57:11 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-a33e5f54-07a8-4c3b-b055-c931464e81be tempest-AttachVolumeTestJSON-2118030158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:57:11 devstack sudo[97245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 Jul 13 13:57:11 devstack sudo[97245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:57:11 devstack sudo[97238]: pam_unix(sudo:session): session closed for user root Jul 13 13:57:11 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-c6004e8b-5772-40af-96a2-b3cb0895573c tempest-VolumesGetTest-148886235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-88957f43-3d5e-42ff-88ac-f1b565537c8a 1073741824" returned: 0 in 0.589s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:57:11 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-c6004e8b-5772-40af-96a2-b3cb0895573c tempest-VolumesGetTest-148886235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-88957f43-3d5e-42ff-88ac-f1b565537c8a {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:57:11 devstack sudo[97248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-88957f43-3d5e-42ff-88ac-f1b565537c8a Jul 13 13:57:11 devstack sudo[97248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:57:11 devstack sudo[97245]: pam_unix(sudo:session): session closed for user root Jul 13 13:57:11 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-a33e5f54-07a8-4c3b-b055-c931464e81be tempest-AttachVolumeTestJSON-2118030158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78" returned: 0 in 0.289s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:57:11 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-a33e5f54-07a8-4c3b-b055-c931464e81be tempest-AttachVolumeTestJSON-2118030158 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 13:57:11 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-a33e5f54-07a8-4c3b-b055-c931464e81be tempest-AttachVolumeTestJSON-2118030158 None] Deleted volume successfully. Jul 13 13:57:11 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-a33e5f54-07a8-4c3b-b055-c931464e81be tempest-AttachVolumeTestJSON-2118030158 None] Lock "cinder-36d3b495-7663-427a-bc0c-393ad3afc75a-delete_volume" released by "delete_volume" :: held 1.534s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 13:57:11 devstack sudo[97248]: pam_unix(sudo:session): session closed for user root Jul 13 13:57:11 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-c6004e8b-5772-40af-96a2-b3cb0895573c tempest-VolumesGetTest-148886235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-88957f43-3d5e-42ff-88ac-f1b565537c8a" returned: 0 in 0.257s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:57:11 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-c6004e8b-5772-40af-96a2-b3cb0895573c tempest-VolumesGetTest-148886235 None] <== create_volume: return (936ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'} {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 13 13:57:11 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-c6004e8b-5772-40af-96a2-b3cb0895573c tempest-VolumesGetTest-148886235 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.939s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:57:11 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-1d36bdcd-f0dd-40a2-850d-0d8d34a83e72 tempest-VolumesActionsTest-265384025 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.576s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:57:11 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-1d36bdcd-f0dd-40a2-850d-0d8d34a83e72 tempest-VolumesActionsTest-265384025 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T11:57:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1727898669',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15d4f8a5-a158-404e-91f2-6bf10ab5dc87,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='768408e2746a45718eb8a6046266a7b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T11:57:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T11:57:11Z,use_quota=True,user_id='05fb2b2e905c4534abb5765cc1b8c871',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1147de8b-623b-426c-a13d-7fc824a80f67),volume_type_id=1147de8b-623b-426c-a13d-7fc824a80f67)}" {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 13 13:57:11 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-1d36bdcd-f0dd-40a2-850d-0d8d34a83e72 tempest-VolumesActionsTest-265384025 None] Creating volume 15d4f8a5-a158-404e-91f2-6bf10ab5dc87 {{(pid=87098) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 13 13:57:11 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-1d36bdcd-f0dd-40a2-850d-0d8d34a83e72 tempest-VolumesActionsTest-265384025 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:57:11 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-1d36bdcd-f0dd-40a2-850d-0d8d34a83e72 tempest-VolumesActionsTest-265384025 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:57:11 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-1d36bdcd-f0dd-40a2-850d-0d8d34a83e72 tempest-VolumesActionsTest-265384025 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 13:57:11 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-1d36bdcd-f0dd-40a2-850d-0d8d34a83e72 tempest-VolumesActionsTest-265384025 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 13:57:11 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-1d36bdcd-f0dd-40a2-850d-0d8d34a83e72 tempest-VolumesActionsTest-265384025 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:57:11 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-1d36bdcd-f0dd-40a2-850d-0d8d34a83e72 tempest-VolumesActionsTest-265384025 None] Selected osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 13:57:11 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-1d36bdcd-f0dd-40a2-850d-0d8d34a83e72 tempest-VolumesActionsTest-265384025 None] casted to osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 Jul 13 13:57:11 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-1d36bdcd-f0dd-40a2-850d-0d8d34a83e72 tempest-VolumesActionsTest-265384025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-15d4f8a5-a158-404e-91f2-6bf10ab5dc87 1073741824 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:57:11 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-c6004e8b-5772-40af-96a2-b3cb0895573c tempest-VolumesGetTest-148886235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e6f0afa-6378-4b17-9c24-88c20784a8a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-88957f43-3d5e-42ff-88ac-f1b565537c8a', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:57:11 devstack sudo[97251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-15d4f8a5-a158-404e-91f2-6bf10ab5dc87 1073741824 Jul 13 13:57:11 devstack sudo[97251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:57:11 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-c6004e8b-5772-40af-96a2-b3cb0895573c tempest-VolumesGetTest-148886235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4effc227-03eb-498d-b781-edb2a63d37aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:57:11 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-c6004e8b-5772-40af-96a2-b3cb0895573c tempest-VolumesGetTest-148886235 None] Volume volume-88957f43-3d5e-42ff-88ac-f1b565537c8a (88957f43-3d5e-42ff-88ac-f1b565537c8a): created successfully Jul 13 13:57:11 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-c6004e8b-5772-40af-96a2-b3cb0895573c tempest-VolumesGetTest-148886235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4effc227-03eb-498d-b781-edb2a63d37aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:57:11 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-c6004e8b-5772-40af-96a2-b3cb0895573c tempest-VolumesGetTest-148886235 None] Flow 'volume_create_manager' (60421ac8-ac0f-4718-ac00-cb1197d6cd39) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 13:57:11 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-c6004e8b-5772-40af-96a2-b3cb0895573c tempest-VolumesGetTest-148886235 None] Created volume successfully. Jul 13 13:57:12 devstack sudo[97251]: pam_unix(sudo:session): session closed for user root Jul 13 13:57:12 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-b70b2165-ed07-4963-b4fe-36baaf43fffb tempest-VolumesGetTest-148886235 None] Acquiring lock "cinder-88957f43-3d5e-42ff-88ac-f1b565537c8a-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 13:57:12 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-1d36bdcd-f0dd-40a2-850d-0d8d34a83e72 tempest-VolumesActionsTest-265384025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-15d4f8a5-a158-404e-91f2-6bf10ab5dc87 1073741824" returned: 0 in 0.565s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:57:12 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-b70b2165-ed07-4963-b4fe-36baaf43fffb tempest-VolumesGetTest-148886235 None] Lock "cinder-88957f43-3d5e-42ff-88ac-f1b565537c8a-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 13:57:12 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-dffd2bca-9a3d-499e-a247-98fc714fefd1 tempest-AttachVolumeTestJSON-2118030158 None] Acquiring lock "cinder-6137375d-767f-471c-9779-832082fd5e63-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 13:57:12 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-dffd2bca-9a3d-499e-a247-98fc714fefd1 tempest-AttachVolumeTestJSON-2118030158 None] Lock "cinder-6137375d-767f-471c-9779-832082fd5e63-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 13:57:12 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-1d36bdcd-f0dd-40a2-850d-0d8d34a83e72 tempest-VolumesActionsTest-265384025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-15d4f8a5-a158-404e-91f2-6bf10ab5dc87 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:57:12 devstack sudo[97256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-15d4f8a5-a158-404e-91f2-6bf10ab5dc87 Jul 13 13:57:12 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-b70b2165-ed07-4963-b4fe-36baaf43fffb tempest-VolumesGetTest-148886235 None] Acquiring lock "cinder-quobyte-88957f43-3d5e-42ff-88ac-f1b565537c8a" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 13:57:12 devstack sudo[97256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:57:12 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-dffd2bca-9a3d-499e-a247-98fc714fefd1 tempest-AttachVolumeTestJSON-2118030158 None] Acquiring lock "cinder-quobyte-6137375d-767f-471c-9779-832082fd5e63" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 13:57:12 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-b70b2165-ed07-4963-b4fe-36baaf43fffb tempest-VolumesGetTest-148886235 None] Lock "cinder-quobyte-88957f43-3d5e-42ff-88ac-f1b565537c8a" acquired by "delete_volume" :: waited 0.026s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 13:57:12 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-dffd2bca-9a3d-499e-a247-98fc714fefd1 tempest-AttachVolumeTestJSON-2118030158 None] Lock "cinder-quobyte-6137375d-767f-471c-9779-832082fd5e63" acquired by "delete_volume" :: waited 0.036s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 13:57:12 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[97837f9a-f68e-49ec-a50b-624d1a6c049a]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 13:57:12 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-b70b2165-ed07-4963-b4fe-36baaf43fffb tempest-VolumesGetTest-148886235 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-88957f43-3d5e-42ff-88ac-f1b565537c8a {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:57:12 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a9d9361-9243-4bae-8fbb-f9e62c86e411]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 13:57:12 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-dffd2bca-9a3d-499e-a247-98fc714fefd1 tempest-AttachVolumeTestJSON-2118030158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-6137375d-767f-471c-9779-832082fd5e63 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:57:12 devstack sudo[97258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-88957f43-3d5e-42ff-88ac-f1b565537c8a Jul 13 13:57:12 devstack sudo[97258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:57:12 devstack sudo[97259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-6137375d-767f-471c-9779-832082fd5e63 Jul 13 13:57:12 devstack sudo[97259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:57:12 devstack sudo[97256]: pam_unix(sudo:session): session closed for user root Jul 13 13:57:12 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-1d36bdcd-f0dd-40a2-850d-0d8d34a83e72 tempest-VolumesActionsTest-265384025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-15d4f8a5-a158-404e-91f2-6bf10ab5dc87" returned: 0 in 0.312s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:57:12 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-1d36bdcd-f0dd-40a2-850d-0d8d34a83e72 tempest-VolumesActionsTest-265384025 None] <== create_volume: return (999ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'} {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 13 13:57:12 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-1d36bdcd-f0dd-40a2-850d-0d8d34a83e72 tempest-VolumesActionsTest-265384025 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.002s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:57:12 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-1d36bdcd-f0dd-40a2-850d-0d8d34a83e72 tempest-VolumesActionsTest-265384025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83106e9f-76c8-438a-b567-0b3bf2ad12d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-15d4f8a5-a158-404e-91f2-6bf10ab5dc87', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:57:12 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-1d36bdcd-f0dd-40a2-850d-0d8d34a83e72 tempest-VolumesActionsTest-265384025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d01b94b-a3a8-4220-9cf0-f4171ec05033) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:57:12 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-1d36bdcd-f0dd-40a2-850d-0d8d34a83e72 tempest-VolumesActionsTest-265384025 None] Volume volume-15d4f8a5-a158-404e-91f2-6bf10ab5dc87 (15d4f8a5-a158-404e-91f2-6bf10ab5dc87): created successfully Jul 13 13:57:12 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-1d36bdcd-f0dd-40a2-850d-0d8d34a83e72 tempest-VolumesActionsTest-265384025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d01b94b-a3a8-4220-9cf0-f4171ec05033) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:57:12 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-1d36bdcd-f0dd-40a2-850d-0d8d34a83e72 tempest-VolumesActionsTest-265384025 None] Flow 'volume_create_manager' (13da4203-cd7c-4b09-9cb0-5344d56f1663) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 13:57:12 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-1d36bdcd-f0dd-40a2-850d-0d8d34a83e72 tempest-VolumesActionsTest-265384025 None] Created volume successfully. Jul 13 13:57:13 devstack sudo[97258]: pam_unix(sudo:session): session closed for user root Jul 13 13:57:13 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-b70b2165-ed07-4963-b4fe-36baaf43fffb tempest-VolumesGetTest-148886235 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-88957f43-3d5e-42ff-88ac-f1b565537c8a" returned: 0 in 0.399s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:57:13 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-b70b2165-ed07-4963-b4fe-36baaf43fffb tempest-VolumesGetTest-148886235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-88957f43-3d5e-42ff-88ac-f1b565537c8a {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:57:13 devstack sudo[97268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-88957f43-3d5e-42ff-88ac-f1b565537c8a Jul 13 13:57:13 devstack sudo[97268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:57:13 devstack sudo[97259]: pam_unix(sudo:session): session closed for user root Jul 13 13:57:13 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-dffd2bca-9a3d-499e-a247-98fc714fefd1 tempest-AttachVolumeTestJSON-2118030158 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-6137375d-767f-471c-9779-832082fd5e63" returned: 0 in 0.454s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:57:13 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-dffd2bca-9a3d-499e-a247-98fc714fefd1 tempest-AttachVolumeTestJSON-2118030158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-6137375d-767f-471c-9779-832082fd5e63 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:57:13 devstack sudo[97271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-6137375d-767f-471c-9779-832082fd5e63 Jul 13 13:57:13 devstack sudo[97271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:57:13 devstack sudo[97268]: pam_unix(sudo:session): session closed for user root Jul 13 13:57:13 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-b70b2165-ed07-4963-b4fe-36baaf43fffb tempest-VolumesGetTest-148886235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-88957f43-3d5e-42ff-88ac-f1b565537c8a" returned: 0 in 0.329s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:57:13 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-b70b2165-ed07-4963-b4fe-36baaf43fffb tempest-VolumesGetTest-148886235 None] Lock "cinder-quobyte-88957f43-3d5e-42ff-88ac-f1b565537c8a" released by "delete_volume" :: held 0.773s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 13:57:13 devstack sudo[97271]: pam_unix(sudo:session): session closed for user root Jul 13 13:57:13 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-dffd2bca-9a3d-499e-a247-98fc714fefd1 tempest-AttachVolumeTestJSON-2118030158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-6137375d-767f-471c-9779-832082fd5e63" returned: 0 in 0.289s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:57:13 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-dffd2bca-9a3d-499e-a247-98fc714fefd1 tempest-AttachVolumeTestJSON-2118030158 None] Lock "cinder-quobyte-6137375d-767f-471c-9779-832082fd5e63" released by "delete_volume" :: held 0.794s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 13:57:13 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-682427a7-502f-446b-8d7a-204c1be4b637 tempest-VolumesActionsTest-1849404092 None] Acquiring lock "cinder-15d4f8a5-a158-404e-91f2-6bf10ab5dc87-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 13:57:13 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-682427a7-502f-446b-8d7a-204c1be4b637 tempest-VolumesActionsTest-1849404092 None] Lock "cinder-15d4f8a5-a158-404e-91f2-6bf10ab5dc87-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 13:57:13 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-b70b2165-ed07-4963-b4fe-36baaf43fffb tempest-VolumesGetTest-148886235 None] Created reservations ['622b1df0-bb30-42a1-bc46-75f600de018b', '20277969-5697-441c-81bd-415b9ac30fb5', '5df15441-a204-4246-ab50-10a47b36e44e', 'cbb29238-5ada-4849-82eb-a5871f007a4a'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 13:57:13 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-dffd2bca-9a3d-499e-a247-98fc714fefd1 tempest-AttachVolumeTestJSON-2118030158 None] Created reservations ['38e4df9e-4d02-4938-8848-a362f22fa539', 'cbcebf8c-6625-46e7-a67c-2b51bd0ed112', 'c54219fe-6071-4e07-9b51-42f4982f4974', '9bda47a7-3fb8-40d2-9a12-ccc13b205838'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 13:57:13 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-682427a7-502f-446b-8d7a-204c1be4b637 tempest-VolumesActionsTest-1849404092 None] Acquiring lock "cinder-quobyte-15d4f8a5-a158-404e-91f2-6bf10ab5dc87" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 13:57:13 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-682427a7-502f-446b-8d7a-204c1be4b637 tempest-VolumesActionsTest-1849404092 None] Lock "cinder-quobyte-15d4f8a5-a158-404e-91f2-6bf10ab5dc87" acquired by "delete_volume" :: waited 0.032s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 13:57:13 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[31df529f-af1d-47c7-85b2-33ef46c493a7]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 13:57:13 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-682427a7-502f-446b-8d7a-204c1be4b637 tempest-VolumesActionsTest-1849404092 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-15d4f8a5-a158-404e-91f2-6bf10ab5dc87 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:57:13 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-b70b2165-ed07-4963-b4fe-36baaf43fffb tempest-VolumesGetTest-148886235 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:57:13 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-b70b2165-ed07-4963-b4fe-36baaf43fffb tempest-VolumesGetTest-148886235 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:57:13 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-b70b2165-ed07-4963-b4fe-36baaf43fffb tempest-VolumesGetTest-148886235 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 13:57:13 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-b70b2165-ed07-4963-b4fe-36baaf43fffb tempest-VolumesGetTest-148886235 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 13:57:13 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-b70b2165-ed07-4963-b4fe-36baaf43fffb tempest-VolumesGetTest-148886235 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:57:13 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-b70b2165-ed07-4963-b4fe-36baaf43fffb tempest-VolumesGetTest-148886235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:57:13 devstack sudo[97276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 Jul 13 13:57:13 devstack sudo[97276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:57:13 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-dffd2bca-9a3d-499e-a247-98fc714fefd1 tempest-AttachVolumeTestJSON-2118030158 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:57:13 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-dffd2bca-9a3d-499e-a247-98fc714fefd1 tempest-AttachVolumeTestJSON-2118030158 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:57:13 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-dffd2bca-9a3d-499e-a247-98fc714fefd1 tempest-AttachVolumeTestJSON-2118030158 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 13:57:13 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-dffd2bca-9a3d-499e-a247-98fc714fefd1 tempest-AttachVolumeTestJSON-2118030158 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 13:57:13 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-dffd2bca-9a3d-499e-a247-98fc714fefd1 tempest-AttachVolumeTestJSON-2118030158 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:57:13 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-dffd2bca-9a3d-499e-a247-98fc714fefd1 tempest-AttachVolumeTestJSON-2118030158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:57:13 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-52083364-b179-4863-bd6c-a6539063c25d tempest-VolumesGetTest-148886235 None] Acquiring lock "cinder-3bcd0822-ea00-45e7-a195-2e78d2e5c20f-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 13:57:13 devstack sudo[97275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-15d4f8a5-a158-404e-91f2-6bf10ab5dc87 Jul 13 13:57:13 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-52083364-b179-4863-bd6c-a6539063c25d tempest-VolumesGetTest-148886235 None] Lock "cinder-3bcd0822-ea00-45e7-a195-2e78d2e5c20f-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 13:57:13 devstack sudo[97275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:57:13 devstack sudo[97278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 Jul 13 13:57:13 devstack sudo[97278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:57:13 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-52083364-b179-4863-bd6c-a6539063c25d tempest-VolumesGetTest-148886235 None] Acquiring lock "cinder-quobyte-3bcd0822-ea00-45e7-a195-2e78d2e5c20f" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 13:57:13 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-52083364-b179-4863-bd6c-a6539063c25d tempest-VolumesGetTest-148886235 None] Lock "cinder-quobyte-3bcd0822-ea00-45e7-a195-2e78d2e5c20f" acquired by "delete_volume" :: waited 0.026s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 13:57:14 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac0c25d4-c875-47a2-98d4-eeca2ed7cb32]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 13:57:14 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-52083364-b179-4863-bd6c-a6539063c25d tempest-VolumesGetTest-148886235 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-3bcd0822-ea00-45e7-a195-2e78d2e5c20f {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:57:14 devstack sudo[97276]: pam_unix(sudo:session): session closed for user root Jul 13 13:57:14 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-b70b2165-ed07-4963-b4fe-36baaf43fffb tempest-VolumesGetTest-148886235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78" returned: 0 in 0.393s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:57:14 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-b70b2165-ed07-4963-b4fe-36baaf43fffb tempest-VolumesGetTest-148886235 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 13:57:14 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-b70b2165-ed07-4963-b4fe-36baaf43fffb tempest-VolumesGetTest-148886235 None] Deleted volume successfully. Jul 13 13:57:14 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-b70b2165-ed07-4963-b4fe-36baaf43fffb tempest-VolumesGetTest-148886235 None] Lock "cinder-88957f43-3d5e-42ff-88ac-f1b565537c8a-delete_volume" released by "delete_volume" :: held 1.651s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 13:57:14 devstack sudo[97278]: pam_unix(sudo:session): session closed for user root Jul 13 13:57:14 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-dffd2bca-9a3d-499e-a247-98fc714fefd1 tempest-AttachVolumeTestJSON-2118030158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78" returned: 0 in 0.402s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:57:14 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-dffd2bca-9a3d-499e-a247-98fc714fefd1 tempest-AttachVolumeTestJSON-2118030158 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 13:57:14 devstack sudo[97281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-3bcd0822-ea00-45e7-a195-2e78d2e5c20f Jul 13 13:57:14 devstack sudo[97281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:57:14 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-dffd2bca-9a3d-499e-a247-98fc714fefd1 tempest-AttachVolumeTestJSON-2118030158 None] Deleted volume successfully. Jul 13 13:57:14 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-dffd2bca-9a3d-499e-a247-98fc714fefd1 tempest-AttachVolumeTestJSON-2118030158 None] Lock "cinder-6137375d-767f-471c-9779-832082fd5e63-delete_volume" released by "delete_volume" :: held 1.698s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 13:57:14 devstack sudo[97275]: pam_unix(sudo:session): session closed for user root Jul 13 13:57:14 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-682427a7-502f-446b-8d7a-204c1be4b637 tempest-VolumesActionsTest-1849404092 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-15d4f8a5-a158-404e-91f2-6bf10ab5dc87" returned: 0 in 0.603s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:57:14 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-682427a7-502f-446b-8d7a-204c1be4b637 tempest-VolumesActionsTest-1849404092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-15d4f8a5-a158-404e-91f2-6bf10ab5dc87 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:57:14 devstack sudo[97288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-15d4f8a5-a158-404e-91f2-6bf10ab5dc87 Jul 13 13:57:14 devstack sudo[97288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:57:14 devstack sudo[97281]: pam_unix(sudo:session): session closed for user root Jul 13 13:57:14 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-52083364-b179-4863-bd6c-a6539063c25d tempest-VolumesGetTest-148886235 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-3bcd0822-ea00-45e7-a195-2e78d2e5c20f" returned: 0 in 0.489s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:57:14 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-52083364-b179-4863-bd6c-a6539063c25d tempest-VolumesGetTest-148886235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-3bcd0822-ea00-45e7-a195-2e78d2e5c20f {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:57:14 devstack sudo[97294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-3bcd0822-ea00-45e7-a195-2e78d2e5c20f Jul 13 13:57:14 devstack sudo[97294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:57:14 devstack sudo[97288]: pam_unix(sudo:session): session closed for user root Jul 13 13:57:14 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-682427a7-502f-446b-8d7a-204c1be4b637 tempest-VolumesActionsTest-1849404092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-15d4f8a5-a158-404e-91f2-6bf10ab5dc87" returned: 0 in 0.363s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:57:14 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-682427a7-502f-446b-8d7a-204c1be4b637 tempest-VolumesActionsTest-1849404092 None] Lock "cinder-quobyte-15d4f8a5-a158-404e-91f2-6bf10ab5dc87" released by "delete_volume" :: held 1.027s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 13:57:14 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-682427a7-502f-446b-8d7a-204c1be4b637 tempest-VolumesActionsTest-1849404092 None] Created reservations ['72cf3fa6-07e4-4718-90e2-b6fafe142073', '1d5d7bba-0448-4a99-9614-1039d7f4cdd5', '949a8fa7-c14c-45ea-80f1-c70a1d1991aa', '2475de02-6cf4-4302-a22e-af69d5e852f9'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 13:57:14 devstack sudo[97294]: pam_unix(sudo:session): session closed for user root Jul 13 13:57:14 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-52083364-b179-4863-bd6c-a6539063c25d tempest-VolumesGetTest-148886235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-3bcd0822-ea00-45e7-a195-2e78d2e5c20f" returned: 0 in 0.308s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:57:14 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-52083364-b179-4863-bd6c-a6539063c25d tempest-VolumesGetTest-148886235 None] Lock "cinder-quobyte-3bcd0822-ea00-45e7-a195-2e78d2e5c20f" released by "delete_volume" :: held 0.877s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 13:57:14 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-682427a7-502f-446b-8d7a-204c1be4b637 tempest-VolumesActionsTest-1849404092 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:57:14 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-682427a7-502f-446b-8d7a-204c1be4b637 tempest-VolumesActionsTest-1849404092 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:57:14 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-682427a7-502f-446b-8d7a-204c1be4b637 tempest-VolumesActionsTest-1849404092 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 13:57:14 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-682427a7-502f-446b-8d7a-204c1be4b637 tempest-VolumesActionsTest-1849404092 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 13:57:14 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-682427a7-502f-446b-8d7a-204c1be4b637 tempest-VolumesActionsTest-1849404092 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:57:14 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-682427a7-502f-446b-8d7a-204c1be4b637 tempest-VolumesActionsTest-1849404092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:57:14 devstack sudo[97298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 Jul 13 13:57:14 devstack sudo[97298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:57:14 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-52083364-b179-4863-bd6c-a6539063c25d tempest-VolumesGetTest-148886235 None] Created reservations ['ac936677-af10-4617-920e-a99b0db484b2', 'b4238d16-ab40-491c-925e-7dc021a749d5', '4dce321c-82fe-4c4b-8dfd-86f88f22797b', '7c93a7b2-d959-4065-af67-f675c2a6c8a4'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 13:57:15 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-52083364-b179-4863-bd6c-a6539063c25d tempest-VolumesGetTest-148886235 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:57:15 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-52083364-b179-4863-bd6c-a6539063c25d tempest-VolumesGetTest-148886235 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:57:15 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-52083364-b179-4863-bd6c-a6539063c25d tempest-VolumesGetTest-148886235 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 13:57:15 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-52083364-b179-4863-bd6c-a6539063c25d tempest-VolumesGetTest-148886235 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 13:57:15 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-52083364-b179-4863-bd6c-a6539063c25d tempest-VolumesGetTest-148886235 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:57:15 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-52083364-b179-4863-bd6c-a6539063c25d tempest-VolumesGetTest-148886235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:57:15 devstack sudo[97300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 Jul 13 13:57:15 devstack sudo[97300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:57:15 devstack sudo[97298]: pam_unix(sudo:session): session closed for user root Jul 13 13:57:15 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-682427a7-502f-446b-8d7a-204c1be4b637 tempest-VolumesActionsTest-1849404092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78" returned: 0 in 0.323s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:57:15 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-682427a7-502f-446b-8d7a-204c1be4b637 tempest-VolumesActionsTest-1849404092 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 13:57:15 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-682427a7-502f-446b-8d7a-204c1be4b637 tempest-VolumesActionsTest-1849404092 None] Deleted volume successfully. Jul 13 13:57:15 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-682427a7-502f-446b-8d7a-204c1be4b637 tempest-VolumesActionsTest-1849404092 None] Lock "cinder-15d4f8a5-a158-404e-91f2-6bf10ab5dc87-delete_volume" released by "delete_volume" :: held 1.705s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 13:57:15 devstack sudo[97300]: pam_unix(sudo:session): session closed for user root Jul 13 13:57:15 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-52083364-b179-4863-bd6c-a6539063c25d tempest-VolumesGetTest-148886235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78" returned: 0 in 0.351s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:57:15 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-52083364-b179-4863-bd6c-a6539063c25d tempest-VolumesGetTest-148886235 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 13:57:15 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-52083364-b179-4863-bd6c-a6539063c25d tempest-VolumesGetTest-148886235 None] Deleted volume successfully. Jul 13 13:57:15 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-52083364-b179-4863-bd6c-a6539063c25d tempest-VolumesGetTest-148886235 None] Lock "cinder-3bcd0822-ea00-45e7-a195-2e78d2e5c20f-delete_volume" released by "delete_volume" :: held 1.597s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 13:57:15 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-6d2c45c4-ae31-4878-bfa6-9f0ff3a2b375 tempest-VolumesGetTest-148886235 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 13:57:15 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-6d2c45c4-ae31-4878-bfa6-9f0ff3a2b375 tempest-VolumesGetTest-148886235 None] Flow 'volume_create_manager' (ab180ed2-f339-4be7-b84f-a67f671eddd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 13:57:15 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-6d2c45c4-ae31-4878-bfa6-9f0ff3a2b375 tempest-VolumesGetTest-148886235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad12b5c2-ae2b-48b8-923e-65a74fe047f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:57:15 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-6d2c45c4-ae31-4878-bfa6-9f0ff3a2b375 tempest-VolumesGetTest-148886235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad12b5c2-ae2b-48b8-923e-65a74fe047f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T11:57:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1562495477',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47ee3913-9bbd-4202-922d-832e2a28dfc6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fce5cc7d83924cda908696f4e23b92f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T11:57:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T11:57:16Z,use_quota=True,user_id='9b36f110e7f84651be59cde67a7b41e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1147de8b-623b-426c-a13d-7fc824a80f67),volume_type_id=1147de8b-623b-426c-a13d-7fc824a80f67)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:57:15 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-6d2c45c4-ae31-4878-bfa6-9f0ff3a2b375 tempest-VolumesGetTest-148886235 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b599e161-36e1-4431-8689-2075c1fbbf4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:57:15 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-6d2c45c4-ae31-4878-bfa6-9f0ff3a2b375 tempest-VolumesGetTest-148886235 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b599e161-36e1-4431-8689-2075c1fbbf4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:57:15 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-6d2c45c4-ae31-4878-bfa6-9f0ff3a2b375 tempest-VolumesGetTest-148886235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9afac736-19df-4354-8e4a-b794b26fb3ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:57:15 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-6d2c45c4-ae31-4878-bfa6-9f0ff3a2b375 tempest-VolumesGetTest-148886235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9afac736-19df-4354-8e4a-b794b26fb3ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '47ee3913-9bbd-4202-922d-832e2a28dfc6', 'volume_name': 'volume-47ee3913-9bbd-4202-922d-832e2a28dfc6', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:57:15 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-6d2c45c4-ae31-4878-bfa6-9f0ff3a2b375 tempest-VolumesGetTest-148886235 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99fb352e-9e3c-4f41-91eb-987a028335e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:57:15 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-6d2c45c4-ae31-4878-bfa6-9f0ff3a2b375 tempest-VolumesGetTest-148886235 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99fb352e-9e3c-4f41-91eb-987a028335e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:57:15 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-6d2c45c4-ae31-4878-bfa6-9f0ff3a2b375 tempest-VolumesGetTest-148886235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aab31cb1-4a60-4f12-b886-55ee6b3a8643) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:57:15 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-6d2c45c4-ae31-4878-bfa6-9f0ff3a2b375 tempest-VolumesGetTest-148886235 None] Volume 47ee3913-9bbd-4202-922d-832e2a28dfc6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-47ee3913-9bbd-4202-922d-832e2a28dfc6', 'volume_size': 1} Jul 13 13:57:15 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-6d2c45c4-ae31-4878-bfa6-9f0ff3a2b375 tempest-VolumesGetTest-148886235 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:57:15 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-6d2c45c4-ae31-4878-bfa6-9f0ff3a2b375 tempest-VolumesGetTest-148886235 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:57:15 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-6d2c45c4-ae31-4878-bfa6-9f0ff3a2b375 tempest-VolumesGetTest-148886235 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T11:57:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1562495477',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47ee3913-9bbd-4202-922d-832e2a28dfc6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fce5cc7d83924cda908696f4e23b92f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T11:57:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T11:57:16Z,use_quota=True,user_id='9b36f110e7f84651be59cde67a7b41e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1147de8b-623b-426c-a13d-7fc824a80f67),volume_type_id=1147de8b-623b-426c-a13d-7fc824a80f67)}" {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 13 13:57:15 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-6d2c45c4-ae31-4878-bfa6-9f0ff3a2b375 tempest-VolumesGetTest-148886235 None] Creating volume 47ee3913-9bbd-4202-922d-832e2a28dfc6 {{(pid=87098) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 13 13:57:15 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-6d2c45c4-ae31-4878-bfa6-9f0ff3a2b375 tempest-VolumesGetTest-148886235 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:57:15 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-6d2c45c4-ae31-4878-bfa6-9f0ff3a2b375 tempest-VolumesGetTest-148886235 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:57:15 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-6d2c45c4-ae31-4878-bfa6-9f0ff3a2b375 tempest-VolumesGetTest-148886235 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 13:57:15 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-6d2c45c4-ae31-4878-bfa6-9f0ff3a2b375 tempest-VolumesGetTest-148886235 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 13:57:15 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-6d2c45c4-ae31-4878-bfa6-9f0ff3a2b375 tempest-VolumesGetTest-148886235 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:57:15 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-6d2c45c4-ae31-4878-bfa6-9f0ff3a2b375 tempest-VolumesGetTest-148886235 None] Selected osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 13:57:15 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-6d2c45c4-ae31-4878-bfa6-9f0ff3a2b375 tempest-VolumesGetTest-148886235 None] casted to osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 Jul 13 13:57:15 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-6d2c45c4-ae31-4878-bfa6-9f0ff3a2b375 tempest-VolumesGetTest-148886235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-47ee3913-9bbd-4202-922d-832e2a28dfc6 1073741824 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:57:15 devstack sudo[97306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-47ee3913-9bbd-4202-922d-832e2a28dfc6 1073741824 Jul 13 13:57:15 devstack sudo[97306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:57:16 devstack cinder-volume[87098]: DEBUG cinder.image.image_utils [None req-f262b70f-5598-4c19-8f1c-2b414152e183 tempest-TestInstancesWithCinderVolumes-1739256037 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_5051b5e5-c857-4b44-8332-f584efd78830_rsg6xbykdevstack@QuobyteHD, size 20.69 MB, duration 5.36 sec {{(pid=87098) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 13 13:57:16 devstack cinder-volume[87098]: INFO cinder.image.image_utils [None req-f262b70f-5598-4c19-8f1c-2b414152e183 tempest-TestInstancesWithCinderVolumes-1739256037 None] Image download 20.69 MB at 3.86 MB/s Jul 13 13:57:16 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[abd85999-ab07-4804-8f7d-9b03e466dcff]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 13:57:16 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-f262b70f-5598-4c19-8f1c-2b414152e183 tempest-TestInstancesWithCinderVolumes-1739256037 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5051b5e5-c857-4b44-8332-f584efd78830_rsg6xbykdevstack@QuobyteHD {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:57:16 devstack sudo[97311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5051b5e5-c857-4b44-8332-f584efd78830_rsg6xbykdevstack@QuobyteHD Jul 13 13:57:16 devstack sudo[97311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:57:16 devstack sudo[97306]: pam_unix(sudo:session): session closed for user root Jul 13 13:57:16 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-6d2c45c4-ae31-4878-bfa6-9f0ff3a2b375 tempest-VolumesGetTest-148886235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-47ee3913-9bbd-4202-922d-832e2a28dfc6 1073741824" returned: 0 in 0.580s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:57:16 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-6d2c45c4-ae31-4878-bfa6-9f0ff3a2b375 tempest-VolumesGetTest-148886235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-47ee3913-9bbd-4202-922d-832e2a28dfc6 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:57:16 devstack sudo[97314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-47ee3913-9bbd-4202-922d-832e2a28dfc6 Jul 13 13:57:16 devstack sudo[97314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:57:16 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-2dae70c7-28ac-46ba-97e6-041615e52f8f tempest-VolumesActionsTest-265384025 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 13:57:16 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-2dae70c7-28ac-46ba-97e6-041615e52f8f tempest-VolumesActionsTest-265384025 None] Flow 'volume_create_manager' (4deb34ed-7970-430c-bc71-b909a1564a37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 13:57:16 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-2dae70c7-28ac-46ba-97e6-041615e52f8f tempest-VolumesActionsTest-265384025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7387db34-a70d-4fa4-9416-2445b093436e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:57:16 devstack sudo[97311]: pam_unix(sudo:session): session closed for user root Jul 13 13:57:16 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-2dae70c7-28ac-46ba-97e6-041615e52f8f tempest-VolumesActionsTest-265384025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7387db34-a70d-4fa4-9416-2445b093436e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T11:57:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-901632068',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ecccc6f-0f85-46f0-bdd2-626307d19aeb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='768408e2746a45718eb8a6046266a7b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T11:57:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T11:57:16Z,use_quota=True,user_id='05fb2b2e905c4534abb5765cc1b8c871',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1147de8b-623b-426c-a13d-7fc824a80f67),volume_type_id=1147de8b-623b-426c-a13d-7fc824a80f67)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:57:16 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-2dae70c7-28ac-46ba-97e6-041615e52f8f tempest-VolumesActionsTest-265384025 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c829bf14-7f6a-45b1-9d79-06c01c6456a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:57:16 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-2dae70c7-28ac-46ba-97e6-041615e52f8f tempest-VolumesActionsTest-265384025 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c829bf14-7f6a-45b1-9d79-06c01c6456a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:57:16 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-2dae70c7-28ac-46ba-97e6-041615e52f8f tempest-VolumesActionsTest-265384025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (157ac887-772b-4826-ae77-f452d11717ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:57:16 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-2dae70c7-28ac-46ba-97e6-041615e52f8f tempest-VolumesActionsTest-265384025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (157ac887-772b-4826-ae77-f452d11717ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8ecccc6f-0f85-46f0-bdd2-626307d19aeb', 'volume_name': 'volume-8ecccc6f-0f85-46f0-bdd2-626307d19aeb', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:57:16 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-2dae70c7-28ac-46ba-97e6-041615e52f8f tempest-VolumesActionsTest-265384025 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61b696bd-da60-4e25-8cca-623535fee9da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:57:16 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-2dae70c7-28ac-46ba-97e6-041615e52f8f tempest-VolumesActionsTest-265384025 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61b696bd-da60-4e25-8cca-623535fee9da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:57:16 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-2dae70c7-28ac-46ba-97e6-041615e52f8f tempest-VolumesActionsTest-265384025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ff62d88-ac75-49a8-926b-493edb6a8501) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:57:16 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-2dae70c7-28ac-46ba-97e6-041615e52f8f tempest-VolumesActionsTest-265384025 None] Volume 8ecccc6f-0f85-46f0-bdd2-626307d19aeb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8ecccc6f-0f85-46f0-bdd2-626307d19aeb', 'volume_size': 1} Jul 13 13:57:16 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-2dae70c7-28ac-46ba-97e6-041615e52f8f tempest-VolumesActionsTest-265384025 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:57:16 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-f262b70f-5598-4c19-8f1c-2b414152e183 tempest-TestInstancesWithCinderVolumes-1739256037 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5051b5e5-c857-4b44-8332-f584efd78830_rsg6xbykdevstack@QuobyteHD" returned: 0 in 0.490s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:57:16 devstack cinder-volume[87098]: DEBUG cinder.image.image_utils [None req-f262b70f-5598-4c19-8f1c-2b414152e183 tempest-TestInstancesWithCinderVolumes-1739256037 None] Temporary image 5051b5e5-c857-4b44-8332-f584efd78830 is fetched for user 51b5f237c78f487cb2a632a8ef7348d8. {{(pid=87098) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 13 13:57:16 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[65e77cd0-08ef-4849-8e13-04a89dc25c1f]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 13:57:16 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-f262b70f-5598-4c19-8f1c-2b414152e183 tempest-TestInstancesWithCinderVolumes-1739256037 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5051b5e5-c857-4b44-8332-f584efd78830_rsg6xbykdevstack@QuobyteHD {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:57:16 devstack sudo[97314]: pam_unix(sudo:session): session closed for user root Jul 13 13:57:16 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-6d2c45c4-ae31-4878-bfa6-9f0ff3a2b375 tempest-VolumesGetTest-148886235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-47ee3913-9bbd-4202-922d-832e2a28dfc6" returned: 0 in 0.304s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:57:16 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-6d2c45c4-ae31-4878-bfa6-9f0ff3a2b375 tempest-VolumesGetTest-148886235 None] <== create_volume: return (953ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'} {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 13 13:57:16 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-6d2c45c4-ae31-4878-bfa6-9f0ff3a2b375 tempest-VolumesGetTest-148886235 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.955s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:57:16 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-2dae70c7-28ac-46ba-97e6-041615e52f8f tempest-VolumesActionsTest-265384025 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.132s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:57:16 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-2dae70c7-28ac-46ba-97e6-041615e52f8f tempest-VolumesActionsTest-265384025 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T11:57:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-901632068',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ecccc6f-0f85-46f0-bdd2-626307d19aeb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='768408e2746a45718eb8a6046266a7b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T11:57:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T11:57:16Z,use_quota=True,user_id='05fb2b2e905c4534abb5765cc1b8c871',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1147de8b-623b-426c-a13d-7fc824a80f67),volume_type_id=1147de8b-623b-426c-a13d-7fc824a80f67)}" {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 13 13:57:16 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-2dae70c7-28ac-46ba-97e6-041615e52f8f tempest-VolumesActionsTest-265384025 None] Creating volume 8ecccc6f-0f85-46f0-bdd2-626307d19aeb {{(pid=87098) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 13 13:57:16 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-2dae70c7-28ac-46ba-97e6-041615e52f8f tempest-VolumesActionsTest-265384025 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:57:16 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-2dae70c7-28ac-46ba-97e6-041615e52f8f tempest-VolumesActionsTest-265384025 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:57:16 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-2dae70c7-28ac-46ba-97e6-041615e52f8f tempest-VolumesActionsTest-265384025 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 13:57:16 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-2dae70c7-28ac-46ba-97e6-041615e52f8f tempest-VolumesActionsTest-265384025 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 13:57:16 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-2dae70c7-28ac-46ba-97e6-041615e52f8f tempest-VolumesActionsTest-265384025 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:57:16 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-2dae70c7-28ac-46ba-97e6-041615e52f8f tempest-VolumesActionsTest-265384025 None] Selected osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 13:57:16 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-2dae70c7-28ac-46ba-97e6-041615e52f8f tempest-VolumesActionsTest-265384025 None] casted to osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 Jul 13 13:57:16 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-2dae70c7-28ac-46ba-97e6-041615e52f8f tempest-VolumesActionsTest-265384025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-8ecccc6f-0f85-46f0-bdd2-626307d19aeb 1073741824 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:57:16 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-6d2c45c4-ae31-4878-bfa6-9f0ff3a2b375 tempest-VolumesGetTest-148886235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aab31cb1-4a60-4f12-b886-55ee6b3a8643) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-47ee3913-9bbd-4202-922d-832e2a28dfc6', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:57:16 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-6d2c45c4-ae31-4878-bfa6-9f0ff3a2b375 tempest-VolumesGetTest-148886235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0286fb7c-2fcd-4a85-b0e9-f9bfb0f1092f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:57:16 devstack sudo[97322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-8ecccc6f-0f85-46f0-bdd2-626307d19aeb 1073741824 Jul 13 13:57:16 devstack sudo[97322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:57:16 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-6d2c45c4-ae31-4878-bfa6-9f0ff3a2b375 tempest-VolumesGetTest-148886235 None] Volume volume-47ee3913-9bbd-4202-922d-832e2a28dfc6 (47ee3913-9bbd-4202-922d-832e2a28dfc6): created successfully Jul 13 13:57:16 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-6d2c45c4-ae31-4878-bfa6-9f0ff3a2b375 tempest-VolumesGetTest-148886235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0286fb7c-2fcd-4a85-b0e9-f9bfb0f1092f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:57:16 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-6d2c45c4-ae31-4878-bfa6-9f0ff3a2b375 tempest-VolumesGetTest-148886235 None] Flow 'volume_create_manager' (ab180ed2-f339-4be7-b84f-a67f671eddd3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 13:57:16 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-6d2c45c4-ae31-4878-bfa6-9f0ff3a2b375 tempest-VolumesGetTest-148886235 None] Created volume successfully. Jul 13 13:57:16 devstack sudo[97321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5051b5e5-c857-4b44-8332-f584efd78830_rsg6xbykdevstack@QuobyteHD Jul 13 13:57:16 devstack sudo[97321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:57:17 devstack sudo[97321]: pam_unix(sudo:session): session closed for user root Jul 13 13:57:17 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-f262b70f-5598-4c19-8f1c-2b414152e183 tempest-TestInstancesWithCinderVolumes-1739256037 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5051b5e5-c857-4b44-8332-f584efd78830_rsg6xbykdevstack@QuobyteHD" returned: 0 in 0.401s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:57:17 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-f262b70f-5598-4c19-8f1c-2b414152e183 tempest-TestInstancesWithCinderVolumes-1739256037 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:57:17 devstack sudo[97322]: pam_unix(sudo:session): session closed for user root Jul 13 13:57:17 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-2dae70c7-28ac-46ba-97e6-041615e52f8f tempest-VolumesActionsTest-265384025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-8ecccc6f-0f85-46f0-bdd2-626307d19aeb 1073741824" returned: 0 in 0.483s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:57:17 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-2dae70c7-28ac-46ba-97e6-041615e52f8f tempest-VolumesActionsTest-265384025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-8ecccc6f-0f85-46f0-bdd2-626307d19aeb {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:57:17 devstack sudo[97331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-8ecccc6f-0f85-46f0-bdd2-626307d19aeb Jul 13 13:57:17 devstack sudo[97331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:57:17 devstack sudo[97331]: pam_unix(sudo:session): session closed for user root Jul 13 13:57:17 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-2dae70c7-28ac-46ba-97e6-041615e52f8f tempest-VolumesActionsTest-265384025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-8ecccc6f-0f85-46f0-bdd2-626307d19aeb" returned: 0 in 0.269s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:57:17 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-2dae70c7-28ac-46ba-97e6-041615e52f8f tempest-VolumesActionsTest-265384025 None] <== create_volume: return (846ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'} {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 13 13:57:17 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-2dae70c7-28ac-46ba-97e6-041615e52f8f tempest-VolumesActionsTest-265384025 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.850s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:57:17 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-f262b70f-5598-4c19-8f1c-2b414152e183 tempest-TestInstancesWithCinderVolumes-1739256037 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.498s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:57:17 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-f262b70f-5598-4c19-8f1c-2b414152e183 tempest-TestInstancesWithCinderVolumes-1739256037 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T11:57:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-169716418',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e16a6c11-4674-4833-9c5e-c793a8d36a58,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe824dc7c0ac4dd887f18f7c50c376f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T11:57:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T11:57:10Z,use_quota=True,user_id='51b5f237c78f487cb2a632a8ef7348d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c1574b4-b927-4a19-8dbe-da40446c8168),volume_type_id=8c1574b4-b927-4a19-8dbe-da40446c8168)}" {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 13 13:57:17 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-f262b70f-5598-4c19-8f1c-2b414152e183 tempest-TestInstancesWithCinderVolumes-1739256037 None] Creating volume e16a6c11-4674-4833-9c5e-c793a8d36a58 {{(pid=87098) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 13 13:57:17 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-f262b70f-5598-4c19-8f1c-2b414152e183 tempest-TestInstancesWithCinderVolumes-1739256037 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:57:17 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-f262b70f-5598-4c19-8f1c-2b414152e183 tempest-TestInstancesWithCinderVolumes-1739256037 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:57:17 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-f262b70f-5598-4c19-8f1c-2b414152e183 tempest-TestInstancesWithCinderVolumes-1739256037 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 13:57:17 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-f262b70f-5598-4c19-8f1c-2b414152e183 tempest-TestInstancesWithCinderVolumes-1739256037 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 13:57:17 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-f262b70f-5598-4c19-8f1c-2b414152e183 tempest-TestInstancesWithCinderVolumes-1739256037 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:57:17 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-f262b70f-5598-4c19-8f1c-2b414152e183 tempest-TestInstancesWithCinderVolumes-1739256037 None] Selected osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 13:57:17 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-f262b70f-5598-4c19-8f1c-2b414152e183 tempest-TestInstancesWithCinderVolumes-1739256037 None] casted to osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 Jul 13 13:57:17 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-f262b70f-5598-4c19-8f1c-2b414152e183 tempest-TestInstancesWithCinderVolumes-1739256037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-e16a6c11-4674-4833-9c5e-c793a8d36a58 1073741824 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:57:17 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-2dae70c7-28ac-46ba-97e6-041615e52f8f tempest-VolumesActionsTest-265384025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ff62d88-ac75-49a8-926b-493edb6a8501) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8ecccc6f-0f85-46f0-bdd2-626307d19aeb', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:57:17 devstack sudo[97334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-e16a6c11-4674-4833-9c5e-c793a8d36a58 1073741824 Jul 13 13:57:17 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-2dae70c7-28ac-46ba-97e6-041615e52f8f tempest-VolumesActionsTest-265384025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a1310bc-1b7f-4cf9-ab28-55673affaadc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:57:17 devstack sudo[97334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:57:17 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-2dae70c7-28ac-46ba-97e6-041615e52f8f tempest-VolumesActionsTest-265384025 None] Volume volume-8ecccc6f-0f85-46f0-bdd2-626307d19aeb (8ecccc6f-0f85-46f0-bdd2-626307d19aeb): created successfully Jul 13 13:57:17 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-2dae70c7-28ac-46ba-97e6-041615e52f8f tempest-VolumesActionsTest-265384025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a1310bc-1b7f-4cf9-ab28-55673affaadc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:57:17 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-2dae70c7-28ac-46ba-97e6-041615e52f8f tempest-VolumesActionsTest-265384025 None] Flow 'volume_create_manager' (4deb34ed-7970-430c-bc71-b909a1564a37) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 13:57:17 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-2dae70c7-28ac-46ba-97e6-041615e52f8f tempest-VolumesActionsTest-265384025 None] Created volume successfully. Jul 13 13:57:18 devstack sudo[97334]: pam_unix(sudo:session): session closed for user root Jul 13 13:57:18 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-f262b70f-5598-4c19-8f1c-2b414152e183 tempest-TestInstancesWithCinderVolumes-1739256037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-e16a6c11-4674-4833-9c5e-c793a8d36a58 1073741824" returned: 0 in 0.550s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:57:18 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-f262b70f-5598-4c19-8f1c-2b414152e183 tempest-TestInstancesWithCinderVolumes-1739256037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-e16a6c11-4674-4833-9c5e-c793a8d36a58 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:57:18 devstack sudo[97343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-e16a6c11-4674-4833-9c5e-c793a8d36a58 Jul 13 13:57:18 devstack sudo[97343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:57:18 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-d9e2d38e-ce4a-4d97-a025-a8ae15e00560 tempest-VolumesGetTest-148886235 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 13:57:18 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-d9e2d38e-ce4a-4d97-a025-a8ae15e00560 tempest-VolumesGetTest-148886235 None] Flow 'volume_create_manager' (f30cd8a7-e5b7-4d14-8f15-7946057fd0db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 13:57:18 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-d9e2d38e-ce4a-4d97-a025-a8ae15e00560 tempest-VolumesGetTest-148886235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce2f657b-fe55-450d-99a9-0a2c4a16064b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:57:18 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-d9e2d38e-ce4a-4d97-a025-a8ae15e00560 tempest-VolumesGetTest-148886235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce2f657b-fe55-450d-99a9-0a2c4a16064b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T11:57:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-252477621',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16089004-076e-4d2a-8dae-9f761f0934de,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='fce5cc7d83924cda908696f4e23b92f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T11:57:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=47ee3913-9bbd-4202-922d-832e2a28dfc6,status='creating',terminated_at=None,updated_at=2026-07-13T11:57:18Z,use_quota=True,user_id='9b36f110e7f84651be59cde67a7b41e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1147de8b-623b-426c-a13d-7fc824a80f67),volume_type_id=1147de8b-623b-426c-a13d-7fc824a80f67)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:57:18 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-d9e2d38e-ce4a-4d97-a025-a8ae15e00560 tempest-VolumesGetTest-148886235 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4dd111c7-3b47-4e05-9fac-6e6b7e5c8805) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:57:18 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-d9e2d38e-ce4a-4d97-a025-a8ae15e00560 tempest-VolumesGetTest-148886235 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4dd111c7-3b47-4e05-9fac-6e6b7e5c8805) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:57:18 devstack sudo[97343]: pam_unix(sudo:session): session closed for user root Jul 13 13:57:18 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-d9e2d38e-ce4a-4d97-a025-a8ae15e00560 tempest-VolumesGetTest-148886235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ba06bdf-764b-4654-a704-5f5b56c6f2da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:57:18 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-f262b70f-5598-4c19-8f1c-2b414152e183 tempest-TestInstancesWithCinderVolumes-1739256037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-e16a6c11-4674-4833-9c5e-c793a8d36a58" returned: 0 in 0.317s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:57:18 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-f262b70f-5598-4c19-8f1c-2b414152e183 tempest-TestInstancesWithCinderVolumes-1739256037 None] <== create_volume: return (927ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'} {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 13 13:57:18 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-f262b70f-5598-4c19-8f1c-2b414152e183 tempest-TestInstancesWithCinderVolumes-1739256037 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.937s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:57:18 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-d9e2d38e-ce4a-4d97-a025-a8ae15e00560 tempest-VolumesGetTest-148886235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ba06bdf-764b-4654-a704-5f5b56c6f2da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '16089004-076e-4d2a-8dae-9f761f0934de', 'volume_name': 'volume-16089004-076e-4d2a-8dae-9f761f0934de', 'volume_size': 1, 'source_volid': '47ee3913-9bbd-4202-922d-832e2a28dfc6', 'source_volstatus': 'available'}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:57:18 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-d9e2d38e-ce4a-4d97-a025-a8ae15e00560 tempest-VolumesGetTest-148886235 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b799ef5d-bb67-48ca-8f7b-c4f7ee92eabe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:57:18 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-d9e2d38e-ce4a-4d97-a025-a8ae15e00560 tempest-VolumesGetTest-148886235 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b799ef5d-bb67-48ca-8f7b-c4f7ee92eabe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:57:18 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-d9e2d38e-ce4a-4d97-a025-a8ae15e00560 tempest-VolumesGetTest-148886235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7dfeef7-80c6-4fe6-b740-cea0fe69e30f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:57:18 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-d9e2d38e-ce4a-4d97-a025-a8ae15e00560 tempest-VolumesGetTest-148886235 None] Volume 16089004-076e-4d2a-8dae-9f761f0934de: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-16089004-076e-4d2a-8dae-9f761f0934de', 'volume_size': 1, 'source_volid': '47ee3913-9bbd-4202-922d-832e2a28dfc6', 'source_volstatus': 'available'} Jul 13 13:57:18 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-d9e2d38e-ce4a-4d97-a025-a8ae15e00560 tempest-VolumesGetTest-148886235 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:57:18 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-d9e2d38e-ce4a-4d97-a025-a8ae15e00560 tempest-VolumesGetTest-148886235 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.004s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:57:18 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-d9e2d38e-ce4a-4d97-a025-a8ae15e00560 tempest-VolumesGetTest-148886235 None] Cloning volume 47ee3913-9bbd-4202-922d-832e2a28dfc6 to volume 16089004-076e-4d2a-8dae-9f761f0934de Jul 13 13:57:18 devstack cinder-volume[87098]: DEBUG cinder.volume.volume_utils [None req-f262b70f-5598-4c19-8f1c-2b414152e183 tempest-TestInstancesWithCinderVolumes-1739256037 None] Attempting download of 5051b5e5-c857-4b44-8332-f584efd78830 ((None, [{'url': 'file:///opt/stack/data/glance/images/5051b5e5-c857-4b44-8332-f584efd78830', 'metadata': {}}])) to volume e16a6c11-4674-4833-9c5e-c793a8d36a58. {{(pid=87098) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 13 13:57:18 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-d9e2d38e-ce4a-4d97-a025-a8ae15e00560 tempest-VolumesGetTest-148886235 None] Creating offline snapshot 962c2c77-e2e1-4162-a8ee-15e7ffaad209 of volume 47ee3913-9bbd-4202-922d-832e2a28dfc6 {{(pid=87098) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 13 13:57:18 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[0697e947-30a0-4162-93a0-af27a56da0dc]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 13:57:18 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-d9e2d38e-ce4a-4d97-a025-a8ae15e00560 tempest-VolumesGetTest-148886235 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-47ee3913-9bbd-4202-922d-832e2a28dfc6 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:57:18 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[81a6b909-f234-45a4-b23f-3f58bf8bf20c]: (4, 'raw') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 13:57:18 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-f262b70f-5598-4c19-8f1c-2b414152e183 tempest-TestInstancesWithCinderVolumes-1739256037 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5051b5e5-c857-4b44-8332-f584efd78830_g1az_f0o {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:57:18 devstack sudo[97352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-47ee3913-9bbd-4202-922d-832e2a28dfc6 Jul 13 13:57:18 devstack sudo[97352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:57:18 devstack sudo[97353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5051b5e5-c857-4b44-8332-f584efd78830_g1az_f0o Jul 13 13:57:18 devstack sudo[97353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:57:19 devstack sudo[97353]: pam_unix(sudo:session): session closed for user root Jul 13 13:57:19 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-f262b70f-5598-4c19-8f1c-2b414152e183 tempest-TestInstancesWithCinderVolumes-1739256037 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5051b5e5-c857-4b44-8332-f584efd78830_g1az_f0o" returned: 0 in 0.452s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:57:19 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-f262b70f-5598-4c19-8f1c-2b414152e183 tempest-TestInstancesWithCinderVolumes-1739256037 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5051b5e5-c857-4b44-8332-f584efd78830_g1az_f0o {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:57:19 devstack sudo[97352]: pam_unix(sudo:session): session closed for user root Jul 13 13:57:19 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-d9e2d38e-ce4a-4d97-a025-a8ae15e00560 tempest-VolumesGetTest-148886235 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-47ee3913-9bbd-4202-922d-832e2a28dfc6" returned: 0 in 0.518s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:57:19 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-d9e2d38e-ce4a-4d97-a025-a8ae15e00560 tempest-VolumesGetTest-148886235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-47ee3913-9bbd-4202-922d-832e2a28dfc6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-47ee3913-9bbd-4202-922d-832e2a28dfc6.962c2c77-e2e1-4162-a8ee-15e7ffaad209 1G {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:57:19 devstack sudo[97363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-47ee3913-9bbd-4202-922d-832e2a28dfc6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-47ee3913-9bbd-4202-922d-832e2a28dfc6.962c2c77-e2e1-4162-a8ee-15e7ffaad209 1G Jul 13 13:57:19 devstack sudo[97363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:57:19 devstack sudo[97362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5051b5e5-c857-4b44-8332-f584efd78830_g1az_f0o Jul 13 13:57:19 devstack sudo[97362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:57:19 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-32920b6b-18c9-4c10-9bc4-8175f2dc07a0 tempest-VolumesActionsTest-265384025 None] Acquiring lock "cinder-8ecccc6f-0f85-46f0-bdd2-626307d19aeb-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 13:57:19 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-32920b6b-18c9-4c10-9bc4-8175f2dc07a0 tempest-VolumesActionsTest-265384025 None] Lock "cinder-8ecccc6f-0f85-46f0-bdd2-626307d19aeb-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 13:57:19 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-32920b6b-18c9-4c10-9bc4-8175f2dc07a0 tempest-VolumesActionsTest-265384025 None] Acquiring lock "cinder-quobyte-8ecccc6f-0f85-46f0-bdd2-626307d19aeb" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 13:57:19 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-32920b6b-18c9-4c10-9bc4-8175f2dc07a0 tempest-VolumesActionsTest-265384025 None] Lock "cinder-quobyte-8ecccc6f-0f85-46f0-bdd2-626307d19aeb" acquired by "delete_volume" :: waited 0.018s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 13:57:19 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[acc474f0-d66e-41c6-92df-b0a77a542408]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 13:57:19 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-32920b6b-18c9-4c10-9bc4-8175f2dc07a0 tempest-VolumesActionsTest-265384025 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-8ecccc6f-0f85-46f0-bdd2-626307d19aeb {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:57:19 devstack sudo[97367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-8ecccc6f-0f85-46f0-bdd2-626307d19aeb Jul 13 13:57:19 devstack sudo[97367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:57:19 devstack sudo[97362]: pam_unix(sudo:session): session closed for user root Jul 13 13:57:19 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-f262b70f-5598-4c19-8f1c-2b414152e183 tempest-TestInstancesWithCinderVolumes-1739256037 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5051b5e5-c857-4b44-8332-f584efd78830_g1az_f0o" returned: 1 in 0.584s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:57:19 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-f262b70f-5598-4c19-8f1c-2b414152e183 tempest-TestInstancesWithCinderVolumes-1739256037 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5051b5e5-c857-4b44-8332-f584efd78830_g1az_f0o' failed. Not Retrying. {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 13 13:57:19 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[7729f23e-1d7a-4296-b4fa-0c447336e658]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 13:57:19 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-f262b70f-5598-4c19-8f1c-2b414152e183 tempest-TestInstancesWithCinderVolumes-1739256037 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5051b5e5-c857-4b44-8332-f584efd78830_rsg6xbykdevstack@QuobyteHD {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:57:19 devstack sudo[97363]: pam_unix(sudo:session): session closed for user root Jul 13 13:57:19 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-d9e2d38e-ce4a-4d97-a025-a8ae15e00560 tempest-VolumesGetTest-148886235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-47ee3913-9bbd-4202-922d-832e2a28dfc6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-47ee3913-9bbd-4202-922d-832e2a28dfc6.962c2c77-e2e1-4162-a8ee-15e7ffaad209 1G" returned: 0 in 0.669s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:57:19 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-d9e2d38e-ce4a-4d97-a025-a8ae15e00560 tempest-VolumesGetTest-148886235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-47ee3913-9bbd-4202-922d-832e2a28dfc6 -F qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-47ee3913-9bbd-4202-922d-832e2a28dfc6.962c2c77-e2e1-4162-a8ee-15e7ffaad209 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:57:19 devstack sudo[97373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5051b5e5-c857-4b44-8332-f584efd78830_rsg6xbykdevstack@QuobyteHD Jul 13 13:57:19 devstack sudo[97373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:57:19 devstack sudo[97376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-47ee3913-9bbd-4202-922d-832e2a28dfc6 -F qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-47ee3913-9bbd-4202-922d-832e2a28dfc6.962c2c77-e2e1-4162-a8ee-15e7ffaad209 Jul 13 13:57:19 devstack sudo[97376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:57:20 devstack sudo[97367]: pam_unix(sudo:session): session closed for user root Jul 13 13:57:20 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-32920b6b-18c9-4c10-9bc4-8175f2dc07a0 tempest-VolumesActionsTest-265384025 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-8ecccc6f-0f85-46f0-bdd2-626307d19aeb" returned: 0 in 0.491s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:57:20 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-32920b6b-18c9-4c10-9bc4-8175f2dc07a0 tempest-VolumesActionsTest-265384025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-8ecccc6f-0f85-46f0-bdd2-626307d19aeb {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:57:20 devstack sudo[97381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-8ecccc6f-0f85-46f0-bdd2-626307d19aeb Jul 13 13:57:20 devstack sudo[97381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:57:20 devstack sudo[97373]: pam_unix(sudo:session): session closed for user root Jul 13 13:57:20 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-f262b70f-5598-4c19-8f1c-2b414152e183 tempest-TestInstancesWithCinderVolumes-1739256037 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5051b5e5-c857-4b44-8332-f584efd78830_rsg6xbykdevstack@QuobyteHD" returned: 0 in 0.407s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:57:20 devstack cinder-volume[87098]: DEBUG cinder.image.image_utils [None req-f262b70f-5598-4c19-8f1c-2b414152e183 tempest-TestInstancesWithCinderVolumes-1739256037 None] 5051b5e5-c857-4b44-8332-f584efd78830 was qcow2, converting to raw {{(pid=87098) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 13 13:57:20 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-f262b70f-5598-4c19-8f1c-2b414152e183 tempest-TestInstancesWithCinderVolumes-1739256037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5051b5e5-c857-4b44-8332-f584efd78830_rsg6xbykdevstack@QuobyteHD /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-e16a6c11-4674-4833-9c5e-c793a8d36a58 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:57:20 devstack sudo[97389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5051b5e5-c857-4b44-8332-f584efd78830_rsg6xbykdevstack@QuobyteHD /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-e16a6c11-4674-4833-9c5e-c793a8d36a58 Jul 13 13:57:20 devstack sudo[97389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:57:20 devstack sudo[97376]: pam_unix(sudo:session): session closed for user root Jul 13 13:57:20 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-d9e2d38e-ce4a-4d97-a025-a8ae15e00560 tempest-VolumesGetTest-148886235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-47ee3913-9bbd-4202-922d-832e2a28dfc6 -F qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-47ee3913-9bbd-4202-922d-832e2a28dfc6.962c2c77-e2e1-4162-a8ee-15e7ffaad209" returned: 0 in 0.356s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:57:20 devstack cinder-volume[87098]: WARNING cinder.volume.drivers.remotefs [None req-d9e2d38e-ce4a-4d97-a025-a8ae15e00560 tempest-VolumesGetTest-148886235 None] /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-47ee3913-9bbd-4202-922d-832e2a28dfc6.962c2c77-e2e1-4162-a8ee-15e7ffaad209 is being set with open permissions: ugo+rw Jul 13 13:57:20 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-d9e2d38e-ce4a-4d97-a025-a8ae15e00560 tempest-VolumesGetTest-148886235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-47ee3913-9bbd-4202-922d-832e2a28dfc6.962c2c77-e2e1-4162-a8ee-15e7ffaad209 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:57:20 devstack sudo[97391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-47ee3913-9bbd-4202-922d-832e2a28dfc6.962c2c77-e2e1-4162-a8ee-15e7ffaad209 Jul 13 13:57:20 devstack sudo[97391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:57:20 devstack sudo[97381]: pam_unix(sudo:session): session closed for user root Jul 13 13:57:20 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-32920b6b-18c9-4c10-9bc4-8175f2dc07a0 tempest-VolumesActionsTest-265384025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-8ecccc6f-0f85-46f0-bdd2-626307d19aeb" returned: 0 in 0.308s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:57:20 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-32920b6b-18c9-4c10-9bc4-8175f2dc07a0 tempest-VolumesActionsTest-265384025 None] Lock "cinder-quobyte-8ecccc6f-0f85-46f0-bdd2-626307d19aeb" released by "delete_volume" :: held 0.881s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 13:57:20 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-32920b6b-18c9-4c10-9bc4-8175f2dc07a0 tempest-VolumesActionsTest-265384025 None] Created reservations ['2178dd65-4de9-4590-ab2a-680fb1c18126', '686afebe-7e6f-4246-8400-f330b4e7ab60', '9bfe293b-4e2b-4e15-a6d3-f16861bb753a', 'ce79841a-fb27-40ba-b89e-3a9ca76eaa25'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 13:57:20 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-32920b6b-18c9-4c10-9bc4-8175f2dc07a0 tempest-VolumesActionsTest-265384025 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:57:20 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-32920b6b-18c9-4c10-9bc4-8175f2dc07a0 tempest-VolumesActionsTest-265384025 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:57:20 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-32920b6b-18c9-4c10-9bc4-8175f2dc07a0 tempest-VolumesActionsTest-265384025 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 13:57:20 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-32920b6b-18c9-4c10-9bc4-8175f2dc07a0 tempest-VolumesActionsTest-265384025 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 13:57:20 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-32920b6b-18c9-4c10-9bc4-8175f2dc07a0 tempest-VolumesActionsTest-265384025 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:57:20 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-32920b6b-18c9-4c10-9bc4-8175f2dc07a0 tempest-VolumesActionsTest-265384025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:57:20 devstack sudo[97391]: pam_unix(sudo:session): session closed for user root Jul 13 13:57:20 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-d9e2d38e-ce4a-4d97-a025-a8ae15e00560 tempest-VolumesGetTest-148886235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-47ee3913-9bbd-4202-922d-832e2a28dfc6.962c2c77-e2e1-4162-a8ee-15e7ffaad209" returned: 0 in 0.349s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:57:20 devstack sudo[97399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 Jul 13 13:57:20 devstack sudo[97399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:57:20 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-d9e2d38e-ce4a-4d97-a025-a8ae15e00560 tempest-VolumesGetTest-148886235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-47ee3913-9bbd-4202-922d-832e2a28dfc6.info {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:57:20 devstack sudo[97404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-47ee3913-9bbd-4202-922d-832e2a28dfc6.info Jul 13 13:57:20 devstack sudo[97404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:57:20 devstack sudo[97399]: pam_unix(sudo:session): session closed for user root Jul 13 13:57:20 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-32920b6b-18c9-4c10-9bc4-8175f2dc07a0 tempest-VolumesActionsTest-265384025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78" returned: 0 in 0.435s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:57:21 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-32920b6b-18c9-4c10-9bc4-8175f2dc07a0 tempest-VolumesActionsTest-265384025 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 13:57:21 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-32920b6b-18c9-4c10-9bc4-8175f2dc07a0 tempest-VolumesActionsTest-265384025 None] Deleted volume successfully. Jul 13 13:57:21 devstack sudo[97404]: pam_unix(sudo:session): session closed for user root Jul 13 13:57:21 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-d9e2d38e-ce4a-4d97-a025-a8ae15e00560 tempest-VolumesGetTest-148886235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-47ee3913-9bbd-4202-922d-832e2a28dfc6.info" returned: 0 in 0.392s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:57:21 devstack cinder-volume[87098]: WARNING cinder.volume.drivers.remotefs [None req-d9e2d38e-ce4a-4d97-a025-a8ae15e00560 tempest-VolumesGetTest-148886235 None] /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-47ee3913-9bbd-4202-922d-832e2a28dfc6.info is being set with open permissions: ugo+rw Jul 13 13:57:21 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-d9e2d38e-ce4a-4d97-a025-a8ae15e00560 tempest-VolumesGetTest-148886235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-47ee3913-9bbd-4202-922d-832e2a28dfc6.info {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:57:21 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-32920b6b-18c9-4c10-9bc4-8175f2dc07a0 tempest-VolumesActionsTest-265384025 None] Lock "cinder-8ecccc6f-0f85-46f0-bdd2-626307d19aeb-delete_volume" released by "delete_volume" :: held 1.650s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 13:57:21 devstack sudo[97409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-47ee3913-9bbd-4202-922d-832e2a28dfc6.info Jul 13 13:57:21 devstack sudo[97409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:57:21 devstack sudo[97409]: pam_unix(sudo:session): session closed for user root Jul 13 13:57:21 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-d9e2d38e-ce4a-4d97-a025-a8ae15e00560 tempest-VolumesGetTest-148886235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-47ee3913-9bbd-4202-922d-832e2a28dfc6.info" returned: 0 in 0.401s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:57:21 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-d9e2d38e-ce4a-4d97-a025-a8ae15e00560 tempest-VolumesGetTest-148886235 None] Acquiring lock "cinder-quobyte-16089004-076e-4d2a-8dae-9f761f0934de" by "_copy_volume_from_snapshot" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 13:57:21 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-d9e2d38e-ce4a-4d97-a025-a8ae15e00560 tempest-VolumesGetTest-148886235 None] Lock "cinder-quobyte-16089004-076e-4d2a-8dae-9f761f0934de" acquired by "_copy_volume_from_snapshot" :: waited 0.022s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 13:57:21 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-d9e2d38e-ce4a-4d97-a025-a8ae15e00560 tempest-VolumesGetTest-148886235 None] snapshot: 962c2c77-e2e1-4162-a8ee-15e7ffaad209, volume: 16089004-076e-4d2a-8dae-9f761f0934de, {{(pid=87098) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 13 13:57:21 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-d9e2d38e-ce4a-4d97-a025-a8ae15e00560 tempest-VolumesGetTest-148886235 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:57:21 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-d9e2d38e-ce4a-4d97-a025-a8ae15e00560 tempest-VolumesGetTest-148886235 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:57:21 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-d9e2d38e-ce4a-4d97-a025-a8ae15e00560 tempest-VolumesGetTest-148886235 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 13:57:21 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-d9e2d38e-ce4a-4d97-a025-a8ae15e00560 tempest-VolumesGetTest-148886235 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 13:57:21 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-d9e2d38e-ce4a-4d97-a025-a8ae15e00560 tempest-VolumesGetTest-148886235 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:57:21 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[09608b0e-5a6a-4aa7-a53d-db6ad1999bbc]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 13:57:21 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-d9e2d38e-ce4a-4d97-a025-a8ae15e00560 tempest-VolumesGetTest-148886235 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-47ee3913-9bbd-4202-922d-832e2a28dfc6.962c2c77-e2e1-4162-a8ee-15e7ffaad209 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:57:21 devstack sudo[97412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-47ee3913-9bbd-4202-922d-832e2a28dfc6.962c2c77-e2e1-4162-a8ee-15e7ffaad209 Jul 13 13:57:21 devstack sudo[97412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:57:22 devstack sudo[97412]: pam_unix(sudo:session): session closed for user root Jul 13 13:57:22 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-d9e2d38e-ce4a-4d97-a025-a8ae15e00560 tempest-VolumesGetTest-148886235 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-47ee3913-9bbd-4202-922d-832e2a28dfc6.962c2c77-e2e1-4162-a8ee-15e7ffaad209" returned: 0 in 0.461s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:57:22 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-d9e2d38e-ce4a-4d97-a025-a8ae15e00560 tempest-VolumesGetTest-148886235 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-47ee3913-9bbd-4202-922d-832e2a28dfc6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87098) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 13 13:57:22 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-d9e2d38e-ce4a-4d97-a025-a8ae15e00560 tempest-VolumesGetTest-148886235 None] will copy from snapshot at /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-47ee3913-9bbd-4202-922d-832e2a28dfc6 {{(pid=87098) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 13 13:57:22 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-d9e2d38e-ce4a-4d97-a025-a8ae15e00560 tempest-VolumesGetTest-148886235 None] Creating direct copy from snapshot {{(pid=87098) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 13 13:57:22 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf52d1a6-9d57-4973-b86d-84ef3536660a]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 13:57:22 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-d9e2d38e-ce4a-4d97-a025-a8ae15e00560 tempest-VolumesGetTest-148886235 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-47ee3913-9bbd-4202-922d-832e2a28dfc6 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:57:22 devstack sudo[97418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-47ee3913-9bbd-4202-922d-832e2a28dfc6 Jul 13 13:57:22 devstack sudo[97418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:57:22 devstack sudo[97389]: pam_unix(sudo:session): session closed for user root Jul 13 13:57:22 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-f262b70f-5598-4c19-8f1c-2b414152e183 tempest-TestInstancesWithCinderVolumes-1739256037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5051b5e5-c857-4b44-8332-f584efd78830_rsg6xbykdevstack@QuobyteHD /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-e16a6c11-4674-4833-9c5e-c793a8d36a58" returned: 0 in 2.101s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:57:22 devstack cinder-volume[87098]: DEBUG cinder.image.image_utils [None req-f262b70f-5598-4c19-8f1c-2b414152e183 tempest-TestInstancesWithCinderVolumes-1739256037 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_5051b5e5-c857-4b44-8332-f584efd78830_rsg6xbykdevstack@QuobyteHD, size 112.00 MB, duration 2.10 sec, destination /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-e16a6c11-4674-4833-9c5e-c793a8d36a58 {{(pid=87098) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 13 13:57:22 devstack cinder-volume[87098]: INFO cinder.image.image_utils [None req-f262b70f-5598-4c19-8f1c-2b414152e183 tempest-TestInstancesWithCinderVolumes-1739256037 None] Converted 112.00 MB image at 53.21 MB/s Jul 13 13:57:22 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-f262b70f-5598-4c19-8f1c-2b414152e183 tempest-TestInstancesWithCinderVolumes-1739256037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-e16a6c11-4674-4833-9c5e-c793a8d36a58 1G {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:57:22 devstack sudo[97421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-e16a6c11-4674-4833-9c5e-c793a8d36a58 1G Jul 13 13:57:22 devstack sudo[97421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:57:22 devstack sudo[97418]: pam_unix(sudo:session): session closed for user root Jul 13 13:57:22 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-d9e2d38e-ce4a-4d97-a025-a8ae15e00560 tempest-VolumesGetTest-148886235 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-47ee3913-9bbd-4202-922d-832e2a28dfc6" returned: 0 in 0.486s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:57:22 devstack cinder-volume[87098]: DEBUG cinder.utils [None req-d9e2d38e-ce4a-4d97-a025-a8ae15e00560 tempest-VolumesGetTest-148886235 None] Path /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-16089004-076e-4d2a-8dae-9f761f0934de not found in is_blk_device check {{(pid=87098) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 13 13:57:22 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-d9e2d38e-ce4a-4d97-a025-a8ae15e00560 tempest-VolumesGetTest-148886235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-47ee3913-9bbd-4202-922d-832e2a28dfc6 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-16089004-076e-4d2a-8dae-9f761f0934de {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:57:22 devstack sudo[97428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-47ee3913-9bbd-4202-922d-832e2a28dfc6 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-16089004-076e-4d2a-8dae-9f761f0934de Jul 13 13:57:22 devstack sudo[97428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:57:22 devstack sudo[97421]: pam_unix(sudo:session): session closed for user root Jul 13 13:57:22 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-f262b70f-5598-4c19-8f1c-2b414152e183 tempest-TestInstancesWithCinderVolumes-1739256037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-e16a6c11-4674-4833-9c5e-c793a8d36a58 1G" returned: 0 in 0.474s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:57:22 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbc7411f-45ef-4235-8758-c1c527504ae1]: (4, 'raw') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 13:57:22 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-f262b70f-5598-4c19-8f1c-2b414152e183 tempest-TestInstancesWithCinderVolumes-1739256037 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-e16a6c11-4674-4833-9c5e-c793a8d36a58 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:57:22 devstack cinder-volume[87098]: DEBUG dbcounter [-] [87098] Writing DB stats cinder:SELECT=163,cinder:INSERT=48,cinder:UPDATE=201,cinder:DELETE=19 {{(pid=87098) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 13 13:57:22 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-4038facb-69ff-4a97-ae48-930a13f8e968 tempest-VolumesTestJSON-226431309 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 13:57:22 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-4038facb-69ff-4a97-ae48-930a13f8e968 tempest-VolumesTestJSON-226431309 None] Flow 'volume_create_manager' (287fe2f9-2fac-4953-ae9f-0e4c1bf9ae27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 13:57:22 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-4038facb-69ff-4a97-ae48-930a13f8e968 tempest-VolumesTestJSON-226431309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e92bd1ea-dd50-4dda-8155-9c7f562d92e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:57:22 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-4038facb-69ff-4a97-ae48-930a13f8e968 tempest-VolumesTestJSON-226431309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e92bd1ea-dd50-4dda-8155-9c7f562d92e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T11:57:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1063540576',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08748ff3-4c05-4001-ab9a-ab8daaee4588,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='cff69fdd745a4e1aa4406c69e643553f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T11:57:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T11:57:23Z,use_quota=True,user_id='8090d511a0d64e22b568d456056e5f58',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1147de8b-623b-426c-a13d-7fc824a80f67),volume_type_id=1147de8b-623b-426c-a13d-7fc824a80f67)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:57:22 devstack sudo[97432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-e16a6c11-4674-4833-9c5e-c793a8d36a58 Jul 13 13:57:22 devstack sudo[97432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:57:22 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-4038facb-69ff-4a97-ae48-930a13f8e968 tempest-VolumesTestJSON-226431309 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9921487-6852-447e-aef7-2c1e9c910ccf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:57:22 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-4038facb-69ff-4a97-ae48-930a13f8e968 tempest-VolumesTestJSON-226431309 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9921487-6852-447e-aef7-2c1e9c910ccf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:57:22 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-4038facb-69ff-4a97-ae48-930a13f8e968 tempest-VolumesTestJSON-226431309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8d299e0-0ef8-4cd4-ad20-876904052df2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:57:22 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-4038facb-69ff-4a97-ae48-930a13f8e968 tempest-VolumesTestJSON-226431309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8d299e0-0ef8-4cd4-ad20-876904052df2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '08748ff3-4c05-4001-ab9a-ab8daaee4588', 'volume_name': 'volume-08748ff3-4c05-4001-ab9a-ab8daaee4588', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:57:22 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-4038facb-69ff-4a97-ae48-930a13f8e968 tempest-VolumesTestJSON-226431309 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96b72fbf-ba59-45ae-a8d8-b3e79776735e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:57:22 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-4038facb-69ff-4a97-ae48-930a13f8e968 tempest-VolumesTestJSON-226431309 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96b72fbf-ba59-45ae-a8d8-b3e79776735e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:57:22 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-4038facb-69ff-4a97-ae48-930a13f8e968 tempest-VolumesTestJSON-226431309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72c5a8bd-0634-494d-a9c1-b5331d1df07a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:57:22 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-4038facb-69ff-4a97-ae48-930a13f8e968 tempest-VolumesTestJSON-226431309 None] Volume 08748ff3-4c05-4001-ab9a-ab8daaee4588: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-08748ff3-4c05-4001-ab9a-ab8daaee4588', 'volume_size': 1} Jul 13 13:57:22 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-4038facb-69ff-4a97-ae48-930a13f8e968 tempest-VolumesTestJSON-226431309 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:57:23 devstack sudo[97432]: pam_unix(sudo:session): session closed for user root Jul 13 13:57:23 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-f262b70f-5598-4c19-8f1c-2b414152e183 tempest-TestInstancesWithCinderVolumes-1739256037 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-e16a6c11-4674-4833-9c5e-c793a8d36a58" returned: 0 in 0.583s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:57:23 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-f262b70f-5598-4c19-8f1c-2b414152e183 tempest-TestInstancesWithCinderVolumes-1739256037 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-e16a6c11-4674-4833-9c5e-c793a8d36a58 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:57:23 devstack sudo[97446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-e16a6c11-4674-4833-9c5e-c793a8d36a58 Jul 13 13:57:23 devstack sudo[97446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:57:24 devstack sudo[97446]: pam_unix(sudo:session): session closed for user root Jul 13 13:57:24 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-f262b70f-5598-4c19-8f1c-2b414152e183 tempest-TestInstancesWithCinderVolumes-1739256037 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-e16a6c11-4674-4833-9c5e-c793a8d36a58" returned: 1 in 0.931s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:57:24 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-f262b70f-5598-4c19-8f1c-2b414152e183 tempest-TestInstancesWithCinderVolumes-1739256037 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-e16a6c11-4674-4833-9c5e-c793a8d36a58' failed. Not Retrying. {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 13 13:57:24 devstack cinder-volume[87098]: DEBUG cinder.volume.volume_utils [None req-f262b70f-5598-4c19-8f1c-2b414152e183 tempest-TestInstancesWithCinderVolumes-1739256037 None] Downloaded image 5051b5e5-c857-4b44-8332-f584efd78830 ((None, [{'url': 'file:///opt/stack/data/glance/images/5051b5e5-c857-4b44-8332-f584efd78830', 'metadata': {}}])) to volume e16a6c11-4674-4833-9c5e-c793a8d36a58 successfully. {{(pid=87098) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 13 13:57:24 devstack cinder-volume[87098]: DEBUG cinder.image.image_utils [None req-f262b70f-5598-4c19-8f1c-2b414152e183 tempest-TestInstancesWithCinderVolumes-1739256037 None] Temporary image 5051b5e5-c857-4b44-8332-f584efd78830 for user 51b5f237c78f487cb2a632a8ef7348d8 is deleted. {{(pid=87098) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 13 13:57:24 devstack cinder-volume[87098]: DEBUG cinder.volume.volume_utils [None req-f262b70f-5598-4c19-8f1c-2b414152e183 tempest-TestInstancesWithCinderVolumes-1739256037 None] Marking volume e16a6c11-4674-4833-9c5e-c793a8d36a58 as bootable. {{(pid=87098) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 13 13:57:24 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-f262b70f-5598-4c19-8f1c-2b414152e183 tempest-TestInstancesWithCinderVolumes-1739256037 None] Copying metadata from image 5051b5e5-c857-4b44-8332-f584efd78830 to e16a6c11-4674-4833-9c5e-c793a8d36a58. {{(pid=87098) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 13 13:57:24 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-f262b70f-5598-4c19-8f1c-2b414152e183 tempest-TestInstancesWithCinderVolumes-1739256037 None] Creating volume glance metadata for volume e16a6c11-4674-4833-9c5e-c793a8d36a58 backed by image 5051b5e5-c857-4b44-8332-f584efd78830 with: {'image_id': '5051b5e5-c857-4b44-8332-f584efd78830', 'image_name': 'tempest-scenario-img--1237164917', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87098) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 13 13:57:24 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-f262b70f-5598-4c19-8f1c-2b414152e183 tempest-TestInstancesWithCinderVolumes-1739256037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e2161ed-28d8-4097-988e-18b3be427031) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e16a6c11-4674-4833-9c5e-c793a8d36a58', 'volume_size': 1, 'image_id': '5051b5e5-c857-4b44-8332-f584efd78830', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5051b5e5-c857-4b44-8332-f584efd78830', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1237164917', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'fe824dc7c0ac4dd887f18f7c50c376f0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5051b5e5-c857-4b44-8332-f584efd78830', 'created_at': datetime.datetime(2026, 7, 13, 11, 57, 5, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 13, 11, 57, 7, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5051b5e5-c857-4b44-8332-f584efd78830/file', 'properties': {}}, 'image_service': }' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:57:24 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-f262b70f-5598-4c19-8f1c-2b414152e183 tempest-TestInstancesWithCinderVolumes-1739256037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c735de85-9eb9-4ecb-82d5-821eb91a67be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:57:24 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-f262b70f-5598-4c19-8f1c-2b414152e183 tempest-TestInstancesWithCinderVolumes-1739256037 None] Volume volume-e16a6c11-4674-4833-9c5e-c793a8d36a58 (e16a6c11-4674-4833-9c5e-c793a8d36a58): created successfully Jul 13 13:57:24 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-f262b70f-5598-4c19-8f1c-2b414152e183 tempest-TestInstancesWithCinderVolumes-1739256037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c735de85-9eb9-4ecb-82d5-821eb91a67be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:57:24 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-f262b70f-5598-4c19-8f1c-2b414152e183 tempest-TestInstancesWithCinderVolumes-1739256037 None] Flow 'volume_create_manager' (e2f3a888-e9a3-4f9a-af4e-51f555a4bf26) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 13:57:24 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-f262b70f-5598-4c19-8f1c-2b414152e183 tempest-TestInstancesWithCinderVolumes-1739256037 None] Created volume successfully. Jul 13 13:57:28 devstack sudo[97428]: pam_unix(sudo:session): session closed for user root Jul 13 13:57:28 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-d9e2d38e-ce4a-4d97-a025-a8ae15e00560 tempest-VolumesGetTest-148886235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-47ee3913-9bbd-4202-922d-832e2a28dfc6 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-16089004-076e-4d2a-8dae-9f761f0934de" returned: 0 in 5.814s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:57:28 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[7204b94c-581e-49db-9fb3-223d8f743fc4]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 13:57:28 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-d9e2d38e-ce4a-4d97-a025-a8ae15e00560 tempest-VolumesGetTest-148886235 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-47ee3913-9bbd-4202-922d-832e2a28dfc6 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:57:28 devstack sudo[97457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-47ee3913-9bbd-4202-922d-832e2a28dfc6 Jul 13 13:57:28 devstack sudo[97457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:57:28 devstack sudo[97457]: pam_unix(sudo:session): session closed for user root Jul 13 13:57:28 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-d9e2d38e-ce4a-4d97-a025-a8ae15e00560 tempest-VolumesGetTest-148886235 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-47ee3913-9bbd-4202-922d-832e2a28dfc6" returned: 0 in 0.606s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:57:28 devstack cinder-volume[87098]: DEBUG cinder.image.image_utils [None req-d9e2d38e-ce4a-4d97-a025-a8ae15e00560 tempest-VolumesGetTest-148886235 None] Image conversion details: src /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-47ee3913-9bbd-4202-922d-832e2a28dfc6, size 1024.00 MB, duration 5.81 sec, destination /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-16089004-076e-4d2a-8dae-9f761f0934de {{(pid=87098) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 13 13:57:29 devstack cinder-volume[87098]: INFO cinder.image.image_utils [None req-d9e2d38e-ce4a-4d97-a025-a8ae15e00560 tempest-VolumesGetTest-148886235 None] Converted 1024.00 MB image at 176.10 MB/s Jul 13 13:57:29 devstack cinder-volume[87098]: WARNING cinder.volume.drivers.remotefs [None req-d9e2d38e-ce4a-4d97-a025-a8ae15e00560 tempest-VolumesGetTest-148886235 None] /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-16089004-076e-4d2a-8dae-9f761f0934de is being set with open permissions: ugo+rw Jul 13 13:57:29 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-d9e2d38e-ce4a-4d97-a025-a8ae15e00560 tempest-VolumesGetTest-148886235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-16089004-076e-4d2a-8dae-9f761f0934de {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:57:29 devstack cinder-volume[87098]: DEBUG oslo_service.periodic_task [None req-727a1692-ea28-4a77-b327-0d94e8f01efb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87098) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 13 13:57:29 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-727a1692-ea28-4a77-b327-0d94e8f01efb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:57:29 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-727a1692-ea28-4a77-b327-0d94e8f01efb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:57:29 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-727a1692-ea28-4a77-b327-0d94e8f01efb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 13:57:29 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-727a1692-ea28-4a77-b327-0d94e8f01efb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 13:57:29 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-727a1692-ea28-4a77-b327-0d94e8f01efb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:57:29 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-727a1692-ea28-4a77-b327-0d94e8f01efb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:57:29 devstack sudo[97462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-16089004-076e-4d2a-8dae-9f761f0934de Jul 13 13:57:29 devstack sudo[97462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:57:29 devstack sudo[97464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 Jul 13 13:57:29 devstack sudo[97464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:57:29 devstack sudo[97462]: pam_unix(sudo:session): session closed for user root Jul 13 13:57:29 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-d9e2d38e-ce4a-4d97-a025-a8ae15e00560 tempest-VolumesGetTest-148886235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-16089004-076e-4d2a-8dae-9f761f0934de" returned: 0 in 0.303s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:57:29 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-d9e2d38e-ce4a-4d97-a025-a8ae15e00560 tempest-VolumesGetTest-148886235 None] Lock "cinder-quobyte-16089004-076e-4d2a-8dae-9f761f0934de" released by "_copy_volume_from_snapshot" :: held 7.818s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 13:57:29 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-d9e2d38e-ce4a-4d97-a025-a8ae15e00560 tempest-VolumesGetTest-148886235 None] Acquiring lock "cinder-quobyte-962c2c77-e2e1-4162-a8ee-15e7ffaad209" by "_delete_snapshot" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 13:57:29 devstack sudo[97464]: pam_unix(sudo:session): session closed for user root Jul 13 13:57:29 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-727a1692-ea28-4a77-b327-0d94e8f01efb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78" returned: 0 in 0.308s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:57:29 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-727a1692-ea28-4a77-b327-0d94e8f01efb None None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 13:57:29 devstack cinder-volume[87098]: DEBUG oslo_service.periodic_task [None req-727a1692-ea28-4a77-b327-0d94e8f01efb None None] Running periodic task VolumeManager._thread_info {{(pid=87098) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 13 13:57:29 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-727a1692-ea28-4a77-b327-0d94e8f01efb None None] thread count: 28 {{(pid=87098) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 13 13:57:29 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-727a1692-ea28-4a77-b327-0d94e8f01efb None None] thread info: [<_MainThread(MainThread, started 127988054597760)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87098) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 13 13:57:29 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-d9e2d38e-ce4a-4d97-a025-a8ae15e00560 tempest-VolumesGetTest-148886235 None] Lock "cinder-quobyte-962c2c77-e2e1-4162-a8ee-15e7ffaad209" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 13:57:29 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-d9e2d38e-ce4a-4d97-a025-a8ae15e00560 tempest-VolumesGetTest-148886235 None] Deleting offline snapshot 962c2c77-e2e1-4162-a8ee-15e7ffaad209 of volume 47ee3913-9bbd-4202-922d-832e2a28dfc6 {{(pid=87098) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 13 13:57:29 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-d9e2d38e-ce4a-4d97-a025-a8ae15e00560 tempest-VolumesGetTest-148886235 None] snapshot_file for this snap is: volume-47ee3913-9bbd-4202-922d-832e2a28dfc6.962c2c77-e2e1-4162-a8ee-15e7ffaad209 {{(pid=87098) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 13 13:57:29 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[065f5414-9700-4c74-8c5f-3a7ae18388cb]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 13:57:29 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-d9e2d38e-ce4a-4d97-a025-a8ae15e00560 tempest-VolumesGetTest-148886235 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-47ee3913-9bbd-4202-922d-832e2a28dfc6.962c2c77-e2e1-4162-a8ee-15e7ffaad209 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:57:29 devstack sudo[97468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-47ee3913-9bbd-4202-922d-832e2a28dfc6.962c2c77-e2e1-4162-a8ee-15e7ffaad209 Jul 13 13:57:29 devstack sudo[97468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:57:29 devstack sudo[97468]: pam_unix(sudo:session): session closed for user root Jul 13 13:57:29 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-d9e2d38e-ce4a-4d97-a025-a8ae15e00560 tempest-VolumesGetTest-148886235 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-47ee3913-9bbd-4202-922d-832e2a28dfc6.962c2c77-e2e1-4162-a8ee-15e7ffaad209" returned: 0 in 0.543s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:57:29 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-d9e2d38e-ce4a-4d97-a025-a8ae15e00560 tempest-VolumesGetTest-148886235 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-47ee3913-9bbd-4202-922d-832e2a28dfc6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87098) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 13 13:57:29 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[abe7b594-f70b-4b92-a617-c676daeb37c8]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 13:57:29 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-d9e2d38e-ce4a-4d97-a025-a8ae15e00560 tempest-VolumesGetTest-148886235 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-47ee3913-9bbd-4202-922d-832e2a28dfc6 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:57:30 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [req-9834e92e-c0d8-4dc2-ad4e-3aa90f28597d req-a11c3b90-1be0-499e-a6b6-7ce68961cb3c tempest-TestInstancesWithCinderVolumes-1739256037 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:57:30 devstack sudo[97482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-47ee3913-9bbd-4202-922d-832e2a28dfc6 Jul 13 13:57:30 devstack sudo[97482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:57:30 devstack sudo[97482]: pam_unix(sudo:session): session closed for user root Jul 13 13:57:30 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-d9e2d38e-ce4a-4d97-a025-a8ae15e00560 tempest-VolumesGetTest-148886235 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-47ee3913-9bbd-4202-922d-832e2a28dfc6" returned: 0 in 0.449s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:57:30 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-d9e2d38e-ce4a-4d97-a025-a8ae15e00560 tempest-VolumesGetTest-148886235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-47ee3913-9bbd-4202-922d-832e2a28dfc6.962c2c77-e2e1-4162-a8ee-15e7ffaad209 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:57:30 devstack sudo[97489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-47ee3913-9bbd-4202-922d-832e2a28dfc6.962c2c77-e2e1-4162-a8ee-15e7ffaad209 Jul 13 13:57:30 devstack sudo[97489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:57:30 devstack sudo[97489]: pam_unix(sudo:session): session closed for user root Jul 13 13:57:30 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-d9e2d38e-ce4a-4d97-a025-a8ae15e00560 tempest-VolumesGetTest-148886235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-47ee3913-9bbd-4202-922d-832e2a28dfc6.962c2c77-e2e1-4162-a8ee-15e7ffaad209" returned: 0 in 0.508s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:57:30 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-d9e2d38e-ce4a-4d97-a025-a8ae15e00560 tempest-VolumesGetTest-148886235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-47ee3913-9bbd-4202-922d-832e2a28dfc6.962c2c77-e2e1-4162-a8ee-15e7ffaad209 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:57:30 devstack sudo[97495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-47ee3913-9bbd-4202-922d-832e2a28dfc6.962c2c77-e2e1-4162-a8ee-15e7ffaad209 Jul 13 13:57:30 devstack sudo[97495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:57:31 devstack sudo[97495]: pam_unix(sudo:session): session closed for user root Jul 13 13:57:31 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-d9e2d38e-ce4a-4d97-a025-a8ae15e00560 tempest-VolumesGetTest-148886235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-47ee3913-9bbd-4202-922d-832e2a28dfc6.962c2c77-e2e1-4162-a8ee-15e7ffaad209" returned: 0 in 0.283s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:57:31 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-d9e2d38e-ce4a-4d97-a025-a8ae15e00560 tempest-VolumesGetTest-148886235 None] Lock "cinder-quobyte-962c2c77-e2e1-4162-a8ee-15e7ffaad209" released by "_delete_snapshot" :: held 1.895s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 13:57:31 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-d9e2d38e-ce4a-4d97-a025-a8ae15e00560 tempest-VolumesGetTest-148886235 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 12.705s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:57:31 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-4038facb-69ff-4a97-ae48-930a13f8e968 tempest-VolumesTestJSON-226431309 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.317s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:57:31 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-4038facb-69ff-4a97-ae48-930a13f8e968 tempest-VolumesTestJSON-226431309 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T11:57:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1063540576',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08748ff3-4c05-4001-ab9a-ab8daaee4588,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='cff69fdd745a4e1aa4406c69e643553f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T11:57:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T11:57:23Z,use_quota=True,user_id='8090d511a0d64e22b568d456056e5f58',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1147de8b-623b-426c-a13d-7fc824a80f67),volume_type_id=1147de8b-623b-426c-a13d-7fc824a80f67)}" {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 13 13:57:31 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-4038facb-69ff-4a97-ae48-930a13f8e968 tempest-VolumesTestJSON-226431309 None] Creating volume 08748ff3-4c05-4001-ab9a-ab8daaee4588 {{(pid=87098) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 13 13:57:31 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-4038facb-69ff-4a97-ae48-930a13f8e968 tempest-VolumesTestJSON-226431309 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:57:31 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-4038facb-69ff-4a97-ae48-930a13f8e968 tempest-VolumesTestJSON-226431309 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:57:31 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-4038facb-69ff-4a97-ae48-930a13f8e968 tempest-VolumesTestJSON-226431309 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 13:57:31 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-4038facb-69ff-4a97-ae48-930a13f8e968 tempest-VolumesTestJSON-226431309 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 13:57:31 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-4038facb-69ff-4a97-ae48-930a13f8e968 tempest-VolumesTestJSON-226431309 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:57:31 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-4038facb-69ff-4a97-ae48-930a13f8e968 tempest-VolumesTestJSON-226431309 None] Selected osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 13:57:31 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-4038facb-69ff-4a97-ae48-930a13f8e968 tempest-VolumesTestJSON-226431309 None] casted to osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 Jul 13 13:57:31 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-4038facb-69ff-4a97-ae48-930a13f8e968 tempest-VolumesTestJSON-226431309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-08748ff3-4c05-4001-ab9a-ab8daaee4588 1073741824 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:57:31 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-d9e2d38e-ce4a-4d97-a025-a8ae15e00560 tempest-VolumesGetTest-148886235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7dfeef7-80c6-4fe6-b740-cea0fe69e30f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-16089004-076e-4d2a-8dae-9f761f0934de', 'volume_size': 1, 'source_volid': '47ee3913-9bbd-4202-922d-832e2a28dfc6', 'source_volstatus': 'available'}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:57:31 devstack sudo[97498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-08748ff3-4c05-4001-ab9a-ab8daaee4588 1073741824 Jul 13 13:57:31 devstack sudo[97498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:57:31 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-d9e2d38e-ce4a-4d97-a025-a8ae15e00560 tempest-VolumesGetTest-148886235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44bd1e4a-9293-4447-b2e9-1a3fe7095c0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:57:31 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-d9e2d38e-ce4a-4d97-a025-a8ae15e00560 tempest-VolumesGetTest-148886235 None] Volume volume-16089004-076e-4d2a-8dae-9f761f0934de (16089004-076e-4d2a-8dae-9f761f0934de): created successfully Jul 13 13:57:31 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-d9e2d38e-ce4a-4d97-a025-a8ae15e00560 tempest-VolumesGetTest-148886235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44bd1e4a-9293-4447-b2e9-1a3fe7095c0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:57:31 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-d9e2d38e-ce4a-4d97-a025-a8ae15e00560 tempest-VolumesGetTest-148886235 None] Flow 'volume_create_manager' (f30cd8a7-e5b7-4d14-8f15-7946057fd0db) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 13:57:31 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-d9e2d38e-ce4a-4d97-a025-a8ae15e00560 tempest-VolumesGetTest-148886235 None] Created volume successfully. Jul 13 13:57:32 devstack sudo[97498]: pam_unix(sudo:session): session closed for user root Jul 13 13:57:32 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-4038facb-69ff-4a97-ae48-930a13f8e968 tempest-VolumesTestJSON-226431309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-08748ff3-4c05-4001-ab9a-ab8daaee4588 1073741824" returned: 0 in 0.711s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:57:32 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-4038facb-69ff-4a97-ae48-930a13f8e968 tempest-VolumesTestJSON-226431309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-08748ff3-4c05-4001-ab9a-ab8daaee4588 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:57:32 devstack sudo[97504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-08748ff3-4c05-4001-ab9a-ab8daaee4588 Jul 13 13:57:32 devstack sudo[97504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:57:32 devstack sudo[97504]: pam_unix(sudo:session): session closed for user root Jul 13 13:57:32 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-4038facb-69ff-4a97-ae48-930a13f8e968 tempest-VolumesTestJSON-226431309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-08748ff3-4c05-4001-ab9a-ab8daaee4588" returned: 0 in 0.356s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:57:32 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-4038facb-69ff-4a97-ae48-930a13f8e968 tempest-VolumesTestJSON-226431309 None] <== create_volume: return (1134ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'} {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 13 13:57:32 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-4038facb-69ff-4a97-ae48-930a13f8e968 tempest-VolumesTestJSON-226431309 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.138s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:57:32 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [req-9834e92e-c0d8-4dc2-ad4e-3aa90f28597d req-a11c3b90-1be0-499e-a6b6-7ce68961cb3c tempest-TestInstancesWithCinderVolumes-1739256037 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 2.313s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:57:32 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-4038facb-69ff-4a97-ae48-930a13f8e968 tempest-VolumesTestJSON-226431309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72c5a8bd-0634-494d-a9c1-b5331d1df07a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-08748ff3-4c05-4001-ab9a-ab8daaee4588', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:57:32 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-4038facb-69ff-4a97-ae48-930a13f8e968 tempest-VolumesTestJSON-226431309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64cd3bd5-e373-4cde-b3ea-5317c3d3d502) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:57:32 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-4038facb-69ff-4a97-ae48-930a13f8e968 tempest-VolumesTestJSON-226431309 None] Volume volume-08748ff3-4c05-4001-ab9a-ab8daaee4588 (08748ff3-4c05-4001-ab9a-ab8daaee4588): created successfully Jul 13 13:57:32 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-4038facb-69ff-4a97-ae48-930a13f8e968 tempest-VolumesTestJSON-226431309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64cd3bd5-e373-4cde-b3ea-5317c3d3d502) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:57:32 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-4038facb-69ff-4a97-ae48-930a13f8e968 tempest-VolumesTestJSON-226431309 None] Flow 'volume_create_manager' (287fe2f9-2fac-4953-ae9f-0e4c1bf9ae27) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 13:57:32 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[455ad238-c14a-4f4d-95aa-bbce243ec063]: (4, 'raw') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 13:57:32 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [req-9834e92e-c0d8-4dc2-ad4e-3aa90f28597d req-a11c3b90-1be0-499e-a6b6-7ce68961cb3c tempest-TestInstancesWithCinderVolumes-1739256037 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-e16a6c11-4674-4833-9c5e-c793a8d36a58 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:57:32 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-4038facb-69ff-4a97-ae48-930a13f8e968 tempest-VolumesTestJSON-226431309 None] Created volume successfully. Jul 13 13:57:32 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-8ca12c74-411b-4254-8509-095c073e915c tempest-VolumesGetTest-148886235 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 13:57:32 devstack sudo[97508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-e16a6c11-4674-4833-9c5e-c793a8d36a58 Jul 13 13:57:32 devstack sudo[97508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:57:32 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-8ca12c74-411b-4254-8509-095c073e915c tempest-VolumesGetTest-148886235 None] Flow 'volume_create_manager' (a9894cdb-7b70-48d0-9409-89adf3ffb43f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 13:57:32 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-8ca12c74-411b-4254-8509-095c073e915c tempest-VolumesGetTest-148886235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07b442ae-22ec-42af-a1d4-c8ce02e1a424) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:57:32 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-8ca12c74-411b-4254-8509-095c073e915c tempest-VolumesGetTest-148886235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07b442ae-22ec-42af-a1d4-c8ce02e1a424) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T11:57:32Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1457685527',display_name='tempest-VolumesGetTest-Volume-1833379016',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d8f49bf-ad77-45e7-8dae-cf24fd2a3758,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fce5cc7d83924cda908696f4e23b92f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T11:57:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T11:57:33Z,use_quota=True,user_id='9b36f110e7f84651be59cde67a7b41e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1147de8b-623b-426c-a13d-7fc824a80f67),volume_type_id=1147de8b-623b-426c-a13d-7fc824a80f67)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:57:32 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-8ca12c74-411b-4254-8509-095c073e915c tempest-VolumesGetTest-148886235 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c51699b-5b22-49aa-bb43-81aa3aa088a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:57:32 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-8ca12c74-411b-4254-8509-095c073e915c tempest-VolumesGetTest-148886235 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c51699b-5b22-49aa-bb43-81aa3aa088a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:57:32 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-8ca12c74-411b-4254-8509-095c073e915c tempest-VolumesGetTest-148886235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a7ab7d8-349c-4d2f-a9d3-a8863f457c0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:57:32 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-8ca12c74-411b-4254-8509-095c073e915c tempest-VolumesGetTest-148886235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a7ab7d8-349c-4d2f-a9d3-a8863f457c0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8d8f49bf-ad77-45e7-8dae-cf24fd2a3758', 'volume_name': 'volume-8d8f49bf-ad77-45e7-8dae-cf24fd2a3758', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:57:32 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-8ca12c74-411b-4254-8509-095c073e915c tempest-VolumesGetTest-148886235 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c2c2602-cb96-4d94-8400-b3df007aef5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:57:32 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-8ca12c74-411b-4254-8509-095c073e915c tempest-VolumesGetTest-148886235 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c2c2602-cb96-4d94-8400-b3df007aef5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:57:32 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-8ca12c74-411b-4254-8509-095c073e915c tempest-VolumesGetTest-148886235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6542d3f7-c8ba-4a49-914c-8f94b8ae197d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:57:32 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-8ca12c74-411b-4254-8509-095c073e915c tempest-VolumesGetTest-148886235 None] Volume 8d8f49bf-ad77-45e7-8dae-cf24fd2a3758: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8d8f49bf-ad77-45e7-8dae-cf24fd2a3758', 'volume_size': 1} Jul 13 13:57:32 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-8ca12c74-411b-4254-8509-095c073e915c tempest-VolumesGetTest-148886235 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:57:33 devstack sudo[97508]: pam_unix(sudo:session): session closed for user root Jul 13 13:57:33 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [req-9834e92e-c0d8-4dc2-ad4e-3aa90f28597d req-a11c3b90-1be0-499e-a6b6-7ce68961cb3c tempest-TestInstancesWithCinderVolumes-1739256037 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-e16a6c11-4674-4833-9c5e-c793a8d36a58" returned: 0 in 0.591s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:57:33 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [req-9834e92e-c0d8-4dc2-ad4e-3aa90f28597d req-a11c3b90-1be0-499e-a6b6-7ce68961cb3c tempest-TestInstancesWithCinderVolumes-1739256037 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-e16a6c11-4674-4833-9c5e-c793a8d36a58 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:57:33 devstack sudo[97513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-e16a6c11-4674-4833-9c5e-c793a8d36a58 Jul 13 13:57:33 devstack sudo[97513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:57:33 devstack sudo[97513]: pam_unix(sudo:session): session closed for user root Jul 13 13:57:33 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [req-9834e92e-c0d8-4dc2-ad4e-3aa90f28597d req-a11c3b90-1be0-499e-a6b6-7ce68961cb3c tempest-TestInstancesWithCinderVolumes-1739256037 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-e16a6c11-4674-4833-9c5e-c793a8d36a58" returned: 1 in 0.608s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:57:33 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [req-9834e92e-c0d8-4dc2-ad4e-3aa90f28597d req-a11c3b90-1be0-499e-a6b6-7ce68961cb3c tempest-TestInstancesWithCinderVolumes-1739256037 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-e16a6c11-4674-4833-9c5e-c793a8d36a58' failed. Not Retrying. {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 13 13:57:33 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [req-9834e92e-c0d8-4dc2-ad4e-3aa90f28597d req-a11c3b90-1be0-499e-a6b6-7ce68961cb3c tempest-TestInstancesWithCinderVolumes-1739256037 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.292s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:57:33 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-8ca12c74-411b-4254-8509-095c073e915c tempest-VolumesGetTest-148886235 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.931s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:57:33 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-8ca12c74-411b-4254-8509-095c073e915c tempest-VolumesGetTest-148886235 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T11:57:32Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1457685527',display_name='tempest-VolumesGetTest-Volume-1833379016',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d8f49bf-ad77-45e7-8dae-cf24fd2a3758,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fce5cc7d83924cda908696f4e23b92f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T11:57:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T11:57:33Z,use_quota=True,user_id='9b36f110e7f84651be59cde67a7b41e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1147de8b-623b-426c-a13d-7fc824a80f67),volume_type_id=1147de8b-623b-426c-a13d-7fc824a80f67)}" {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 13 13:57:33 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-8ca12c74-411b-4254-8509-095c073e915c tempest-VolumesGetTest-148886235 None] Creating volume 8d8f49bf-ad77-45e7-8dae-cf24fd2a3758 {{(pid=87098) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 13 13:57:33 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-8ca12c74-411b-4254-8509-095c073e915c tempest-VolumesGetTest-148886235 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:57:33 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-8ca12c74-411b-4254-8509-095c073e915c tempest-VolumesGetTest-148886235 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:57:33 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-8ca12c74-411b-4254-8509-095c073e915c tempest-VolumesGetTest-148886235 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 13:57:33 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-8ca12c74-411b-4254-8509-095c073e915c tempest-VolumesGetTest-148886235 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 13:57:33 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-8ca12c74-411b-4254-8509-095c073e915c tempest-VolumesGetTest-148886235 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:57:33 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-8ca12c74-411b-4254-8509-095c073e915c tempest-VolumesGetTest-148886235 None] Selected osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 13:57:33 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-8ca12c74-411b-4254-8509-095c073e915c tempest-VolumesGetTest-148886235 None] casted to osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 Jul 13 13:57:33 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-8ca12c74-411b-4254-8509-095c073e915c tempest-VolumesGetTest-148886235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-8d8f49bf-ad77-45e7-8dae-cf24fd2a3758 1073741824 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:57:33 devstack sudo[97518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-8d8f49bf-ad77-45e7-8dae-cf24fd2a3758 1073741824 Jul 13 13:57:33 devstack sudo[97518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:57:33 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e2cae89-8423-4271-a825-af03662ed00f tempest-VolumesTestJSON-226431309 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 13:57:33 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-7e2cae89-8423-4271-a825-af03662ed00f tempest-VolumesTestJSON-226431309 None] Flow 'volume_create_manager' (a4fd24ba-1b54-47a6-9c51-ecb58e31a708) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 13:57:33 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-7e2cae89-8423-4271-a825-af03662ed00f tempest-VolumesTestJSON-226431309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4eaa493-3620-467f-9329-ede57d115631) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:57:33 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [req-9834e92e-c0d8-4dc2-ad4e-3aa90f28597d req-a11c3b90-1be0-499e-a6b6-7ce68961cb3c tempest-TestInstancesWithCinderVolumes-1739256037 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654', 'name': 'volume-e16a6c11-4674-4833-9c5e-c793a8d36a58', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f0666e4a-75b6-49a2-8ec7-03dd2636b3b7', 'enforce_multipath': True} {{(pid=87098) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 13 13:57:33 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-7e2cae89-8423-4271-a825-af03662ed00f tempest-VolumesTestJSON-226431309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4eaa493-3620-467f-9329-ede57d115631) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T11:57:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-658379073',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd99e52b-cbc5-4aeb-b959-87732b4a4674,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='cff69fdd745a4e1aa4406c69e643553f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T11:57:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T11:57:34Z,use_quota=True,user_id='8090d511a0d64e22b568d456056e5f58',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1147de8b-623b-426c-a13d-7fc824a80f67),volume_type_id=1147de8b-623b-426c-a13d-7fc824a80f67)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:57:33 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-7e2cae89-8423-4271-a825-af03662ed00f tempest-VolumesTestJSON-226431309 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6905779f-43cc-47e6-b909-82d92da66ae6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:57:33 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-7e2cae89-8423-4271-a825-af03662ed00f tempest-VolumesTestJSON-226431309 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6905779f-43cc-47e6-b909-82d92da66ae6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:57:33 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-7e2cae89-8423-4271-a825-af03662ed00f tempest-VolumesTestJSON-226431309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30209311-666a-4591-8100-aa9b9e0efe97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:57:33 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-7e2cae89-8423-4271-a825-af03662ed00f tempest-VolumesTestJSON-226431309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30209311-666a-4591-8100-aa9b9e0efe97) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fd99e52b-cbc5-4aeb-b959-87732b4a4674', 'volume_name': 'volume-fd99e52b-cbc5-4aeb-b959-87732b4a4674', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:57:33 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-7e2cae89-8423-4271-a825-af03662ed00f tempest-VolumesTestJSON-226431309 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a0f0b9d-8ae4-47dc-b833-60e4a8ea59a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:57:33 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-7e2cae89-8423-4271-a825-af03662ed00f tempest-VolumesTestJSON-226431309 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a0f0b9d-8ae4-47dc-b833-60e4a8ea59a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:57:33 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-7e2cae89-8423-4271-a825-af03662ed00f tempest-VolumesTestJSON-226431309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf3b47de-cac3-4a8f-9cc2-fe9f7bdb163a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:57:33 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-7e2cae89-8423-4271-a825-af03662ed00f tempest-VolumesTestJSON-226431309 None] Volume fd99e52b-cbc5-4aeb-b959-87732b4a4674: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fd99e52b-cbc5-4aeb-b959-87732b4a4674', 'volume_size': 1} Jul 13 13:57:33 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-7e2cae89-8423-4271-a825-af03662ed00f tempest-VolumesTestJSON-226431309 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:57:33 devstack cinder-volume[87098]: INFO cinder.volume.manager [req-9834e92e-c0d8-4dc2-ad4e-3aa90f28597d req-a11c3b90-1be0-499e-a6b6-7ce68961cb3c tempest-TestInstancesWithCinderVolumes-1739256037 None] attachment_update completed successfully. Jul 13 13:57:34 devstack sudo[97518]: pam_unix(sudo:session): session closed for user root Jul 13 13:57:34 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-8ca12c74-411b-4254-8509-095c073e915c tempest-VolumesGetTest-148886235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-8d8f49bf-ad77-45e7-8dae-cf24fd2a3758 1073741824" returned: 0 in 0.546s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:57:34 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-8ca12c74-411b-4254-8509-095c073e915c tempest-VolumesGetTest-148886235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-8d8f49bf-ad77-45e7-8dae-cf24fd2a3758 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:57:34 devstack sudo[97525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-8d8f49bf-ad77-45e7-8dae-cf24fd2a3758 Jul 13 13:57:34 devstack sudo[97525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:57:34 devstack sudo[97525]: pam_unix(sudo:session): session closed for user root Jul 13 13:57:34 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-8ca12c74-411b-4254-8509-095c073e915c tempest-VolumesGetTest-148886235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-8d8f49bf-ad77-45e7-8dae-cf24fd2a3758" returned: 0 in 0.291s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:57:34 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-8ca12c74-411b-4254-8509-095c073e915c tempest-VolumesGetTest-148886235 None] <== create_volume: return (884ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'} {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 13 13:57:34 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-8ca12c74-411b-4254-8509-095c073e915c tempest-VolumesGetTest-148886235 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.888s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:57:34 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-7e2cae89-8423-4271-a825-af03662ed00f tempest-VolumesTestJSON-226431309 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.734s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:57:34 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-7e2cae89-8423-4271-a825-af03662ed00f tempest-VolumesTestJSON-226431309 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T11:57:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-658379073',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd99e52b-cbc5-4aeb-b959-87732b4a4674,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='cff69fdd745a4e1aa4406c69e643553f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T11:57:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T11:57:34Z,use_quota=True,user_id='8090d511a0d64e22b568d456056e5f58',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1147de8b-623b-426c-a13d-7fc824a80f67),volume_type_id=1147de8b-623b-426c-a13d-7fc824a80f67)}" {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 13 13:57:34 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-7e2cae89-8423-4271-a825-af03662ed00f tempest-VolumesTestJSON-226431309 None] Creating volume fd99e52b-cbc5-4aeb-b959-87732b4a4674 {{(pid=87098) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 13 13:57:34 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-7e2cae89-8423-4271-a825-af03662ed00f tempest-VolumesTestJSON-226431309 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:57:34 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-7e2cae89-8423-4271-a825-af03662ed00f tempest-VolumesTestJSON-226431309 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:57:34 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-7e2cae89-8423-4271-a825-af03662ed00f tempest-VolumesTestJSON-226431309 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 13:57:34 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-7e2cae89-8423-4271-a825-af03662ed00f tempest-VolumesTestJSON-226431309 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 13:57:34 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-7e2cae89-8423-4271-a825-af03662ed00f tempest-VolumesTestJSON-226431309 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:57:34 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-7e2cae89-8423-4271-a825-af03662ed00f tempest-VolumesTestJSON-226431309 None] Selected osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 13:57:34 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-7e2cae89-8423-4271-a825-af03662ed00f tempest-VolumesTestJSON-226431309 None] casted to osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 Jul 13 13:57:34 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-7e2cae89-8423-4271-a825-af03662ed00f tempest-VolumesTestJSON-226431309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-fd99e52b-cbc5-4aeb-b959-87732b4a4674 1073741824 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:57:34 devstack sudo[97595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-fd99e52b-cbc5-4aeb-b959-87732b4a4674 1073741824 Jul 13 13:57:34 devstack sudo[97595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:57:34 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-8ca12c74-411b-4254-8509-095c073e915c tempest-VolumesGetTest-148886235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6542d3f7-c8ba-4a49-914c-8f94b8ae197d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8d8f49bf-ad77-45e7-8dae-cf24fd2a3758', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:57:34 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-8ca12c74-411b-4254-8509-095c073e915c tempest-VolumesGetTest-148886235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e652b8c-3720-48f1-800f-096a78e51546) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:57:34 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-8ca12c74-411b-4254-8509-095c073e915c tempest-VolumesGetTest-148886235 None] Volume volume-8d8f49bf-ad77-45e7-8dae-cf24fd2a3758 (8d8f49bf-ad77-45e7-8dae-cf24fd2a3758): created successfully Jul 13 13:57:34 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-8ca12c74-411b-4254-8509-095c073e915c tempest-VolumesGetTest-148886235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e652b8c-3720-48f1-800f-096a78e51546) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:57:34 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-8ca12c74-411b-4254-8509-095c073e915c tempest-VolumesGetTest-148886235 None] Flow 'volume_create_manager' (a9894cdb-7b70-48d0-9409-89adf3ffb43f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 13:57:34 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-8ca12c74-411b-4254-8509-095c073e915c tempest-VolumesGetTest-148886235 None] Created volume successfully. Jul 13 13:57:35 devstack sudo[97595]: pam_unix(sudo:session): session closed for user root Jul 13 13:57:35 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-7e2cae89-8423-4271-a825-af03662ed00f tempest-VolumesTestJSON-226431309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-fd99e52b-cbc5-4aeb-b959-87732b4a4674 1073741824" returned: 0 in 0.973s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:57:35 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-7e2cae89-8423-4271-a825-af03662ed00f tempest-VolumesTestJSON-226431309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-fd99e52b-cbc5-4aeb-b959-87732b4a4674 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:57:35 devstack sudo[97973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-fd99e52b-cbc5-4aeb-b959-87732b4a4674 Jul 13 13:57:35 devstack sudo[97973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:57:36 devstack sudo[97973]: pam_unix(sudo:session): session closed for user root Jul 13 13:57:36 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-7e2cae89-8423-4271-a825-af03662ed00f tempest-VolumesTestJSON-226431309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-fd99e52b-cbc5-4aeb-b959-87732b4a4674" returned: 0 in 0.332s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:57:36 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-7e2cae89-8423-4271-a825-af03662ed00f tempest-VolumesTestJSON-226431309 None] <== create_volume: return (1420ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'} {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 13 13:57:36 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-7e2cae89-8423-4271-a825-af03662ed00f tempest-VolumesTestJSON-226431309 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.429s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:57:36 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-7e2cae89-8423-4271-a825-af03662ed00f tempest-VolumesTestJSON-226431309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf3b47de-cac3-4a8f-9cc2-fe9f7bdb163a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fd99e52b-cbc5-4aeb-b959-87732b4a4674', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:57:36 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-7e2cae89-8423-4271-a825-af03662ed00f tempest-VolumesTestJSON-226431309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6fb28de-d855-4f00-a4ea-023a9e8658b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:57:36 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-7e2cae89-8423-4271-a825-af03662ed00f tempest-VolumesTestJSON-226431309 None] Volume volume-fd99e52b-cbc5-4aeb-b959-87732b4a4674 (fd99e52b-cbc5-4aeb-b959-87732b4a4674): created successfully Jul 13 13:57:36 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-7e2cae89-8423-4271-a825-af03662ed00f tempest-VolumesTestJSON-226431309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6fb28de-d855-4f00-a4ea-023a9e8658b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:57:36 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-7e2cae89-8423-4271-a825-af03662ed00f tempest-VolumesTestJSON-226431309 None] Flow 'volume_create_manager' (a4fd24ba-1b54-47a6-9c51-ecb58e31a708) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 13:57:36 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-7e2cae89-8423-4271-a825-af03662ed00f tempest-VolumesTestJSON-226431309 None] Created volume successfully. Jul 13 13:57:36 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-86d11ce2-49b2-40c1-83e8-58788dc1c282 tempest-VolumesGetTest-148886235 None] Acquiring lock "cinder-8d8f49bf-ad77-45e7-8dae-cf24fd2a3758-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 13:57:36 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-86d11ce2-49b2-40c1-83e8-58788dc1c282 tempest-VolumesGetTest-148886235 None] Lock "cinder-8d8f49bf-ad77-45e7-8dae-cf24fd2a3758-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 13:57:36 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-86d11ce2-49b2-40c1-83e8-58788dc1c282 tempest-VolumesGetTest-148886235 None] Acquiring lock "cinder-quobyte-8d8f49bf-ad77-45e7-8dae-cf24fd2a3758" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 13:57:36 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-86d11ce2-49b2-40c1-83e8-58788dc1c282 tempest-VolumesGetTest-148886235 None] Lock "cinder-quobyte-8d8f49bf-ad77-45e7-8dae-cf24fd2a3758" acquired by "delete_volume" :: waited 0.015s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 13:57:36 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[06e9e5db-7068-4dee-a6c7-c6df22dbf872]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 13:57:36 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-86d11ce2-49b2-40c1-83e8-58788dc1c282 tempest-VolumesGetTest-148886235 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-8d8f49bf-ad77-45e7-8dae-cf24fd2a3758 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:57:36 devstack sudo[97979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-8d8f49bf-ad77-45e7-8dae-cf24fd2a3758 Jul 13 13:57:36 devstack sudo[97979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:57:36 devstack sudo[97979]: pam_unix(sudo:session): session closed for user root Jul 13 13:57:36 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-86d11ce2-49b2-40c1-83e8-58788dc1c282 tempest-VolumesGetTest-148886235 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-8d8f49bf-ad77-45e7-8dae-cf24fd2a3758" returned: 0 in 0.562s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:57:36 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-86d11ce2-49b2-40c1-83e8-58788dc1c282 tempest-VolumesGetTest-148886235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-8d8f49bf-ad77-45e7-8dae-cf24fd2a3758 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:57:37 devstack sudo[97988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-8d8f49bf-ad77-45e7-8dae-cf24fd2a3758 Jul 13 13:57:37 devstack sudo[97988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:57:37 devstack sudo[97988]: pam_unix(sudo:session): session closed for user root Jul 13 13:57:37 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-86d11ce2-49b2-40c1-83e8-58788dc1c282 tempest-VolumesGetTest-148886235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-8d8f49bf-ad77-45e7-8dae-cf24fd2a3758" returned: 0 in 0.362s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:57:37 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-86d11ce2-49b2-40c1-83e8-58788dc1c282 tempest-VolumesGetTest-148886235 None] Lock "cinder-quobyte-8d8f49bf-ad77-45e7-8dae-cf24fd2a3758" released by "delete_volume" :: held 0.978s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 13:57:37 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-86d11ce2-49b2-40c1-83e8-58788dc1c282 tempest-VolumesGetTest-148886235 None] Created reservations ['5f71832e-d601-4f9e-9623-af290c8cd283', 'aeaa6ab3-c351-4efd-abda-6e31638c6473', '2f53b5a9-1e9c-43ff-ad10-41608e241ee0', 'e06fe9a9-4048-46ad-8f59-2c02fce88a2b'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 13:57:37 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-86d11ce2-49b2-40c1-83e8-58788dc1c282 tempest-VolumesGetTest-148886235 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:57:37 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-86d11ce2-49b2-40c1-83e8-58788dc1c282 tempest-VolumesGetTest-148886235 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:57:37 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-86d11ce2-49b2-40c1-83e8-58788dc1c282 tempest-VolumesGetTest-148886235 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 13:57:37 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-86d11ce2-49b2-40c1-83e8-58788dc1c282 tempest-VolumesGetTest-148886235 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 13:57:37 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-86d11ce2-49b2-40c1-83e8-58788dc1c282 tempest-VolumesGetTest-148886235 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:57:37 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-86d11ce2-49b2-40c1-83e8-58788dc1c282 tempest-VolumesGetTest-148886235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:57:37 devstack sudo[97991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 Jul 13 13:57:37 devstack sudo[97991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:57:38 devstack sudo[97991]: pam_unix(sudo:session): session closed for user root Jul 13 13:57:38 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-86d11ce2-49b2-40c1-83e8-58788dc1c282 tempest-VolumesGetTest-148886235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78" returned: 0 in 0.526s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:57:38 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-86d11ce2-49b2-40c1-83e8-58788dc1c282 tempest-VolumesGetTest-148886235 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 13:57:38 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-86d11ce2-49b2-40c1-83e8-58788dc1c282 tempest-VolumesGetTest-148886235 None] Deleted volume successfully. Jul 13 13:57:38 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-86d11ce2-49b2-40c1-83e8-58788dc1c282 tempest-VolumesGetTest-148886235 None] Lock "cinder-8d8f49bf-ad77-45e7-8dae-cf24fd2a3758-delete_volume" released by "delete_volume" :: held 1.867s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 13:57:38 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-33b6ebf2-bb58-460d-82ca-c1fef41a70b1 tempest-VolumesTestJSON-226431309 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 13:57:38 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-33b6ebf2-bb58-460d-82ca-c1fef41a70b1 tempest-VolumesTestJSON-226431309 None] Flow 'volume_create_manager' (578c3005-32bd-41b5-98ae-7089c5f15535) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 13:57:38 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-33b6ebf2-bb58-460d-82ca-c1fef41a70b1 tempest-VolumesTestJSON-226431309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36cf4272-7bd9-4d4e-a10b-9aaa977f9df0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:57:38 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-33b6ebf2-bb58-460d-82ca-c1fef41a70b1 tempest-VolumesTestJSON-226431309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36cf4272-7bd9-4d4e-a10b-9aaa977f9df0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T11:57:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-77240254',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=320fad0b-4561-45c9-b534-ba27dfa756c1,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='cff69fdd745a4e1aa4406c69e643553f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T11:57:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T11:57:38Z,use_quota=True,user_id='8090d511a0d64e22b568d456056e5f58',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1147de8b-623b-426c-a13d-7fc824a80f67),volume_type_id=1147de8b-623b-426c-a13d-7fc824a80f67)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:57:38 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-33b6ebf2-bb58-460d-82ca-c1fef41a70b1 tempest-VolumesTestJSON-226431309 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3cfac3ec-cc90-4dfa-b9c1-125fe3117ccc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:57:38 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-33b6ebf2-bb58-460d-82ca-c1fef41a70b1 tempest-VolumesTestJSON-226431309 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3cfac3ec-cc90-4dfa-b9c1-125fe3117ccc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:57:38 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-33b6ebf2-bb58-460d-82ca-c1fef41a70b1 tempest-VolumesTestJSON-226431309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3ead19c-eb9a-4d22-9622-f4e21845a0c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:57:38 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-33b6ebf2-bb58-460d-82ca-c1fef41a70b1 tempest-VolumesTestJSON-226431309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3ead19c-eb9a-4d22-9622-f4e21845a0c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '320fad0b-4561-45c9-b534-ba27dfa756c1', 'volume_name': 'volume-320fad0b-4561-45c9-b534-ba27dfa756c1', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:57:38 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-33b6ebf2-bb58-460d-82ca-c1fef41a70b1 tempest-VolumesTestJSON-226431309 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3dd9f120-448c-4064-a21f-dbce474561d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:57:38 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-33b6ebf2-bb58-460d-82ca-c1fef41a70b1 tempest-VolumesTestJSON-226431309 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3dd9f120-448c-4064-a21f-dbce474561d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:57:38 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-33b6ebf2-bb58-460d-82ca-c1fef41a70b1 tempest-VolumesTestJSON-226431309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b07bf7e5-0d45-4d63-888a-46060c4bbb45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:57:38 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-33b6ebf2-bb58-460d-82ca-c1fef41a70b1 tempest-VolumesTestJSON-226431309 None] Volume 320fad0b-4561-45c9-b534-ba27dfa756c1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-320fad0b-4561-45c9-b534-ba27dfa756c1', 'volume_size': 1} Jul 13 13:57:38 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-33b6ebf2-bb58-460d-82ca-c1fef41a70b1 tempest-VolumesTestJSON-226431309 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:57:38 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-33b6ebf2-bb58-460d-82ca-c1fef41a70b1 tempest-VolumesTestJSON-226431309 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:57:38 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-33b6ebf2-bb58-460d-82ca-c1fef41a70b1 tempest-VolumesTestJSON-226431309 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T11:57:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-77240254',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=320fad0b-4561-45c9-b534-ba27dfa756c1,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='cff69fdd745a4e1aa4406c69e643553f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T11:57:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T11:57:38Z,use_quota=True,user_id='8090d511a0d64e22b568d456056e5f58',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1147de8b-623b-426c-a13d-7fc824a80f67),volume_type_id=1147de8b-623b-426c-a13d-7fc824a80f67)}" {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 13 13:57:38 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-33b6ebf2-bb58-460d-82ca-c1fef41a70b1 tempest-VolumesTestJSON-226431309 None] Creating volume 320fad0b-4561-45c9-b534-ba27dfa756c1 {{(pid=87098) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 13 13:57:38 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-33b6ebf2-bb58-460d-82ca-c1fef41a70b1 tempest-VolumesTestJSON-226431309 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:57:38 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-33b6ebf2-bb58-460d-82ca-c1fef41a70b1 tempest-VolumesTestJSON-226431309 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:57:38 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-33b6ebf2-bb58-460d-82ca-c1fef41a70b1 tempest-VolumesTestJSON-226431309 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 13:57:38 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-33b6ebf2-bb58-460d-82ca-c1fef41a70b1 tempest-VolumesTestJSON-226431309 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 13:57:38 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-33b6ebf2-bb58-460d-82ca-c1fef41a70b1 tempest-VolumesTestJSON-226431309 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:57:38 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-33b6ebf2-bb58-460d-82ca-c1fef41a70b1 tempest-VolumesTestJSON-226431309 None] Selected osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 13:57:38 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-33b6ebf2-bb58-460d-82ca-c1fef41a70b1 tempest-VolumesTestJSON-226431309 None] casted to osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 Jul 13 13:57:38 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-33b6ebf2-bb58-460d-82ca-c1fef41a70b1 tempest-VolumesTestJSON-226431309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-320fad0b-4561-45c9-b534-ba27dfa756c1 1073741824 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:57:38 devstack sudo[97994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-320fad0b-4561-45c9-b534-ba27dfa756c1 1073741824 Jul 13 13:57:38 devstack sudo[97994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:57:38 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-92402804-b27d-4188-84ac-84e5def22bc7 tempest-VolumesGetTest-148886235 None] Acquiring lock "cinder-16089004-076e-4d2a-8dae-9f761f0934de-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 13:57:38 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-92402804-b27d-4188-84ac-84e5def22bc7 tempest-VolumesGetTest-148886235 None] Lock "cinder-16089004-076e-4d2a-8dae-9f761f0934de-delete_volume" acquired by "delete_volume" :: waited 0.086s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 13:57:38 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-92402804-b27d-4188-84ac-84e5def22bc7 tempest-VolumesGetTest-148886235 None] Acquiring lock "cinder-quobyte-16089004-076e-4d2a-8dae-9f761f0934de" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 13:57:39 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-92402804-b27d-4188-84ac-84e5def22bc7 tempest-VolumesGetTest-148886235 None] Lock "cinder-quobyte-16089004-076e-4d2a-8dae-9f761f0934de" acquired by "delete_volume" :: waited 0.031s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 13:57:39 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c7f1b68-c2fc-477b-bced-94f5f62078e1]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 13:57:39 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-92402804-b27d-4188-84ac-84e5def22bc7 tempest-VolumesGetTest-148886235 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-16089004-076e-4d2a-8dae-9f761f0934de {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:57:39 devstack sudo[97999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-16089004-076e-4d2a-8dae-9f761f0934de Jul 13 13:57:39 devstack sudo[97999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:57:39 devstack sudo[97994]: pam_unix(sudo:session): session closed for user root Jul 13 13:57:39 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-33b6ebf2-bb58-460d-82ca-c1fef41a70b1 tempest-VolumesTestJSON-226431309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-320fad0b-4561-45c9-b534-ba27dfa756c1 1073741824" returned: 0 in 0.865s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:57:39 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-33b6ebf2-bb58-460d-82ca-c1fef41a70b1 tempest-VolumesTestJSON-226431309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-320fad0b-4561-45c9-b534-ba27dfa756c1 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:57:39 devstack sudo[98002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-320fad0b-4561-45c9-b534-ba27dfa756c1 Jul 13 13:57:39 devstack sudo[98002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:57:39 devstack sudo[97999]: pam_unix(sudo:session): session closed for user root Jul 13 13:57:39 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-92402804-b27d-4188-84ac-84e5def22bc7 tempest-VolumesGetTest-148886235 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-16089004-076e-4d2a-8dae-9f761f0934de" returned: 0 in 0.767s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:57:39 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-92402804-b27d-4188-84ac-84e5def22bc7 tempest-VolumesGetTest-148886235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-16089004-076e-4d2a-8dae-9f761f0934de {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:57:39 devstack sudo[98007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-16089004-076e-4d2a-8dae-9f761f0934de Jul 13 13:57:39 devstack sudo[98007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:57:39 devstack sudo[98002]: pam_unix(sudo:session): session closed for user root Jul 13 13:57:39 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-33b6ebf2-bb58-460d-82ca-c1fef41a70b1 tempest-VolumesTestJSON-226431309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-320fad0b-4561-45c9-b534-ba27dfa756c1" returned: 0 in 0.504s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:57:39 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-33b6ebf2-bb58-460d-82ca-c1fef41a70b1 tempest-VolumesTestJSON-226431309 None] <== create_volume: return (1461ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'} {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 13 13:57:39 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-33b6ebf2-bb58-460d-82ca-c1fef41a70b1 tempest-VolumesTestJSON-226431309 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.471s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:57:40 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-33b6ebf2-bb58-460d-82ca-c1fef41a70b1 tempest-VolumesTestJSON-226431309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b07bf7e5-0d45-4d63-888a-46060c4bbb45) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-320fad0b-4561-45c9-b534-ba27dfa756c1', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:57:40 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-33b6ebf2-bb58-460d-82ca-c1fef41a70b1 tempest-VolumesTestJSON-226431309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7af6d3f0-9af5-4651-bd9b-a8afece39abe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:57:40 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-33b6ebf2-bb58-460d-82ca-c1fef41a70b1 tempest-VolumesTestJSON-226431309 None] Volume volume-320fad0b-4561-45c9-b534-ba27dfa756c1 (320fad0b-4561-45c9-b534-ba27dfa756c1): created successfully Jul 13 13:57:40 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-33b6ebf2-bb58-460d-82ca-c1fef41a70b1 tempest-VolumesTestJSON-226431309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7af6d3f0-9af5-4651-bd9b-a8afece39abe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:57:40 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-33b6ebf2-bb58-460d-82ca-c1fef41a70b1 tempest-VolumesTestJSON-226431309 None] Flow 'volume_create_manager' (578c3005-32bd-41b5-98ae-7089c5f15535) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 13:57:40 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-33b6ebf2-bb58-460d-82ca-c1fef41a70b1 tempest-VolumesTestJSON-226431309 None] Created volume successfully. Jul 13 13:57:40 devstack sudo[98007]: pam_unix(sudo:session): session closed for user root Jul 13 13:57:40 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-92402804-b27d-4188-84ac-84e5def22bc7 tempest-VolumesGetTest-148886235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-16089004-076e-4d2a-8dae-9f761f0934de" returned: 0 in 0.455s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:57:40 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-92402804-b27d-4188-84ac-84e5def22bc7 tempest-VolumesGetTest-148886235 None] Lock "cinder-quobyte-16089004-076e-4d2a-8dae-9f761f0934de" released by "delete_volume" :: held 1.297s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 13:57:40 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-92402804-b27d-4188-84ac-84e5def22bc7 tempest-VolumesGetTest-148886235 None] Created reservations ['0a5249da-6263-4b93-bdfa-c6afd1457225', 'b461e004-35d2-441b-8257-b0c724d23f80', 'cb1ba7fe-d826-44fc-9603-f084b5e0e69d', '77a90bd3-cbc0-4b44-82e4-d0d9644d3638'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 13:57:40 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-92402804-b27d-4188-84ac-84e5def22bc7 tempest-VolumesGetTest-148886235 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:57:40 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-92402804-b27d-4188-84ac-84e5def22bc7 tempest-VolumesGetTest-148886235 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:57:40 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-92402804-b27d-4188-84ac-84e5def22bc7 tempest-VolumesGetTest-148886235 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 13:57:40 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-92402804-b27d-4188-84ac-84e5def22bc7 tempest-VolumesGetTest-148886235 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 13:57:40 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-92402804-b27d-4188-84ac-84e5def22bc7 tempest-VolumesGetTest-148886235 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:57:40 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-92402804-b27d-4188-84ac-84e5def22bc7 tempest-VolumesGetTest-148886235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:57:40 devstack sudo[98011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 Jul 13 13:57:40 devstack sudo[98011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:57:40 devstack sudo[98011]: pam_unix(sudo:session): session closed for user root Jul 13 13:57:40 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-92402804-b27d-4188-84ac-84e5def22bc7 tempest-VolumesGetTest-148886235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78" returned: 0 in 0.426s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:57:40 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-92402804-b27d-4188-84ac-84e5def22bc7 tempest-VolumesGetTest-148886235 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 13:57:40 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-92402804-b27d-4188-84ac-84e5def22bc7 tempest-VolumesGetTest-148886235 None] Deleted volume successfully. Jul 13 13:57:41 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-92402804-b27d-4188-84ac-84e5def22bc7 tempest-VolumesGetTest-148886235 None] Lock "cinder-16089004-076e-4d2a-8dae-9f761f0934de-delete_volume" released by "delete_volume" :: held 2.109s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 13:57:41 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-8f58ad15-d57b-4398-aac1-2c43907327e6 tempest-VolumesGetTest-148886235 None] Acquiring lock "cinder-47ee3913-9bbd-4202-922d-832e2a28dfc6-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 13:57:41 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-8f58ad15-d57b-4398-aac1-2c43907327e6 tempest-VolumesGetTest-148886235 None] Lock "cinder-47ee3913-9bbd-4202-922d-832e2a28dfc6-delete_volume" acquired by "delete_volume" :: waited 0.073s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 13:57:41 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-8f58ad15-d57b-4398-aac1-2c43907327e6 tempest-VolumesGetTest-148886235 None] Acquiring lock "cinder-quobyte-47ee3913-9bbd-4202-922d-832e2a28dfc6" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 13:57:41 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-8f58ad15-d57b-4398-aac1-2c43907327e6 tempest-VolumesGetTest-148886235 None] Lock "cinder-quobyte-47ee3913-9bbd-4202-922d-832e2a28dfc6" acquired by "delete_volume" :: waited 0.034s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 13:57:41 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4c2d058-4bad-4049-806e-e22543dd6843]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 13:57:41 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-8f58ad15-d57b-4398-aac1-2c43907327e6 tempest-VolumesGetTest-148886235 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-47ee3913-9bbd-4202-922d-832e2a28dfc6 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:57:41 devstack sudo[98015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-47ee3913-9bbd-4202-922d-832e2a28dfc6 Jul 13 13:57:41 devstack sudo[98015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:57:42 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-276b8f14-28b4-47d1-ac3d-c32d489ec57c tempest-VolumesTestJSON-226431309 None] Acquiring lock "cinder-320fad0b-4561-45c9-b534-ba27dfa756c1-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 13:57:42 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-276b8f14-28b4-47d1-ac3d-c32d489ec57c tempest-VolumesTestJSON-226431309 None] Lock "cinder-320fad0b-4561-45c9-b534-ba27dfa756c1-delete_volume" acquired by "delete_volume" :: waited 0.067s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 13:57:42 devstack sudo[98015]: pam_unix(sudo:session): session closed for user root Jul 13 13:57:42 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-8f58ad15-d57b-4398-aac1-2c43907327e6 tempest-VolumesGetTest-148886235 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-47ee3913-9bbd-4202-922d-832e2a28dfc6" returned: 0 in 0.957s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:57:42 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-8f58ad15-d57b-4398-aac1-2c43907327e6 tempest-VolumesGetTest-148886235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-47ee3913-9bbd-4202-922d-832e2a28dfc6 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:57:42 devstack sudo[98023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-47ee3913-9bbd-4202-922d-832e2a28dfc6 Jul 13 13:57:42 devstack sudo[98023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:57:42 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-276b8f14-28b4-47d1-ac3d-c32d489ec57c tempest-VolumesTestJSON-226431309 None] Acquiring lock "cinder-quobyte-320fad0b-4561-45c9-b534-ba27dfa756c1" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 13:57:42 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-276b8f14-28b4-47d1-ac3d-c32d489ec57c tempest-VolumesTestJSON-226431309 None] Lock "cinder-quobyte-320fad0b-4561-45c9-b534-ba27dfa756c1" acquired by "delete_volume" :: waited 0.043s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 13:57:42 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1cfb0f1-2411-4c26-9509-411a25d55cb0]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 13:57:42 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-276b8f14-28b4-47d1-ac3d-c32d489ec57c tempest-VolumesTestJSON-226431309 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-320fad0b-4561-45c9-b534-ba27dfa756c1 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:57:43 devstack sudo[98025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-320fad0b-4561-45c9-b534-ba27dfa756c1 Jul 13 13:57:43 devstack sudo[98025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:57:43 devstack sudo[98023]: pam_unix(sudo:session): session closed for user root Jul 13 13:57:43 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-8f58ad15-d57b-4398-aac1-2c43907327e6 tempest-VolumesGetTest-148886235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-47ee3913-9bbd-4202-922d-832e2a28dfc6" returned: 0 in 0.640s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:57:43 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-8f58ad15-d57b-4398-aac1-2c43907327e6 tempest-VolumesGetTest-148886235 None] Lock "cinder-quobyte-47ee3913-9bbd-4202-922d-832e2a28dfc6" released by "delete_volume" :: held 1.770s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 13:57:43 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-8f58ad15-d57b-4398-aac1-2c43907327e6 tempest-VolumesGetTest-148886235 None] Created reservations ['7546bcea-ab4b-4b55-8816-b791f7f8e9ad', 'c02ff273-e35f-40ec-8bfb-704f21a61c0d', '264349f8-2a3a-4a4e-a050-ba5bdb734154', 'c2dea9c6-1274-4598-b04f-805d41587924'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 13:57:43 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-8f58ad15-d57b-4398-aac1-2c43907327e6 tempest-VolumesGetTest-148886235 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:57:43 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-8f58ad15-d57b-4398-aac1-2c43907327e6 tempest-VolumesGetTest-148886235 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.009s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:57:43 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-8f58ad15-d57b-4398-aac1-2c43907327e6 tempest-VolumesGetTest-148886235 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 13:57:43 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-8f58ad15-d57b-4398-aac1-2c43907327e6 tempest-VolumesGetTest-148886235 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 13:57:43 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-8f58ad15-d57b-4398-aac1-2c43907327e6 tempest-VolumesGetTest-148886235 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.035s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:57:43 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-8f58ad15-d57b-4398-aac1-2c43907327e6 tempest-VolumesGetTest-148886235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:57:43 devstack sudo[98031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 Jul 13 13:57:43 devstack sudo[98031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:57:43 devstack sudo[98025]: pam_unix(sudo:session): session closed for user root Jul 13 13:57:43 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-276b8f14-28b4-47d1-ac3d-c32d489ec57c tempest-VolumesTestJSON-226431309 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-320fad0b-4561-45c9-b534-ba27dfa756c1" returned: 0 in 0.959s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:57:43 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-276b8f14-28b4-47d1-ac3d-c32d489ec57c tempest-VolumesTestJSON-226431309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-320fad0b-4561-45c9-b534-ba27dfa756c1 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:57:43 devstack sudo[98033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-320fad0b-4561-45c9-b534-ba27dfa756c1 Jul 13 13:57:43 devstack sudo[98033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:57:43 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-e5d6e34f-d9f2-4168-9920-36b475bfb118 tempest-VolumesMetadataTest-907872926 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 13:57:43 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-e5d6e34f-d9f2-4168-9920-36b475bfb118 tempest-VolumesMetadataTest-907872926 None] Flow 'volume_create_manager' (f2b03c43-a2b8-429e-ac72-34a6e7235cb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 13:57:44 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-e5d6e34f-d9f2-4168-9920-36b475bfb118 tempest-VolumesMetadataTest-907872926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76429b7e-3fa4-4d18-a360-05c960ab33bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:57:44 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-e5d6e34f-d9f2-4168-9920-36b475bfb118 tempest-VolumesMetadataTest-907872926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76429b7e-3fa4-4d18-a360-05c960ab33bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T11:57:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1749739251',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95f507df-02d0-4b71-9184-17d35c9b51b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d22d59bacc4b4a6193ee491cf4bd1ff8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T11:57:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T11:57:44Z,use_quota=True,user_id='fe061f0faebc4bd3a615ea8130a38a54',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1147de8b-623b-426c-a13d-7fc824a80f67),volume_type_id=1147de8b-623b-426c-a13d-7fc824a80f67)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:57:44 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-e5d6e34f-d9f2-4168-9920-36b475bfb118 tempest-VolumesMetadataTest-907872926 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77fe3d26-792e-403f-b9f4-251e69ae3725) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:57:44 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-e5d6e34f-d9f2-4168-9920-36b475bfb118 tempest-VolumesMetadataTest-907872926 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77fe3d26-792e-403f-b9f4-251e69ae3725) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:57:44 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-e5d6e34f-d9f2-4168-9920-36b475bfb118 tempest-VolumesMetadataTest-907872926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c33b4c9c-784a-40e9-b05e-e9aa49db46bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:57:44 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-e5d6e34f-d9f2-4168-9920-36b475bfb118 tempest-VolumesMetadataTest-907872926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c33b4c9c-784a-40e9-b05e-e9aa49db46bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '95f507df-02d0-4b71-9184-17d35c9b51b2', 'volume_name': 'volume-95f507df-02d0-4b71-9184-17d35c9b51b2', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:57:44 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-e5d6e34f-d9f2-4168-9920-36b475bfb118 tempest-VolumesMetadataTest-907872926 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (287c84d6-7834-4a39-9926-c0aa4af09ac1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:57:44 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-e5d6e34f-d9f2-4168-9920-36b475bfb118 tempest-VolumesMetadataTest-907872926 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (287c84d6-7834-4a39-9926-c0aa4af09ac1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:57:44 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-e5d6e34f-d9f2-4168-9920-36b475bfb118 tempest-VolumesMetadataTest-907872926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26c7aa9c-f02f-45bd-bbf0-9a2710fb0be5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:57:44 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-e5d6e34f-d9f2-4168-9920-36b475bfb118 tempest-VolumesMetadataTest-907872926 None] Volume 95f507df-02d0-4b71-9184-17d35c9b51b2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-95f507df-02d0-4b71-9184-17d35c9b51b2', 'volume_size': 1} Jul 13 13:57:44 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-e5d6e34f-d9f2-4168-9920-36b475bfb118 tempest-VolumesMetadataTest-907872926 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:57:44 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-e5d6e34f-d9f2-4168-9920-36b475bfb118 tempest-VolumesMetadataTest-907872926 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:57:44 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-e5d6e34f-d9f2-4168-9920-36b475bfb118 tempest-VolumesMetadataTest-907872926 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T11:57:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1749739251',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95f507df-02d0-4b71-9184-17d35c9b51b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d22d59bacc4b4a6193ee491cf4bd1ff8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T11:57:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T11:57:44Z,use_quota=True,user_id='fe061f0faebc4bd3a615ea8130a38a54',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1147de8b-623b-426c-a13d-7fc824a80f67),volume_type_id=1147de8b-623b-426c-a13d-7fc824a80f67)}" {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 13 13:57:44 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-e5d6e34f-d9f2-4168-9920-36b475bfb118 tempest-VolumesMetadataTest-907872926 None] Creating volume 95f507df-02d0-4b71-9184-17d35c9b51b2 {{(pid=87098) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 13 13:57:44 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-e5d6e34f-d9f2-4168-9920-36b475bfb118 tempest-VolumesMetadataTest-907872926 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:57:44 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-e5d6e34f-d9f2-4168-9920-36b475bfb118 tempest-VolumesMetadataTest-907872926 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:57:44 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-e5d6e34f-d9f2-4168-9920-36b475bfb118 tempest-VolumesMetadataTest-907872926 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 13:57:44 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-e5d6e34f-d9f2-4168-9920-36b475bfb118 tempest-VolumesMetadataTest-907872926 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 13:57:44 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-e5d6e34f-d9f2-4168-9920-36b475bfb118 tempest-VolumesMetadataTest-907872926 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:57:44 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-e5d6e34f-d9f2-4168-9920-36b475bfb118 tempest-VolumesMetadataTest-907872926 None] Selected osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 13:57:44 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-e5d6e34f-d9f2-4168-9920-36b475bfb118 tempest-VolumesMetadataTest-907872926 None] casted to osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 Jul 13 13:57:44 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-e5d6e34f-d9f2-4168-9920-36b475bfb118 tempest-VolumesMetadataTest-907872926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-95f507df-02d0-4b71-9184-17d35c9b51b2 1073741824 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:57:44 devstack sudo[98031]: pam_unix(sudo:session): session closed for user root Jul 13 13:57:44 devstack sudo[98036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-95f507df-02d0-4b71-9184-17d35c9b51b2 1073741824 Jul 13 13:57:44 devstack sudo[98036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:57:44 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-8f58ad15-d57b-4398-aac1-2c43907327e6 tempest-VolumesGetTest-148886235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78" returned: 0 in 0.540s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:57:44 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-8f58ad15-d57b-4398-aac1-2c43907327e6 tempest-VolumesGetTest-148886235 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 13:57:44 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-8f58ad15-d57b-4398-aac1-2c43907327e6 tempest-VolumesGetTest-148886235 None] Deleted volume successfully. Jul 13 13:57:44 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-8f58ad15-d57b-4398-aac1-2c43907327e6 tempest-VolumesGetTest-148886235 None] Lock "cinder-47ee3913-9bbd-4202-922d-832e2a28dfc6-delete_volume" released by "delete_volume" :: held 2.890s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 13:57:44 devstack sudo[98033]: pam_unix(sudo:session): session closed for user root Jul 13 13:57:44 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-276b8f14-28b4-47d1-ac3d-c32d489ec57c tempest-VolumesTestJSON-226431309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-320fad0b-4561-45c9-b534-ba27dfa756c1" returned: 0 in 0.495s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:57:44 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-276b8f14-28b4-47d1-ac3d-c32d489ec57c tempest-VolumesTestJSON-226431309 None] Lock "cinder-quobyte-320fad0b-4561-45c9-b534-ba27dfa756c1" released by "delete_volume" :: held 1.595s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 13:57:44 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-276b8f14-28b4-47d1-ac3d-c32d489ec57c tempest-VolumesTestJSON-226431309 None] Created reservations ['6eddf84b-ff1a-4bbe-81c3-f1a1f8a7f3fa', '5db771db-7a96-4d8c-8388-8628238b5cae', '199d5553-8830-4428-948f-081231ea0f90', '8e2b1d14-6038-41f3-b7ff-efcbf734e429'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 13:57:44 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-276b8f14-28b4-47d1-ac3d-c32d489ec57c tempest-VolumesTestJSON-226431309 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:57:44 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-276b8f14-28b4-47d1-ac3d-c32d489ec57c tempest-VolumesTestJSON-226431309 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:57:44 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-276b8f14-28b4-47d1-ac3d-c32d489ec57c tempest-VolumesTestJSON-226431309 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 13:57:44 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-276b8f14-28b4-47d1-ac3d-c32d489ec57c tempest-VolumesTestJSON-226431309 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 13:57:44 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-276b8f14-28b4-47d1-ac3d-c32d489ec57c tempest-VolumesTestJSON-226431309 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:57:44 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-276b8f14-28b4-47d1-ac3d-c32d489ec57c tempest-VolumesTestJSON-226431309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:57:44 devstack sudo[98042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 Jul 13 13:57:44 devstack sudo[98042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:57:45 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-975228f7-a4b1-4c48-a831-e65b6a60aa77 tempest-VolumesTestJSON-226431309 None] Acquiring lock "cinder-fd99e52b-cbc5-4aeb-b959-87732b4a4674-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 13:57:45 devstack sudo[98036]: pam_unix(sudo:session): session closed for user root Jul 13 13:57:45 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-975228f7-a4b1-4c48-a831-e65b6a60aa77 tempest-VolumesTestJSON-226431309 None] Lock "cinder-fd99e52b-cbc5-4aeb-b959-87732b4a4674-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 13:57:45 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-e5d6e34f-d9f2-4168-9920-36b475bfb118 tempest-VolumesMetadataTest-907872926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-95f507df-02d0-4b71-9184-17d35c9b51b2 1073741824" returned: 0 in 0.925s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:57:45 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-975228f7-a4b1-4c48-a831-e65b6a60aa77 tempest-VolumesTestJSON-226431309 None] Acquiring lock "cinder-quobyte-fd99e52b-cbc5-4aeb-b959-87732b4a4674" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 13:57:45 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-e5d6e34f-d9f2-4168-9920-36b475bfb118 tempest-VolumesMetadataTest-907872926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-95f507df-02d0-4b71-9184-17d35c9b51b2 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:57:45 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-975228f7-a4b1-4c48-a831-e65b6a60aa77 tempest-VolumesTestJSON-226431309 None] Lock "cinder-quobyte-fd99e52b-cbc5-4aeb-b959-87732b4a4674" acquired by "delete_volume" :: waited 0.073s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 13:57:45 devstack sudo[98046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-95f507df-02d0-4b71-9184-17d35c9b51b2 Jul 13 13:57:45 devstack sudo[98046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:57:45 devstack sudo[98042]: pam_unix(sudo:session): session closed for user root Jul 13 13:57:45 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-276b8f14-28b4-47d1-ac3d-c32d489ec57c tempest-VolumesTestJSON-226431309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78" returned: 0 in 0.561s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:57:45 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-276b8f14-28b4-47d1-ac3d-c32d489ec57c tempest-VolumesTestJSON-226431309 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 13:57:45 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-276b8f14-28b4-47d1-ac3d-c32d489ec57c tempest-VolumesTestJSON-226431309 None] Deleted volume successfully. Jul 13 13:57:45 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[2075d4ae-1e1e-4b54-8f77-fb17910f0029]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 13:57:45 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-975228f7-a4b1-4c48-a831-e65b6a60aa77 tempest-VolumesTestJSON-226431309 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-fd99e52b-cbc5-4aeb-b959-87732b4a4674 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:57:45 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-276b8f14-28b4-47d1-ac3d-c32d489ec57c tempest-VolumesTestJSON-226431309 None] Lock "cinder-320fad0b-4561-45c9-b534-ba27dfa756c1-delete_volume" released by "delete_volume" :: held 2.820s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 13:57:45 devstack sudo[98046]: pam_unix(sudo:session): session closed for user root Jul 13 13:57:45 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-e5d6e34f-d9f2-4168-9920-36b475bfb118 tempest-VolumesMetadataTest-907872926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-95f507df-02d0-4b71-9184-17d35c9b51b2" returned: 0 in 0.391s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:57:45 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-e5d6e34f-d9f2-4168-9920-36b475bfb118 tempest-VolumesMetadataTest-907872926 None] <== create_volume: return (1460ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'} {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 13 13:57:45 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-e5d6e34f-d9f2-4168-9920-36b475bfb118 tempest-VolumesMetadataTest-907872926 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.468s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:57:45 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-07997679-b128-471f-8171-f826d30706d9 tempest-VolumesGetTest-148886235 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 13:57:45 devstack sudo[98048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-fd99e52b-cbc5-4aeb-b959-87732b4a4674 Jul 13 13:57:45 devstack sudo[98048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:57:45 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-07997679-b128-471f-8171-f826d30706d9 tempest-VolumesGetTest-148886235 None] Flow 'volume_create_manager' (67779fa5-4a39-4454-9e12-471b0672db2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 13:57:45 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-07997679-b128-471f-8171-f826d30706d9 tempest-VolumesGetTest-148886235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ff60be3-3e11-4953-9a91-310f82ed4568) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:57:45 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-e5d6e34f-d9f2-4168-9920-36b475bfb118 tempest-VolumesMetadataTest-907872926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26c7aa9c-f02f-45bd-bbf0-9a2710fb0be5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-95f507df-02d0-4b71-9184-17d35c9b51b2', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:57:45 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-e5d6e34f-d9f2-4168-9920-36b475bfb118 tempest-VolumesMetadataTest-907872926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24932b9d-31ba-47f8-ae5e-06410c89843f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:57:45 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-07997679-b128-471f-8171-f826d30706d9 tempest-VolumesGetTest-148886235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ff60be3-3e11-4953-9a91-310f82ed4568) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T11:57:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-666196360',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c63ed65-b760-43a3-b640-b76a9599340f,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='fce5cc7d83924cda908696f4e23b92f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T11:57:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T11:57:45Z,use_quota=True,user_id='9b36f110e7f84651be59cde67a7b41e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1147de8b-623b-426c-a13d-7fc824a80f67),volume_type_id=1147de8b-623b-426c-a13d-7fc824a80f67)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:57:45 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-07997679-b128-471f-8171-f826d30706d9 tempest-VolumesGetTest-148886235 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf3430fc-50a9-4428-9b64-e617cc9bcd46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:57:45 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-07997679-b128-471f-8171-f826d30706d9 tempest-VolumesGetTest-148886235 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf3430fc-50a9-4428-9b64-e617cc9bcd46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:57:45 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-07997679-b128-471f-8171-f826d30706d9 tempest-VolumesGetTest-148886235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (242b3221-1873-4595-9fb4-fa2087e4e7c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:57:45 devstack cinder-volume[87098]: DEBUG cinder.image.glance [None req-07997679-b128-471f-8171-f826d30706d9 tempest-VolumesGetTest-148886235 None] Creating Keystone auth plugin from conf {{(pid=87098) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 13 13:57:45 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-e5d6e34f-d9f2-4168-9920-36b475bfb118 tempest-VolumesMetadataTest-907872926 None] Volume volume-95f507df-02d0-4b71-9184-17d35c9b51b2 (95f507df-02d0-4b71-9184-17d35c9b51b2): created successfully Jul 13 13:57:45 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-e5d6e34f-d9f2-4168-9920-36b475bfb118 tempest-VolumesMetadataTest-907872926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24932b9d-31ba-47f8-ae5e-06410c89843f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:57:45 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-e5d6e34f-d9f2-4168-9920-36b475bfb118 tempest-VolumesMetadataTest-907872926 None] Flow 'volume_create_manager' (f2b03c43-a2b8-429e-ac72-34a6e7235cb3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 13:57:45 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-e5d6e34f-d9f2-4168-9920-36b475bfb118 tempest-VolumesMetadataTest-907872926 None] Created volume successfully. Jul 13 13:57:46 devstack sudo[98048]: pam_unix(sudo:session): session closed for user root Jul 13 13:57:46 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-975228f7-a4b1-4c48-a831-e65b6a60aa77 tempest-VolumesTestJSON-226431309 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-fd99e52b-cbc5-4aeb-b959-87732b4a4674" returned: 0 in 0.737s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:57:46 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-975228f7-a4b1-4c48-a831-e65b6a60aa77 tempest-VolumesTestJSON-226431309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-fd99e52b-cbc5-4aeb-b959-87732b4a4674 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:57:46 devstack sudo[98054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-fd99e52b-cbc5-4aeb-b959-87732b4a4674 Jul 13 13:57:46 devstack sudo[98054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:57:46 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-07997679-b128-471f-8171-f826d30706d9 tempest-VolumesGetTest-148886235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (242b3221-1873-4595-9fb4-fa2087e4e7c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '9c63ed65-b760-43a3-b640-b76a9599340f', 'volume_name': 'volume-9c63ed65-b760-43a3-b640-b76a9599340f', 'volume_size': 1, 'image_id': 'def20bd7-001f-4245-a717-37b9a4cc8574', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/def20bd7-001f-4245-a717-37b9a4cc8574', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '2181cd3fc958400682584829a80e727e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'def20bd7-001f-4245-a717-37b9a4cc8574', 'created_at': datetime.datetime(2026, 7, 13, 11, 42, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 13, 11, 42, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/def20bd7-001f-4245-a717-37b9a4cc8574/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:57:46 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-07997679-b128-471f-8171-f826d30706d9 tempest-VolumesGetTest-148886235 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1abf6c3f-28fa-4959-9c46-f3676d6521c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:57:46 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-07997679-b128-471f-8171-f826d30706d9 tempest-VolumesGetTest-148886235 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1abf6c3f-28fa-4959-9c46-f3676d6521c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:57:46 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-07997679-b128-471f-8171-f826d30706d9 tempest-VolumesGetTest-148886235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8558cdf6-2e2b-4486-9058-8816ce846ca5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:57:46 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-07997679-b128-471f-8171-f826d30706d9 tempest-VolumesGetTest-148886235 None] Volume 9c63ed65-b760-43a3-b640-b76a9599340f: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-9c63ed65-b760-43a3-b640-b76a9599340f', 'volume_size': 1, 'image_id': 'def20bd7-001f-4245-a717-37b9a4cc8574', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/def20bd7-001f-4245-a717-37b9a4cc8574', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '2181cd3fc958400682584829a80e727e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'def20bd7-001f-4245-a717-37b9a4cc8574', 'created_at': datetime.datetime(2026, 7, 13, 11, 42, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 13, 11, 42, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/def20bd7-001f-4245-a717-37b9a4cc8574/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 13 13:57:46 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-07997679-b128-471f-8171-f826d30706d9 tempest-VolumesGetTest-148886235 None] Trying to clone 9c63ed65-b760-43a3-b640-b76a9599340f from image def20bd7-001f-4245-a717-37b9a4cc8574 at location (None, [{'url': 'file:///opt/stack/data/glance/images/def20bd7-001f-4245-a717-37b9a4cc8574', 'metadata': {}}]). {{(pid=87098) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 13 13:57:46 devstack sudo[98054]: pam_unix(sudo:session): session closed for user root Jul 13 13:57:46 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-975228f7-a4b1-4c48-a831-e65b6a60aa77 tempest-VolumesTestJSON-226431309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-fd99e52b-cbc5-4aeb-b959-87732b4a4674" returned: 0 in 0.429s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:57:46 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-975228f7-a4b1-4c48-a831-e65b6a60aa77 tempest-VolumesTestJSON-226431309 None] Lock "cinder-quobyte-fd99e52b-cbc5-4aeb-b959-87732b4a4674" released by "delete_volume" :: held 1.300s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 13:57:46 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-975228f7-a4b1-4c48-a831-e65b6a60aa77 tempest-VolumesTestJSON-226431309 None] Created reservations ['8ad670dd-169a-44e6-8d13-1ec98cca44c0', 'fcce7653-1d8f-47e5-9be9-ba5246b9b76d', '6a3f39fa-7d9e-42b8-97c2-41121a74e1b6', 'a492182c-2990-4a07-8fe2-21c34787e39e'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 13:57:46 devstack cinder-volume[87098]: DEBUG cinder.image.image_utils [None req-07997679-b128-471f-8171-f826d30706d9 tempest-VolumesGetTest-148886235 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_def20bd7-001f-4245-a717-37b9a4cc8574_yjil87m3devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87098) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 13 13:57:46 devstack cinder-volume[87098]: INFO cinder.image.image_utils [None req-07997679-b128-471f-8171-f826d30706d9 tempest-VolumesGetTest-148886235 None] Image download 20.69 MB at 20.69 MB/s Jul 13 13:57:46 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-975228f7-a4b1-4c48-a831-e65b6a60aa77 tempest-VolumesTestJSON-226431309 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:57:46 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-975228f7-a4b1-4c48-a831-e65b6a60aa77 tempest-VolumesTestJSON-226431309 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:57:46 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-975228f7-a4b1-4c48-a831-e65b6a60aa77 tempest-VolumesTestJSON-226431309 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 13:57:46 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-975228f7-a4b1-4c48-a831-e65b6a60aa77 tempest-VolumesTestJSON-226431309 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 13:57:46 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-975228f7-a4b1-4c48-a831-e65b6a60aa77 tempest-VolumesTestJSON-226431309 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:57:46 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-975228f7-a4b1-4c48-a831-e65b6a60aa77 tempest-VolumesTestJSON-226431309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:57:46 devstack sudo[98059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 Jul 13 13:57:46 devstack sudo[98059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:57:46 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[2795f8d1-9524-41d0-9dbc-a298ad2fe699]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 13:57:46 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-07997679-b128-471f-8171-f826d30706d9 tempest-VolumesGetTest-148886235 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_def20bd7-001f-4245-a717-37b9a4cc8574_yjil87m3devstack@QuobyteHD {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:57:47 devstack sudo[98061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_def20bd7-001f-4245-a717-37b9a4cc8574_yjil87m3devstack@QuobyteHD Jul 13 13:57:47 devstack sudo[98061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:57:47 devstack sudo[98059]: pam_unix(sudo:session): session closed for user root Jul 13 13:57:47 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-975228f7-a4b1-4c48-a831-e65b6a60aa77 tempest-VolumesTestJSON-226431309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78" returned: 0 in 0.469s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:57:47 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-975228f7-a4b1-4c48-a831-e65b6a60aa77 tempest-VolumesTestJSON-226431309 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 13:57:47 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-975228f7-a4b1-4c48-a831-e65b6a60aa77 tempest-VolumesTestJSON-226431309 None] Deleted volume successfully. Jul 13 13:57:47 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-975228f7-a4b1-4c48-a831-e65b6a60aa77 tempest-VolumesTestJSON-226431309 None] Lock "cinder-fd99e52b-cbc5-4aeb-b959-87732b4a4674-delete_volume" released by "delete_volume" :: held 2.411s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 13:57:47 devstack sudo[98061]: pam_unix(sudo:session): session closed for user root Jul 13 13:57:47 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-f1ec1a18-d6c3-4302-b435-1cd9a081b67b tempest-VolumesTestJSON-226431309 None] Acquiring lock "cinder-08748ff3-4c05-4001-ab9a-ab8daaee4588-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 13:57:47 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-07997679-b128-471f-8171-f826d30706d9 tempest-VolumesGetTest-148886235 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_def20bd7-001f-4245-a717-37b9a4cc8574_yjil87m3devstack@QuobyteHD" returned: 0 in 0.533s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:57:47 devstack cinder-volume[87098]: DEBUG cinder.image.image_utils [None req-07997679-b128-471f-8171-f826d30706d9 tempest-VolumesGetTest-148886235 None] Temporary image def20bd7-001f-4245-a717-37b9a4cc8574 is fetched for user 9b36f110e7f84651be59cde67a7b41e3. {{(pid=87098) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 13 13:57:47 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-f1ec1a18-d6c3-4302-b435-1cd9a081b67b tempest-VolumesTestJSON-226431309 None] Lock "cinder-08748ff3-4c05-4001-ab9a-ab8daaee4588-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 13:57:47 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-f1ec1a18-d6c3-4302-b435-1cd9a081b67b tempest-VolumesTestJSON-226431309 None] Acquiring lock "cinder-quobyte-08748ff3-4c05-4001-ab9a-ab8daaee4588" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 13:57:47 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-f1ec1a18-d6c3-4302-b435-1cd9a081b67b tempest-VolumesTestJSON-226431309 None] Lock "cinder-quobyte-08748ff3-4c05-4001-ab9a-ab8daaee4588" acquired by "delete_volume" :: waited 0.038s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 13:57:47 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[7746e597-ddb1-488b-9aaf-11b18f009ed0]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 13:57:47 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-f1ec1a18-d6c3-4302-b435-1cd9a081b67b tempest-VolumesTestJSON-226431309 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-08748ff3-4c05-4001-ab9a-ab8daaee4588 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:57:47 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[18b9b24b-07d1-429f-85fe-bcc0bba6c87f]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 13:57:47 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-07997679-b128-471f-8171-f826d30706d9 tempest-VolumesGetTest-148886235 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_def20bd7-001f-4245-a717-37b9a4cc8574_yjil87m3devstack@QuobyteHD {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:57:47 devstack sudo[98068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_def20bd7-001f-4245-a717-37b9a4cc8574_yjil87m3devstack@QuobyteHD Jul 13 13:57:47 devstack sudo[98068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:57:47 devstack sudo[98067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-08748ff3-4c05-4001-ab9a-ab8daaee4588 Jul 13 13:57:47 devstack sudo[98067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:57:48 devstack sudo[98067]: pam_unix(sudo:session): session closed for user root Jul 13 13:57:48 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-f1ec1a18-d6c3-4302-b435-1cd9a081b67b tempest-VolumesTestJSON-226431309 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-08748ff3-4c05-4001-ab9a-ab8daaee4588" returned: 0 in 0.638s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:57:48 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-f1ec1a18-d6c3-4302-b435-1cd9a081b67b tempest-VolumesTestJSON-226431309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-08748ff3-4c05-4001-ab9a-ab8daaee4588 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:57:48 devstack sudo[98074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-08748ff3-4c05-4001-ab9a-ab8daaee4588 Jul 13 13:57:48 devstack sudo[98074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:57:48 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-ef5af499-f972-4cb8-9cd0-be685474bb7f tempest-VolumesMetadataTest-907872926 None] Acquiring lock "cinder-95f507df-02d0-4b71-9184-17d35c9b51b2-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 13:57:48 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-ef5af499-f972-4cb8-9cd0-be685474bb7f tempest-VolumesMetadataTest-907872926 None] Lock "cinder-95f507df-02d0-4b71-9184-17d35c9b51b2-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 13:57:48 devstack sudo[98068]: pam_unix(sudo:session): session closed for user root Jul 13 13:57:48 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-07997679-b128-471f-8171-f826d30706d9 tempest-VolumesGetTest-148886235 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_def20bd7-001f-4245-a717-37b9a4cc8574_yjil87m3devstack@QuobyteHD" returned: 0 in 0.730s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:57:48 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-07997679-b128-471f-8171-f826d30706d9 tempest-VolumesGetTest-148886235 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:57:48 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-07997679-b128-471f-8171-f826d30706d9 tempest-VolumesGetTest-148886235 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:57:48 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-07997679-b128-471f-8171-f826d30706d9 tempest-VolumesGetTest-148886235 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T11:57:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-666196360',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c63ed65-b760-43a3-b640-b76a9599340f,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='fce5cc7d83924cda908696f4e23b92f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T11:57:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T11:57:45Z,use_quota=True,user_id='9b36f110e7f84651be59cde67a7b41e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1147de8b-623b-426c-a13d-7fc824a80f67),volume_type_id=1147de8b-623b-426c-a13d-7fc824a80f67)}" {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 13 13:57:48 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-07997679-b128-471f-8171-f826d30706d9 tempest-VolumesGetTest-148886235 None] Creating volume 9c63ed65-b760-43a3-b640-b76a9599340f {{(pid=87098) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 13 13:57:48 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-07997679-b128-471f-8171-f826d30706d9 tempest-VolumesGetTest-148886235 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:57:48 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-07997679-b128-471f-8171-f826d30706d9 tempest-VolumesGetTest-148886235 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:57:48 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-07997679-b128-471f-8171-f826d30706d9 tempest-VolumesGetTest-148886235 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 13:57:48 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-07997679-b128-471f-8171-f826d30706d9 tempest-VolumesGetTest-148886235 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 13:57:48 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-07997679-b128-471f-8171-f826d30706d9 tempest-VolumesGetTest-148886235 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:57:48 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-07997679-b128-471f-8171-f826d30706d9 tempest-VolumesGetTest-148886235 None] Selected osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 13:57:48 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-07997679-b128-471f-8171-f826d30706d9 tempest-VolumesGetTest-148886235 None] casted to osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 Jul 13 13:57:48 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-07997679-b128-471f-8171-f826d30706d9 tempest-VolumesGetTest-148886235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-9c63ed65-b760-43a3-b640-b76a9599340f 1073741824 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:57:48 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-ef5af499-f972-4cb8-9cd0-be685474bb7f tempest-VolumesMetadataTest-907872926 None] Acquiring lock "cinder-quobyte-95f507df-02d0-4b71-9184-17d35c9b51b2" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 13:57:48 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-ef5af499-f972-4cb8-9cd0-be685474bb7f tempest-VolumesMetadataTest-907872926 None] Lock "cinder-quobyte-95f507df-02d0-4b71-9184-17d35c9b51b2" acquired by "delete_volume" :: waited 0.031s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 13:57:48 devstack sudo[98079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-9c63ed65-b760-43a3-b640-b76a9599340f 1073741824 Jul 13 13:57:48 devstack sudo[98079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:57:48 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ebade85-850a-4540-8c14-82c104ac3daf]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 13:57:48 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-ef5af499-f972-4cb8-9cd0-be685474bb7f tempest-VolumesMetadataTest-907872926 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-95f507df-02d0-4b71-9184-17d35c9b51b2 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:57:48 devstack sudo[98074]: pam_unix(sudo:session): session closed for user root Jul 13 13:57:48 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-f1ec1a18-d6c3-4302-b435-1cd9a081b67b tempest-VolumesTestJSON-226431309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-08748ff3-4c05-4001-ab9a-ab8daaee4588" returned: 0 in 0.481s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:57:48 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-f1ec1a18-d6c3-4302-b435-1cd9a081b67b tempest-VolumesTestJSON-226431309 None] Lock "cinder-quobyte-08748ff3-4c05-4001-ab9a-ab8daaee4588" released by "delete_volume" :: held 1.255s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 13:57:48 devstack sudo[98081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-95f507df-02d0-4b71-9184-17d35c9b51b2 Jul 13 13:57:48 devstack sudo[98081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:57:49 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-f1ec1a18-d6c3-4302-b435-1cd9a081b67b tempest-VolumesTestJSON-226431309 None] Created reservations ['a0173c6a-81f5-447e-b236-3b3b0e640e1a', 'cc522b28-72df-4ff5-81d5-f05ef9902db4', '46b466ac-32db-4c7c-afd4-1f7f32e682aa', '95e2ccf9-efc1-4b63-9b1b-dbb889c8087b'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 13:57:49 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-f1ec1a18-d6c3-4302-b435-1cd9a081b67b tempest-VolumesTestJSON-226431309 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:57:49 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-f1ec1a18-d6c3-4302-b435-1cd9a081b67b tempest-VolumesTestJSON-226431309 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:57:49 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-f1ec1a18-d6c3-4302-b435-1cd9a081b67b tempest-VolumesTestJSON-226431309 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 13:57:49 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-f1ec1a18-d6c3-4302-b435-1cd9a081b67b tempest-VolumesTestJSON-226431309 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 13:57:49 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-f1ec1a18-d6c3-4302-b435-1cd9a081b67b tempest-VolumesTestJSON-226431309 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:57:49 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-f1ec1a18-d6c3-4302-b435-1cd9a081b67b tempest-VolumesTestJSON-226431309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:57:49 devstack sudo[98087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 Jul 13 13:57:49 devstack sudo[98087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:57:49 devstack sudo[98081]: pam_unix(sudo:session): session closed for user root Jul 13 13:57:49 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-ef5af499-f972-4cb8-9cd0-be685474bb7f tempest-VolumesMetadataTest-907872926 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-95f507df-02d0-4b71-9184-17d35c9b51b2" returned: 0 in 0.856s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:57:49 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-ef5af499-f972-4cb8-9cd0-be685474bb7f tempest-VolumesMetadataTest-907872926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-95f507df-02d0-4b71-9184-17d35c9b51b2 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:57:49 devstack sudo[98079]: pam_unix(sudo:session): session closed for user root Jul 13 13:57:49 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-07997679-b128-471f-8171-f826d30706d9 tempest-VolumesGetTest-148886235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-9c63ed65-b760-43a3-b640-b76a9599340f 1073741824" returned: 0 in 0.993s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:57:49 devstack sudo[98095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-95f507df-02d0-4b71-9184-17d35c9b51b2 Jul 13 13:57:49 devstack sudo[98095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:57:49 devstack sudo[98087]: pam_unix(sudo:session): session closed for user root Jul 13 13:57:49 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-f1ec1a18-d6c3-4302-b435-1cd9a081b67b tempest-VolumesTestJSON-226431309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78" returned: 0 in 0.419s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:57:49 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-f1ec1a18-d6c3-4302-b435-1cd9a081b67b tempest-VolumesTestJSON-226431309 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 13:57:49 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-f1ec1a18-d6c3-4302-b435-1cd9a081b67b tempest-VolumesTestJSON-226431309 None] Deleted volume successfully. Jul 13 13:57:49 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-07997679-b128-471f-8171-f826d30706d9 tempest-VolumesGetTest-148886235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-9c63ed65-b760-43a3-b640-b76a9599340f {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:57:49 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-f1ec1a18-d6c3-4302-b435-1cd9a081b67b tempest-VolumesTestJSON-226431309 None] Lock "cinder-08748ff3-4c05-4001-ab9a-ab8daaee4588-delete_volume" released by "delete_volume" :: held 2.082s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 13:57:49 devstack sudo[98097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-9c63ed65-b760-43a3-b640-b76a9599340f Jul 13 13:57:49 devstack sudo[98097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:57:49 devstack sudo[98095]: pam_unix(sudo:session): session closed for user root Jul 13 13:57:49 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-ef5af499-f972-4cb8-9cd0-be685474bb7f tempest-VolumesMetadataTest-907872926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-95f507df-02d0-4b71-9184-17d35c9b51b2" returned: 0 in 0.472s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:57:49 devstack sudo[98097]: pam_unix(sudo:session): session closed for user root Jul 13 13:57:49 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-07997679-b128-471f-8171-f826d30706d9 tempest-VolumesGetTest-148886235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-9c63ed65-b760-43a3-b640-b76a9599340f" returned: 0 in 0.358s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:57:49 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-07997679-b128-471f-8171-f826d30706d9 tempest-VolumesGetTest-148886235 None] <== create_volume: return (1466ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'} {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 13 13:57:49 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-07997679-b128-471f-8171-f826d30706d9 tempest-VolumesGetTest-148886235 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.471s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:57:49 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-ef5af499-f972-4cb8-9cd0-be685474bb7f tempest-VolumesMetadataTest-907872926 None] Lock "cinder-quobyte-95f507df-02d0-4b71-9184-17d35c9b51b2" released by "delete_volume" :: held 1.406s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 13:57:50 devstack cinder-volume[87098]: DEBUG cinder.volume.volume_utils [None req-07997679-b128-471f-8171-f826d30706d9 tempest-VolumesGetTest-148886235 None] Attempting download of def20bd7-001f-4245-a717-37b9a4cc8574 ((None, [{'url': 'file:///opt/stack/data/glance/images/def20bd7-001f-4245-a717-37b9a4cc8574', 'metadata': {}}])) to volume 9c63ed65-b760-43a3-b640-b76a9599340f. {{(pid=87098) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 13 13:57:50 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-ef5af499-f972-4cb8-9cd0-be685474bb7f tempest-VolumesMetadataTest-907872926 None] Created reservations ['d57397b9-ca1a-4473-b14b-57b922cd453a', '030cc250-3b98-4665-b54d-77a33b3889e7', '3b48c1ed-31ac-44a5-a95c-07af576ba3de', 'e7411e3f-2f31-496a-ae12-42f7bd4674d4'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 13:57:50 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cc44f81-ddf2-4929-aa1c-a2e4bd64c1f0]: (4, 'raw') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 13:57:50 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-07997679-b128-471f-8171-f826d30706d9 tempest-VolumesGetTest-148886235 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_def20bd7-001f-4245-a717-37b9a4cc8574_rkwwhy9u {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:57:50 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-ef5af499-f972-4cb8-9cd0-be685474bb7f tempest-VolumesMetadataTest-907872926 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:57:50 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-ef5af499-f972-4cb8-9cd0-be685474bb7f tempest-VolumesMetadataTest-907872926 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:57:50 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-ef5af499-f972-4cb8-9cd0-be685474bb7f tempest-VolumesMetadataTest-907872926 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 13:57:50 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-ef5af499-f972-4cb8-9cd0-be685474bb7f tempest-VolumesMetadataTest-907872926 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 13:57:50 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-ef5af499-f972-4cb8-9cd0-be685474bb7f tempest-VolumesMetadataTest-907872926 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:57:50 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-ef5af499-f972-4cb8-9cd0-be685474bb7f tempest-VolumesMetadataTest-907872926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:57:50 devstack sudo[98102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 Jul 13 13:57:50 devstack sudo[98102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:57:50 devstack sudo[98101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_def20bd7-001f-4245-a717-37b9a4cc8574_rkwwhy9u Jul 13 13:57:50 devstack sudo[98101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:57:50 devstack sudo[98101]: pam_unix(sudo:session): session closed for user root Jul 13 13:57:50 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-07997679-b128-471f-8171-f826d30706d9 tempest-VolumesGetTest-148886235 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_def20bd7-001f-4245-a717-37b9a4cc8574_rkwwhy9u" returned: 0 in 0.429s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:57:50 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-07997679-b128-471f-8171-f826d30706d9 tempest-VolumesGetTest-148886235 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_def20bd7-001f-4245-a717-37b9a4cc8574_rkwwhy9u {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:57:50 devstack sudo[98102]: pam_unix(sudo:session): session closed for user root Jul 13 13:57:50 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-ef5af499-f972-4cb8-9cd0-be685474bb7f tempest-VolumesMetadataTest-907872926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78" returned: 0 in 0.364s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:57:50 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-ef5af499-f972-4cb8-9cd0-be685474bb7f tempest-VolumesMetadataTest-907872926 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 13:57:50 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-ef5af499-f972-4cb8-9cd0-be685474bb7f tempest-VolumesMetadataTest-907872926 None] Deleted volume successfully. Jul 13 13:57:50 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-ef5af499-f972-4cb8-9cd0-be685474bb7f tempest-VolumesMetadataTest-907872926 None] Lock "cinder-95f507df-02d0-4b71-9184-17d35c9b51b2-delete_volume" released by "delete_volume" :: held 2.171s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 13:57:50 devstack sudo[98108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_def20bd7-001f-4245-a717-37b9a4cc8574_rkwwhy9u Jul 13 13:57:50 devstack sudo[98108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:57:51 devstack sudo[98108]: pam_unix(sudo:session): session closed for user root Jul 13 13:57:51 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-07997679-b128-471f-8171-f826d30706d9 tempest-VolumesGetTest-148886235 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_def20bd7-001f-4245-a717-37b9a4cc8574_rkwwhy9u" returned: 1 in 0.509s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:57:51 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-07997679-b128-471f-8171-f826d30706d9 tempest-VolumesGetTest-148886235 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_def20bd7-001f-4245-a717-37b9a4cc8574_rkwwhy9u' failed. Not Retrying. {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 13 13:57:51 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2d71b12-4d94-40fd-9fdf-d2349e458596]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 13:57:51 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-07997679-b128-471f-8171-f826d30706d9 tempest-VolumesGetTest-148886235 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_def20bd7-001f-4245-a717-37b9a4cc8574_yjil87m3devstack@QuobyteHD {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:57:51 devstack sudo[98112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_def20bd7-001f-4245-a717-37b9a4cc8574_yjil87m3devstack@QuobyteHD Jul 13 13:57:51 devstack sudo[98112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:57:51 devstack sudo[98112]: pam_unix(sudo:session): session closed for user root Jul 13 13:57:51 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-07997679-b128-471f-8171-f826d30706d9 tempest-VolumesGetTest-148886235 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_def20bd7-001f-4245-a717-37b9a4cc8574_yjil87m3devstack@QuobyteHD" returned: 0 in 0.481s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:57:51 devstack cinder-volume[87098]: DEBUG cinder.image.image_utils [None req-07997679-b128-471f-8171-f826d30706d9 tempest-VolumesGetTest-148886235 None] def20bd7-001f-4245-a717-37b9a4cc8574 was qcow2, converting to raw {{(pid=87098) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 13 13:57:51 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-07997679-b128-471f-8171-f826d30706d9 tempest-VolumesGetTest-148886235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_def20bd7-001f-4245-a717-37b9a4cc8574_yjil87m3devstack@QuobyteHD /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-9c63ed65-b760-43a3-b640-b76a9599340f {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:57:51 devstack sudo[98118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_def20bd7-001f-4245-a717-37b9a4cc8574_yjil87m3devstack@QuobyteHD /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-9c63ed65-b760-43a3-b640-b76a9599340f Jul 13 13:57:51 devstack sudo[98118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:57:53 devstack sudo[98118]: pam_unix(sudo:session): session closed for user root Jul 13 13:57:53 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-07997679-b128-471f-8171-f826d30706d9 tempest-VolumesGetTest-148886235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_def20bd7-001f-4245-a717-37b9a4cc8574_yjil87m3devstack@QuobyteHD /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-9c63ed65-b760-43a3-b640-b76a9599340f" returned: 0 in 1.958s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:57:53 devstack cinder-volume[87098]: DEBUG cinder.image.image_utils [None req-07997679-b128-471f-8171-f826d30706d9 tempest-VolumesGetTest-148886235 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_def20bd7-001f-4245-a717-37b9a4cc8574_yjil87m3devstack@QuobyteHD, size 112.00 MB, duration 1.96 sec, destination /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-9c63ed65-b760-43a3-b640-b76a9599340f {{(pid=87098) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 13 13:57:53 devstack cinder-volume[87098]: INFO cinder.image.image_utils [None req-07997679-b128-471f-8171-f826d30706d9 tempest-VolumesGetTest-148886235 None] Converted 112.00 MB image at 57.16 MB/s Jul 13 13:57:53 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-07997679-b128-471f-8171-f826d30706d9 tempest-VolumesGetTest-148886235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-9c63ed65-b760-43a3-b640-b76a9599340f 1G {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:57:53 devstack sudo[98129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-9c63ed65-b760-43a3-b640-b76a9599340f 1G Jul 13 13:57:53 devstack sudo[98129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:57:53 devstack sudo[98129]: pam_unix(sudo:session): session closed for user root Jul 13 13:57:53 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-07997679-b128-471f-8171-f826d30706d9 tempest-VolumesGetTest-148886235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-9c63ed65-b760-43a3-b640-b76a9599340f 1G" returned: 0 in 0.434s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:57:54 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[653bccd8-14d9-4356-8369-2911b9839905]: (4, 'raw') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 13:57:54 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-07997679-b128-471f-8171-f826d30706d9 tempest-VolumesGetTest-148886235 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-9c63ed65-b760-43a3-b640-b76a9599340f {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:57:54 devstack sudo[98198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-9c63ed65-b760-43a3-b640-b76a9599340f Jul 13 13:57:54 devstack sudo[98198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:57:54 devstack sudo[98198]: pam_unix(sudo:session): session closed for user root Jul 13 13:57:54 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-07997679-b128-471f-8171-f826d30706d9 tempest-VolumesGetTest-148886235 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-9c63ed65-b760-43a3-b640-b76a9599340f" returned: 0 in 0.522s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:57:54 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-07997679-b128-471f-8171-f826d30706d9 tempest-VolumesGetTest-148886235 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-9c63ed65-b760-43a3-b640-b76a9599340f {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:57:54 devstack sudo[98226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-9c63ed65-b760-43a3-b640-b76a9599340f Jul 13 13:57:54 devstack sudo[98226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:57:55 devstack sudo[98226]: pam_unix(sudo:session): session closed for user root Jul 13 13:57:55 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-07997679-b128-471f-8171-f826d30706d9 tempest-VolumesGetTest-148886235 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-9c63ed65-b760-43a3-b640-b76a9599340f" returned: 1 in 0.509s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:57:55 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-07997679-b128-471f-8171-f826d30706d9 tempest-VolumesGetTest-148886235 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-9c63ed65-b760-43a3-b640-b76a9599340f' failed. Not Retrying. {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 13 13:57:55 devstack cinder-volume[87098]: DEBUG cinder.volume.volume_utils [None req-07997679-b128-471f-8171-f826d30706d9 tempest-VolumesGetTest-148886235 None] Downloaded image def20bd7-001f-4245-a717-37b9a4cc8574 ((None, [{'url': 'file:///opt/stack/data/glance/images/def20bd7-001f-4245-a717-37b9a4cc8574', 'metadata': {}}])) to volume 9c63ed65-b760-43a3-b640-b76a9599340f successfully. {{(pid=87098) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 13 13:57:55 devstack cinder-volume[87098]: DEBUG cinder.image.image_utils [None req-07997679-b128-471f-8171-f826d30706d9 tempest-VolumesGetTest-148886235 None] Temporary image def20bd7-001f-4245-a717-37b9a4cc8574 for user 9b36f110e7f84651be59cde67a7b41e3 is deleted. {{(pid=87098) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 13 13:57:55 devstack cinder-volume[87098]: DEBUG cinder.volume.volume_utils [None req-07997679-b128-471f-8171-f826d30706d9 tempest-VolumesGetTest-148886235 None] Marking volume 9c63ed65-b760-43a3-b640-b76a9599340f as bootable. {{(pid=87098) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 13 13:57:55 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-07997679-b128-471f-8171-f826d30706d9 tempest-VolumesGetTest-148886235 None] Copying metadata from image def20bd7-001f-4245-a717-37b9a4cc8574 to 9c63ed65-b760-43a3-b640-b76a9599340f. {{(pid=87098) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 13 13:57:55 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-07997679-b128-471f-8171-f826d30706d9 tempest-VolumesGetTest-148886235 None] Creating volume glance metadata for volume 9c63ed65-b760-43a3-b640-b76a9599340f backed by image def20bd7-001f-4245-a717-37b9a4cc8574 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'def20bd7-001f-4245-a717-37b9a4cc8574', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87098) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 13 13:57:55 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-07997679-b128-471f-8171-f826d30706d9 tempest-VolumesGetTest-148886235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8558cdf6-2e2b-4486-9058-8816ce846ca5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9c63ed65-b760-43a3-b640-b76a9599340f', 'volume_size': 1, 'image_id': 'def20bd7-001f-4245-a717-37b9a4cc8574', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/def20bd7-001f-4245-a717-37b9a4cc8574', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '2181cd3fc958400682584829a80e727e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'def20bd7-001f-4245-a717-37b9a4cc8574', 'created_at': datetime.datetime(2026, 7, 13, 11, 42, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 13, 11, 42, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/def20bd7-001f-4245-a717-37b9a4cc8574/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:57:55 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-07997679-b128-471f-8171-f826d30706d9 tempest-VolumesGetTest-148886235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (070cf854-a047-493a-8e18-bb4bdfa37874) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:57:55 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-07997679-b128-471f-8171-f826d30706d9 tempest-VolumesGetTest-148886235 None] Volume volume-9c63ed65-b760-43a3-b640-b76a9599340f (9c63ed65-b760-43a3-b640-b76a9599340f): created successfully Jul 13 13:57:55 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-07997679-b128-471f-8171-f826d30706d9 tempest-VolumesGetTest-148886235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (070cf854-a047-493a-8e18-bb4bdfa37874) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:57:55 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-07997679-b128-471f-8171-f826d30706d9 tempest-VolumesGetTest-148886235 None] Flow 'volume_create_manager' (67779fa5-4a39-4454-9e12-471b0672db2d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 13:57:55 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-07997679-b128-471f-8171-f826d30706d9 tempest-VolumesGetTest-148886235 None] Created volume successfully. Jul 13 13:57:56 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-9943acc2-ace7-4d88-ad19-2d6b7d723ccd tempest-VolumesGetTest-148886235 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 13:57:56 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-9943acc2-ace7-4d88-ad19-2d6b7d723ccd tempest-VolumesGetTest-148886235 None] Flow 'volume_create_manager' (bd5d4393-abdd-4fe0-8dc8-25c4ef08c998) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 13:57:56 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-9943acc2-ace7-4d88-ad19-2d6b7d723ccd tempest-VolumesGetTest-148886235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f59d221-b9ef-417c-a7b9-af66b73e2fc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:57:56 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-9943acc2-ace7-4d88-ad19-2d6b7d723ccd tempest-VolumesGetTest-148886235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f59d221-b9ef-417c-a7b9-af66b73e2fc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T11:57:56Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-394306021',display_name='tempest-VolumesGetTest-Volume-763660124',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3038fd1a-c915-4973-878a-60a69ca54431,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fce5cc7d83924cda908696f4e23b92f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T11:57:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T11:57:56Z,use_quota=True,user_id='9b36f110e7f84651be59cde67a7b41e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1147de8b-623b-426c-a13d-7fc824a80f67),volume_type_id=1147de8b-623b-426c-a13d-7fc824a80f67)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:57:56 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-9943acc2-ace7-4d88-ad19-2d6b7d723ccd tempest-VolumesGetTest-148886235 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (103835ef-afa6-4b32-b4e5-9260a3a87740) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:57:56 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-9943acc2-ace7-4d88-ad19-2d6b7d723ccd tempest-VolumesGetTest-148886235 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (103835ef-afa6-4b32-b4e5-9260a3a87740) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:57:56 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-9943acc2-ace7-4d88-ad19-2d6b7d723ccd tempest-VolumesGetTest-148886235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00eb9116-5d57-45da-b606-04808bdf387a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:57:56 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-9943acc2-ace7-4d88-ad19-2d6b7d723ccd tempest-VolumesGetTest-148886235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00eb9116-5d57-45da-b606-04808bdf387a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3038fd1a-c915-4973-878a-60a69ca54431', 'volume_name': 'volume-3038fd1a-c915-4973-878a-60a69ca54431', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:57:56 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-9943acc2-ace7-4d88-ad19-2d6b7d723ccd tempest-VolumesGetTest-148886235 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba5d7eb2-958c-40d5-82a0-a0c6e8f9a216) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:57:56 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-9943acc2-ace7-4d88-ad19-2d6b7d723ccd tempest-VolumesGetTest-148886235 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba5d7eb2-958c-40d5-82a0-a0c6e8f9a216) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:57:56 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-9943acc2-ace7-4d88-ad19-2d6b7d723ccd tempest-VolumesGetTest-148886235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3e2c945-04fb-4d48-9612-3424d90508cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:57:56 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-9943acc2-ace7-4d88-ad19-2d6b7d723ccd tempest-VolumesGetTest-148886235 None] Volume 3038fd1a-c915-4973-878a-60a69ca54431: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3038fd1a-c915-4973-878a-60a69ca54431', 'volume_size': 1} Jul 13 13:57:56 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-9943acc2-ace7-4d88-ad19-2d6b7d723ccd tempest-VolumesGetTest-148886235 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:57:56 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-9943acc2-ace7-4d88-ad19-2d6b7d723ccd tempest-VolumesGetTest-148886235 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:57:56 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-9943acc2-ace7-4d88-ad19-2d6b7d723ccd tempest-VolumesGetTest-148886235 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T11:57:56Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-394306021',display_name='tempest-VolumesGetTest-Volume-763660124',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3038fd1a-c915-4973-878a-60a69ca54431,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fce5cc7d83924cda908696f4e23b92f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T11:57:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T11:57:56Z,use_quota=True,user_id='9b36f110e7f84651be59cde67a7b41e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1147de8b-623b-426c-a13d-7fc824a80f67),volume_type_id=1147de8b-623b-426c-a13d-7fc824a80f67)}" {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 13 13:57:56 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-9943acc2-ace7-4d88-ad19-2d6b7d723ccd tempest-VolumesGetTest-148886235 None] Creating volume 3038fd1a-c915-4973-878a-60a69ca54431 {{(pid=87098) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 13 13:57:56 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-9943acc2-ace7-4d88-ad19-2d6b7d723ccd tempest-VolumesGetTest-148886235 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:57:56 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-9943acc2-ace7-4d88-ad19-2d6b7d723ccd tempest-VolumesGetTest-148886235 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:57:56 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-9943acc2-ace7-4d88-ad19-2d6b7d723ccd tempest-VolumesGetTest-148886235 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 13:57:56 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-9943acc2-ace7-4d88-ad19-2d6b7d723ccd tempest-VolumesGetTest-148886235 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 13:57:56 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-9943acc2-ace7-4d88-ad19-2d6b7d723ccd tempest-VolumesGetTest-148886235 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:57:56 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-9943acc2-ace7-4d88-ad19-2d6b7d723ccd tempest-VolumesGetTest-148886235 None] Selected osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 13:57:56 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-9943acc2-ace7-4d88-ad19-2d6b7d723ccd tempest-VolumesGetTest-148886235 None] casted to osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 Jul 13 13:57:56 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-9943acc2-ace7-4d88-ad19-2d6b7d723ccd tempest-VolumesGetTest-148886235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-3038fd1a-c915-4973-878a-60a69ca54431 1073741824 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:57:56 devstack sudo[98231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-3038fd1a-c915-4973-878a-60a69ca54431 1073741824 Jul 13 13:57:56 devstack sudo[98231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:57:56 devstack sudo[98231]: pam_unix(sudo:session): session closed for user root Jul 13 13:57:56 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-9943acc2-ace7-4d88-ad19-2d6b7d723ccd tempest-VolumesGetTest-148886235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-3038fd1a-c915-4973-878a-60a69ca54431 1073741824" returned: 0 in 0.563s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:57:57 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-b55d0deb-933d-4122-96d9-4234f66cac88 tempest-VolumesTransfersV355Test-1836116807 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 13:57:57 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-b55d0deb-933d-4122-96d9-4234f66cac88 tempest-VolumesTransfersV355Test-1836116807 None] Flow 'volume_create_manager' (d2b1c91f-78f1-4ad1-a396-4a9dd6d2bf2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 13:57:57 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-b55d0deb-933d-4122-96d9-4234f66cac88 tempest-VolumesTransfersV355Test-1836116807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9536c9a8-5c2b-4521-80d8-623a6da1533f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:57:57 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-b55d0deb-933d-4122-96d9-4234f66cac88 tempest-VolumesTransfersV355Test-1836116807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9536c9a8-5c2b-4521-80d8-623a6da1533f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T11:57:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1005204852',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a345c0a7-c3d0-435e-9952-a4a780266c32,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b7c912a8a44c4e9891fc5e1e2e997b59',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T11:57:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T11:57:57Z,use_quota=True,user_id='c1e1fcfcd8c14463ac45f70470f6c572',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1147de8b-623b-426c-a13d-7fc824a80f67),volume_type_id=1147de8b-623b-426c-a13d-7fc824a80f67)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:57:57 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-b55d0deb-933d-4122-96d9-4234f66cac88 tempest-VolumesTransfersV355Test-1836116807 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed4244eb-39f4-471f-ae52-b25da4ef9ae7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:57:57 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-b55d0deb-933d-4122-96d9-4234f66cac88 tempest-VolumesTransfersV355Test-1836116807 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed4244eb-39f4-471f-ae52-b25da4ef9ae7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:57:57 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-b55d0deb-933d-4122-96d9-4234f66cac88 tempest-VolumesTransfersV355Test-1836116807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed0cd2c4-3850-4dfb-9fb9-8183122c8ed1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:57:57 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-b55d0deb-933d-4122-96d9-4234f66cac88 tempest-VolumesTransfersV355Test-1836116807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed0cd2c4-3850-4dfb-9fb9-8183122c8ed1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a345c0a7-c3d0-435e-9952-a4a780266c32', 'volume_name': 'volume-a345c0a7-c3d0-435e-9952-a4a780266c32', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:57:57 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-b55d0deb-933d-4122-96d9-4234f66cac88 tempest-VolumesTransfersV355Test-1836116807 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07362d36-079d-4848-9ddf-259732f466a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:57:57 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-b55d0deb-933d-4122-96d9-4234f66cac88 tempest-VolumesTransfersV355Test-1836116807 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07362d36-079d-4848-9ddf-259732f466a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:57:57 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-b55d0deb-933d-4122-96d9-4234f66cac88 tempest-VolumesTransfersV355Test-1836116807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69582d17-9d45-40e2-b2df-be5f4cce4199) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:57:57 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-b55d0deb-933d-4122-96d9-4234f66cac88 tempest-VolumesTransfersV355Test-1836116807 None] Volume a345c0a7-c3d0-435e-9952-a4a780266c32: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a345c0a7-c3d0-435e-9952-a4a780266c32', 'volume_size': 1} Jul 13 13:57:57 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-b55d0deb-933d-4122-96d9-4234f66cac88 tempest-VolumesTransfersV355Test-1836116807 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:57:57 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-9943acc2-ace7-4d88-ad19-2d6b7d723ccd tempest-VolumesGetTest-148886235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-3038fd1a-c915-4973-878a-60a69ca54431 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:57:57 devstack sudo[98238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-3038fd1a-c915-4973-878a-60a69ca54431 Jul 13 13:57:57 devstack sudo[98238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:57:57 devstack sudo[98238]: pam_unix(sudo:session): session closed for user root Jul 13 13:57:57 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-9943acc2-ace7-4d88-ad19-2d6b7d723ccd tempest-VolumesGetTest-148886235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-3038fd1a-c915-4973-878a-60a69ca54431" returned: 0 in 0.257s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:57:57 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-9943acc2-ace7-4d88-ad19-2d6b7d723ccd tempest-VolumesGetTest-148886235 None] <== create_volume: return (954ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'} {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 13 13:57:57 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-9943acc2-ace7-4d88-ad19-2d6b7d723ccd tempest-VolumesGetTest-148886235 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.956s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:57:57 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-b55d0deb-933d-4122-96d9-4234f66cac88 tempest-VolumesTransfersV355Test-1836116807 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.266s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:57:57 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-b55d0deb-933d-4122-96d9-4234f66cac88 tempest-VolumesTransfersV355Test-1836116807 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T11:57:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1005204852',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a345c0a7-c3d0-435e-9952-a4a780266c32,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b7c912a8a44c4e9891fc5e1e2e997b59',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T11:57:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T11:57:57Z,use_quota=True,user_id='c1e1fcfcd8c14463ac45f70470f6c572',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1147de8b-623b-426c-a13d-7fc824a80f67),volume_type_id=1147de8b-623b-426c-a13d-7fc824a80f67)}" {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 13 13:57:57 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-b55d0deb-933d-4122-96d9-4234f66cac88 tempest-VolumesTransfersV355Test-1836116807 None] Creating volume a345c0a7-c3d0-435e-9952-a4a780266c32 {{(pid=87098) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 13 13:57:57 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-b55d0deb-933d-4122-96d9-4234f66cac88 tempest-VolumesTransfersV355Test-1836116807 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:57:57 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-b55d0deb-933d-4122-96d9-4234f66cac88 tempest-VolumesTransfersV355Test-1836116807 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:57:57 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-b55d0deb-933d-4122-96d9-4234f66cac88 tempest-VolumesTransfersV355Test-1836116807 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 13:57:57 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-b55d0deb-933d-4122-96d9-4234f66cac88 tempest-VolumesTransfersV355Test-1836116807 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 13:57:57 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-b55d0deb-933d-4122-96d9-4234f66cac88 tempest-VolumesTransfersV355Test-1836116807 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:57:57 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-b55d0deb-933d-4122-96d9-4234f66cac88 tempest-VolumesTransfersV355Test-1836116807 None] Selected osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 13:57:57 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-b55d0deb-933d-4122-96d9-4234f66cac88 tempest-VolumesTransfersV355Test-1836116807 None] casted to osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 Jul 13 13:57:57 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-b55d0deb-933d-4122-96d9-4234f66cac88 tempest-VolumesTransfersV355Test-1836116807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-a345c0a7-c3d0-435e-9952-a4a780266c32 1073741824 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:57:57 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-9943acc2-ace7-4d88-ad19-2d6b7d723ccd tempest-VolumesGetTest-148886235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3e2c945-04fb-4d48-9612-3424d90508cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3038fd1a-c915-4973-878a-60a69ca54431', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:57:57 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-9943acc2-ace7-4d88-ad19-2d6b7d723ccd tempest-VolumesGetTest-148886235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9166f63-b18b-43aa-943d-e8267ef5d771) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:57:57 devstack sudo[98241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-a345c0a7-c3d0-435e-9952-a4a780266c32 1073741824 Jul 13 13:57:57 devstack sudo[98241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:57:57 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-9943acc2-ace7-4d88-ad19-2d6b7d723ccd tempest-VolumesGetTest-148886235 None] Volume volume-3038fd1a-c915-4973-878a-60a69ca54431 (3038fd1a-c915-4973-878a-60a69ca54431): created successfully Jul 13 13:57:57 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-9943acc2-ace7-4d88-ad19-2d6b7d723ccd tempest-VolumesGetTest-148886235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9166f63-b18b-43aa-943d-e8267ef5d771) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:57:57 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-9943acc2-ace7-4d88-ad19-2d6b7d723ccd tempest-VolumesGetTest-148886235 None] Flow 'volume_create_manager' (bd5d4393-abdd-4fe0-8dc8-25c4ef08c998) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 13:57:57 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-9943acc2-ace7-4d88-ad19-2d6b7d723ccd tempest-VolumesGetTest-148886235 None] Created volume successfully. Jul 13 13:57:57 devstack sudo[98241]: pam_unix(sudo:session): session closed for user root Jul 13 13:57:57 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-b55d0deb-933d-4122-96d9-4234f66cac88 tempest-VolumesTransfersV355Test-1836116807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-a345c0a7-c3d0-435e-9952-a4a780266c32 1073741824" returned: 0 in 0.499s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:57:57 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-b55d0deb-933d-4122-96d9-4234f66cac88 tempest-VolumesTransfersV355Test-1836116807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-a345c0a7-c3d0-435e-9952-a4a780266c32 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:57:57 devstack sudo[98247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-a345c0a7-c3d0-435e-9952-a4a780266c32 Jul 13 13:57:57 devstack sudo[98247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:57:58 devstack sudo[98247]: pam_unix(sudo:session): session closed for user root Jul 13 13:57:58 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-b55d0deb-933d-4122-96d9-4234f66cac88 tempest-VolumesTransfersV355Test-1836116807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-a345c0a7-c3d0-435e-9952-a4a780266c32" returned: 0 in 0.251s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:57:58 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-b55d0deb-933d-4122-96d9-4234f66cac88 tempest-VolumesTransfersV355Test-1836116807 None] <== create_volume: return (797ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'} {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 13 13:57:58 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-b55d0deb-933d-4122-96d9-4234f66cac88 tempest-VolumesTransfersV355Test-1836116807 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.800s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:57:58 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-b55d0deb-933d-4122-96d9-4234f66cac88 tempest-VolumesTransfersV355Test-1836116807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69582d17-9d45-40e2-b2df-be5f4cce4199) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a345c0a7-c3d0-435e-9952-a4a780266c32', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:57:58 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-b55d0deb-933d-4122-96d9-4234f66cac88 tempest-VolumesTransfersV355Test-1836116807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67fdf4bf-5ffe-488d-bfc2-88c3e0961d59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:57:58 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-b55d0deb-933d-4122-96d9-4234f66cac88 tempest-VolumesTransfersV355Test-1836116807 None] Volume volume-a345c0a7-c3d0-435e-9952-a4a780266c32 (a345c0a7-c3d0-435e-9952-a4a780266c32): created successfully Jul 13 13:57:58 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-b55d0deb-933d-4122-96d9-4234f66cac88 tempest-VolumesTransfersV355Test-1836116807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67fdf4bf-5ffe-488d-bfc2-88c3e0961d59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:57:58 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-b55d0deb-933d-4122-96d9-4234f66cac88 tempest-VolumesTransfersV355Test-1836116807 None] Flow 'volume_create_manager' (d2b1c91f-78f1-4ad1-a396-4a9dd6d2bf2e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 13:57:58 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-b55d0deb-933d-4122-96d9-4234f66cac88 tempest-VolumesTransfersV355Test-1836116807 None] Created volume successfully. Jul 13 13:57:58 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-4c501612-ea18-4850-8416-15b8ed373e7e tempest-VolumesGetTest-148886235 None] Acquiring lock "cinder-3038fd1a-c915-4973-878a-60a69ca54431-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 13:57:58 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-4c501612-ea18-4850-8416-15b8ed373e7e tempest-VolumesGetTest-148886235 None] Lock "cinder-3038fd1a-c915-4973-878a-60a69ca54431-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 13:57:58 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-4c501612-ea18-4850-8416-15b8ed373e7e tempest-VolumesGetTest-148886235 None] Acquiring lock "cinder-quobyte-3038fd1a-c915-4973-878a-60a69ca54431" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 13:57:58 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-4c501612-ea18-4850-8416-15b8ed373e7e tempest-VolumesGetTest-148886235 None] Lock "cinder-quobyte-3038fd1a-c915-4973-878a-60a69ca54431" acquired by "delete_volume" :: waited 0.025s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 13:57:58 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[474c5c65-cc1c-4124-bdfb-779896992c0d]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 13:57:58 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-4c501612-ea18-4850-8416-15b8ed373e7e tempest-VolumesGetTest-148886235 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-3038fd1a-c915-4973-878a-60a69ca54431 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:57:58 devstack sudo[98250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-3038fd1a-c915-4973-878a-60a69ca54431 Jul 13 13:57:58 devstack sudo[98250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:57:58 devstack sudo[98250]: pam_unix(sudo:session): session closed for user root Jul 13 13:57:58 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-4c501612-ea18-4850-8416-15b8ed373e7e tempest-VolumesGetTest-148886235 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-3038fd1a-c915-4973-878a-60a69ca54431" returned: 0 in 0.383s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:57:58 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-4c501612-ea18-4850-8416-15b8ed373e7e tempest-VolumesGetTest-148886235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-3038fd1a-c915-4973-878a-60a69ca54431 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:57:59 devstack sudo[98255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-3038fd1a-c915-4973-878a-60a69ca54431 Jul 13 13:57:59 devstack sudo[98255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:57:59 devstack sudo[98255]: pam_unix(sudo:session): session closed for user root Jul 13 13:57:59 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-4c501612-ea18-4850-8416-15b8ed373e7e tempest-VolumesGetTest-148886235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-3038fd1a-c915-4973-878a-60a69ca54431" returned: 0 in 0.265s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:57:59 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-4c501612-ea18-4850-8416-15b8ed373e7e tempest-VolumesGetTest-148886235 None] Lock "cinder-quobyte-3038fd1a-c915-4973-878a-60a69ca54431" released by "delete_volume" :: held 0.701s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 13:57:59 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-4c501612-ea18-4850-8416-15b8ed373e7e tempest-VolumesGetTest-148886235 None] Created reservations ['3def0717-f2aa-463e-a5f5-1cb208519c2a', 'fa9def69-3acf-4695-9928-dca377169ea2', 'b9549cc8-7f55-4717-8e7e-53b919f48a74', 'cf88cb64-81f4-4dc3-a407-fd8f858f4044'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 13:57:59 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-4c501612-ea18-4850-8416-15b8ed373e7e tempest-VolumesGetTest-148886235 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:57:59 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-4c501612-ea18-4850-8416-15b8ed373e7e tempest-VolumesGetTest-148886235 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:57:59 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-4c501612-ea18-4850-8416-15b8ed373e7e tempest-VolumesGetTest-148886235 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 13:57:59 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-4c501612-ea18-4850-8416-15b8ed373e7e tempest-VolumesGetTest-148886235 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 13:57:59 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-4c501612-ea18-4850-8416-15b8ed373e7e tempest-VolumesGetTest-148886235 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:57:59 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-4c501612-ea18-4850-8416-15b8ed373e7e tempest-VolumesGetTest-148886235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:57:59 devstack sudo[98258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 Jul 13 13:57:59 devstack sudo[98258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:57:59 devstack sudo[98258]: pam_unix(sudo:session): session closed for user root Jul 13 13:57:59 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-4c501612-ea18-4850-8416-15b8ed373e7e tempest-VolumesGetTest-148886235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78" returned: 0 in 0.305s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:57:59 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-4c501612-ea18-4850-8416-15b8ed373e7e tempest-VolumesGetTest-148886235 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 13:57:59 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-4c501612-ea18-4850-8416-15b8ed373e7e tempest-VolumesGetTest-148886235 None] Deleted volume successfully. Jul 13 13:57:59 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-f4e8825b-a2ff-4290-912a-38069d6bbab3 tempest-VolumesGetTest-148886235 None] Acquiring lock "cinder-9c63ed65-b760-43a3-b640-b76a9599340f-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 13:57:59 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-4c501612-ea18-4850-8416-15b8ed373e7e tempest-VolumesGetTest-148886235 None] Lock "cinder-3038fd1a-c915-4973-878a-60a69ca54431-delete_volume" released by "delete_volume" :: held 1.297s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 13:57:59 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-f4e8825b-a2ff-4290-912a-38069d6bbab3 tempest-VolumesGetTest-148886235 None] Lock "cinder-9c63ed65-b760-43a3-b640-b76a9599340f-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 13:57:59 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-f4e8825b-a2ff-4290-912a-38069d6bbab3 tempest-VolumesGetTest-148886235 None] Acquiring lock "cinder-quobyte-9c63ed65-b760-43a3-b640-b76a9599340f" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 13:57:59 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-f4e8825b-a2ff-4290-912a-38069d6bbab3 tempest-VolumesGetTest-148886235 None] Lock "cinder-quobyte-9c63ed65-b760-43a3-b640-b76a9599340f" acquired by "delete_volume" :: waited 0.023s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 13:57:59 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-334d99b3-3e43-409b-be78-6b8d4ddb4363 tempest-VolumesTransfersV355Test-600019373 None] Transfer volume completed successfully. Jul 13 13:57:59 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[f89a0a52-c954-4be4-b6e4-a3346718fc68]: (4, 'raw') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 13:57:59 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-f4e8825b-a2ff-4290-912a-38069d6bbab3 tempest-VolumesGetTest-148886235 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-9c63ed65-b760-43a3-b640-b76a9599340f {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:58:00 devstack sudo[98261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-9c63ed65-b760-43a3-b640-b76a9599340f Jul 13 13:58:00 devstack sudo[98261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:58:00 devstack sudo[98261]: pam_unix(sudo:session): session closed for user root Jul 13 13:58:00 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-f4e8825b-a2ff-4290-912a-38069d6bbab3 tempest-VolumesGetTest-148886235 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-9c63ed65-b760-43a3-b640-b76a9599340f" returned: 0 in 0.395s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:58:00 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-f4e8825b-a2ff-4290-912a-38069d6bbab3 tempest-VolumesGetTest-148886235 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-9c63ed65-b760-43a3-b640-b76a9599340f {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:58:00 devstack sudo[98265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-9c63ed65-b760-43a3-b640-b76a9599340f Jul 13 13:58:00 devstack sudo[98265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:58:00 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-5eebacdf-c6bb-42b3-ac82-b030293258d2 tempest-VolumesTransfersV355Test-1576637629 None] Acquiring lock "cinder-a345c0a7-c3d0-435e-9952-a4a780266c32-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 13:58:00 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-80793f0e-50cf-4bd3-bfa0-e875319c4bc6 tempest-GroupsTest-709769296 None] Group tempest-Group1-1944040676: creating Jul 13 13:58:00 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-5eebacdf-c6bb-42b3-ac82-b030293258d2 tempest-VolumesTransfersV355Test-1576637629 None] Lock "cinder-a345c0a7-c3d0-435e-9952-a4a780266c32-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 13:58:00 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-80793f0e-50cf-4bd3-bfa0-e875319c4bc6 tempest-GroupsTest-709769296 None] Group tempest-Group1-1944040676: created successfully Jul 13 13:58:00 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-80793f0e-50cf-4bd3-bfa0-e875319c4bc6 tempest-GroupsTest-709769296 None] Create group completed successfully. Jul 13 13:58:00 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-5eebacdf-c6bb-42b3-ac82-b030293258d2 tempest-VolumesTransfersV355Test-1576637629 None] Acquiring lock "cinder-quobyte-a345c0a7-c3d0-435e-9952-a4a780266c32" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 13:58:00 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-5eebacdf-c6bb-42b3-ac82-b030293258d2 tempest-VolumesTransfersV355Test-1576637629 None] Lock "cinder-quobyte-a345c0a7-c3d0-435e-9952-a4a780266c32" acquired by "delete_volume" :: waited 0.018s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 13:58:00 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9bead44-a81a-4f5a-92c5-4e91c0f82b7a]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 13:58:00 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-5eebacdf-c6bb-42b3-ac82-b030293258d2 tempest-VolumesTransfersV355Test-1576637629 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-a345c0a7-c3d0-435e-9952-a4a780266c32 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:58:00 devstack sudo[98265]: pam_unix(sudo:session): session closed for user root Jul 13 13:58:00 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-f4e8825b-a2ff-4290-912a-38069d6bbab3 tempest-VolumesGetTest-148886235 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-9c63ed65-b760-43a3-b640-b76a9599340f" returned: 1 in 0.399s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:58:00 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-f4e8825b-a2ff-4290-912a-38069d6bbab3 tempest-VolumesGetTest-148886235 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-9c63ed65-b760-43a3-b640-b76a9599340f' failed. Not Retrying. {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 13 13:58:00 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-f4e8825b-a2ff-4290-912a-38069d6bbab3 tempest-VolumesGetTest-148886235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-9c63ed65-b760-43a3-b640-b76a9599340f {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:58:00 devstack sudo[98272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-9c63ed65-b760-43a3-b640-b76a9599340f Jul 13 13:58:00 devstack sudo[98272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:58:00 devstack sudo[98268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-a345c0a7-c3d0-435e-9952-a4a780266c32 Jul 13 13:58:00 devstack sudo[98268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:58:01 devstack sudo[98272]: pam_unix(sudo:session): session closed for user root Jul 13 13:58:01 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-f4e8825b-a2ff-4290-912a-38069d6bbab3 tempest-VolumesGetTest-148886235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-9c63ed65-b760-43a3-b640-b76a9599340f" returned: 0 in 0.292s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:58:01 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-f4e8825b-a2ff-4290-912a-38069d6bbab3 tempest-VolumesGetTest-148886235 None] Lock "cinder-quobyte-9c63ed65-b760-43a3-b640-b76a9599340f" released by "delete_volume" :: held 1.176s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 13:58:01 devstack sudo[98268]: pam_unix(sudo:session): session closed for user root Jul 13 13:58:01 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-5eebacdf-c6bb-42b3-ac82-b030293258d2 tempest-VolumesTransfersV355Test-1576637629 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-a345c0a7-c3d0-435e-9952-a4a780266c32" returned: 0 in 0.409s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:58:01 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-5eebacdf-c6bb-42b3-ac82-b030293258d2 tempest-VolumesTransfersV355Test-1576637629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-a345c0a7-c3d0-435e-9952-a4a780266c32 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:58:01 devstack sudo[98279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-a345c0a7-c3d0-435e-9952-a4a780266c32 Jul 13 13:58:01 devstack sudo[98279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:58:01 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-f4e8825b-a2ff-4290-912a-38069d6bbab3 tempest-VolumesGetTest-148886235 None] Created reservations ['f56a6ca1-5c48-4039-929f-a3d634f598f2', '55ad40a0-c87f-425e-962e-d9debf72dfa4', 'c23ae195-6c5d-4ce3-88ca-08ef6d95984e', '103cc1da-1d49-4703-a712-76d2d411ca7a'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 13:58:01 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-f4e8825b-a2ff-4290-912a-38069d6bbab3 tempest-VolumesGetTest-148886235 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:58:01 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-f4e8825b-a2ff-4290-912a-38069d6bbab3 tempest-VolumesGetTest-148886235 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:58:01 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-f4e8825b-a2ff-4290-912a-38069d6bbab3 tempest-VolumesGetTest-148886235 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 13:58:01 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-f4e8825b-a2ff-4290-912a-38069d6bbab3 tempest-VolumesGetTest-148886235 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 13:58:01 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-f4e8825b-a2ff-4290-912a-38069d6bbab3 tempest-VolumesGetTest-148886235 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:58:01 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-f4e8825b-a2ff-4290-912a-38069d6bbab3 tempest-VolumesGetTest-148886235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:58:01 devstack sudo[98281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 Jul 13 13:58:01 devstack sudo[98281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:58:01 devstack sudo[98279]: pam_unix(sudo:session): session closed for user root Jul 13 13:58:01 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-5eebacdf-c6bb-42b3-ac82-b030293258d2 tempest-VolumesTransfersV355Test-1576637629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-a345c0a7-c3d0-435e-9952-a4a780266c32" returned: 0 in 0.315s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:58:01 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-5eebacdf-c6bb-42b3-ac82-b030293258d2 tempest-VolumesTransfersV355Test-1576637629 None] Lock "cinder-quobyte-a345c0a7-c3d0-435e-9952-a4a780266c32" released by "delete_volume" :: held 0.775s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 13:58:01 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-5eebacdf-c6bb-42b3-ac82-b030293258d2 tempest-VolumesTransfersV355Test-1576637629 None] Created reservations ['1ee4e0f8-da13-4328-aec0-132f2dab4aa5', '312fa53f-db41-4fe0-81ff-a37b9e008bf8', '5627a7b0-0f0b-4c22-a64e-4c9e2c9e3ff5', '2517b422-6fd6-4127-b950-40420e849048'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 13:58:01 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-5eebacdf-c6bb-42b3-ac82-b030293258d2 tempest-VolumesTransfersV355Test-1576637629 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:58:01 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-5eebacdf-c6bb-42b3-ac82-b030293258d2 tempest-VolumesTransfersV355Test-1576637629 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:58:01 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-5eebacdf-c6bb-42b3-ac82-b030293258d2 tempest-VolumesTransfersV355Test-1576637629 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 13:58:01 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-5eebacdf-c6bb-42b3-ac82-b030293258d2 tempest-VolumesTransfersV355Test-1576637629 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 13:58:01 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-5eebacdf-c6bb-42b3-ac82-b030293258d2 tempest-VolumesTransfersV355Test-1576637629 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:58:01 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-5eebacdf-c6bb-42b3-ac82-b030293258d2 tempest-VolumesTransfersV355Test-1576637629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:58:01 devstack sudo[98281]: pam_unix(sudo:session): session closed for user root Jul 13 13:58:01 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-f4e8825b-a2ff-4290-912a-38069d6bbab3 tempest-VolumesGetTest-148886235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78" returned: 0 in 0.306s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:58:01 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-f4e8825b-a2ff-4290-912a-38069d6bbab3 tempest-VolumesGetTest-148886235 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 13:58:01 devstack sudo[98285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 Jul 13 13:58:01 devstack sudo[98285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:58:01 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-f4e8825b-a2ff-4290-912a-38069d6bbab3 tempest-VolumesGetTest-148886235 None] Deleted volume successfully. Jul 13 13:58:01 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-f4e8825b-a2ff-4290-912a-38069d6bbab3 tempest-VolumesGetTest-148886235 None] Lock "cinder-9c63ed65-b760-43a3-b640-b76a9599340f-delete_volume" released by "delete_volume" :: held 1.804s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 13:58:01 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-741f3e5a-f759-46d7-93aa-88a398bf05bf tempest-GroupsTest-709769296 None] Group tempest-Group2-2106928631: creating Jul 13 13:58:01 devstack sudo[98285]: pam_unix(sudo:session): session closed for user root Jul 13 13:58:01 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-5eebacdf-c6bb-42b3-ac82-b030293258d2 tempest-VolumesTransfersV355Test-1576637629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78" returned: 0 in 0.344s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:58:01 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-5eebacdf-c6bb-42b3-ac82-b030293258d2 tempest-VolumesTransfersV355Test-1576637629 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 13:58:01 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-5eebacdf-c6bb-42b3-ac82-b030293258d2 tempest-VolumesTransfersV355Test-1576637629 None] Deleted volume successfully. Jul 13 13:58:01 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-741f3e5a-f759-46d7-93aa-88a398bf05bf tempest-GroupsTest-709769296 None] Group tempest-Group2-2106928631: created successfully Jul 13 13:58:01 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-5eebacdf-c6bb-42b3-ac82-b030293258d2 tempest-VolumesTransfersV355Test-1576637629 None] Lock "cinder-a345c0a7-c3d0-435e-9952-a4a780266c32-delete_volume" released by "delete_volume" :: held 1.368s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 13:58:01 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-741f3e5a-f759-46d7-93aa-88a398bf05bf tempest-GroupsTest-709769296 None] Create group completed successfully. Jul 13 13:58:02 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-49ae7e14-a3eb-4209-90ce-1f69efc6ca5d tempest-VolumesTransfersV355Test-1836116807 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 13:58:02 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-49ae7e14-a3eb-4209-90ce-1f69efc6ca5d tempest-VolumesTransfersV355Test-1836116807 None] Flow 'volume_create_manager' (e40ddbf8-9c14-4916-a33d-24a3be3cbff0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 13:58:02 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-49ae7e14-a3eb-4209-90ce-1f69efc6ca5d tempest-VolumesTransfersV355Test-1836116807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6c1e19e-e2d4-48df-871c-54e0c8f09fae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:58:02 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-49ae7e14-a3eb-4209-90ce-1f69efc6ca5d tempest-VolumesTransfersV355Test-1836116807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6c1e19e-e2d4-48df-871c-54e0c8f09fae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T11:58:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1298655329',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7a908d3-049b-4872-9298-ae6abcd8ce8f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b7c912a8a44c4e9891fc5e1e2e997b59',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T11:58:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T11:58:02Z,use_quota=True,user_id='c1e1fcfcd8c14463ac45f70470f6c572',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1147de8b-623b-426c-a13d-7fc824a80f67),volume_type_id=1147de8b-623b-426c-a13d-7fc824a80f67)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:58:02 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-49ae7e14-a3eb-4209-90ce-1f69efc6ca5d tempest-VolumesTransfersV355Test-1836116807 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87bfcaca-7707-4810-9894-b1f70f06854f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:58:02 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-49ae7e14-a3eb-4209-90ce-1f69efc6ca5d tempest-VolumesTransfersV355Test-1836116807 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87bfcaca-7707-4810-9894-b1f70f06854f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:58:02 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-49ae7e14-a3eb-4209-90ce-1f69efc6ca5d tempest-VolumesTransfersV355Test-1836116807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (171957c6-1a5a-4484-9f60-5107db269764) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:58:02 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-49ae7e14-a3eb-4209-90ce-1f69efc6ca5d tempest-VolumesTransfersV355Test-1836116807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (171957c6-1a5a-4484-9f60-5107db269764) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f7a908d3-049b-4872-9298-ae6abcd8ce8f', 'volume_name': 'volume-f7a908d3-049b-4872-9298-ae6abcd8ce8f', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:58:02 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-49ae7e14-a3eb-4209-90ce-1f69efc6ca5d tempest-VolumesTransfersV355Test-1836116807 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b024739-c7f6-45df-9d20-ece523248c41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:58:02 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-49ae7e14-a3eb-4209-90ce-1f69efc6ca5d tempest-VolumesTransfersV355Test-1836116807 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b024739-c7f6-45df-9d20-ece523248c41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:58:02 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-49ae7e14-a3eb-4209-90ce-1f69efc6ca5d tempest-VolumesTransfersV355Test-1836116807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9857fd2-0d44-4e78-ad6e-8a186aea89fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:58:02 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-49ae7e14-a3eb-4209-90ce-1f69efc6ca5d tempest-VolumesTransfersV355Test-1836116807 None] Volume f7a908d3-049b-4872-9298-ae6abcd8ce8f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f7a908d3-049b-4872-9298-ae6abcd8ce8f', 'volume_size': 1} Jul 13 13:58:02 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-49ae7e14-a3eb-4209-90ce-1f69efc6ca5d tempest-VolumesTransfersV355Test-1836116807 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:58:02 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-49ae7e14-a3eb-4209-90ce-1f69efc6ca5d tempest-VolumesTransfersV355Test-1836116807 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:58:02 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-49ae7e14-a3eb-4209-90ce-1f69efc6ca5d tempest-VolumesTransfersV355Test-1836116807 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T11:58:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1298655329',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7a908d3-049b-4872-9298-ae6abcd8ce8f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b7c912a8a44c4e9891fc5e1e2e997b59',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T11:58:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T11:58:02Z,use_quota=True,user_id='c1e1fcfcd8c14463ac45f70470f6c572',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1147de8b-623b-426c-a13d-7fc824a80f67),volume_type_id=1147de8b-623b-426c-a13d-7fc824a80f67)}" {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 13 13:58:02 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-49ae7e14-a3eb-4209-90ce-1f69efc6ca5d tempest-VolumesTransfersV355Test-1836116807 None] Creating volume f7a908d3-049b-4872-9298-ae6abcd8ce8f {{(pid=87098) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 13 13:58:02 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-49ae7e14-a3eb-4209-90ce-1f69efc6ca5d tempest-VolumesTransfersV355Test-1836116807 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:58:02 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-49ae7e14-a3eb-4209-90ce-1f69efc6ca5d tempest-VolumesTransfersV355Test-1836116807 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:58:02 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-49ae7e14-a3eb-4209-90ce-1f69efc6ca5d tempest-VolumesTransfersV355Test-1836116807 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 13:58:02 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-49ae7e14-a3eb-4209-90ce-1f69efc6ca5d tempest-VolumesTransfersV355Test-1836116807 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 13:58:02 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-49ae7e14-a3eb-4209-90ce-1f69efc6ca5d tempest-VolumesTransfersV355Test-1836116807 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:58:02 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-49ae7e14-a3eb-4209-90ce-1f69efc6ca5d tempest-VolumesTransfersV355Test-1836116807 None] Selected osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 13:58:02 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-49ae7e14-a3eb-4209-90ce-1f69efc6ca5d tempest-VolumesTransfersV355Test-1836116807 None] casted to osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 Jul 13 13:58:02 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-49ae7e14-a3eb-4209-90ce-1f69efc6ca5d tempest-VolumesTransfersV355Test-1836116807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-f7a908d3-049b-4872-9298-ae6abcd8ce8f 1073741824 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:58:02 devstack sudo[98288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-f7a908d3-049b-4872-9298-ae6abcd8ce8f 1073741824 Jul 13 13:58:02 devstack sudo[98288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:58:03 devstack sudo[98288]: pam_unix(sudo:session): session closed for user root Jul 13 13:58:03 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-49ae7e14-a3eb-4209-90ce-1f69efc6ca5d tempest-VolumesTransfersV355Test-1836116807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-f7a908d3-049b-4872-9298-ae6abcd8ce8f 1073741824" returned: 0 in 0.522s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:58:03 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-49ae7e14-a3eb-4209-90ce-1f69efc6ca5d tempest-VolumesTransfersV355Test-1836116807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-f7a908d3-049b-4872-9298-ae6abcd8ce8f {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:58:03 devstack sudo[98293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-f7a908d3-049b-4872-9298-ae6abcd8ce8f Jul 13 13:58:03 devstack sudo[98293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:58:03 devstack sudo[98293]: pam_unix(sudo:session): session closed for user root Jul 13 13:58:03 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-49ae7e14-a3eb-4209-90ce-1f69efc6ca5d tempest-VolumesTransfersV355Test-1836116807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-f7a908d3-049b-4872-9298-ae6abcd8ce8f" returned: 0 in 0.367s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:58:03 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-49ae7e14-a3eb-4209-90ce-1f69efc6ca5d tempest-VolumesTransfersV355Test-1836116807 None] <== create_volume: return (955ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'} {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 13 13:58:03 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-49ae7e14-a3eb-4209-90ce-1f69efc6ca5d tempest-VolumesTransfersV355Test-1836116807 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.958s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:58:03 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-49ae7e14-a3eb-4209-90ce-1f69efc6ca5d tempest-VolumesTransfersV355Test-1836116807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9857fd2-0d44-4e78-ad6e-8a186aea89fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f7a908d3-049b-4872-9298-ae6abcd8ce8f', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:58:03 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-49ae7e14-a3eb-4209-90ce-1f69efc6ca5d tempest-VolumesTransfersV355Test-1836116807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22360237-67ec-487d-ada1-224b26831d73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:58:03 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-49ae7e14-a3eb-4209-90ce-1f69efc6ca5d tempest-VolumesTransfersV355Test-1836116807 None] Volume volume-f7a908d3-049b-4872-9298-ae6abcd8ce8f (f7a908d3-049b-4872-9298-ae6abcd8ce8f): created successfully Jul 13 13:58:03 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-49ae7e14-a3eb-4209-90ce-1f69efc6ca5d tempest-VolumesTransfersV355Test-1836116807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22360237-67ec-487d-ada1-224b26831d73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:58:03 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-49ae7e14-a3eb-4209-90ce-1f69efc6ca5d tempest-VolumesTransfersV355Test-1836116807 None] Flow 'volume_create_manager' (e40ddbf8-9c14-4916-a33d-24a3be3cbff0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 13:58:03 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-49ae7e14-a3eb-4209-90ce-1f69efc6ca5d tempest-VolumesTransfersV355Test-1836116807 None] Created volume successfully. Jul 13 13:58:03 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ac8f15b-ce61-436b-8c1c-b2071c2dc21a tempest-GroupsTest-709769296 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 13:58:03 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-3ac8f15b-ce61-436b-8c1c-b2071c2dc21a tempest-GroupsTest-709769296 None] Flow 'volume_create_manager' (6288403b-736f-4f8e-83fb-76156cce36cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 13:58:03 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-3ac8f15b-ce61-436b-8c1c-b2071c2dc21a tempest-GroupsTest-709769296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e087535-f666-4999-a6a4-4f26620da447) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:58:03 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-3ac8f15b-ce61-436b-8c1c-b2071c2dc21a tempest-GroupsTest-709769296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e087535-f666-4999-a6a4-4f26620da447) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T11:58:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-233317246',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=956936cb-7bba-49d5-97ed-d4b9d23b5b3d,host='devstack@QuobyteHD#QuobyteHD',id=43728558-2caa-4a59-bf4d-296e506bf8df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6ce39f9cd944f7ea024069ec05ef98a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T11:58:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T11:58:04Z,use_quota=True,user_id='64f46ba1525342bcb3cfb8e5339a44aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7e1fea0-5843-4494-8388-8c17ae2d27fe),volume_type_id=f7e1fea0-5843-4494-8388-8c17ae2d27fe)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:58:03 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-3ac8f15b-ce61-436b-8c1c-b2071c2dc21a tempest-GroupsTest-709769296 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11734c60-9dbe-42de-8be7-6ebac20e7b18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:58:03 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-3ac8f15b-ce61-436b-8c1c-b2071c2dc21a tempest-GroupsTest-709769296 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11734c60-9dbe-42de-8be7-6ebac20e7b18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:58:03 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-3ac8f15b-ce61-436b-8c1c-b2071c2dc21a tempest-GroupsTest-709769296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19aefccb-1706-4fc0-929d-4c6b74fc9191) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:58:03 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-3ac8f15b-ce61-436b-8c1c-b2071c2dc21a tempest-GroupsTest-709769296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19aefccb-1706-4fc0-929d-4c6b74fc9191) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '43728558-2caa-4a59-bf4d-296e506bf8df', 'volume_name': 'volume-43728558-2caa-4a59-bf4d-296e506bf8df', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:58:03 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-3ac8f15b-ce61-436b-8c1c-b2071c2dc21a tempest-GroupsTest-709769296 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1f1220d-9479-490f-8ee6-4b72e69550e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:58:03 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-3ac8f15b-ce61-436b-8c1c-b2071c2dc21a tempest-GroupsTest-709769296 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1f1220d-9479-490f-8ee6-4b72e69550e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:58:03 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-3ac8f15b-ce61-436b-8c1c-b2071c2dc21a tempest-GroupsTest-709769296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8450dd75-e2fc-43b5-b091-b6ddc5e78591) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:58:03 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-3ac8f15b-ce61-436b-8c1c-b2071c2dc21a tempest-GroupsTest-709769296 None] Volume 43728558-2caa-4a59-bf4d-296e506bf8df: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-43728558-2caa-4a59-bf4d-296e506bf8df', 'volume_size': 1} Jul 13 13:58:03 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-3ac8f15b-ce61-436b-8c1c-b2071c2dc21a tempest-GroupsTest-709769296 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:58:03 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-3ac8f15b-ce61-436b-8c1c-b2071c2dc21a tempest-GroupsTest-709769296 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:58:03 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-3ac8f15b-ce61-436b-8c1c-b2071c2dc21a tempest-GroupsTest-709769296 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=956936cb-7bba-49d5-97ed-d4b9d23b5b3d,created_at=2026-07-13T11:58:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-233317246',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=956936cb-7bba-49d5-97ed-d4b9d23b5b3d,host='devstack@QuobyteHD#QuobyteHD',id=43728558-2caa-4a59-bf4d-296e506bf8df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6ce39f9cd944f7ea024069ec05ef98a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T11:58:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T11:58:04Z,use_quota=True,user_id='64f46ba1525342bcb3cfb8e5339a44aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7e1fea0-5843-4494-8388-8c17ae2d27fe),volume_type_id=f7e1fea0-5843-4494-8388-8c17ae2d27fe)}" {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 13 13:58:03 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-3ac8f15b-ce61-436b-8c1c-b2071c2dc21a tempest-GroupsTest-709769296 None] Creating volume 43728558-2caa-4a59-bf4d-296e506bf8df {{(pid=87098) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 13 13:58:03 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-3ac8f15b-ce61-436b-8c1c-b2071c2dc21a tempest-GroupsTest-709769296 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:58:03 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-3ac8f15b-ce61-436b-8c1c-b2071c2dc21a tempest-GroupsTest-709769296 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:58:03 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-3ac8f15b-ce61-436b-8c1c-b2071c2dc21a tempest-GroupsTest-709769296 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 13:58:03 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-3ac8f15b-ce61-436b-8c1c-b2071c2dc21a tempest-GroupsTest-709769296 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 13:58:03 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-3ac8f15b-ce61-436b-8c1c-b2071c2dc21a tempest-GroupsTest-709769296 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:58:03 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-3ac8f15b-ce61-436b-8c1c-b2071c2dc21a tempest-GroupsTest-709769296 None] Selected osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 13:58:03 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-3ac8f15b-ce61-436b-8c1c-b2071c2dc21a tempest-GroupsTest-709769296 None] casted to osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 Jul 13 13:58:03 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-3ac8f15b-ce61-436b-8c1c-b2071c2dc21a tempest-GroupsTest-709769296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-43728558-2caa-4a59-bf4d-296e506bf8df 1073741824 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:58:03 devstack sudo[98299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-43728558-2caa-4a59-bf4d-296e506bf8df 1073741824 Jul 13 13:58:03 devstack sudo[98299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:58:04 devstack sudo[98299]: pam_unix(sudo:session): session closed for user root Jul 13 13:58:04 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-3ac8f15b-ce61-436b-8c1c-b2071c2dc21a tempest-GroupsTest-709769296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-43728558-2caa-4a59-bf4d-296e506bf8df 1073741824" returned: 0 in 0.575s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:58:04 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-3ac8f15b-ce61-436b-8c1c-b2071c2dc21a tempest-GroupsTest-709769296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-43728558-2caa-4a59-bf4d-296e506bf8df {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:58:04 devstack sudo[98309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-43728558-2caa-4a59-bf4d-296e506bf8df Jul 13 13:58:04 devstack sudo[98309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:58:04 devstack sudo[98309]: pam_unix(sudo:session): session closed for user root Jul 13 13:58:04 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-3ac8f15b-ce61-436b-8c1c-b2071c2dc21a tempest-GroupsTest-709769296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-43728558-2caa-4a59-bf4d-296e506bf8df" returned: 0 in 0.383s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:58:04 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-3ac8f15b-ce61-436b-8c1c-b2071c2dc21a tempest-GroupsTest-709769296 None] <== create_volume: return (1014ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'} {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 13 13:58:04 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-3ac8f15b-ce61-436b-8c1c-b2071c2dc21a tempest-GroupsTest-709769296 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.017s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:58:04 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-53341911-d1f4-4d4b-b6ca-b6dcc17470cf tempest-VolumesTransfersV355Test-1576637629 None] Acquiring lock "cinder-f7a908d3-049b-4872-9298-ae6abcd8ce8f-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 13:58:04 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-3ac8f15b-ce61-436b-8c1c-b2071c2dc21a tempest-GroupsTest-709769296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8450dd75-e2fc-43b5-b091-b6ddc5e78591) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-43728558-2caa-4a59-bf4d-296e506bf8df', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:58:04 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-3ac8f15b-ce61-436b-8c1c-b2071c2dc21a tempest-GroupsTest-709769296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (977c63e0-338f-48bd-a3de-4e32ce150600) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:58:05 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-53341911-d1f4-4d4b-b6ca-b6dcc17470cf tempest-VolumesTransfersV355Test-1576637629 None] Lock "cinder-f7a908d3-049b-4872-9298-ae6abcd8ce8f-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 13:58:05 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-3ac8f15b-ce61-436b-8c1c-b2071c2dc21a tempest-GroupsTest-709769296 None] Volume volume-43728558-2caa-4a59-bf4d-296e506bf8df (43728558-2caa-4a59-bf4d-296e506bf8df): created successfully Jul 13 13:58:05 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-3ac8f15b-ce61-436b-8c1c-b2071c2dc21a tempest-GroupsTest-709769296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (977c63e0-338f-48bd-a3de-4e32ce150600) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:58:05 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-3ac8f15b-ce61-436b-8c1c-b2071c2dc21a tempest-GroupsTest-709769296 None] Flow 'volume_create_manager' (6288403b-736f-4f8e-83fb-76156cce36cd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 13:58:05 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-3ac8f15b-ce61-436b-8c1c-b2071c2dc21a tempest-GroupsTest-709769296 None] Created volume successfully. Jul 13 13:58:05 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-53341911-d1f4-4d4b-b6ca-b6dcc17470cf tempest-VolumesTransfersV355Test-1576637629 None] Acquiring lock "cinder-quobyte-f7a908d3-049b-4872-9298-ae6abcd8ce8f" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 13:58:05 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-53341911-d1f4-4d4b-b6ca-b6dcc17470cf tempest-VolumesTransfersV355Test-1576637629 None] Lock "cinder-quobyte-f7a908d3-049b-4872-9298-ae6abcd8ce8f" acquired by "delete_volume" :: waited 0.020s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 13:58:05 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[194b4dc2-e2e3-44d1-aea1-32c2f5ed4353]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 13:58:05 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-53341911-d1f4-4d4b-b6ca-b6dcc17470cf tempest-VolumesTransfersV355Test-1576637629 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-f7a908d3-049b-4872-9298-ae6abcd8ce8f {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:58:05 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [req-d95488d5-3f90-44c3-b935-1ae96b08248a req-8edc2036-83fc-4ded-b2f9-7d0e30a318fd tempest-TestInstancesWithCinderVolumes-1739256037 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:58:05 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [req-d95488d5-3f90-44c3-b935-1ae96b08248a req-8edc2036-83fc-4ded-b2f9-7d0e30a318fd tempest-TestInstancesWithCinderVolumes-1739256037 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:58:05 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a34c2e5-4105-475e-b95b-590ee4fe5611]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 13:58:05 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [req-d95488d5-3f90-44c3-b935-1ae96b08248a req-8edc2036-83fc-4ded-b2f9-7d0e30a318fd tempest-TestInstancesWithCinderVolumes-1739256037 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-72998338-69fb-46f0-b04c-890de1054fb9 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:58:05 devstack sudo[98320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-f7a908d3-049b-4872-9298-ae6abcd8ce8f Jul 13 13:58:05 devstack sudo[98320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:58:05 devstack sudo[98321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-72998338-69fb-46f0-b04c-890de1054fb9 Jul 13 13:58:05 devstack sudo[98321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:58:05 devstack sudo[98320]: pam_unix(sudo:session): session closed for user root Jul 13 13:58:05 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-53341911-d1f4-4d4b-b6ca-b6dcc17470cf tempest-VolumesTransfersV355Test-1576637629 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-f7a908d3-049b-4872-9298-ae6abcd8ce8f" returned: 0 in 0.408s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:58:05 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-53341911-d1f4-4d4b-b6ca-b6dcc17470cf tempest-VolumesTransfersV355Test-1576637629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-f7a908d3-049b-4872-9298-ae6abcd8ce8f {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:58:05 devstack sudo[98330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-f7a908d3-049b-4872-9298-ae6abcd8ce8f Jul 13 13:58:05 devstack sudo[98330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:58:05 devstack sudo[98321]: pam_unix(sudo:session): session closed for user root Jul 13 13:58:05 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [req-d95488d5-3f90-44c3-b935-1ae96b08248a req-8edc2036-83fc-4ded-b2f9-7d0e30a318fd tempest-TestInstancesWithCinderVolumes-1739256037 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-72998338-69fb-46f0-b04c-890de1054fb9" returned: 0 in 0.396s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:58:05 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [req-d95488d5-3f90-44c3-b935-1ae96b08248a req-8edc2036-83fc-4ded-b2f9-7d0e30a318fd tempest-TestInstancesWithCinderVolumes-1739256037 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.422s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:58:05 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [req-d95488d5-3f90-44c3-b935-1ae96b08248a req-8edc2036-83fc-4ded-b2f9-7d0e30a318fd tempest-TestInstancesWithCinderVolumes-1739256037 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654', 'name': 'volume-72998338-69fb-46f0-b04c-890de1054fb9', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8056bf27-1e66-47f0-b623-f5560d6f7401', 'enforce_multipath': True} {{(pid=87098) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 13 13:58:05 devstack cinder-volume[87098]: INFO cinder.volume.manager [req-d95488d5-3f90-44c3-b935-1ae96b08248a req-8edc2036-83fc-4ded-b2f9-7d0e30a318fd tempest-TestInstancesWithCinderVolumes-1739256037 None] attachment_update completed successfully. Jul 13 13:58:05 devstack sudo[98330]: pam_unix(sudo:session): session closed for user root Jul 13 13:58:05 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-53341911-d1f4-4d4b-b6ca-b6dcc17470cf tempest-VolumesTransfersV355Test-1576637629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-f7a908d3-049b-4872-9298-ae6abcd8ce8f" returned: 0 in 0.321s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:58:05 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-53341911-d1f4-4d4b-b6ca-b6dcc17470cf tempest-VolumesTransfersV355Test-1576637629 None] Lock "cinder-quobyte-f7a908d3-049b-4872-9298-ae6abcd8ce8f" released by "delete_volume" :: held 0.780s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 13:58:05 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-53341911-d1f4-4d4b-b6ca-b6dcc17470cf tempest-VolumesTransfersV355Test-1576637629 None] Created reservations ['8aaee735-e4aa-4962-bc34-d6ae8db12739', '48134f5b-278e-4309-9f31-eaa3bd12608e', 'a5beef89-b800-4b3e-946a-3640751041bf', '5c54cb46-8e9e-4890-bff1-70d15a4f3514'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 13:58:06 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-53341911-d1f4-4d4b-b6ca-b6dcc17470cf tempest-VolumesTransfersV355Test-1576637629 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:58:06 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-53341911-d1f4-4d4b-b6ca-b6dcc17470cf tempest-VolumesTransfersV355Test-1576637629 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:58:06 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-53341911-d1f4-4d4b-b6ca-b6dcc17470cf tempest-VolumesTransfersV355Test-1576637629 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 13:58:06 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-53341911-d1f4-4d4b-b6ca-b6dcc17470cf tempest-VolumesTransfersV355Test-1576637629 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 13:58:06 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-53341911-d1f4-4d4b-b6ca-b6dcc17470cf tempest-VolumesTransfersV355Test-1576637629 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:58:06 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-53341911-d1f4-4d4b-b6ca-b6dcc17470cf tempest-VolumesTransfersV355Test-1576637629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:58:06 devstack sudo[98335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 Jul 13 13:58:06 devstack sudo[98335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:58:06 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-ba9e7f79-074a-45f8-9fdb-4bc940a0c69f tempest-VolumesListTestJSON-64571285 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 13:58:06 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-ba9e7f79-074a-45f8-9fdb-4bc940a0c69f tempest-VolumesListTestJSON-64571285 None] Flow 'volume_create_manager' (96fc9057-258b-44b2-991a-a31ffab60e80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 13:58:06 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-ba9e7f79-074a-45f8-9fdb-4bc940a0c69f tempest-VolumesListTestJSON-64571285 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d5c2d9e-ff53-4e04-8538-d61f756be9de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:58:06 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-ba9e7f79-074a-45f8-9fdb-4bc940a0c69f tempest-VolumesListTestJSON-64571285 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d5c2d9e-ff53-4e04-8538-d61f756be9de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T11:58:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-525953754',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=efa7c894-2653-470c-b5ea-d6d683310c10,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='664f764852af44c09fc9f73d6b49df01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T11:58:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T11:58:06Z,use_quota=True,user_id='d33f191c6426438988a1d3fd112a0bad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1147de8b-623b-426c-a13d-7fc824a80f67),volume_type_id=1147de8b-623b-426c-a13d-7fc824a80f67)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:58:06 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-ba9e7f79-074a-45f8-9fdb-4bc940a0c69f tempest-VolumesListTestJSON-64571285 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54c50cc2-877f-4a8c-b179-71b6c1bc6386) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:58:06 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-ba9e7f79-074a-45f8-9fdb-4bc940a0c69f tempest-VolumesListTestJSON-64571285 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54c50cc2-877f-4a8c-b179-71b6c1bc6386) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:58:06 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-ba9e7f79-074a-45f8-9fdb-4bc940a0c69f tempest-VolumesListTestJSON-64571285 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d469902-2016-4ae5-9fe5-26b8ab5a8f8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:58:06 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-ba9e7f79-074a-45f8-9fdb-4bc940a0c69f tempest-VolumesListTestJSON-64571285 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d469902-2016-4ae5-9fe5-26b8ab5a8f8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'efa7c894-2653-470c-b5ea-d6d683310c10', 'volume_name': 'volume-efa7c894-2653-470c-b5ea-d6d683310c10', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:58:06 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-ba9e7f79-074a-45f8-9fdb-4bc940a0c69f tempest-VolumesListTestJSON-64571285 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c67a989-501a-4be1-9b07-016a5a032816) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:58:06 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-ba9e7f79-074a-45f8-9fdb-4bc940a0c69f tempest-VolumesListTestJSON-64571285 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c67a989-501a-4be1-9b07-016a5a032816) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:58:06 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-ba9e7f79-074a-45f8-9fdb-4bc940a0c69f tempest-VolumesListTestJSON-64571285 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76759b29-c9b6-4dc2-83e5-b51ab3dd969a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:58:06 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-ba9e7f79-074a-45f8-9fdb-4bc940a0c69f tempest-VolumesListTestJSON-64571285 None] Volume efa7c894-2653-470c-b5ea-d6d683310c10: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-efa7c894-2653-470c-b5ea-d6d683310c10', 'volume_size': 1} Jul 13 13:58:06 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-ba9e7f79-074a-45f8-9fdb-4bc940a0c69f tempest-VolumesListTestJSON-64571285 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:58:06 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-ba9e7f79-074a-45f8-9fdb-4bc940a0c69f tempest-VolumesListTestJSON-64571285 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:58:06 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-ba9e7f79-074a-45f8-9fdb-4bc940a0c69f tempest-VolumesListTestJSON-64571285 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T11:58:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-525953754',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=efa7c894-2653-470c-b5ea-d6d683310c10,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='664f764852af44c09fc9f73d6b49df01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T11:58:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T11:58:06Z,use_quota=True,user_id='d33f191c6426438988a1d3fd112a0bad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1147de8b-623b-426c-a13d-7fc824a80f67),volume_type_id=1147de8b-623b-426c-a13d-7fc824a80f67)}" {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 13 13:58:06 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-ba9e7f79-074a-45f8-9fdb-4bc940a0c69f tempest-VolumesListTestJSON-64571285 None] Creating volume efa7c894-2653-470c-b5ea-d6d683310c10 {{(pid=87098) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 13 13:58:06 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-ba9e7f79-074a-45f8-9fdb-4bc940a0c69f tempest-VolumesListTestJSON-64571285 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:58:06 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-ba9e7f79-074a-45f8-9fdb-4bc940a0c69f tempest-VolumesListTestJSON-64571285 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:58:06 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-ba9e7f79-074a-45f8-9fdb-4bc940a0c69f tempest-VolumesListTestJSON-64571285 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 13:58:06 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-ba9e7f79-074a-45f8-9fdb-4bc940a0c69f tempest-VolumesListTestJSON-64571285 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 13:58:06 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-ba9e7f79-074a-45f8-9fdb-4bc940a0c69f tempest-VolumesListTestJSON-64571285 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:58:06 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-ba9e7f79-074a-45f8-9fdb-4bc940a0c69f tempest-VolumesListTestJSON-64571285 None] Selected osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 13:58:06 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-ba9e7f79-074a-45f8-9fdb-4bc940a0c69f tempest-VolumesListTestJSON-64571285 None] casted to osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 Jul 13 13:58:06 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-ba9e7f79-074a-45f8-9fdb-4bc940a0c69f tempest-VolumesListTestJSON-64571285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-efa7c894-2653-470c-b5ea-d6d683310c10 1073741824 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:58:06 devstack sudo[98335]: pam_unix(sudo:session): session closed for user root Jul 13 13:58:06 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-53341911-d1f4-4d4b-b6ca-b6dcc17470cf tempest-VolumesTransfersV355Test-1576637629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78" returned: 0 in 0.372s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:58:06 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-53341911-d1f4-4d4b-b6ca-b6dcc17470cf tempest-VolumesTransfersV355Test-1576637629 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 13:58:06 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-53341911-d1f4-4d4b-b6ca-b6dcc17470cf tempest-VolumesTransfersV355Test-1576637629 None] Deleted volume successfully. Jul 13 13:58:06 devstack sudo[98338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-efa7c894-2653-470c-b5ea-d6d683310c10 1073741824 Jul 13 13:58:06 devstack sudo[98338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:58:06 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-53341911-d1f4-4d4b-b6ca-b6dcc17470cf tempest-VolumesTransfersV355Test-1576637629 None] Lock "cinder-f7a908d3-049b-4872-9298-ae6abcd8ce8f-delete_volume" released by "delete_volume" :: held 1.480s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 13:58:06 devstack sudo[98338]: pam_unix(sudo:session): session closed for user root Jul 13 13:58:06 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-ba9e7f79-074a-45f8-9fdb-4bc940a0c69f tempest-VolumesListTestJSON-64571285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-efa7c894-2653-470c-b5ea-d6d683310c10 1073741824" returned: 0 in 0.542s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:58:07 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-ba9e7f79-074a-45f8-9fdb-4bc940a0c69f tempest-VolumesListTestJSON-64571285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-efa7c894-2653-470c-b5ea-d6d683310c10 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:58:07 devstack sudo[98345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-efa7c894-2653-470c-b5ea-d6d683310c10 Jul 13 13:58:07 devstack sudo[98345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:58:07 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-f0d7df60-48b6-4e77-bd80-94a3a14fc220 tempest-GroupsTest-709769296 None] Acquiring lock "cinder-quobyte-43728558-2caa-4a59-bf4d-296e506bf8df" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 13:58:07 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-f0d7df60-48b6-4e77-bd80-94a3a14fc220 tempest-GroupsTest-709769296 None] Lock "cinder-quobyte-43728558-2caa-4a59-bf4d-296e506bf8df" acquired by "delete_volume" :: waited 0.022s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 13:58:07 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad63c393-f948-4550-942f-92928faaba62]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 13:58:07 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-f0d7df60-48b6-4e77-bd80-94a3a14fc220 tempest-GroupsTest-709769296 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-43728558-2caa-4a59-bf4d-296e506bf8df {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:58:07 devstack sudo[98349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-43728558-2caa-4a59-bf4d-296e506bf8df Jul 13 13:58:07 devstack sudo[98349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:58:07 devstack sudo[98345]: pam_unix(sudo:session): session closed for user root Jul 13 13:58:07 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-ba9e7f79-074a-45f8-9fdb-4bc940a0c69f tempest-VolumesListTestJSON-64571285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-efa7c894-2653-470c-b5ea-d6d683310c10" returned: 0 in 0.384s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:58:07 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-ba9e7f79-074a-45f8-9fdb-4bc940a0c69f tempest-VolumesListTestJSON-64571285 None] <== create_volume: return (992ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'} {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 13 13:58:07 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-ba9e7f79-074a-45f8-9fdb-4bc940a0c69f tempest-VolumesListTestJSON-64571285 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.995s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:58:07 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-ba9e7f79-074a-45f8-9fdb-4bc940a0c69f tempest-VolumesListTestJSON-64571285 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76759b29-c9b6-4dc2-83e5-b51ab3dd969a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-efa7c894-2653-470c-b5ea-d6d683310c10', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:58:07 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-ba9e7f79-074a-45f8-9fdb-4bc940a0c69f tempest-VolumesListTestJSON-64571285 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9e483ac-76fe-4623-b00a-27a8ba85955c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:58:07 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-ba9e7f79-074a-45f8-9fdb-4bc940a0c69f tempest-VolumesListTestJSON-64571285 None] Volume volume-efa7c894-2653-470c-b5ea-d6d683310c10 (efa7c894-2653-470c-b5ea-d6d683310c10): created successfully Jul 13 13:58:07 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-ba9e7f79-074a-45f8-9fdb-4bc940a0c69f tempest-VolumesListTestJSON-64571285 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9e483ac-76fe-4623-b00a-27a8ba85955c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:58:07 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-ba9e7f79-074a-45f8-9fdb-4bc940a0c69f tempest-VolumesListTestJSON-64571285 None] Flow 'volume_create_manager' (96fc9057-258b-44b2-991a-a31ffab60e80) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 13:58:07 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-ba9e7f79-074a-45f8-9fdb-4bc940a0c69f tempest-VolumesListTestJSON-64571285 None] Created volume successfully. Jul 13 13:58:07 devstack sudo[98349]: pam_unix(sudo:session): session closed for user root Jul 13 13:58:07 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-f0d7df60-48b6-4e77-bd80-94a3a14fc220 tempest-GroupsTest-709769296 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-43728558-2caa-4a59-bf4d-296e506bf8df" returned: 0 in 0.500s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:58:07 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-f0d7df60-48b6-4e77-bd80-94a3a14fc220 tempest-GroupsTest-709769296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-43728558-2caa-4a59-bf4d-296e506bf8df {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:58:07 devstack sudo[98396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-43728558-2caa-4a59-bf4d-296e506bf8df Jul 13 13:58:07 devstack sudo[98396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:58:07 devstack sudo[98396]: pam_unix(sudo:session): session closed for user root Jul 13 13:58:07 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-f0d7df60-48b6-4e77-bd80-94a3a14fc220 tempest-GroupsTest-709769296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-43728558-2caa-4a59-bf4d-296e506bf8df" returned: 0 in 0.338s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:58:08 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-f0d7df60-48b6-4e77-bd80-94a3a14fc220 tempest-GroupsTest-709769296 None] Lock "cinder-quobyte-43728558-2caa-4a59-bf4d-296e506bf8df" released by "delete_volume" :: held 0.912s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 13:58:08 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-f0d7df60-48b6-4e77-bd80-94a3a14fc220 tempest-GroupsTest-709769296 None] Created reservations ['0ea19995-2b60-48ce-a4db-e4d22960d9d7'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 13:58:08 devstack cinder-volume[87098]: WARNING cinder.quota [None req-f0d7df60-48b6-4e77-bd80-94a3a14fc220 tempest-GroupsTest-709769296 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-484518940 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-484518940, it is now deprecated. Please use the default quota class for default quota. Jul 13 13:58:08 devstack cinder-volume[87098]: WARNING cinder.quota [None req-f0d7df60-48b6-4e77-bd80-94a3a14fc220 tempest-GroupsTest-709769296 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-484518940 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-484518940, it is now deprecated. Please use the default quota class for default quota. Jul 13 13:58:08 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-f0d7df60-48b6-4e77-bd80-94a3a14fc220 tempest-GroupsTest-709769296 None] Created reservations ['cf0a089e-cd06-458a-a6be-66354b976a13', 'eadb7db3-fc20-4e15-8169-b65a46cecd3c', '2d9cae3a-2897-4593-9df4-bb5497da75cd', '43302e13-c520-4b9c-92d2-74bb803971e5'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 13:58:08 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-f0d7df60-48b6-4e77-bd80-94a3a14fc220 tempest-GroupsTest-709769296 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:58:08 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-f0d7df60-48b6-4e77-bd80-94a3a14fc220 tempest-GroupsTest-709769296 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:58:08 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-f0d7df60-48b6-4e77-bd80-94a3a14fc220 tempest-GroupsTest-709769296 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 13:58:08 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-f0d7df60-48b6-4e77-bd80-94a3a14fc220 tempest-GroupsTest-709769296 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 13:58:08 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-f0d7df60-48b6-4e77-bd80-94a3a14fc220 tempest-GroupsTest-709769296 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:58:08 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-f0d7df60-48b6-4e77-bd80-94a3a14fc220 tempest-GroupsTest-709769296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:58:08 devstack sudo[98409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 Jul 13 13:58:08 devstack sudo[98409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:58:08 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [req-808ed002-f67c-4fd7-9e7e-37033ff5522b req-dd938f61-0cf8-4488-8e41-b045481d82bc tempest-TestInstancesWithCinderVolumes-1739256037 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:58:08 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [req-808ed002-f67c-4fd7-9e7e-37033ff5522b req-dd938f61-0cf8-4488-8e41-b045481d82bc tempest-TestInstancesWithCinderVolumes-1739256037 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:58:08 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7e8656c-af2a-4e88-8a9f-eacc37cb5958]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 13:58:08 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [req-808ed002-f67c-4fd7-9e7e-37033ff5522b req-dd938f61-0cf8-4488-8e41-b045481d82bc tempest-TestInstancesWithCinderVolumes-1739256037 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-5dd52277-9ad3-4db1-816d-e77beb61b8d4 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:58:08 devstack sudo[98411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-5dd52277-9ad3-4db1-816d-e77beb61b8d4 Jul 13 13:58:08 devstack sudo[98411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:58:08 devstack sudo[98409]: pam_unix(sudo:session): session closed for user root Jul 13 13:58:08 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-f0d7df60-48b6-4e77-bd80-94a3a14fc220 tempest-GroupsTest-709769296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78" returned: 0 in 0.327s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:58:08 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-f0d7df60-48b6-4e77-bd80-94a3a14fc220 tempest-GroupsTest-709769296 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 13:58:08 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-f0d7df60-48b6-4e77-bd80-94a3a14fc220 tempest-GroupsTest-709769296 None] Delete group completed successfully. Jul 13 13:58:09 devstack sudo[98411]: pam_unix(sudo:session): session closed for user root Jul 13 13:58:09 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [req-808ed002-f67c-4fd7-9e7e-37033ff5522b req-dd938f61-0cf8-4488-8e41-b045481d82bc tempest-TestInstancesWithCinderVolumes-1739256037 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-5dd52277-9ad3-4db1-816d-e77beb61b8d4" returned: 0 in 0.471s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:58:09 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [req-808ed002-f67c-4fd7-9e7e-37033ff5522b req-dd938f61-0cf8-4488-8e41-b045481d82bc tempest-TestInstancesWithCinderVolumes-1739256037 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.496s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:58:09 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c646b1d-f22f-4a35-a27a-89a67a2e10dd tempest-VolumesListTestJSON-64571285 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 13:58:09 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-2c646b1d-f22f-4a35-a27a-89a67a2e10dd tempest-VolumesListTestJSON-64571285 None] Flow 'volume_create_manager' (4a2caf12-738a-4ebc-a91b-b4bb6247c3b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 13:58:09 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-2c646b1d-f22f-4a35-a27a-89a67a2e10dd tempest-VolumesListTestJSON-64571285 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24ff6c86-f725-4ec0-9d80-0c5b23dba2d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:58:09 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [req-808ed002-f67c-4fd7-9e7e-37033ff5522b req-dd938f61-0cf8-4488-8e41-b045481d82bc tempest-TestInstancesWithCinderVolumes-1739256037 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654', 'name': 'volume-5dd52277-9ad3-4db1-816d-e77beb61b8d4', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '95ec5f8f-9f98-4a06-953b-90f6a11b976c', 'enforce_multipath': True} {{(pid=87098) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 13 13:58:09 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-2c646b1d-f22f-4a35-a27a-89a67a2e10dd tempest-VolumesListTestJSON-64571285 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24ff6c86-f725-4ec0-9d80-0c5b23dba2d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T11:58:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-957551809',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49001f84-519d-45cd-a57a-2f38b397b09d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='664f764852af44c09fc9f73d6b49df01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T11:58:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T11:58:09Z,use_quota=True,user_id='d33f191c6426438988a1d3fd112a0bad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1147de8b-623b-426c-a13d-7fc824a80f67),volume_type_id=1147de8b-623b-426c-a13d-7fc824a80f67)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:58:09 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-2c646b1d-f22f-4a35-a27a-89a67a2e10dd tempest-VolumesListTestJSON-64571285 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bdb901b6-33ca-44a0-b5dd-dfc8ee5929c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:58:09 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-2c646b1d-f22f-4a35-a27a-89a67a2e10dd tempest-VolumesListTestJSON-64571285 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bdb901b6-33ca-44a0-b5dd-dfc8ee5929c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:58:09 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-2c646b1d-f22f-4a35-a27a-89a67a2e10dd tempest-VolumesListTestJSON-64571285 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (acba276a-7b0b-4b52-872c-b0ed5382ed0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:58:09 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-2c646b1d-f22f-4a35-a27a-89a67a2e10dd tempest-VolumesListTestJSON-64571285 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (acba276a-7b0b-4b52-872c-b0ed5382ed0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '49001f84-519d-45cd-a57a-2f38b397b09d', 'volume_name': 'volume-49001f84-519d-45cd-a57a-2f38b397b09d', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:58:09 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-2c646b1d-f22f-4a35-a27a-89a67a2e10dd tempest-VolumesListTestJSON-64571285 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (095b43e3-4870-4fa7-9c9c-8420eaf90062) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:58:09 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-2c646b1d-f22f-4a35-a27a-89a67a2e10dd tempest-VolumesListTestJSON-64571285 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (095b43e3-4870-4fa7-9c9c-8420eaf90062) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:58:09 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-2c646b1d-f22f-4a35-a27a-89a67a2e10dd tempest-VolumesListTestJSON-64571285 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25847a47-59d8-4d82-8a9b-5fd161d39d62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:58:09 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-2c646b1d-f22f-4a35-a27a-89a67a2e10dd tempest-VolumesListTestJSON-64571285 None] Volume 49001f84-519d-45cd-a57a-2f38b397b09d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-49001f84-519d-45cd-a57a-2f38b397b09d', 'volume_size': 1} Jul 13 13:58:09 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-2c646b1d-f22f-4a35-a27a-89a67a2e10dd tempest-VolumesListTestJSON-64571285 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:58:09 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-2c646b1d-f22f-4a35-a27a-89a67a2e10dd tempest-VolumesListTestJSON-64571285 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:58:09 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-2c646b1d-f22f-4a35-a27a-89a67a2e10dd tempest-VolumesListTestJSON-64571285 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T11:58:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-957551809',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49001f84-519d-45cd-a57a-2f38b397b09d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='664f764852af44c09fc9f73d6b49df01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T11:58:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T11:58:09Z,use_quota=True,user_id='d33f191c6426438988a1d3fd112a0bad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1147de8b-623b-426c-a13d-7fc824a80f67),volume_type_id=1147de8b-623b-426c-a13d-7fc824a80f67)}" {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 13 13:58:09 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-2c646b1d-f22f-4a35-a27a-89a67a2e10dd tempest-VolumesListTestJSON-64571285 None] Creating volume 49001f84-519d-45cd-a57a-2f38b397b09d {{(pid=87098) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 13 13:58:09 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-2c646b1d-f22f-4a35-a27a-89a67a2e10dd tempest-VolumesListTestJSON-64571285 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:58:09 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-2c646b1d-f22f-4a35-a27a-89a67a2e10dd tempest-VolumesListTestJSON-64571285 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:58:09 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-2c646b1d-f22f-4a35-a27a-89a67a2e10dd tempest-VolumesListTestJSON-64571285 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 13:58:09 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-2c646b1d-f22f-4a35-a27a-89a67a2e10dd tempest-VolumesListTestJSON-64571285 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 13:58:09 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-2c646b1d-f22f-4a35-a27a-89a67a2e10dd tempest-VolumesListTestJSON-64571285 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:58:09 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-2c646b1d-f22f-4a35-a27a-89a67a2e10dd tempest-VolumesListTestJSON-64571285 None] Selected osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 13:58:09 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-2c646b1d-f22f-4a35-a27a-89a67a2e10dd tempest-VolumesListTestJSON-64571285 None] casted to osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 Jul 13 13:58:09 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-2c646b1d-f22f-4a35-a27a-89a67a2e10dd tempest-VolumesListTestJSON-64571285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-49001f84-519d-45cd-a57a-2f38b397b09d 1073741824 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:58:09 devstack sudo[98417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-49001f84-519d-45cd-a57a-2f38b397b09d 1073741824 Jul 13 13:58:09 devstack sudo[98417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:58:09 devstack cinder-volume[87098]: INFO cinder.volume.manager [req-808ed002-f67c-4fd7-9e7e-37033ff5522b req-dd938f61-0cf8-4488-8e41-b045481d82bc tempest-TestInstancesWithCinderVolumes-1739256037 None] attachment_update completed successfully. Jul 13 13:58:09 devstack cinder-volume[87098]: DEBUG dbcounter [-] [87098] Writing DB stats cinder:DELETE=18,cinder:SELECT=160,cinder:INSERT=58,cinder:UPDATE=225 {{(pid=87098) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 13 13:58:09 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-e6f93b23-1a9d-4ac5-815f-0bb84d080edf tempest-GroupsTest-709769296 None] Created reservations ['99f4ceb7-d445-4a87-8604-275926ba3368'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 13:58:09 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-e6f93b23-1a9d-4ac5-815f-0bb84d080edf tempest-GroupsTest-709769296 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:58:09 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-e6f93b23-1a9d-4ac5-815f-0bb84d080edf tempest-GroupsTest-709769296 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:58:09 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-e6f93b23-1a9d-4ac5-815f-0bb84d080edf tempest-GroupsTest-709769296 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 13:58:09 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-e6f93b23-1a9d-4ac5-815f-0bb84d080edf tempest-GroupsTest-709769296 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 13:58:09 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-e6f93b23-1a9d-4ac5-815f-0bb84d080edf tempest-GroupsTest-709769296 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:58:09 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-e6f93b23-1a9d-4ac5-815f-0bb84d080edf tempest-GroupsTest-709769296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:58:09 devstack sudo[98425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 Jul 13 13:58:09 devstack sudo[98425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:58:09 devstack sudo[98417]: pam_unix(sudo:session): session closed for user root Jul 13 13:58:09 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-2c646b1d-f22f-4a35-a27a-89a67a2e10dd tempest-VolumesListTestJSON-64571285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-49001f84-519d-45cd-a57a-2f38b397b09d 1073741824" returned: 0 in 0.645s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:58:09 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-2c646b1d-f22f-4a35-a27a-89a67a2e10dd tempest-VolumesListTestJSON-64571285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-49001f84-519d-45cd-a57a-2f38b397b09d {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:58:09 devstack sudo[98427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-49001f84-519d-45cd-a57a-2f38b397b09d Jul 13 13:58:09 devstack sudo[98427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:58:10 devstack sudo[98425]: pam_unix(sudo:session): session closed for user root Jul 13 13:58:10 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-e6f93b23-1a9d-4ac5-815f-0bb84d080edf tempest-GroupsTest-709769296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78" returned: 0 in 0.409s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:58:10 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-e6f93b23-1a9d-4ac5-815f-0bb84d080edf tempest-GroupsTest-709769296 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 13:58:10 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-e6f93b23-1a9d-4ac5-815f-0bb84d080edf tempest-GroupsTest-709769296 None] Delete group completed successfully. Jul 13 13:58:10 devstack sudo[98427]: pam_unix(sudo:session): session closed for user root Jul 13 13:58:10 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-2c646b1d-f22f-4a35-a27a-89a67a2e10dd tempest-VolumesListTestJSON-64571285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-49001f84-519d-45cd-a57a-2f38b397b09d" returned: 0 in 0.367s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:58:10 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-2c646b1d-f22f-4a35-a27a-89a67a2e10dd tempest-VolumesListTestJSON-64571285 None] <== create_volume: return (1097ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'} {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 13 13:58:10 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-2c646b1d-f22f-4a35-a27a-89a67a2e10dd tempest-VolumesListTestJSON-64571285 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.099s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:58:10 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-2c646b1d-f22f-4a35-a27a-89a67a2e10dd tempest-VolumesListTestJSON-64571285 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25847a47-59d8-4d82-8a9b-5fd161d39d62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-49001f84-519d-45cd-a57a-2f38b397b09d', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:58:10 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-2c646b1d-f22f-4a35-a27a-89a67a2e10dd tempest-VolumesListTestJSON-64571285 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b4f2254-28f7-4115-a247-729c7052e76d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:58:10 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-2c646b1d-f22f-4a35-a27a-89a67a2e10dd tempest-VolumesListTestJSON-64571285 None] Volume volume-49001f84-519d-45cd-a57a-2f38b397b09d (49001f84-519d-45cd-a57a-2f38b397b09d): created successfully Jul 13 13:58:10 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-2c646b1d-f22f-4a35-a27a-89a67a2e10dd tempest-VolumesListTestJSON-64571285 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b4f2254-28f7-4115-a247-729c7052e76d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:58:10 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-2c646b1d-f22f-4a35-a27a-89a67a2e10dd tempest-VolumesListTestJSON-64571285 None] Flow 'volume_create_manager' (4a2caf12-738a-4ebc-a91b-b4bb6247c3b2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 13:58:10 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-2c646b1d-f22f-4a35-a27a-89a67a2e10dd tempest-VolumesListTestJSON-64571285 None] Created volume successfully. Jul 13 13:58:11 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-8d61a5a4-5a57-44a3-93e9-cea9df4d69c8 tempest-GroupsTest-709769296 None] Group tempest-GroupsTest-Group-751478704: creating Jul 13 13:58:11 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-8d61a5a4-5a57-44a3-93e9-cea9df4d69c8 tempest-GroupsTest-709769296 None] Group tempest-GroupsTest-Group-751478704: created successfully Jul 13 13:58:11 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-8d61a5a4-5a57-44a3-93e9-cea9df4d69c8 tempest-GroupsTest-709769296 None] Create group completed successfully. Jul 13 13:58:11 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-28feff5d-5c58-4d05-851c-00747e5b78bb tempest-VolumesListTestJSON-64571285 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 13:58:11 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-28feff5d-5c58-4d05-851c-00747e5b78bb tempest-VolumesListTestJSON-64571285 None] Flow 'volume_create_manager' (920e5fe3-964f-4ca8-b07c-224b5ed68386) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 13:58:11 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-28feff5d-5c58-4d05-851c-00747e5b78bb tempest-VolumesListTestJSON-64571285 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39effe55-398f-42c2-a130-fc58bceb7fd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:58:11 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-28feff5d-5c58-4d05-851c-00747e5b78bb tempest-VolumesListTestJSON-64571285 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39effe55-398f-42c2-a130-fc58bceb7fd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T11:58:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-188199848',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5cf22c94-ea8c-49bc-b139-3bd0735c662b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='664f764852af44c09fc9f73d6b49df01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T11:58:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T11:58:12Z,use_quota=True,user_id='d33f191c6426438988a1d3fd112a0bad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1147de8b-623b-426c-a13d-7fc824a80f67),volume_type_id=1147de8b-623b-426c-a13d-7fc824a80f67)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:58:11 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-28feff5d-5c58-4d05-851c-00747e5b78bb tempest-VolumesListTestJSON-64571285 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b270e9d8-3100-4b84-a220-9d9965e46a98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:58:11 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-28feff5d-5c58-4d05-851c-00747e5b78bb tempest-VolumesListTestJSON-64571285 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b270e9d8-3100-4b84-a220-9d9965e46a98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:58:11 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-28feff5d-5c58-4d05-851c-00747e5b78bb tempest-VolumesListTestJSON-64571285 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (358507db-2f15-45cb-97a5-f9b632812b2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:58:11 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-28feff5d-5c58-4d05-851c-00747e5b78bb tempest-VolumesListTestJSON-64571285 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (358507db-2f15-45cb-97a5-f9b632812b2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5cf22c94-ea8c-49bc-b139-3bd0735c662b', 'volume_name': 'volume-5cf22c94-ea8c-49bc-b139-3bd0735c662b', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:58:11 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-28feff5d-5c58-4d05-851c-00747e5b78bb tempest-VolumesListTestJSON-64571285 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d06c9ac-61c8-4246-9244-fec8ab8153c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:58:11 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-28feff5d-5c58-4d05-851c-00747e5b78bb tempest-VolumesListTestJSON-64571285 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d06c9ac-61c8-4246-9244-fec8ab8153c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:58:11 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-28feff5d-5c58-4d05-851c-00747e5b78bb tempest-VolumesListTestJSON-64571285 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe7ad8c3-ce42-4b96-8fbd-4d221901ca1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:58:11 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-28feff5d-5c58-4d05-851c-00747e5b78bb tempest-VolumesListTestJSON-64571285 None] Volume 5cf22c94-ea8c-49bc-b139-3bd0735c662b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5cf22c94-ea8c-49bc-b139-3bd0735c662b', 'volume_size': 1} Jul 13 13:58:11 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-28feff5d-5c58-4d05-851c-00747e5b78bb tempest-VolumesListTestJSON-64571285 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:58:11 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-28feff5d-5c58-4d05-851c-00747e5b78bb tempest-VolumesListTestJSON-64571285 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:58:11 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-28feff5d-5c58-4d05-851c-00747e5b78bb tempest-VolumesListTestJSON-64571285 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T11:58:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-188199848',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5cf22c94-ea8c-49bc-b139-3bd0735c662b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='664f764852af44c09fc9f73d6b49df01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T11:58:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T11:58:12Z,use_quota=True,user_id='d33f191c6426438988a1d3fd112a0bad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1147de8b-623b-426c-a13d-7fc824a80f67),volume_type_id=1147de8b-623b-426c-a13d-7fc824a80f67)}" {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 13 13:58:11 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-28feff5d-5c58-4d05-851c-00747e5b78bb tempest-VolumesListTestJSON-64571285 None] Creating volume 5cf22c94-ea8c-49bc-b139-3bd0735c662b {{(pid=87098) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 13 13:58:11 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-28feff5d-5c58-4d05-851c-00747e5b78bb tempest-VolumesListTestJSON-64571285 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:58:11 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-28feff5d-5c58-4d05-851c-00747e5b78bb tempest-VolumesListTestJSON-64571285 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:58:11 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-28feff5d-5c58-4d05-851c-00747e5b78bb tempest-VolumesListTestJSON-64571285 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 13:58:11 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-28feff5d-5c58-4d05-851c-00747e5b78bb tempest-VolumesListTestJSON-64571285 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 13:58:11 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-28feff5d-5c58-4d05-851c-00747e5b78bb tempest-VolumesListTestJSON-64571285 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:58:11 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-28feff5d-5c58-4d05-851c-00747e5b78bb tempest-VolumesListTestJSON-64571285 None] Selected osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 13:58:11 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-28feff5d-5c58-4d05-851c-00747e5b78bb tempest-VolumesListTestJSON-64571285 None] casted to osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 Jul 13 13:58:11 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-28feff5d-5c58-4d05-851c-00747e5b78bb tempest-VolumesListTestJSON-64571285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-5cf22c94-ea8c-49bc-b139-3bd0735c662b 1073741824 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:58:11 devstack sudo[98439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-5cf22c94-ea8c-49bc-b139-3bd0735c662b 1073741824 Jul 13 13:58:11 devstack sudo[98439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:58:12 devstack sudo[98439]: pam_unix(sudo:session): session closed for user root Jul 13 13:58:12 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-28feff5d-5c58-4d05-851c-00747e5b78bb tempest-VolumesListTestJSON-64571285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-5cf22c94-ea8c-49bc-b139-3bd0735c662b 1073741824" returned: 0 in 0.496s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:58:12 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-28feff5d-5c58-4d05-851c-00747e5b78bb tempest-VolumesListTestJSON-64571285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-5cf22c94-ea8c-49bc-b139-3bd0735c662b {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:58:12 devstack sudo[98445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-5cf22c94-ea8c-49bc-b139-3bd0735c662b Jul 13 13:58:12 devstack sudo[98445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:58:12 devstack sudo[98445]: pam_unix(sudo:session): session closed for user root Jul 13 13:58:12 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-28feff5d-5c58-4d05-851c-00747e5b78bb tempest-VolumesListTestJSON-64571285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-5cf22c94-ea8c-49bc-b139-3bd0735c662b" returned: 0 in 0.323s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:58:12 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-28feff5d-5c58-4d05-851c-00747e5b78bb tempest-VolumesListTestJSON-64571285 None] <== create_volume: return (866ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'} {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 13 13:58:12 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-28feff5d-5c58-4d05-851c-00747e5b78bb tempest-VolumesListTestJSON-64571285 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.871s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:58:12 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-28feff5d-5c58-4d05-851c-00747e5b78bb tempest-VolumesListTestJSON-64571285 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe7ad8c3-ce42-4b96-8fbd-4d221901ca1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5cf22c94-ea8c-49bc-b139-3bd0735c662b', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:58:12 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-28feff5d-5c58-4d05-851c-00747e5b78bb tempest-VolumesListTestJSON-64571285 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc279f10-e40f-4c60-8b4f-6241423991ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:58:12 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-28feff5d-5c58-4d05-851c-00747e5b78bb tempest-VolumesListTestJSON-64571285 None] Volume volume-5cf22c94-ea8c-49bc-b139-3bd0735c662b (5cf22c94-ea8c-49bc-b139-3bd0735c662b): created successfully Jul 13 13:58:12 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-28feff5d-5c58-4d05-851c-00747e5b78bb tempest-VolumesListTestJSON-64571285 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc279f10-e40f-4c60-8b4f-6241423991ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:58:12 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-28feff5d-5c58-4d05-851c-00747e5b78bb tempest-VolumesListTestJSON-64571285 None] Flow 'volume_create_manager' (920e5fe3-964f-4ca8-b07c-224b5ed68386) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 13:58:12 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-28feff5d-5c58-4d05-851c-00747e5b78bb tempest-VolumesListTestJSON-64571285 None] Created volume successfully. Jul 13 13:58:13 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-6801c3a3-ac5c-4f59-80e7-afb62d59d596 tempest-GroupsTest-709769296 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 13:58:13 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-6801c3a3-ac5c-4f59-80e7-afb62d59d596 tempest-GroupsTest-709769296 None] Flow 'volume_create_manager' (f6b33e68-03b4-4af9-b080-09af0b2550a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 13:58:13 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-6801c3a3-ac5c-4f59-80e7-afb62d59d596 tempest-GroupsTest-709769296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b6402fc-cc40-4302-b252-431df70ba3dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:58:13 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-6801c3a3-ac5c-4f59-80e7-afb62d59d596 tempest-GroupsTest-709769296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b6402fc-cc40-4302-b252-431df70ba3dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T11:58:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-502376380',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=79e78082-119a-4ba5-9ef4-561ea8626098,host='devstack@QuobyteHD#QuobyteHD',id=2fb6005b-bf1c-4783-9426-bf8aa7455431,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6ce39f9cd944f7ea024069ec05ef98a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T11:58:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T11:58:13Z,use_quota=True,user_id='64f46ba1525342bcb3cfb8e5339a44aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(19f40a0b-7308-4d48-be93-4601c3fa0e69),volume_type_id=19f40a0b-7308-4d48-be93-4601c3fa0e69)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:58:13 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-6801c3a3-ac5c-4f59-80e7-afb62d59d596 tempest-GroupsTest-709769296 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e308dd71-9297-404e-8ee3-f536c2880b9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:58:13 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-6801c3a3-ac5c-4f59-80e7-afb62d59d596 tempest-GroupsTest-709769296 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e308dd71-9297-404e-8ee3-f536c2880b9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:58:13 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-6801c3a3-ac5c-4f59-80e7-afb62d59d596 tempest-GroupsTest-709769296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4a511fb-41aa-47b4-a4db-728fbdac286b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:58:13 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-6801c3a3-ac5c-4f59-80e7-afb62d59d596 tempest-GroupsTest-709769296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4a511fb-41aa-47b4-a4db-728fbdac286b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2fb6005b-bf1c-4783-9426-bf8aa7455431', 'volume_name': 'volume-2fb6005b-bf1c-4783-9426-bf8aa7455431', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:58:13 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-6801c3a3-ac5c-4f59-80e7-afb62d59d596 tempest-GroupsTest-709769296 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d52dac6e-4c93-47d3-8f5e-661e2d38c806) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:58:13 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-6801c3a3-ac5c-4f59-80e7-afb62d59d596 tempest-GroupsTest-709769296 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d52dac6e-4c93-47d3-8f5e-661e2d38c806) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:58:13 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-6801c3a3-ac5c-4f59-80e7-afb62d59d596 tempest-GroupsTest-709769296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (302c5690-a47d-4dba-8ef8-1a967a483da1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:58:13 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-6801c3a3-ac5c-4f59-80e7-afb62d59d596 tempest-GroupsTest-709769296 None] Volume 2fb6005b-bf1c-4783-9426-bf8aa7455431: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2fb6005b-bf1c-4783-9426-bf8aa7455431', 'volume_size': 1} Jul 13 13:58:13 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-6801c3a3-ac5c-4f59-80e7-afb62d59d596 tempest-GroupsTest-709769296 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:58:13 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-6801c3a3-ac5c-4f59-80e7-afb62d59d596 tempest-GroupsTest-709769296 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:58:13 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-6801c3a3-ac5c-4f59-80e7-afb62d59d596 tempest-GroupsTest-709769296 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=79e78082-119a-4ba5-9ef4-561ea8626098,created_at=2026-07-13T11:58:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-502376380',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=79e78082-119a-4ba5-9ef4-561ea8626098,host='devstack@QuobyteHD#QuobyteHD',id=2fb6005b-bf1c-4783-9426-bf8aa7455431,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6ce39f9cd944f7ea024069ec05ef98a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T11:58:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T11:58:13Z,use_quota=True,user_id='64f46ba1525342bcb3cfb8e5339a44aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(19f40a0b-7308-4d48-be93-4601c3fa0e69),volume_type_id=19f40a0b-7308-4d48-be93-4601c3fa0e69)}" {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 13 13:58:13 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-6801c3a3-ac5c-4f59-80e7-afb62d59d596 tempest-GroupsTest-709769296 None] Creating volume 2fb6005b-bf1c-4783-9426-bf8aa7455431 {{(pid=87098) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 13 13:58:13 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-6801c3a3-ac5c-4f59-80e7-afb62d59d596 tempest-GroupsTest-709769296 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:58:13 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-6801c3a3-ac5c-4f59-80e7-afb62d59d596 tempest-GroupsTest-709769296 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:58:13 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-6801c3a3-ac5c-4f59-80e7-afb62d59d596 tempest-GroupsTest-709769296 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 13:58:13 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-6801c3a3-ac5c-4f59-80e7-afb62d59d596 tempest-GroupsTest-709769296 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 13:58:13 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-6801c3a3-ac5c-4f59-80e7-afb62d59d596 tempest-GroupsTest-709769296 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:58:13 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-6801c3a3-ac5c-4f59-80e7-afb62d59d596 tempest-GroupsTest-709769296 None] Selected osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 13:58:13 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-6801c3a3-ac5c-4f59-80e7-afb62d59d596 tempest-GroupsTest-709769296 None] casted to osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 Jul 13 13:58:13 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-6801c3a3-ac5c-4f59-80e7-afb62d59d596 tempest-GroupsTest-709769296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-2fb6005b-bf1c-4783-9426-bf8aa7455431 1073741824 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:58:13 devstack sudo[98457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-2fb6005b-bf1c-4783-9426-bf8aa7455431 1073741824 Jul 13 13:58:13 devstack sudo[98457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:58:14 devstack sudo[98457]: pam_unix(sudo:session): session closed for user root Jul 13 13:58:14 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-6801c3a3-ac5c-4f59-80e7-afb62d59d596 tempest-GroupsTest-709769296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-2fb6005b-bf1c-4783-9426-bf8aa7455431 1073741824" returned: 0 in 0.609s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:58:14 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-6801c3a3-ac5c-4f59-80e7-afb62d59d596 tempest-GroupsTest-709769296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-2fb6005b-bf1c-4783-9426-bf8aa7455431 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:58:14 devstack sudo[98474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-2fb6005b-bf1c-4783-9426-bf8aa7455431 Jul 13 13:58:14 devstack sudo[98474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:58:14 devstack sudo[98474]: pam_unix(sudo:session): session closed for user root Jul 13 13:58:14 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-6801c3a3-ac5c-4f59-80e7-afb62d59d596 tempest-GroupsTest-709769296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-2fb6005b-bf1c-4783-9426-bf8aa7455431" returned: 0 in 0.355s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:58:14 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-6801c3a3-ac5c-4f59-80e7-afb62d59d596 tempest-GroupsTest-709769296 None] <== create_volume: return (1030ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'} {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 13 13:58:14 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-6801c3a3-ac5c-4f59-80e7-afb62d59d596 tempest-GroupsTest-709769296 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.034s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:58:14 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-6801c3a3-ac5c-4f59-80e7-afb62d59d596 tempest-GroupsTest-709769296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (302c5690-a47d-4dba-8ef8-1a967a483da1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2fb6005b-bf1c-4783-9426-bf8aa7455431', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:58:14 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-6801c3a3-ac5c-4f59-80e7-afb62d59d596 tempest-GroupsTest-709769296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f30f7f0-d0a3-4c47-bba7-b4bd868fc9de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:58:14 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-6801c3a3-ac5c-4f59-80e7-afb62d59d596 tempest-GroupsTest-709769296 None] Volume volume-2fb6005b-bf1c-4783-9426-bf8aa7455431 (2fb6005b-bf1c-4783-9426-bf8aa7455431): created successfully Jul 13 13:58:14 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-6801c3a3-ac5c-4f59-80e7-afb62d59d596 tempest-GroupsTest-709769296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f30f7f0-d0a3-4c47-bba7-b4bd868fc9de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:58:14 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-6801c3a3-ac5c-4f59-80e7-afb62d59d596 tempest-GroupsTest-709769296 None] Flow 'volume_create_manager' (f6b33e68-03b4-4af9-b080-09af0b2550a9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 13:58:14 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-6801c3a3-ac5c-4f59-80e7-afb62d59d596 tempest-GroupsTest-709769296 None] Created volume successfully. Jul 13 13:58:15 devstack cinder-volume[87098]: INFO cinder.volume.manager [req-700d5bff-aa41-4104-a019-f06f3c19025e req-605fa90f-3528-470e-a80c-00b4eeae7dec tempest-TestInstancesWithCinderVolumes-1739256037 None] Terminate volume connection completed successfully. Jul 13 13:58:15 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [req-700d5bff-aa41-4104-a019-f06f3c19025e req-605fa90f-3528-470e-a80c-00b4eeae7dec tempest-TestInstancesWithCinderVolumes-1739256037 None] Deleting attachment 8056bf27-1e66-47f0-b623-f5560d6f7401. {{(pid=87098) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 13 13:58:16 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-75277d97-5cf5-470f-867d-780e1b2c89ce tempest-TestInstancesWithCinderVolumes-1739256037 None] Acquiring lock "cinder-72998338-69fb-46f0-b04c-890de1054fb9-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 13:58:16 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-75277d97-5cf5-470f-867d-780e1b2c89ce tempest-TestInstancesWithCinderVolumes-1739256037 None] Lock "cinder-72998338-69fb-46f0-b04c-890de1054fb9-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 13:58:16 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-75277d97-5cf5-470f-867d-780e1b2c89ce tempest-TestInstancesWithCinderVolumes-1739256037 None] Acquiring lock "cinder-quobyte-72998338-69fb-46f0-b04c-890de1054fb9" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 13:58:16 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-75277d97-5cf5-470f-867d-780e1b2c89ce tempest-TestInstancesWithCinderVolumes-1739256037 None] Lock "cinder-quobyte-72998338-69fb-46f0-b04c-890de1054fb9" acquired by "delete_volume" :: waited 0.016s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 13:58:16 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3304a88-5a92-48c1-870f-941568104711]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 13:58:16 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-75277d97-5cf5-470f-867d-780e1b2c89ce tempest-TestInstancesWithCinderVolumes-1739256037 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-72998338-69fb-46f0-b04c-890de1054fb9 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:58:16 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-632e9899-9b7c-4f7d-a043-e9059117ed00 tempest-GroupsTest-709769296 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 13:58:16 devstack sudo[98484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-72998338-69fb-46f0-b04c-890de1054fb9 Jul 13 13:58:16 devstack sudo[98484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:58:16 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-632e9899-9b7c-4f7d-a043-e9059117ed00 tempest-GroupsTest-709769296 None] Flow 'volume_create_manager' (ae38d6b2-975d-42de-ab1c-123bfb3b6e34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 13:58:16 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-632e9899-9b7c-4f7d-a043-e9059117ed00 tempest-GroupsTest-709769296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7bc81613-5ad9-4a6d-9c88-030668446798) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:58:16 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-d1b09642-828c-44e7-ad50-a577e219a475 tempest-VolumesListTestJSON-64571285 None] Acquiring lock "cinder-5cf22c94-ea8c-49bc-b139-3bd0735c662b-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 13:58:16 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-632e9899-9b7c-4f7d-a043-e9059117ed00 tempest-GroupsTest-709769296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7bc81613-5ad9-4a6d-9c88-030668446798) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T11:58:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-257939959',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=79e78082-119a-4ba5-9ef4-561ea8626098,host='devstack@QuobyteHD#QuobyteHD',id=4f2f303c-5d93-4339-aa36-b6b687774358,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6ce39f9cd944f7ea024069ec05ef98a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T11:58:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T11:58:16Z,use_quota=True,user_id='64f46ba1525342bcb3cfb8e5339a44aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(19f40a0b-7308-4d48-be93-4601c3fa0e69),volume_type_id=19f40a0b-7308-4d48-be93-4601c3fa0e69)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:58:16 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-632e9899-9b7c-4f7d-a043-e9059117ed00 tempest-GroupsTest-709769296 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e83f79d-c388-4a5b-a961-81fc0155345b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:58:16 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-632e9899-9b7c-4f7d-a043-e9059117ed00 tempest-GroupsTest-709769296 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e83f79d-c388-4a5b-a961-81fc0155345b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:58:16 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-632e9899-9b7c-4f7d-a043-e9059117ed00 tempest-GroupsTest-709769296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2ca33b5-148e-40e6-862d-e40390f69c76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:58:16 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-632e9899-9b7c-4f7d-a043-e9059117ed00 tempest-GroupsTest-709769296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2ca33b5-148e-40e6-862d-e40390f69c76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4f2f303c-5d93-4339-aa36-b6b687774358', 'volume_name': 'volume-4f2f303c-5d93-4339-aa36-b6b687774358', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:58:16 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-632e9899-9b7c-4f7d-a043-e9059117ed00 tempest-GroupsTest-709769296 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (012bf376-af47-417c-a529-57ee0a72aa4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:58:16 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-632e9899-9b7c-4f7d-a043-e9059117ed00 tempest-GroupsTest-709769296 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (012bf376-af47-417c-a529-57ee0a72aa4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:58:16 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-632e9899-9b7c-4f7d-a043-e9059117ed00 tempest-GroupsTest-709769296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d074ee6-2207-4fd1-9fda-d4e22b56bee0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:58:16 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-632e9899-9b7c-4f7d-a043-e9059117ed00 tempest-GroupsTest-709769296 None] Volume 4f2f303c-5d93-4339-aa36-b6b687774358: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4f2f303c-5d93-4339-aa36-b6b687774358', 'volume_size': 1} Jul 13 13:58:16 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-632e9899-9b7c-4f7d-a043-e9059117ed00 tempest-GroupsTest-709769296 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:58:16 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-632e9899-9b7c-4f7d-a043-e9059117ed00 tempest-GroupsTest-709769296 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:58:16 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-632e9899-9b7c-4f7d-a043-e9059117ed00 tempest-GroupsTest-709769296 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=79e78082-119a-4ba5-9ef4-561ea8626098,created_at=2026-07-13T11:58:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-257939959',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=79e78082-119a-4ba5-9ef4-561ea8626098,host='devstack@QuobyteHD#QuobyteHD',id=4f2f303c-5d93-4339-aa36-b6b687774358,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6ce39f9cd944f7ea024069ec05ef98a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T11:58:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T11:58:16Z,use_quota=True,user_id='64f46ba1525342bcb3cfb8e5339a44aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(19f40a0b-7308-4d48-be93-4601c3fa0e69),volume_type_id=19f40a0b-7308-4d48-be93-4601c3fa0e69)}" {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 13 13:58:16 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-632e9899-9b7c-4f7d-a043-e9059117ed00 tempest-GroupsTest-709769296 None] Creating volume 4f2f303c-5d93-4339-aa36-b6b687774358 {{(pid=87098) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 13 13:58:16 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-632e9899-9b7c-4f7d-a043-e9059117ed00 tempest-GroupsTest-709769296 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:58:16 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-632e9899-9b7c-4f7d-a043-e9059117ed00 tempest-GroupsTest-709769296 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:58:16 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-632e9899-9b7c-4f7d-a043-e9059117ed00 tempest-GroupsTest-709769296 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 13:58:16 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-632e9899-9b7c-4f7d-a043-e9059117ed00 tempest-GroupsTest-709769296 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 13:58:16 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-632e9899-9b7c-4f7d-a043-e9059117ed00 tempest-GroupsTest-709769296 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:58:16 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-632e9899-9b7c-4f7d-a043-e9059117ed00 tempest-GroupsTest-709769296 None] Selected osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 13:58:16 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-632e9899-9b7c-4f7d-a043-e9059117ed00 tempest-GroupsTest-709769296 None] casted to osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 Jul 13 13:58:16 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-632e9899-9b7c-4f7d-a043-e9059117ed00 tempest-GroupsTest-709769296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-4f2f303c-5d93-4339-aa36-b6b687774358 1073741824 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:58:16 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-d1b09642-828c-44e7-ad50-a577e219a475 tempest-VolumesListTestJSON-64571285 None] Lock "cinder-5cf22c94-ea8c-49bc-b139-3bd0735c662b-delete_volume" acquired by "delete_volume" :: waited 0.131s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 13:58:16 devstack sudo[98486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-4f2f303c-5d93-4339-aa36-b6b687774358 1073741824 Jul 13 13:58:16 devstack sudo[98486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:58:16 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-d1b09642-828c-44e7-ad50-a577e219a475 tempest-VolumesListTestJSON-64571285 None] Acquiring lock "cinder-quobyte-5cf22c94-ea8c-49bc-b139-3bd0735c662b" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 13:58:16 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-d1b09642-828c-44e7-ad50-a577e219a475 tempest-VolumesListTestJSON-64571285 None] Lock "cinder-quobyte-5cf22c94-ea8c-49bc-b139-3bd0735c662b" acquired by "delete_volume" :: waited 0.027s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 13:58:16 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[4181097f-bab9-4f76-b55b-ff44ce9dad75]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 13:58:16 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-d1b09642-828c-44e7-ad50-a577e219a475 tempest-VolumesListTestJSON-64571285 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-5cf22c94-ea8c-49bc-b139-3bd0735c662b {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:58:16 devstack sudo[98484]: pam_unix(sudo:session): session closed for user root Jul 13 13:58:16 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-75277d97-5cf5-470f-867d-780e1b2c89ce tempest-TestInstancesWithCinderVolumes-1739256037 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-72998338-69fb-46f0-b04c-890de1054fb9" returned: 0 in 0.665s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:58:16 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-75277d97-5cf5-470f-867d-780e1b2c89ce tempest-TestInstancesWithCinderVolumes-1739256037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-72998338-69fb-46f0-b04c-890de1054fb9 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:58:16 devstack sudo[98493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-72998338-69fb-46f0-b04c-890de1054fb9 Jul 13 13:58:16 devstack sudo[98493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:58:16 devstack sudo[98492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-5cf22c94-ea8c-49bc-b139-3bd0735c662b Jul 13 13:58:16 devstack sudo[98492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:58:17 devstack sudo[98493]: pam_unix(sudo:session): session closed for user root Jul 13 13:58:17 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-75277d97-5cf5-470f-867d-780e1b2c89ce tempest-TestInstancesWithCinderVolumes-1739256037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-72998338-69fb-46f0-b04c-890de1054fb9" returned: 0 in 0.403s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:58:17 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-75277d97-5cf5-470f-867d-780e1b2c89ce tempest-TestInstancesWithCinderVolumes-1739256037 None] Lock "cinder-quobyte-72998338-69fb-46f0-b04c-890de1054fb9" released by "delete_volume" :: held 1.162s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 13:58:17 devstack sudo[98486]: pam_unix(sudo:session): session closed for user root Jul 13 13:58:17 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-632e9899-9b7c-4f7d-a043-e9059117ed00 tempest-GroupsTest-709769296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-4f2f303c-5d93-4339-aa36-b6b687774358 1073741824" returned: 0 in 0.699s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:58:17 devstack sudo[98492]: pam_unix(sudo:session): session closed for user root Jul 13 13:58:17 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-d1b09642-828c-44e7-ad50-a577e219a475 tempest-VolumesListTestJSON-64571285 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-5cf22c94-ea8c-49bc-b139-3bd0735c662b" returned: 0 in 0.584s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:58:17 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-d1b09642-828c-44e7-ad50-a577e219a475 tempest-VolumesListTestJSON-64571285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-5cf22c94-ea8c-49bc-b139-3bd0735c662b {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:58:17 devstack sudo[98504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-5cf22c94-ea8c-49bc-b139-3bd0735c662b Jul 13 13:58:17 devstack sudo[98504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:58:17 devstack cinder-volume[87098]: WARNING cinder.quota [None req-75277d97-5cf5-470f-867d-780e1b2c89ce tempest-TestInstancesWithCinderVolumes-1739256037 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-839791314-2055291155 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-839791314-2055291155, it is now deprecated. Please use the default quota class for default quota. Jul 13 13:58:17 devstack cinder-volume[87098]: WARNING cinder.quota [None req-75277d97-5cf5-470f-867d-780e1b2c89ce tempest-TestInstancesWithCinderVolumes-1739256037 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-839791314-2055291155 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-839791314-2055291155, it is now deprecated. Please use the default quota class for default quota. Jul 13 13:58:17 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca7159aa-c1b4-4c2e-b5cf-24095aa73469 tempest-VolumesSnapshotNegativeTestJSON-1056492376 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 13:58:17 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-ca7159aa-c1b4-4c2e-b5cf-24095aa73469 tempest-VolumesSnapshotNegativeTestJSON-1056492376 None] Flow 'volume_create_manager' (baa18e90-43db-4e4d-932d-d5e8cb6994d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 13:58:17 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-ca7159aa-c1b4-4c2e-b5cf-24095aa73469 tempest-VolumesSnapshotNegativeTestJSON-1056492376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b32995ab-9629-4cce-a75b-f22e9f72a6cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:58:17 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-632e9899-9b7c-4f7d-a043-e9059117ed00 tempest-GroupsTest-709769296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-4f2f303c-5d93-4339-aa36-b6b687774358 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:58:17 devstack sudo[98506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-4f2f303c-5d93-4339-aa36-b6b687774358 Jul 13 13:58:17 devstack sudo[98506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:58:17 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-ca7159aa-c1b4-4c2e-b5cf-24095aa73469 tempest-VolumesSnapshotNegativeTestJSON-1056492376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b32995ab-9629-4cce-a75b-f22e9f72a6cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T11:58:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-450004871',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ac71e49-eeb7-49a7-85f0-5520e21e60ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b303b4d152f946c594746fe8e475ee13',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T11:58:17Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T11:58:17Z,use_quota=True,user_id='6976b2a6a06a4f4a8ae8e378e2970afc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1147de8b-623b-426c-a13d-7fc824a80f67),volume_type_id=1147de8b-623b-426c-a13d-7fc824a80f67)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:58:17 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-ca7159aa-c1b4-4c2e-b5cf-24095aa73469 tempest-VolumesSnapshotNegativeTestJSON-1056492376 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab044aea-64c7-48cc-9c69-f94f6649cd5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:58:17 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-ca7159aa-c1b4-4c2e-b5cf-24095aa73469 tempest-VolumesSnapshotNegativeTestJSON-1056492376 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab044aea-64c7-48cc-9c69-f94f6649cd5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:58:17 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-ca7159aa-c1b4-4c2e-b5cf-24095aa73469 tempest-VolumesSnapshotNegativeTestJSON-1056492376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e86bb631-2a34-4d76-af4c-cea24e0f10b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:58:17 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-ca7159aa-c1b4-4c2e-b5cf-24095aa73469 tempest-VolumesSnapshotNegativeTestJSON-1056492376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e86bb631-2a34-4d76-af4c-cea24e0f10b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2ac71e49-eeb7-49a7-85f0-5520e21e60ba', 'volume_name': 'volume-2ac71e49-eeb7-49a7-85f0-5520e21e60ba', 'volume_size': 2}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:58:17 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-ca7159aa-c1b4-4c2e-b5cf-24095aa73469 tempest-VolumesSnapshotNegativeTestJSON-1056492376 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e5dde6e-28e9-4d5e-9be6-138672f56166) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:58:17 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-ca7159aa-c1b4-4c2e-b5cf-24095aa73469 tempest-VolumesSnapshotNegativeTestJSON-1056492376 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e5dde6e-28e9-4d5e-9be6-138672f56166) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:58:17 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-ca7159aa-c1b4-4c2e-b5cf-24095aa73469 tempest-VolumesSnapshotNegativeTestJSON-1056492376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c49a9fb-d4e1-492f-bc82-39b552d0797a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:58:17 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-ca7159aa-c1b4-4c2e-b5cf-24095aa73469 tempest-VolumesSnapshotNegativeTestJSON-1056492376 None] Volume 2ac71e49-eeb7-49a7-85f0-5520e21e60ba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2ac71e49-eeb7-49a7-85f0-5520e21e60ba', 'volume_size': 2} Jul 13 13:58:17 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-ca7159aa-c1b4-4c2e-b5cf-24095aa73469 tempest-VolumesSnapshotNegativeTestJSON-1056492376 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:58:17 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-75277d97-5cf5-470f-867d-780e1b2c89ce tempest-TestInstancesWithCinderVolumes-1739256037 None] Created reservations ['7f17a876-e911-4c11-a463-e97fe39604a5', '84bb51d0-96bc-48eb-af74-2a151b602c0b', '936b355e-f62c-4ed6-94bc-d8c31b22f50a', 'd2f6978f-3be8-4116-bb44-2482c7690c0b'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 13:58:17 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-75277d97-5cf5-470f-867d-780e1b2c89ce tempest-TestInstancesWithCinderVolumes-1739256037 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:58:17 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-75277d97-5cf5-470f-867d-780e1b2c89ce tempest-TestInstancesWithCinderVolumes-1739256037 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:58:17 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-75277d97-5cf5-470f-867d-780e1b2c89ce tempest-TestInstancesWithCinderVolumes-1739256037 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 13:58:17 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-75277d97-5cf5-470f-867d-780e1b2c89ce tempest-TestInstancesWithCinderVolumes-1739256037 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 13:58:17 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-75277d97-5cf5-470f-867d-780e1b2c89ce tempest-TestInstancesWithCinderVolumes-1739256037 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:58:17 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-75277d97-5cf5-470f-867d-780e1b2c89ce tempest-TestInstancesWithCinderVolumes-1739256037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:58:17 devstack sudo[98509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 Jul 13 13:58:17 devstack sudo[98509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:58:17 devstack sudo[98504]: pam_unix(sudo:session): session closed for user root Jul 13 13:58:17 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-d1b09642-828c-44e7-ad50-a577e219a475 tempest-VolumesListTestJSON-64571285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-5cf22c94-ea8c-49bc-b139-3bd0735c662b" returned: 0 in 0.383s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:58:17 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-d1b09642-828c-44e7-ad50-a577e219a475 tempest-VolumesListTestJSON-64571285 None] Lock "cinder-quobyte-5cf22c94-ea8c-49bc-b139-3bd0735c662b" released by "delete_volume" :: held 1.042s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 13:58:17 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-d1b09642-828c-44e7-ad50-a577e219a475 tempest-VolumesListTestJSON-64571285 None] Created reservations ['068423c2-4c33-4fc8-b3b6-f408f5d2daa3', '58b60386-1925-4106-932b-3ed9c11b0664', '117b6448-7b1f-4887-947b-460ba1ccc1ae', '5004913c-10d4-45c9-a1a1-161dd2b5408a'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 13:58:17 devstack sudo[98506]: pam_unix(sudo:session): session closed for user root Jul 13 13:58:17 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-632e9899-9b7c-4f7d-a043-e9059117ed00 tempest-GroupsTest-709769296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-4f2f303c-5d93-4339-aa36-b6b687774358" returned: 0 in 0.429s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:58:17 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-632e9899-9b7c-4f7d-a043-e9059117ed00 tempest-GroupsTest-709769296 None] <== create_volume: return (1279ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'} {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 13 13:58:17 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-632e9899-9b7c-4f7d-a043-e9059117ed00 tempest-GroupsTest-709769296 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.283s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:58:17 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-ca7159aa-c1b4-4c2e-b5cf-24095aa73469 tempest-VolumesSnapshotNegativeTestJSON-1056492376 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.348s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:58:17 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-ca7159aa-c1b4-4c2e-b5cf-24095aa73469 tempest-VolumesSnapshotNegativeTestJSON-1056492376 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T11:58:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-450004871',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ac71e49-eeb7-49a7-85f0-5520e21e60ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b303b4d152f946c594746fe8e475ee13',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T11:58:17Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T11:58:17Z,use_quota=True,user_id='6976b2a6a06a4f4a8ae8e378e2970afc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1147de8b-623b-426c-a13d-7fc824a80f67),volume_type_id=1147de8b-623b-426c-a13d-7fc824a80f67)}" {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 13 13:58:17 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-ca7159aa-c1b4-4c2e-b5cf-24095aa73469 tempest-VolumesSnapshotNegativeTestJSON-1056492376 None] Creating volume 2ac71e49-eeb7-49a7-85f0-5520e21e60ba {{(pid=87098) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 13 13:58:17 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-ca7159aa-c1b4-4c2e-b5cf-24095aa73469 tempest-VolumesSnapshotNegativeTestJSON-1056492376 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:58:17 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-ca7159aa-c1b4-4c2e-b5cf-24095aa73469 tempest-VolumesSnapshotNegativeTestJSON-1056492376 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:58:17 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-ca7159aa-c1b4-4c2e-b5cf-24095aa73469 tempest-VolumesSnapshotNegativeTestJSON-1056492376 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 13:58:17 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-ca7159aa-c1b4-4c2e-b5cf-24095aa73469 tempest-VolumesSnapshotNegativeTestJSON-1056492376 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 13:58:17 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-ca7159aa-c1b4-4c2e-b5cf-24095aa73469 tempest-VolumesSnapshotNegativeTestJSON-1056492376 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:58:17 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-ca7159aa-c1b4-4c2e-b5cf-24095aa73469 tempest-VolumesSnapshotNegativeTestJSON-1056492376 None] Selected osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 13:58:17 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-ca7159aa-c1b4-4c2e-b5cf-24095aa73469 tempest-VolumesSnapshotNegativeTestJSON-1056492376 None] casted to osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 Jul 13 13:58:17 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-ca7159aa-c1b4-4c2e-b5cf-24095aa73469 tempest-VolumesSnapshotNegativeTestJSON-1056492376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-2ac71e49-eeb7-49a7-85f0-5520e21e60ba 2147483648 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:58:17 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-632e9899-9b7c-4f7d-a043-e9059117ed00 tempest-GroupsTest-709769296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d074ee6-2207-4fd1-9fda-d4e22b56bee0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4f2f303c-5d93-4339-aa36-b6b687774358', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:58:17 devstack sudo[98513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-2ac71e49-eeb7-49a7-85f0-5520e21e60ba 2147483648 Jul 13 13:58:17 devstack sudo[98513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:58:17 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-632e9899-9b7c-4f7d-a043-e9059117ed00 tempest-GroupsTest-709769296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eafa7976-faec-4b89-a348-7a825cd2fb65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:58:17 devstack sudo[98509]: pam_unix(sudo:session): session closed for user root Jul 13 13:58:17 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-75277d97-5cf5-470f-867d-780e1b2c89ce tempest-TestInstancesWithCinderVolumes-1739256037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78" returned: 0 in 0.308s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:58:17 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-75277d97-5cf5-470f-867d-780e1b2c89ce tempest-TestInstancesWithCinderVolumes-1739256037 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 13:58:17 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-632e9899-9b7c-4f7d-a043-e9059117ed00 tempest-GroupsTest-709769296 None] Volume volume-4f2f303c-5d93-4339-aa36-b6b687774358 (4f2f303c-5d93-4339-aa36-b6b687774358): created successfully Jul 13 13:58:17 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-632e9899-9b7c-4f7d-a043-e9059117ed00 tempest-GroupsTest-709769296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eafa7976-faec-4b89-a348-7a825cd2fb65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:58:17 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-632e9899-9b7c-4f7d-a043-e9059117ed00 tempest-GroupsTest-709769296 None] Flow 'volume_create_manager' (ae38d6b2-975d-42de-ab1c-123bfb3b6e34) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 13:58:17 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-75277d97-5cf5-470f-867d-780e1b2c89ce tempest-TestInstancesWithCinderVolumes-1739256037 None] Deleted volume successfully. Jul 13 13:58:18 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-632e9899-9b7c-4f7d-a043-e9059117ed00 tempest-GroupsTest-709769296 None] Created volume successfully. Jul 13 13:58:18 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-75277d97-5cf5-470f-867d-780e1b2c89ce tempest-TestInstancesWithCinderVolumes-1739256037 None] Lock "cinder-72998338-69fb-46f0-b04c-890de1054fb9-delete_volume" released by "delete_volume" :: held 1.938s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 13:58:18 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-d1b09642-828c-44e7-ad50-a577e219a475 tempest-VolumesListTestJSON-64571285 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:58:18 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-d1b09642-828c-44e7-ad50-a577e219a475 tempest-VolumesListTestJSON-64571285 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:58:18 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-d1b09642-828c-44e7-ad50-a577e219a475 tempest-VolumesListTestJSON-64571285 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 13:58:18 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-d1b09642-828c-44e7-ad50-a577e219a475 tempest-VolumesListTestJSON-64571285 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 13:58:18 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-d1b09642-828c-44e7-ad50-a577e219a475 tempest-VolumesListTestJSON-64571285 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:58:18 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-d1b09642-828c-44e7-ad50-a577e219a475 tempest-VolumesListTestJSON-64571285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:58:18 devstack sudo[98515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 Jul 13 13:58:18 devstack sudo[98515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:58:18 devstack sudo[98515]: pam_unix(sudo:session): session closed for user root Jul 13 13:58:18 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-d1b09642-828c-44e7-ad50-a577e219a475 tempest-VolumesListTestJSON-64571285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78" returned: 0 in 0.316s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:58:18 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-d1b09642-828c-44e7-ad50-a577e219a475 tempest-VolumesListTestJSON-64571285 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 13:58:18 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-d1b09642-828c-44e7-ad50-a577e219a475 tempest-VolumesListTestJSON-64571285 None] Deleted volume successfully. Jul 13 13:58:18 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-d1b09642-828c-44e7-ad50-a577e219a475 tempest-VolumesListTestJSON-64571285 None] Lock "cinder-5cf22c94-ea8c-49bc-b139-3bd0735c662b-delete_volume" released by "delete_volume" :: held 1.733s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 13:58:18 devstack sudo[98513]: pam_unix(sudo:session): session closed for user root Jul 13 13:58:18 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-ca7159aa-c1b4-4c2e-b5cf-24095aa73469 tempest-VolumesSnapshotNegativeTestJSON-1056492376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-2ac71e49-eeb7-49a7-85f0-5520e21e60ba 2147483648" returned: 0 in 0.599s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:58:18 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-ca7159aa-c1b4-4c2e-b5cf-24095aa73469 tempest-VolumesSnapshotNegativeTestJSON-1056492376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-2ac71e49-eeb7-49a7-85f0-5520e21e60ba {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:58:18 devstack sudo[98529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-2ac71e49-eeb7-49a7-85f0-5520e21e60ba Jul 13 13:58:18 devstack sudo[98529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:58:18 devstack sudo[98529]: pam_unix(sudo:session): session closed for user root Jul 13 13:58:18 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-ca7159aa-c1b4-4c2e-b5cf-24095aa73469 tempest-VolumesSnapshotNegativeTestJSON-1056492376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-2ac71e49-eeb7-49a7-85f0-5520e21e60ba" returned: 0 in 0.323s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:58:18 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-ca7159aa-c1b4-4c2e-b5cf-24095aa73469 tempest-VolumesSnapshotNegativeTestJSON-1056492376 None] <== create_volume: return (966ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'} {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 13 13:58:18 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-ca7159aa-c1b4-4c2e-b5cf-24095aa73469 tempest-VolumesSnapshotNegativeTestJSON-1056492376 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.970s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:58:18 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-ca7159aa-c1b4-4c2e-b5cf-24095aa73469 tempest-VolumesSnapshotNegativeTestJSON-1056492376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c49a9fb-d4e1-492f-bc82-39b552d0797a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2ac71e49-eeb7-49a7-85f0-5520e21e60ba', 'volume_size': 2}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:58:18 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-ca7159aa-c1b4-4c2e-b5cf-24095aa73469 tempest-VolumesSnapshotNegativeTestJSON-1056492376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7eefb1b8-e216-4965-b445-35f9cdc778fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:58:18 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-ca7159aa-c1b4-4c2e-b5cf-24095aa73469 tempest-VolumesSnapshotNegativeTestJSON-1056492376 None] Volume volume-2ac71e49-eeb7-49a7-85f0-5520e21e60ba (2ac71e49-eeb7-49a7-85f0-5520e21e60ba): created successfully Jul 13 13:58:18 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-ca7159aa-c1b4-4c2e-b5cf-24095aa73469 tempest-VolumesSnapshotNegativeTestJSON-1056492376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7eefb1b8-e216-4965-b445-35f9cdc778fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:58:18 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-ca7159aa-c1b4-4c2e-b5cf-24095aa73469 tempest-VolumesSnapshotNegativeTestJSON-1056492376 None] Flow 'volume_create_manager' (baa18e90-43db-4e4d-932d-d5e8cb6994d9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 13:58:18 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-86ac2253-9abe-49b1-abdc-db0c20ba9e37 tempest-VolumesListTestJSON-64571285 None] Acquiring lock "cinder-49001f84-519d-45cd-a57a-2f38b397b09d-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 13:58:19 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-86ac2253-9abe-49b1-abdc-db0c20ba9e37 tempest-VolumesListTestJSON-64571285 None] Lock "cinder-49001f84-519d-45cd-a57a-2f38b397b09d-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 13:58:19 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-ca7159aa-c1b4-4c2e-b5cf-24095aa73469 tempest-VolumesSnapshotNegativeTestJSON-1056492376 None] Created volume successfully. Jul 13 13:58:19 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-86ac2253-9abe-49b1-abdc-db0c20ba9e37 tempest-VolumesListTestJSON-64571285 None] Acquiring lock "cinder-quobyte-49001f84-519d-45cd-a57a-2f38b397b09d" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 13:58:19 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-86ac2253-9abe-49b1-abdc-db0c20ba9e37 tempest-VolumesListTestJSON-64571285 None] Lock "cinder-quobyte-49001f84-519d-45cd-a57a-2f38b397b09d" acquired by "delete_volume" :: waited 0.019s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 13:58:19 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[2049554b-018f-452a-999f-132f0a90263e]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 13:58:19 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-86ac2253-9abe-49b1-abdc-db0c20ba9e37 tempest-VolumesListTestJSON-64571285 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-49001f84-519d-45cd-a57a-2f38b397b09d {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:58:19 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-d40e0064-98d7-498d-8873-523b3525de60 tempest-GroupsTest-709769296 None] Update group completed successfully. Jul 13 13:58:19 devstack sudo[98547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-49001f84-519d-45cd-a57a-2f38b397b09d Jul 13 13:58:19 devstack sudo[98547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:58:19 devstack sudo[98547]: pam_unix(sudo:session): session closed for user root Jul 13 13:58:19 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-86ac2253-9abe-49b1-abdc-db0c20ba9e37 tempest-VolumesListTestJSON-64571285 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-49001f84-519d-45cd-a57a-2f38b397b09d" returned: 0 in 0.380s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:58:19 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-86ac2253-9abe-49b1-abdc-db0c20ba9e37 tempest-VolumesListTestJSON-64571285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-49001f84-519d-45cd-a57a-2f38b397b09d {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:58:19 devstack sudo[98560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-49001f84-519d-45cd-a57a-2f38b397b09d Jul 13 13:58:19 devstack sudo[98560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:58:19 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-44a1da65-fd2c-4a1c-95df-79a3f896bbe6 tempest-VolumesSnapshotNegativeTestJSON-1056492376 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:58:19 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-44a1da65-fd2c-4a1c-95df-79a3f896bbe6 tempest-VolumesSnapshotNegativeTestJSON-1056492376 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:58:19 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-44a1da65-fd2c-4a1c-95df-79a3f896bbe6 tempest-VolumesSnapshotNegativeTestJSON-1056492376 None] Creating offline snapshot 60a110b1-42a1-44e9-ae28-fbd0af89a8f5 of volume 2ac71e49-eeb7-49a7-85f0-5520e21e60ba {{(pid=87098) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 13 13:58:19 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[47b45ecb-3313-4409-bdbc-259f98dc8376]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 13:58:19 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-44a1da65-fd2c-4a1c-95df-79a3f896bbe6 tempest-VolumesSnapshotNegativeTestJSON-1056492376 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-2ac71e49-eeb7-49a7-85f0-5520e21e60ba {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:58:19 devstack sudo[98560]: pam_unix(sudo:session): session closed for user root Jul 13 13:58:19 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-86ac2253-9abe-49b1-abdc-db0c20ba9e37 tempest-VolumesListTestJSON-64571285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-49001f84-519d-45cd-a57a-2f38b397b09d" returned: 0 in 0.296s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:58:19 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-86ac2253-9abe-49b1-abdc-db0c20ba9e37 tempest-VolumesListTestJSON-64571285 None] Lock "cinder-quobyte-49001f84-519d-45cd-a57a-2f38b397b09d" released by "delete_volume" :: held 0.720s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 13:58:19 devstack sudo[98562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-2ac71e49-eeb7-49a7-85f0-5520e21e60ba Jul 13 13:58:19 devstack sudo[98562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:58:19 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-86ac2253-9abe-49b1-abdc-db0c20ba9e37 tempest-VolumesListTestJSON-64571285 None] Created reservations ['69b4ddfc-dbfc-48a7-82e6-ee38a34445e3', '03f555c0-23d5-4433-ad76-7e0477b39cb4', 'f08ea017-cbcd-4e8f-9cab-c9a83b0959e7', '3b81e82a-7653-46e8-87cf-cd0ca8a8568a'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 13:58:19 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-86ac2253-9abe-49b1-abdc-db0c20ba9e37 tempest-VolumesListTestJSON-64571285 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:58:19 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-86ac2253-9abe-49b1-abdc-db0c20ba9e37 tempest-VolumesListTestJSON-64571285 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:58:19 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-86ac2253-9abe-49b1-abdc-db0c20ba9e37 tempest-VolumesListTestJSON-64571285 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 13:58:19 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-86ac2253-9abe-49b1-abdc-db0c20ba9e37 tempest-VolumesListTestJSON-64571285 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 13:58:19 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-86ac2253-9abe-49b1-abdc-db0c20ba9e37 tempest-VolumesListTestJSON-64571285 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:58:19 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-86ac2253-9abe-49b1-abdc-db0c20ba9e37 tempest-VolumesListTestJSON-64571285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:58:19 devstack sudo[98565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 Jul 13 13:58:19 devstack sudo[98565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:58:20 devstack sudo[98562]: pam_unix(sudo:session): session closed for user root Jul 13 13:58:20 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-44a1da65-fd2c-4a1c-95df-79a3f896bbe6 tempest-VolumesSnapshotNegativeTestJSON-1056492376 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-2ac71e49-eeb7-49a7-85f0-5520e21e60ba" returned: 0 in 0.471s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:58:20 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-44a1da65-fd2c-4a1c-95df-79a3f896bbe6 tempest-VolumesSnapshotNegativeTestJSON-1056492376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-2ac71e49-eeb7-49a7-85f0-5520e21e60ba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-2ac71e49-eeb7-49a7-85f0-5520e21e60ba.60a110b1-42a1-44e9-ae28-fbd0af89a8f5 2G {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:58:20 devstack sudo[98571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-2ac71e49-eeb7-49a7-85f0-5520e21e60ba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-2ac71e49-eeb7-49a7-85f0-5520e21e60ba.60a110b1-42a1-44e9-ae28-fbd0af89a8f5 2G Jul 13 13:58:20 devstack sudo[98571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:58:20 devstack sudo[98565]: pam_unix(sudo:session): session closed for user root Jul 13 13:58:20 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-86ac2253-9abe-49b1-abdc-db0c20ba9e37 tempest-VolumesListTestJSON-64571285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78" returned: 0 in 0.330s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:58:20 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-86ac2253-9abe-49b1-abdc-db0c20ba9e37 tempest-VolumesListTestJSON-64571285 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 13:58:20 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-86ac2253-9abe-49b1-abdc-db0c20ba9e37 tempest-VolumesListTestJSON-64571285 None] Deleted volume successfully. Jul 13 13:58:20 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-86ac2253-9abe-49b1-abdc-db0c20ba9e37 tempest-VolumesListTestJSON-64571285 None] Lock "cinder-49001f84-519d-45cd-a57a-2f38b397b09d-delete_volume" released by "delete_volume" :: held 1.302s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 13:58:20 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-b0208ed1-e8e4-4ff8-8851-982243101353 tempest-VolumesListTestJSON-64571285 None] Acquiring lock "cinder-efa7c894-2653-470c-b5ea-d6d683310c10-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 13:58:20 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-b0208ed1-e8e4-4ff8-8851-982243101353 tempest-VolumesListTestJSON-64571285 None] Lock "cinder-efa7c894-2653-470c-b5ea-d6d683310c10-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 13:58:20 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-b0208ed1-e8e4-4ff8-8851-982243101353 tempest-VolumesListTestJSON-64571285 None] Acquiring lock "cinder-quobyte-efa7c894-2653-470c-b5ea-d6d683310c10" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 13:58:20 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-b0208ed1-e8e4-4ff8-8851-982243101353 tempest-VolumesListTestJSON-64571285 None] Lock "cinder-quobyte-efa7c894-2653-470c-b5ea-d6d683310c10" acquired by "delete_volume" :: waited 0.029s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 13:58:20 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[349c71a8-c4fb-4efe-9ba6-ed2881c7779c]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 13:58:20 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-b0208ed1-e8e4-4ff8-8851-982243101353 tempest-VolumesListTestJSON-64571285 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-efa7c894-2653-470c-b5ea-d6d683310c10 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:58:20 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-66a40472-beca-46da-a1fa-ba5ad53efc45 tempest-GroupsTest-709769296 None] Update group completed successfully. Jul 13 13:58:20 devstack cinder-volume[87098]: INFO cinder.volume.manager [req-a133c312-a697-4c9d-a371-a2767c87a3f0 req-7a77e445-cd08-4604-af10-b9f1464cefe0 tempest-TestInstancesWithCinderVolumes-1739256037 None] Terminate volume connection completed successfully. Jul 13 13:58:20 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [req-a133c312-a697-4c9d-a371-a2767c87a3f0 req-7a77e445-cd08-4604-af10-b9f1464cefe0 tempest-TestInstancesWithCinderVolumes-1739256037 None] Deleting attachment 95ec5f8f-9f98-4a06-953b-90f6a11b976c. {{(pid=87098) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 13 13:58:20 devstack sudo[98575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-efa7c894-2653-470c-b5ea-d6d683310c10 Jul 13 13:58:20 devstack sudo[98575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:58:20 devstack sudo[98571]: pam_unix(sudo:session): session closed for user root Jul 13 13:58:20 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-44a1da65-fd2c-4a1c-95df-79a3f896bbe6 tempest-VolumesSnapshotNegativeTestJSON-1056492376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-2ac71e49-eeb7-49a7-85f0-5520e21e60ba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-2ac71e49-eeb7-49a7-85f0-5520e21e60ba.60a110b1-42a1-44e9-ae28-fbd0af89a8f5 2G" returned: 0 in 0.555s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:58:20 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-44a1da65-fd2c-4a1c-95df-79a3f896bbe6 tempest-VolumesSnapshotNegativeTestJSON-1056492376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2ac71e49-eeb7-49a7-85f0-5520e21e60ba -F qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-2ac71e49-eeb7-49a7-85f0-5520e21e60ba.60a110b1-42a1-44e9-ae28-fbd0af89a8f5 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:58:20 devstack sudo[98582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2ac71e49-eeb7-49a7-85f0-5520e21e60ba -F qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-2ac71e49-eeb7-49a7-85f0-5520e21e60ba.60a110b1-42a1-44e9-ae28-fbd0af89a8f5 Jul 13 13:58:20 devstack sudo[98582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:58:20 devstack sudo[98575]: pam_unix(sudo:session): session closed for user root Jul 13 13:58:20 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-b0208ed1-e8e4-4ff8-8851-982243101353 tempest-VolumesListTestJSON-64571285 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-efa7c894-2653-470c-b5ea-d6d683310c10" returned: 0 in 0.476s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:58:20 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-b0208ed1-e8e4-4ff8-8851-982243101353 tempest-VolumesListTestJSON-64571285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-efa7c894-2653-470c-b5ea-d6d683310c10 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:58:20 devstack sudo[98587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-efa7c894-2653-470c-b5ea-d6d683310c10 Jul 13 13:58:20 devstack sudo[98587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:58:21 devstack sudo[98582]: pam_unix(sudo:session): session closed for user root Jul 13 13:58:21 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-44a1da65-fd2c-4a1c-95df-79a3f896bbe6 tempest-VolumesSnapshotNegativeTestJSON-1056492376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2ac71e49-eeb7-49a7-85f0-5520e21e60ba -F qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-2ac71e49-eeb7-49a7-85f0-5520e21e60ba.60a110b1-42a1-44e9-ae28-fbd0af89a8f5" returned: 0 in 0.314s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:58:21 devstack cinder-volume[87098]: WARNING cinder.volume.drivers.remotefs [None req-44a1da65-fd2c-4a1c-95df-79a3f896bbe6 tempest-VolumesSnapshotNegativeTestJSON-1056492376 None] /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-2ac71e49-eeb7-49a7-85f0-5520e21e60ba.60a110b1-42a1-44e9-ae28-fbd0af89a8f5 is being set with open permissions: ugo+rw Jul 13 13:58:21 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-44a1da65-fd2c-4a1c-95df-79a3f896bbe6 tempest-VolumesSnapshotNegativeTestJSON-1056492376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-2ac71e49-eeb7-49a7-85f0-5520e21e60ba.60a110b1-42a1-44e9-ae28-fbd0af89a8f5 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:58:21 devstack sudo[98592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-2ac71e49-eeb7-49a7-85f0-5520e21e60ba.60a110b1-42a1-44e9-ae28-fbd0af89a8f5 Jul 13 13:58:21 devstack sudo[98592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:58:21 devstack sudo[98587]: pam_unix(sudo:session): session closed for user root Jul 13 13:58:21 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-b0208ed1-e8e4-4ff8-8851-982243101353 tempest-VolumesListTestJSON-64571285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-efa7c894-2653-470c-b5ea-d6d683310c10" returned: 0 in 0.265s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:58:21 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-b0208ed1-e8e4-4ff8-8851-982243101353 tempest-VolumesListTestJSON-64571285 None] Lock "cinder-quobyte-efa7c894-2653-470c-b5ea-d6d683310c10" released by "delete_volume" :: held 0.789s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 13:58:21 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-b0208ed1-e8e4-4ff8-8851-982243101353 tempest-VolumesListTestJSON-64571285 None] Created reservations ['57f50d21-0dc3-4a0f-887f-19fa37e2ab87', 'd9737bde-54fb-46dc-9f36-4d91406c4b9a', '1c1578b1-b0f9-40b8-bd52-a3f811492ce6', '9c37ad51-961a-4873-acc8-ee590dd9077e'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 13:58:21 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-cee8e888-323f-4560-82c6-1fb6806bf737 tempest-TestInstancesWithCinderVolumes-1739256037 None] Acquiring lock "cinder-5dd52277-9ad3-4db1-816d-e77beb61b8d4-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 13:58:21 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-cee8e888-323f-4560-82c6-1fb6806bf737 tempest-TestInstancesWithCinderVolumes-1739256037 None] Lock "cinder-5dd52277-9ad3-4db1-816d-e77beb61b8d4-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 13:58:21 devstack sudo[98592]: pam_unix(sudo:session): session closed for user root Jul 13 13:58:21 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-44a1da65-fd2c-4a1c-95df-79a3f896bbe6 tempest-VolumesSnapshotNegativeTestJSON-1056492376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-2ac71e49-eeb7-49a7-85f0-5520e21e60ba.60a110b1-42a1-44e9-ae28-fbd0af89a8f5" returned: 0 in 0.294s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:58:21 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-cee8e888-323f-4560-82c6-1fb6806bf737 tempest-TestInstancesWithCinderVolumes-1739256037 None] Acquiring lock "cinder-quobyte-5dd52277-9ad3-4db1-816d-e77beb61b8d4" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 13:58:21 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-44a1da65-fd2c-4a1c-95df-79a3f896bbe6 tempest-VolumesSnapshotNegativeTestJSON-1056492376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-2ac71e49-eeb7-49a7-85f0-5520e21e60ba.info {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:58:21 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-cee8e888-323f-4560-82c6-1fb6806bf737 tempest-TestInstancesWithCinderVolumes-1739256037 None] Lock "cinder-quobyte-5dd52277-9ad3-4db1-816d-e77beb61b8d4" acquired by "delete_volume" :: waited 0.042s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 13:58:21 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-b0208ed1-e8e4-4ff8-8851-982243101353 tempest-VolumesListTestJSON-64571285 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:58:21 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-b0208ed1-e8e4-4ff8-8851-982243101353 tempest-VolumesListTestJSON-64571285 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:58:21 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-b0208ed1-e8e4-4ff8-8851-982243101353 tempest-VolumesListTestJSON-64571285 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 13:58:21 devstack sudo[98596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-2ac71e49-eeb7-49a7-85f0-5520e21e60ba.info Jul 13 13:58:21 devstack sudo[98596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:58:21 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-b0208ed1-e8e4-4ff8-8851-982243101353 tempest-VolumesListTestJSON-64571285 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 13:58:21 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-b0208ed1-e8e4-4ff8-8851-982243101353 tempest-VolumesListTestJSON-64571285 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:58:21 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-b0208ed1-e8e4-4ff8-8851-982243101353 tempest-VolumesListTestJSON-64571285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:58:21 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[255637a3-b78f-4205-af9c-86080a6a688d]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 13:58:21 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-cee8e888-323f-4560-82c6-1fb6806bf737 tempest-TestInstancesWithCinderVolumes-1739256037 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-5dd52277-9ad3-4db1-816d-e77beb61b8d4 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:58:21 devstack sudo[98598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 Jul 13 13:58:21 devstack sudo[98598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:58:21 devstack sudo[98599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-5dd52277-9ad3-4db1-816d-e77beb61b8d4 Jul 13 13:58:21 devstack sudo[98599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:58:21 devstack sudo[98598]: pam_unix(sudo:session): session closed for user root Jul 13 13:58:21 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-b0208ed1-e8e4-4ff8-8851-982243101353 tempest-VolumesListTestJSON-64571285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78" returned: 0 in 0.363s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:58:21 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-b0208ed1-e8e4-4ff8-8851-982243101353 tempest-VolumesListTestJSON-64571285 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 13:58:21 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-b0208ed1-e8e4-4ff8-8851-982243101353 tempest-VolumesListTestJSON-64571285 None] Deleted volume successfully. Jul 13 13:58:21 devstack sudo[98596]: pam_unix(sudo:session): session closed for user root Jul 13 13:58:21 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-44a1da65-fd2c-4a1c-95df-79a3f896bbe6 tempest-VolumesSnapshotNegativeTestJSON-1056492376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-2ac71e49-eeb7-49a7-85f0-5520e21e60ba.info" returned: 0 in 0.478s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:58:21 devstack cinder-volume[87098]: WARNING cinder.volume.drivers.remotefs [None req-44a1da65-fd2c-4a1c-95df-79a3f896bbe6 tempest-VolumesSnapshotNegativeTestJSON-1056492376 None] /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-2ac71e49-eeb7-49a7-85f0-5520e21e60ba.info is being set with open permissions: ugo+rw Jul 13 13:58:21 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-44a1da65-fd2c-4a1c-95df-79a3f896bbe6 tempest-VolumesSnapshotNegativeTestJSON-1056492376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-2ac71e49-eeb7-49a7-85f0-5520e21e60ba.info {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:58:21 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-b0208ed1-e8e4-4ff8-8851-982243101353 tempest-VolumesListTestJSON-64571285 None] Lock "cinder-efa7c894-2653-470c-b5ea-d6d683310c10-delete_volume" released by "delete_volume" :: held 1.575s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 13:58:21 devstack sudo[98604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-2ac71e49-eeb7-49a7-85f0-5520e21e60ba.info Jul 13 13:58:21 devstack sudo[98604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:58:22 devstack sudo[98599]: pam_unix(sudo:session): session closed for user root Jul 13 13:58:22 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-cee8e888-323f-4560-82c6-1fb6806bf737 tempest-TestInstancesWithCinderVolumes-1739256037 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-5dd52277-9ad3-4db1-816d-e77beb61b8d4" returned: 0 in 0.716s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:58:22 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-cee8e888-323f-4560-82c6-1fb6806bf737 tempest-TestInstancesWithCinderVolumes-1739256037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-5dd52277-9ad3-4db1-816d-e77beb61b8d4 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:58:22 devstack sudo[98604]: pam_unix(sudo:session): session closed for user root Jul 13 13:58:22 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-44a1da65-fd2c-4a1c-95df-79a3f896bbe6 tempest-VolumesSnapshotNegativeTestJSON-1056492376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-2ac71e49-eeb7-49a7-85f0-5520e21e60ba.info" returned: 0 in 0.330s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:58:22 devstack sudo[98610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-5dd52277-9ad3-4db1-816d-e77beb61b8d4 Jul 13 13:58:22 devstack sudo[98610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:58:22 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-44a1da65-fd2c-4a1c-95df-79a3f896bbe6 tempest-VolumesSnapshotNegativeTestJSON-1056492376 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.578s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:58:22 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-44a1da65-fd2c-4a1c-95df-79a3f896bbe6 tempest-VolumesSnapshotNegativeTestJSON-1056492376 None] Create snapshot completed successfully Jul 13 13:58:22 devstack sudo[98610]: pam_unix(sudo:session): session closed for user root Jul 13 13:58:22 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-cee8e888-323f-4560-82c6-1fb6806bf737 tempest-TestInstancesWithCinderVolumes-1739256037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-5dd52277-9ad3-4db1-816d-e77beb61b8d4" returned: 0 in 0.311s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:58:22 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-cee8e888-323f-4560-82c6-1fb6806bf737 tempest-TestInstancesWithCinderVolumes-1739256037 None] Lock "cinder-quobyte-5dd52277-9ad3-4db1-816d-e77beb61b8d4" released by "delete_volume" :: held 1.097s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 13:58:22 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-a45d01ab-0c09-4069-8413-214346cdcdad tempest-GroupsTest-709769296 None] Acquiring lock "cinder-quobyte-2fb6005b-bf1c-4783-9426-bf8aa7455431" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 13:58:22 devstack cinder-volume[87098]: WARNING cinder.quota [None req-cee8e888-323f-4560-82c6-1fb6806bf737 tempest-TestInstancesWithCinderVolumes-1739256037 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1399024696-504544869 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1399024696-504544869, it is now deprecated. Please use the default quota class for default quota. Jul 13 13:58:22 devstack cinder-volume[87098]: WARNING cinder.quota [None req-cee8e888-323f-4560-82c6-1fb6806bf737 tempest-TestInstancesWithCinderVolumes-1739256037 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1399024696-504544869 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1399024696-504544869, it is now deprecated. Please use the default quota class for default quota. Jul 13 13:58:22 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-a45d01ab-0c09-4069-8413-214346cdcdad tempest-GroupsTest-709769296 None] Lock "cinder-quobyte-2fb6005b-bf1c-4783-9426-bf8aa7455431" acquired by "delete_volume" :: waited 0.028s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 13:58:22 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[85a7e08b-3043-4cab-bee4-692c2cb6e2bf]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 13:58:22 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-a45d01ab-0c09-4069-8413-214346cdcdad tempest-GroupsTest-709769296 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-2fb6005b-bf1c-4783-9426-bf8aa7455431 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:58:22 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-cee8e888-323f-4560-82c6-1fb6806bf737 tempest-TestInstancesWithCinderVolumes-1739256037 None] Created reservations ['8c776c8a-ba45-491d-bf87-f128a03535ef', '9df583ef-67ae-4371-9585-4fa0b49f7efb', '333491c4-2081-4ec1-97b6-dda7c805eb34', '074f0ece-7a00-427f-96b4-81682751d74b'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 13:58:22 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-cee8e888-323f-4560-82c6-1fb6806bf737 tempest-TestInstancesWithCinderVolumes-1739256037 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:58:22 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-cee8e888-323f-4560-82c6-1fb6806bf737 tempest-TestInstancesWithCinderVolumes-1739256037 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:58:22 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-cee8e888-323f-4560-82c6-1fb6806bf737 tempest-TestInstancesWithCinderVolumes-1739256037 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 13:58:22 devstack sudo[98613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-2fb6005b-bf1c-4783-9426-bf8aa7455431 Jul 13 13:58:22 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-cee8e888-323f-4560-82c6-1fb6806bf737 tempest-TestInstancesWithCinderVolumes-1739256037 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 13:58:22 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-cee8e888-323f-4560-82c6-1fb6806bf737 tempest-TestInstancesWithCinderVolumes-1739256037 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:58:22 devstack sudo[98613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:58:22 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-cee8e888-323f-4560-82c6-1fb6806bf737 tempest-TestInstancesWithCinderVolumes-1739256037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:58:22 devstack sudo[98615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 Jul 13 13:58:22 devstack sudo[98615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:58:23 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-90f20699-39cf-4682-8c29-3b117bdff1ff tempest-VolumesSnapshotNegativeTestJSON-1056492376 None] Acquiring lock "cinder-60a110b1-42a1-44e9-ae28-fbd0af89a8f5-delete_snapshot" by "delete_snapshot" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 13:58:23 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-90f20699-39cf-4682-8c29-3b117bdff1ff tempest-VolumesSnapshotNegativeTestJSON-1056492376 None] Lock "cinder-60a110b1-42a1-44e9-ae28-fbd0af89a8f5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 13:58:23 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-90f20699-39cf-4682-8c29-3b117bdff1ff tempest-VolumesSnapshotNegativeTestJSON-1056492376 None] Acquiring lock "cinder-quobyte-2ac71e49-eeb7-49a7-85f0-5520e21e60ba" by "delete_snapshot" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 13:58:23 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-90f20699-39cf-4682-8c29-3b117bdff1ff tempest-VolumesSnapshotNegativeTestJSON-1056492376 None] Lock "cinder-quobyte-2ac71e49-eeb7-49a7-85f0-5520e21e60ba" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 13:58:23 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-90f20699-39cf-4682-8c29-3b117bdff1ff tempest-VolumesSnapshotNegativeTestJSON-1056492376 None] Acquiring lock "cinder-quobyte-60a110b1-42a1-44e9-ae28-fbd0af89a8f5" by "_delete_snapshot" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 13:58:23 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-90f20699-39cf-4682-8c29-3b117bdff1ff tempest-VolumesSnapshotNegativeTestJSON-1056492376 None] Lock "cinder-quobyte-60a110b1-42a1-44e9-ae28-fbd0af89a8f5" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 13:58:23 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-90f20699-39cf-4682-8c29-3b117bdff1ff tempest-VolumesSnapshotNegativeTestJSON-1056492376 None] Deleting offline snapshot 60a110b1-42a1-44e9-ae28-fbd0af89a8f5 of volume 2ac71e49-eeb7-49a7-85f0-5520e21e60ba {{(pid=87098) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 13 13:58:23 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-90f20699-39cf-4682-8c29-3b117bdff1ff tempest-VolumesSnapshotNegativeTestJSON-1056492376 None] snapshot_file for this snap is: volume-2ac71e49-eeb7-49a7-85f0-5520e21e60ba.60a110b1-42a1-44e9-ae28-fbd0af89a8f5 {{(pid=87098) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 13 13:58:23 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[18ecf783-ad43-4a17-a697-5672df971471]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 13:58:23 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-90f20699-39cf-4682-8c29-3b117bdff1ff tempest-VolumesSnapshotNegativeTestJSON-1056492376 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-2ac71e49-eeb7-49a7-85f0-5520e21e60ba.60a110b1-42a1-44e9-ae28-fbd0af89a8f5 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:58:23 devstack sudo[98615]: pam_unix(sudo:session): session closed for user root Jul 13 13:58:23 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-cee8e888-323f-4560-82c6-1fb6806bf737 tempest-TestInstancesWithCinderVolumes-1739256037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78" returned: 0 in 0.337s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:58:23 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-cee8e888-323f-4560-82c6-1fb6806bf737 tempest-TestInstancesWithCinderVolumes-1739256037 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 13:58:23 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-cee8e888-323f-4560-82c6-1fb6806bf737 tempest-TestInstancesWithCinderVolumes-1739256037 None] Deleted volume successfully. Jul 13 13:58:23 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-cee8e888-323f-4560-82c6-1fb6806bf737 tempest-TestInstancesWithCinderVolumes-1739256037 None] Lock "cinder-5dd52277-9ad3-4db1-816d-e77beb61b8d4-delete_volume" released by "delete_volume" :: held 1.961s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 13:58:23 devstack sudo[98613]: pam_unix(sudo:session): session closed for user root Jul 13 13:58:23 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-a45d01ab-0c09-4069-8413-214346cdcdad tempest-GroupsTest-709769296 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-2fb6005b-bf1c-4783-9426-bf8aa7455431" returned: 0 in 0.667s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:58:23 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-a45d01ab-0c09-4069-8413-214346cdcdad tempest-GroupsTest-709769296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-2fb6005b-bf1c-4783-9426-bf8aa7455431 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:58:23 devstack sudo[98621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-2ac71e49-eeb7-49a7-85f0-5520e21e60ba.60a110b1-42a1-44e9-ae28-fbd0af89a8f5 Jul 13 13:58:23 devstack sudo[98621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:58:23 devstack sudo[98623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-2fb6005b-bf1c-4783-9426-bf8aa7455431 Jul 13 13:58:23 devstack sudo[98623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:58:23 devstack sudo[98623]: pam_unix(sudo:session): session closed for user root Jul 13 13:58:23 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-a45d01ab-0c09-4069-8413-214346cdcdad tempest-GroupsTest-709769296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-2fb6005b-bf1c-4783-9426-bf8aa7455431" returned: 0 in 0.400s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:58:23 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-a45d01ab-0c09-4069-8413-214346cdcdad tempest-GroupsTest-709769296 None] Lock "cinder-quobyte-2fb6005b-bf1c-4783-9426-bf8aa7455431" released by "delete_volume" :: held 1.145s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 13:58:23 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-a45d01ab-0c09-4069-8413-214346cdcdad tempest-GroupsTest-709769296 None] Acquiring lock "cinder-quobyte-4f2f303c-5d93-4339-aa36-b6b687774358" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 13:58:23 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-a45d01ab-0c09-4069-8413-214346cdcdad tempest-GroupsTest-709769296 None] Lock "cinder-quobyte-4f2f303c-5d93-4339-aa36-b6b687774358" acquired by "delete_volume" :: waited 0.033s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 13:58:23 devstack sudo[98621]: pam_unix(sudo:session): session closed for user root Jul 13 13:58:23 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-90f20699-39cf-4682-8c29-3b117bdff1ff tempest-VolumesSnapshotNegativeTestJSON-1056492376 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-2ac71e49-eeb7-49a7-85f0-5520e21e60ba.60a110b1-42a1-44e9-ae28-fbd0af89a8f5" returned: 0 in 0.634s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:58:23 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-90f20699-39cf-4682-8c29-3b117bdff1ff tempest-VolumesSnapshotNegativeTestJSON-1056492376 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2ac71e49-eeb7-49a7-85f0-5520e21e60ba(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87098) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 13 13:58:23 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[5eeda94c-52a8-421e-9851-7151efa95215]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 13:58:23 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-a45d01ab-0c09-4069-8413-214346cdcdad tempest-GroupsTest-709769296 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-4f2f303c-5d93-4339-aa36-b6b687774358 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:58:23 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[42e0219b-4c43-4f99-a16a-2f50e4b2547c]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 13:58:23 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-90f20699-39cf-4682-8c29-3b117bdff1ff tempest-VolumesSnapshotNegativeTestJSON-1056492376 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-2ac71e49-eeb7-49a7-85f0-5520e21e60ba {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:58:23 devstack sudo[98631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-2ac71e49-eeb7-49a7-85f0-5520e21e60ba Jul 13 13:58:24 devstack sudo[98631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:58:24 devstack sudo[98630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-4f2f303c-5d93-4339-aa36-b6b687774358 Jul 13 13:58:24 devstack sudo[98630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:58:24 devstack sudo[98630]: pam_unix(sudo:session): session closed for user root Jul 13 13:58:24 devstack sudo[98631]: pam_unix(sudo:session): session closed for user root Jul 13 13:58:24 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-a45d01ab-0c09-4069-8413-214346cdcdad tempest-GroupsTest-709769296 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-4f2f303c-5d93-4339-aa36-b6b687774358" returned: 0 in 0.522s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:58:24 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-a45d01ab-0c09-4069-8413-214346cdcdad tempest-GroupsTest-709769296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-4f2f303c-5d93-4339-aa36-b6b687774358 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:58:24 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-90f20699-39cf-4682-8c29-3b117bdff1ff tempest-VolumesSnapshotNegativeTestJSON-1056492376 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-2ac71e49-eeb7-49a7-85f0-5520e21e60ba" returned: 0 in 0.516s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:58:24 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-90f20699-39cf-4682-8c29-3b117bdff1ff tempest-VolumesSnapshotNegativeTestJSON-1056492376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-2ac71e49-eeb7-49a7-85f0-5520e21e60ba.60a110b1-42a1-44e9-ae28-fbd0af89a8f5 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:58:24 devstack sudo[98641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-4f2f303c-5d93-4339-aa36-b6b687774358 Jul 13 13:58:24 devstack sudo[98641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:58:24 devstack sudo[98642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-2ac71e49-eeb7-49a7-85f0-5520e21e60ba.60a110b1-42a1-44e9-ae28-fbd0af89a8f5 Jul 13 13:58:24 devstack sudo[98642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:58:24 devstack sudo[98641]: pam_unix(sudo:session): session closed for user root Jul 13 13:58:24 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-a45d01ab-0c09-4069-8413-214346cdcdad tempest-GroupsTest-709769296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-4f2f303c-5d93-4339-aa36-b6b687774358" returned: 0 in 0.360s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:58:24 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-a45d01ab-0c09-4069-8413-214346cdcdad tempest-GroupsTest-709769296 None] Lock "cinder-quobyte-4f2f303c-5d93-4339-aa36-b6b687774358" released by "delete_volume" :: held 0.967s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 13:58:24 devstack cinder-volume[87098]: DEBUG dbcounter [-] [87098] Writing DB stats cinder:SELECT=178,cinder:INSERT=63,cinder:UPDATE=209,cinder:DELETE=18 {{(pid=87098) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 13 13:58:24 devstack sudo[98642]: pam_unix(sudo:session): session closed for user root Jul 13 13:58:24 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-90f20699-39cf-4682-8c29-3b117bdff1ff tempest-VolumesSnapshotNegativeTestJSON-1056492376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-2ac71e49-eeb7-49a7-85f0-5520e21e60ba.60a110b1-42a1-44e9-ae28-fbd0af89a8f5" returned: 0 in 0.499s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:58:24 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-90f20699-39cf-4682-8c29-3b117bdff1ff tempest-VolumesSnapshotNegativeTestJSON-1056492376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-2ac71e49-eeb7-49a7-85f0-5520e21e60ba.60a110b1-42a1-44e9-ae28-fbd0af89a8f5 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:58:24 devstack sudo[98652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-2ac71e49-eeb7-49a7-85f0-5520e21e60ba.60a110b1-42a1-44e9-ae28-fbd0af89a8f5 Jul 13 13:58:24 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-a45d01ab-0c09-4069-8413-214346cdcdad tempest-GroupsTest-709769296 None] Created reservations ['70354fd0-3e66-49bb-b679-8da85521f5dc'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 13:58:24 devstack sudo[98652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:58:24 devstack cinder-volume[87098]: WARNING cinder.quota [None req-a45d01ab-0c09-4069-8413-214346cdcdad tempest-GroupsTest-709769296 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1770739012 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1770739012, it is now deprecated. Please use the default quota class for default quota. Jul 13 13:58:24 devstack cinder-volume[87098]: WARNING cinder.quota [None req-a45d01ab-0c09-4069-8413-214346cdcdad tempest-GroupsTest-709769296 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1770739012 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1770739012, it is now deprecated. Please use the default quota class for default quota. Jul 13 13:58:25 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-a45d01ab-0c09-4069-8413-214346cdcdad tempest-GroupsTest-709769296 None] Created reservations ['c314910f-be09-43c9-a018-26a9f31c09e0', 'bc46df29-9709-4985-9691-6a49c07cff7c', '787f8e9d-e209-4281-bd4f-215496116d31', 'b8717880-5403-45af-a7c4-be14272e61ab'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 13:58:25 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-a45d01ab-0c09-4069-8413-214346cdcdad tempest-GroupsTest-709769296 None] Created reservations ['a5217eab-34db-4ee0-a496-ba6c271422b2', 'ac9dba95-562f-46ff-b899-d15097e13e58', '72986885-9339-49e8-9f1f-a3f6932bc521', '9d705231-8f8f-4e87-8754-448167af9744'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 13:58:25 devstack sudo[98652]: pam_unix(sudo:session): session closed for user root Jul 13 13:58:25 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-90f20699-39cf-4682-8c29-3b117bdff1ff tempest-VolumesSnapshotNegativeTestJSON-1056492376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-2ac71e49-eeb7-49a7-85f0-5520e21e60ba.60a110b1-42a1-44e9-ae28-fbd0af89a8f5" returned: 0 in 0.402s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:58:25 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-90f20699-39cf-4682-8c29-3b117bdff1ff tempest-VolumesSnapshotNegativeTestJSON-1056492376 None] Lock "cinder-quobyte-60a110b1-42a1-44e9-ae28-fbd0af89a8f5" released by "_delete_snapshot" :: held 2.266s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 13:58:25 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-90f20699-39cf-4682-8c29-3b117bdff1ff tempest-VolumesSnapshotNegativeTestJSON-1056492376 None] Lock "cinder-quobyte-2ac71e49-eeb7-49a7-85f0-5520e21e60ba" released by "delete_snapshot" :: held 2.308s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 13:58:25 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-a45d01ab-0c09-4069-8413-214346cdcdad tempest-GroupsTest-709769296 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:58:25 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-a45d01ab-0c09-4069-8413-214346cdcdad tempest-GroupsTest-709769296 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:58:25 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-a45d01ab-0c09-4069-8413-214346cdcdad tempest-GroupsTest-709769296 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 13:58:25 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-a45d01ab-0c09-4069-8413-214346cdcdad tempest-GroupsTest-709769296 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 13:58:25 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-a45d01ab-0c09-4069-8413-214346cdcdad tempest-GroupsTest-709769296 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:58:25 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-a45d01ab-0c09-4069-8413-214346cdcdad tempest-GroupsTest-709769296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:58:25 devstack sudo[98659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 Jul 13 13:58:25 devstack sudo[98659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:58:25 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-90f20699-39cf-4682-8c29-3b117bdff1ff tempest-VolumesSnapshotNegativeTestJSON-1056492376 None] Created reservations ['399ff071-f5c8-4548-b309-85562ed70609', 'dcba51f2-b3ed-46a3-819a-17e4481a2c33', 'd13bf2ec-5b60-4579-9da6-ae7fed430f3c', '9a5d0e63-d86a-4b8a-a162-e3ce1e978cee'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 13:58:25 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-90f20699-39cf-4682-8c29-3b117bdff1ff tempest-VolumesSnapshotNegativeTestJSON-1056492376 None] Delete snapshot completed successfully. Jul 13 13:58:25 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-90f20699-39cf-4682-8c29-3b117bdff1ff tempest-VolumesSnapshotNegativeTestJSON-1056492376 None] Lock "cinder-60a110b1-42a1-44e9-ae28-fbd0af89a8f5-delete_snapshot" released by "delete_snapshot" :: held 2.799s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 13:58:25 devstack sudo[98659]: pam_unix(sudo:session): session closed for user root Jul 13 13:58:25 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-a45d01ab-0c09-4069-8413-214346cdcdad tempest-GroupsTest-709769296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78" returned: 0 in 0.470s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:58:25 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-a45d01ab-0c09-4069-8413-214346cdcdad tempest-GroupsTest-709769296 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 13:58:25 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-a45d01ab-0c09-4069-8413-214346cdcdad tempest-GroupsTest-709769296 None] Delete group completed successfully. Jul 13 13:58:26 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-22071bb7-4d4b-4d68-96dd-0400541361f8 tempest-VolumesSnapshotNegativeTestJSON-1056492376 None] Acquiring lock "cinder-2ac71e49-eeb7-49a7-85f0-5520e21e60ba-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 13:58:26 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-22071bb7-4d4b-4d68-96dd-0400541361f8 tempest-VolumesSnapshotNegativeTestJSON-1056492376 None] Lock "cinder-2ac71e49-eeb7-49a7-85f0-5520e21e60ba-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 13:58:26 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-22071bb7-4d4b-4d68-96dd-0400541361f8 tempest-VolumesSnapshotNegativeTestJSON-1056492376 None] Acquiring lock "cinder-quobyte-2ac71e49-eeb7-49a7-85f0-5520e21e60ba" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 13:58:26 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-22071bb7-4d4b-4d68-96dd-0400541361f8 tempest-VolumesSnapshotNegativeTestJSON-1056492376 None] Lock "cinder-quobyte-2ac71e49-eeb7-49a7-85f0-5520e21e60ba" acquired by "delete_volume" :: waited 0.031s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 13:58:26 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f60b6b6-92cc-4353-b731-306064f983d7]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 13:58:26 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-22071bb7-4d4b-4d68-96dd-0400541361f8 tempest-VolumesSnapshotNegativeTestJSON-1056492376 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-2ac71e49-eeb7-49a7-85f0-5520e21e60ba {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:58:26 devstack sudo[98680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-2ac71e49-eeb7-49a7-85f0-5520e21e60ba Jul 13 13:58:26 devstack sudo[98680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:58:27 devstack sudo[98680]: pam_unix(sudo:session): session closed for user root Jul 13 13:58:27 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-22071bb7-4d4b-4d68-96dd-0400541361f8 tempest-VolumesSnapshotNegativeTestJSON-1056492376 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-2ac71e49-eeb7-49a7-85f0-5520e21e60ba" returned: 0 in 0.552s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:58:27 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-22071bb7-4d4b-4d68-96dd-0400541361f8 tempest-VolumesSnapshotNegativeTestJSON-1056492376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-2ac71e49-eeb7-49a7-85f0-5520e21e60ba {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:58:27 devstack sudo[98687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-2ac71e49-eeb7-49a7-85f0-5520e21e60ba Jul 13 13:58:27 devstack sudo[98687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:58:27 devstack cinder-volume[87098]: INFO cinder.volume.manager [req-036eb256-331c-49d0-8be5-c38a2b1a24b1 req-552c0ef3-933c-4beb-aa36-29644ed7bdce tempest-TestInstancesWithCinderVolumes-1739256037 None] Terminate volume connection completed successfully. Jul 13 13:58:27 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [req-036eb256-331c-49d0-8be5-c38a2b1a24b1 req-552c0ef3-933c-4beb-aa36-29644ed7bdce tempest-TestInstancesWithCinderVolumes-1739256037 None] Deleting attachment f0666e4a-75b6-49a2-8ec7-03dd2636b3b7. {{(pid=87098) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 13 13:58:27 devstack sudo[98687]: pam_unix(sudo:session): session closed for user root Jul 13 13:58:27 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-22071bb7-4d4b-4d68-96dd-0400541361f8 tempest-VolumesSnapshotNegativeTestJSON-1056492376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-2ac71e49-eeb7-49a7-85f0-5520e21e60ba" returned: 0 in 0.420s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:58:27 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-22071bb7-4d4b-4d68-96dd-0400541361f8 tempest-VolumesSnapshotNegativeTestJSON-1056492376 None] Lock "cinder-quobyte-2ac71e49-eeb7-49a7-85f0-5520e21e60ba" released by "delete_volume" :: held 1.071s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 13:58:27 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-22071bb7-4d4b-4d68-96dd-0400541361f8 tempest-VolumesSnapshotNegativeTestJSON-1056492376 None] Created reservations ['491e8401-dfb0-458d-a4a2-08bfb1bcca82', '1845e9aa-f96f-414e-b6ec-ee9d023ddb86', '0bdc7db6-a419-442d-9e91-544f197adef1', '5e8ffd38-6d2d-4429-b581-a78a0e478c9e'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 13:58:27 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-22071bb7-4d4b-4d68-96dd-0400541361f8 tempest-VolumesSnapshotNegativeTestJSON-1056492376 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:58:27 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-22071bb7-4d4b-4d68-96dd-0400541361f8 tempest-VolumesSnapshotNegativeTestJSON-1056492376 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:58:27 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-22071bb7-4d4b-4d68-96dd-0400541361f8 tempest-VolumesSnapshotNegativeTestJSON-1056492376 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 13:58:27 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-22071bb7-4d4b-4d68-96dd-0400541361f8 tempest-VolumesSnapshotNegativeTestJSON-1056492376 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 13:58:27 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-22071bb7-4d4b-4d68-96dd-0400541361f8 tempest-VolumesSnapshotNegativeTestJSON-1056492376 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:58:27 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-22071bb7-4d4b-4d68-96dd-0400541361f8 tempest-VolumesSnapshotNegativeTestJSON-1056492376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:58:27 devstack sudo[98690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 Jul 13 13:58:27 devstack sudo[98690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:58:28 devstack sudo[98690]: pam_unix(sudo:session): session closed for user root Jul 13 13:58:28 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-22071bb7-4d4b-4d68-96dd-0400541361f8 tempest-VolumesSnapshotNegativeTestJSON-1056492376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78" returned: 0 in 0.374s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:58:28 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-22071bb7-4d4b-4d68-96dd-0400541361f8 tempest-VolumesSnapshotNegativeTestJSON-1056492376 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 13:58:28 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-22071bb7-4d4b-4d68-96dd-0400541361f8 tempest-VolumesSnapshotNegativeTestJSON-1056492376 None] Deleted volume successfully. Jul 13 13:58:28 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-22071bb7-4d4b-4d68-96dd-0400541361f8 tempest-VolumesSnapshotNegativeTestJSON-1056492376 None] Lock "cinder-2ac71e49-eeb7-49a7-85f0-5520e21e60ba-delete_volume" released by "delete_volume" :: held 1.835s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 13:58:29 devstack cinder-volume[87098]: DEBUG oslo_service.periodic_task [None req-727a1692-ea28-4a77-b327-0d94e8f01efb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87098) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 13 13:58:29 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-727a1692-ea28-4a77-b327-0d94e8f01efb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:58:29 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-727a1692-ea28-4a77-b327-0d94e8f01efb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:58:29 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-727a1692-ea28-4a77-b327-0d94e8f01efb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 13:58:29 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-727a1692-ea28-4a77-b327-0d94e8f01efb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 13:58:29 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-727a1692-ea28-4a77-b327-0d94e8f01efb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:58:29 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-727a1692-ea28-4a77-b327-0d94e8f01efb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:58:29 devstack sudo[98693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 Jul 13 13:58:29 devstack sudo[98693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:58:29 devstack sudo[98693]: pam_unix(sudo:session): session closed for user root Jul 13 13:58:29 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-727a1692-ea28-4a77-b327-0d94e8f01efb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78" returned: 0 in 0.309s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:58:29 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-727a1692-ea28-4a77-b327-0d94e8f01efb None None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 13:58:29 devstack cinder-volume[87098]: DEBUG oslo_service.periodic_task [None req-727a1692-ea28-4a77-b327-0d94e8f01efb None None] Running periodic task VolumeManager._thread_info {{(pid=87098) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 13 13:58:29 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-727a1692-ea28-4a77-b327-0d94e8f01efb None None] thread count: 28 {{(pid=87098) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 13 13:58:29 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-727a1692-ea28-4a77-b327-0d94e8f01efb None None] thread info: [<_MainThread(MainThread, started 127988054597760)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87098) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 13 13:58:29 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-32a29d77-626c-44fb-8c7c-f7b9126ee4cb tempest-TestInstancesWithCinderVolumes-1739256037 None] Acquiring lock "cinder-e16a6c11-4674-4833-9c5e-c793a8d36a58-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 13:58:29 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-32a29d77-626c-44fb-8c7c-f7b9126ee4cb tempest-TestInstancesWithCinderVolumes-1739256037 None] Lock "cinder-e16a6c11-4674-4833-9c5e-c793a8d36a58-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 13:58:29 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-32a29d77-626c-44fb-8c7c-f7b9126ee4cb tempest-TestInstancesWithCinderVolumes-1739256037 None] Acquiring lock "cinder-quobyte-e16a6c11-4674-4833-9c5e-c793a8d36a58" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 13:58:29 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-32a29d77-626c-44fb-8c7c-f7b9126ee4cb tempest-TestInstancesWithCinderVolumes-1739256037 None] Lock "cinder-quobyte-e16a6c11-4674-4833-9c5e-c793a8d36a58" acquired by "delete_volume" :: waited 0.017s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 13:58:29 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[5acba52a-cc58-4e2e-894c-67cdb2a744a6]: (4, 'raw') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 13:58:29 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-32a29d77-626c-44fb-8c7c-f7b9126ee4cb tempest-TestInstancesWithCinderVolumes-1739256037 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-e16a6c11-4674-4833-9c5e-c793a8d36a58 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:58:30 devstack sudo[98696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-e16a6c11-4674-4833-9c5e-c793a8d36a58 Jul 13 13:58:30 devstack sudo[98696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:58:30 devstack sudo[98696]: pam_unix(sudo:session): session closed for user root Jul 13 13:58:30 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-32a29d77-626c-44fb-8c7c-f7b9126ee4cb tempest-TestInstancesWithCinderVolumes-1739256037 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-e16a6c11-4674-4833-9c5e-c793a8d36a58" returned: 0 in 0.415s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:58:30 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-32a29d77-626c-44fb-8c7c-f7b9126ee4cb tempest-TestInstancesWithCinderVolumes-1739256037 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-e16a6c11-4674-4833-9c5e-c793a8d36a58 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:58:30 devstack sudo[98700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-e16a6c11-4674-4833-9c5e-c793a8d36a58 Jul 13 13:58:30 devstack sudo[98700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:58:30 devstack sudo[98700]: pam_unix(sudo:session): session closed for user root Jul 13 13:58:30 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-32a29d77-626c-44fb-8c7c-f7b9126ee4cb tempest-TestInstancesWithCinderVolumes-1739256037 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-e16a6c11-4674-4833-9c5e-c793a8d36a58" returned: 1 in 0.446s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:58:30 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-32a29d77-626c-44fb-8c7c-f7b9126ee4cb tempest-TestInstancesWithCinderVolumes-1739256037 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-e16a6c11-4674-4833-9c5e-c793a8d36a58' failed. Not Retrying. {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 13 13:58:30 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-32a29d77-626c-44fb-8c7c-f7b9126ee4cb tempest-TestInstancesWithCinderVolumes-1739256037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-e16a6c11-4674-4833-9c5e-c793a8d36a58 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:58:30 devstack sudo[98705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-e16a6c11-4674-4833-9c5e-c793a8d36a58 Jul 13 13:58:30 devstack sudo[98705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:58:31 devstack sudo[98705]: pam_unix(sudo:session): session closed for user root Jul 13 13:58:31 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-32a29d77-626c-44fb-8c7c-f7b9126ee4cb tempest-TestInstancesWithCinderVolumes-1739256037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-e16a6c11-4674-4833-9c5e-c793a8d36a58" returned: 0 in 0.422s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:58:31 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-32a29d77-626c-44fb-8c7c-f7b9126ee4cb tempest-TestInstancesWithCinderVolumes-1739256037 None] Lock "cinder-quobyte-e16a6c11-4674-4833-9c5e-c793a8d36a58" released by "delete_volume" :: held 1.370s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 13:58:31 devstack cinder-volume[87098]: WARNING cinder.quota [None req-32a29d77-626c-44fb-8c7c-f7b9126ee4cb tempest-TestInstancesWithCinderVolumes-1739256037 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-581271821-1753893819 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-581271821-1753893819, it is now deprecated. Please use the default quota class for default quota. Jul 13 13:58:31 devstack cinder-volume[87098]: WARNING cinder.quota [None req-32a29d77-626c-44fb-8c7c-f7b9126ee4cb tempest-TestInstancesWithCinderVolumes-1739256037 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-581271821-1753893819 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-581271821-1753893819, it is now deprecated. Please use the default quota class for default quota. Jul 13 13:58:31 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-32a29d77-626c-44fb-8c7c-f7b9126ee4cb tempest-TestInstancesWithCinderVolumes-1739256037 None] Created reservations ['1194ca96-0082-40ba-9979-cee459898520', 'f6a05f60-d543-4dd2-831e-45276fe27d9a', '740998f5-4cc9-4927-8673-d8fdf7776d5f', '76ee94c9-b8d3-4432-89ae-db2432ee1e53'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 13:58:31 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-32a29d77-626c-44fb-8c7c-f7b9126ee4cb tempest-TestInstancesWithCinderVolumes-1739256037 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:58:31 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-32a29d77-626c-44fb-8c7c-f7b9126ee4cb tempest-TestInstancesWithCinderVolumes-1739256037 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:58:31 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-32a29d77-626c-44fb-8c7c-f7b9126ee4cb tempest-TestInstancesWithCinderVolumes-1739256037 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 13:58:31 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-32a29d77-626c-44fb-8c7c-f7b9126ee4cb tempest-TestInstancesWithCinderVolumes-1739256037 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 13:58:31 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-32a29d77-626c-44fb-8c7c-f7b9126ee4cb tempest-TestInstancesWithCinderVolumes-1739256037 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:58:31 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-32a29d77-626c-44fb-8c7c-f7b9126ee4cb tempest-TestInstancesWithCinderVolumes-1739256037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:58:31 devstack sudo[98708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 Jul 13 13:58:31 devstack sudo[98708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:58:31 devstack sudo[98708]: pam_unix(sudo:session): session closed for user root Jul 13 13:58:31 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-32a29d77-626c-44fb-8c7c-f7b9126ee4cb tempest-TestInstancesWithCinderVolumes-1739256037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78" returned: 0 in 0.287s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:58:31 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-32a29d77-626c-44fb-8c7c-f7b9126ee4cb tempest-TestInstancesWithCinderVolumes-1739256037 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 13:58:31 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-32a29d77-626c-44fb-8c7c-f7b9126ee4cb tempest-TestInstancesWithCinderVolumes-1739256037 None] Deleted volume successfully. Jul 13 13:58:31 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-32a29d77-626c-44fb-8c7c-f7b9126ee4cb tempest-TestInstancesWithCinderVolumes-1739256037 None] Lock "cinder-e16a6c11-4674-4833-9c5e-c793a8d36a58-delete_volume" released by "delete_volume" :: held 1.979s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 13:58:33 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-60a26dc3-0436-402e-832f-5017b179372e tempest-CreateVolumesFromImageTest-1604318855 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 13:58:33 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-60a26dc3-0436-402e-832f-5017b179372e tempest-CreateVolumesFromImageTest-1604318855 None] Flow 'volume_create_manager' (4212e1a5-2755-4a69-ac02-63cd8f285c47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 13:58:33 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-60a26dc3-0436-402e-832f-5017b179372e tempest-CreateVolumesFromImageTest-1604318855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d32db01c-dd04-4d5c-a6db-a6a3197bd599) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:58:33 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-60a26dc3-0436-402e-832f-5017b179372e tempest-CreateVolumesFromImageTest-1604318855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d32db01c-dd04-4d5c-a6db-a6a3197bd599) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T11:58:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1401150546',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9968be0-682c-4bdc-a9d4-b30db4a35088,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41b8e9a188e747f88f2157d643dc3cd1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T11:58:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T11:58:33Z,use_quota=True,user_id='52d23dbce9c1422c8ce067bb1d34439c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1147de8b-623b-426c-a13d-7fc824a80f67),volume_type_id=1147de8b-623b-426c-a13d-7fc824a80f67)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:58:33 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-60a26dc3-0436-402e-832f-5017b179372e tempest-CreateVolumesFromImageTest-1604318855 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a93bd09e-6d6e-4ca0-a1d3-3a034d0c6e15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:58:33 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-60a26dc3-0436-402e-832f-5017b179372e tempest-CreateVolumesFromImageTest-1604318855 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a93bd09e-6d6e-4ca0-a1d3-3a034d0c6e15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:58:33 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-60a26dc3-0436-402e-832f-5017b179372e tempest-CreateVolumesFromImageTest-1604318855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88f1ef66-4f09-4bfe-b90a-051ba2afb4d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:58:33 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-60a26dc3-0436-402e-832f-5017b179372e tempest-CreateVolumesFromImageTest-1604318855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88f1ef66-4f09-4bfe-b90a-051ba2afb4d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f9968be0-682c-4bdc-a9d4-b30db4a35088', 'volume_name': 'volume-f9968be0-682c-4bdc-a9d4-b30db4a35088', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:58:33 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-60a26dc3-0436-402e-832f-5017b179372e tempest-CreateVolumesFromImageTest-1604318855 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26717b07-b70f-433d-a121-531b6ce8579d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:58:33 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-60a26dc3-0436-402e-832f-5017b179372e tempest-CreateVolumesFromImageTest-1604318855 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26717b07-b70f-433d-a121-531b6ce8579d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:58:33 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-60a26dc3-0436-402e-832f-5017b179372e tempest-CreateVolumesFromImageTest-1604318855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71bdbfdc-2aa9-40ec-a2a8-d9c81413a024) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:58:33 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-60a26dc3-0436-402e-832f-5017b179372e tempest-CreateVolumesFromImageTest-1604318855 None] Volume f9968be0-682c-4bdc-a9d4-b30db4a35088: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f9968be0-682c-4bdc-a9d4-b30db4a35088', 'volume_size': 1} Jul 13 13:58:33 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-60a26dc3-0436-402e-832f-5017b179372e tempest-CreateVolumesFromImageTest-1604318855 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:58:33 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-60a26dc3-0436-402e-832f-5017b179372e tempest-CreateVolumesFromImageTest-1604318855 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:58:33 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-60a26dc3-0436-402e-832f-5017b179372e tempest-CreateVolumesFromImageTest-1604318855 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T11:58:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1401150546',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9968be0-682c-4bdc-a9d4-b30db4a35088,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41b8e9a188e747f88f2157d643dc3cd1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T11:58:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T11:58:33Z,use_quota=True,user_id='52d23dbce9c1422c8ce067bb1d34439c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1147de8b-623b-426c-a13d-7fc824a80f67),volume_type_id=1147de8b-623b-426c-a13d-7fc824a80f67)}" {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 13 13:58:33 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-60a26dc3-0436-402e-832f-5017b179372e tempest-CreateVolumesFromImageTest-1604318855 None] Creating volume f9968be0-682c-4bdc-a9d4-b30db4a35088 {{(pid=87098) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 13 13:58:33 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-60a26dc3-0436-402e-832f-5017b179372e tempest-CreateVolumesFromImageTest-1604318855 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:58:33 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-60a26dc3-0436-402e-832f-5017b179372e tempest-CreateVolumesFromImageTest-1604318855 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:58:33 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-60a26dc3-0436-402e-832f-5017b179372e tempest-CreateVolumesFromImageTest-1604318855 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 13:58:33 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-60a26dc3-0436-402e-832f-5017b179372e tempest-CreateVolumesFromImageTest-1604318855 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 13:58:33 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-60a26dc3-0436-402e-832f-5017b179372e tempest-CreateVolumesFromImageTest-1604318855 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:58:33 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-60a26dc3-0436-402e-832f-5017b179372e tempest-CreateVolumesFromImageTest-1604318855 None] Selected osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 13:58:33 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-60a26dc3-0436-402e-832f-5017b179372e tempest-CreateVolumesFromImageTest-1604318855 None] casted to osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 Jul 13 13:58:33 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-60a26dc3-0436-402e-832f-5017b179372e tempest-CreateVolumesFromImageTest-1604318855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-f9968be0-682c-4bdc-a9d4-b30db4a35088 1073741824 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:58:33 devstack sudo[98711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-f9968be0-682c-4bdc-a9d4-b30db4a35088 1073741824 Jul 13 13:58:33 devstack sudo[98711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:58:34 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-63928565-757c-42cd-9ddf-83f087d41703 tempest-CreateVolumesFromImageTest-1604318855 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 13:58:34 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-63928565-757c-42cd-9ddf-83f087d41703 tempest-CreateVolumesFromImageTest-1604318855 None] Flow 'volume_create_manager' (77202dc4-4121-4551-afd0-fcdc55aa5660) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 13:58:34 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-63928565-757c-42cd-9ddf-83f087d41703 tempest-CreateVolumesFromImageTest-1604318855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8a3ff5c-0e8c-48e4-bf54-d850d1a3c58a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:58:34 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-63928565-757c-42cd-9ddf-83f087d41703 tempest-CreateVolumesFromImageTest-1604318855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8a3ff5c-0e8c-48e4-bf54-d850d1a3c58a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T11:58:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2008764942',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e2681f3-5990-4083-be61-0f798f9c873e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41b8e9a188e747f88f2157d643dc3cd1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T11:58:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T11:58:34Z,use_quota=True,user_id='52d23dbce9c1422c8ce067bb1d34439c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1147de8b-623b-426c-a13d-7fc824a80f67),volume_type_id=1147de8b-623b-426c-a13d-7fc824a80f67)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:58:34 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-63928565-757c-42cd-9ddf-83f087d41703 tempest-CreateVolumesFromImageTest-1604318855 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c191803f-914b-4884-af4a-8cc64622e5d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:58:34 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-63928565-757c-42cd-9ddf-83f087d41703 tempest-CreateVolumesFromImageTest-1604318855 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c191803f-914b-4884-af4a-8cc64622e5d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:58:34 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-63928565-757c-42cd-9ddf-83f087d41703 tempest-CreateVolumesFromImageTest-1604318855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df61727e-2370-4833-abc5-3fff90b73290) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:58:34 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-63928565-757c-42cd-9ddf-83f087d41703 tempest-CreateVolumesFromImageTest-1604318855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df61727e-2370-4833-abc5-3fff90b73290) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9e2681f3-5990-4083-be61-0f798f9c873e', 'volume_name': 'volume-9e2681f3-5990-4083-be61-0f798f9c873e', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:58:34 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-63928565-757c-42cd-9ddf-83f087d41703 tempest-CreateVolumesFromImageTest-1604318855 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e88ace89-5515-4d24-b4b2-b2be6808b1f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:58:34 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-63928565-757c-42cd-9ddf-83f087d41703 tempest-CreateVolumesFromImageTest-1604318855 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e88ace89-5515-4d24-b4b2-b2be6808b1f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:58:34 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-63928565-757c-42cd-9ddf-83f087d41703 tempest-CreateVolumesFromImageTest-1604318855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f087d255-3974-412f-abde-7a5b23c36a6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:58:34 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-63928565-757c-42cd-9ddf-83f087d41703 tempest-CreateVolumesFromImageTest-1604318855 None] Volume 9e2681f3-5990-4083-be61-0f798f9c873e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9e2681f3-5990-4083-be61-0f798f9c873e', 'volume_size': 1} Jul 13 13:58:34 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-63928565-757c-42cd-9ddf-83f087d41703 tempest-CreateVolumesFromImageTest-1604318855 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:58:34 devstack sudo[98711]: pam_unix(sudo:session): session closed for user root Jul 13 13:58:34 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-60a26dc3-0436-402e-832f-5017b179372e tempest-CreateVolumesFromImageTest-1604318855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-f9968be0-682c-4bdc-a9d4-b30db4a35088 1073741824" returned: 0 in 0.807s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:58:34 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-60a26dc3-0436-402e-832f-5017b179372e tempest-CreateVolumesFromImageTest-1604318855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-f9968be0-682c-4bdc-a9d4-b30db4a35088 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:58:34 devstack sudo[98717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-f9968be0-682c-4bdc-a9d4-b30db4a35088 Jul 13 13:58:34 devstack sudo[98717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:58:34 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-92df3ef6-04c4-422e-9ba1-abfecbf9347c tempest-CreateVolumesFromImageTest-1604318855 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 13:58:34 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-92df3ef6-04c4-422e-9ba1-abfecbf9347c tempest-CreateVolumesFromImageTest-1604318855 None] Flow 'volume_create_manager' (e2642d0b-e902-4a8b-8ec3-a44932a5ce20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 13:58:34 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-92df3ef6-04c4-422e-9ba1-abfecbf9347c tempest-CreateVolumesFromImageTest-1604318855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f7474ce-7ec4-4dcb-aa71-72ba7f8cbe32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:58:34 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-92df3ef6-04c4-422e-9ba1-abfecbf9347c tempest-CreateVolumesFromImageTest-1604318855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f7474ce-7ec4-4dcb-aa71-72ba7f8cbe32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T11:58:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1823771912',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f668556-7967-4cac-835d-7ab05097370b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41b8e9a188e747f88f2157d643dc3cd1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T11:58:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T11:58:35Z,use_quota=True,user_id='52d23dbce9c1422c8ce067bb1d34439c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1147de8b-623b-426c-a13d-7fc824a80f67),volume_type_id=1147de8b-623b-426c-a13d-7fc824a80f67)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:58:34 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-92df3ef6-04c4-422e-9ba1-abfecbf9347c tempest-CreateVolumesFromImageTest-1604318855 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6fe9a3c8-9d41-40ef-8f26-ad4de01e3224) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:58:34 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-92df3ef6-04c4-422e-9ba1-abfecbf9347c tempest-CreateVolumesFromImageTest-1604318855 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6fe9a3c8-9d41-40ef-8f26-ad4de01e3224) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:58:34 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-92df3ef6-04c4-422e-9ba1-abfecbf9347c tempest-CreateVolumesFromImageTest-1604318855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f377a93d-2669-4f59-a9cc-b6d6b4d85d31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:58:34 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-92df3ef6-04c4-422e-9ba1-abfecbf9347c tempest-CreateVolumesFromImageTest-1604318855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f377a93d-2669-4f59-a9cc-b6d6b4d85d31) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8f668556-7967-4cac-835d-7ab05097370b', 'volume_name': 'volume-8f668556-7967-4cac-835d-7ab05097370b', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:58:34 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-92df3ef6-04c4-422e-9ba1-abfecbf9347c tempest-CreateVolumesFromImageTest-1604318855 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51a17ab2-091d-45c8-aa26-afa5f7eb129b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:58:34 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-92df3ef6-04c4-422e-9ba1-abfecbf9347c tempest-CreateVolumesFromImageTest-1604318855 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51a17ab2-091d-45c8-aa26-afa5f7eb129b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:58:34 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-92df3ef6-04c4-422e-9ba1-abfecbf9347c tempest-CreateVolumesFromImageTest-1604318855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b78860b-ab54-4505-a862-2a693db56215) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:58:34 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-92df3ef6-04c4-422e-9ba1-abfecbf9347c tempest-CreateVolumesFromImageTest-1604318855 None] Volume 8f668556-7967-4cac-835d-7ab05097370b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8f668556-7967-4cac-835d-7ab05097370b', 'volume_size': 1} Jul 13 13:58:34 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-92df3ef6-04c4-422e-9ba1-abfecbf9347c tempest-CreateVolumesFromImageTest-1604318855 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:58:34 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-f61f5b8d-59f1-495e-89d8-4e7745eafaf3 tempest-GroupsV314Test-1132626347 None] Group tempest-GroupsV314Test-Group-1591146452: creating Jul 13 13:58:34 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-f61f5b8d-59f1-495e-89d8-4e7745eafaf3 tempest-GroupsV314Test-1132626347 None] Group tempest-GroupsV314Test-Group-1591146452: created successfully Jul 13 13:58:34 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-f61f5b8d-59f1-495e-89d8-4e7745eafaf3 tempest-GroupsV314Test-1132626347 None] Create group completed successfully. Jul 13 13:58:35 devstack sudo[98717]: pam_unix(sudo:session): session closed for user root Jul 13 13:58:35 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-60a26dc3-0436-402e-832f-5017b179372e tempest-CreateVolumesFromImageTest-1604318855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-f9968be0-682c-4bdc-a9d4-b30db4a35088" returned: 0 in 0.404s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:58:35 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-60a26dc3-0436-402e-832f-5017b179372e tempest-CreateVolumesFromImageTest-1604318855 None] <== create_volume: return (1312ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'} {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 13 13:58:35 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-60a26dc3-0436-402e-832f-5017b179372e tempest-CreateVolumesFromImageTest-1604318855 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.316s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:58:35 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-63928565-757c-42cd-9ddf-83f087d41703 tempest-CreateVolumesFromImageTest-1604318855 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.856s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:58:35 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-63928565-757c-42cd-9ddf-83f087d41703 tempest-CreateVolumesFromImageTest-1604318855 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T11:58:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2008764942',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e2681f3-5990-4083-be61-0f798f9c873e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41b8e9a188e747f88f2157d643dc3cd1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T11:58:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T11:58:34Z,use_quota=True,user_id='52d23dbce9c1422c8ce067bb1d34439c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1147de8b-623b-426c-a13d-7fc824a80f67),volume_type_id=1147de8b-623b-426c-a13d-7fc824a80f67)}" {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 13 13:58:35 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-63928565-757c-42cd-9ddf-83f087d41703 tempest-CreateVolumesFromImageTest-1604318855 None] Creating volume 9e2681f3-5990-4083-be61-0f798f9c873e {{(pid=87098) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 13 13:58:35 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-63928565-757c-42cd-9ddf-83f087d41703 tempest-CreateVolumesFromImageTest-1604318855 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:58:35 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-63928565-757c-42cd-9ddf-83f087d41703 tempest-CreateVolumesFromImageTest-1604318855 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:58:35 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-63928565-757c-42cd-9ddf-83f087d41703 tempest-CreateVolumesFromImageTest-1604318855 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 13:58:35 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-63928565-757c-42cd-9ddf-83f087d41703 tempest-CreateVolumesFromImageTest-1604318855 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 13:58:35 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-63928565-757c-42cd-9ddf-83f087d41703 tempest-CreateVolumesFromImageTest-1604318855 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:58:35 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-63928565-757c-42cd-9ddf-83f087d41703 tempest-CreateVolumesFromImageTest-1604318855 None] Selected osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 13:58:35 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-63928565-757c-42cd-9ddf-83f087d41703 tempest-CreateVolumesFromImageTest-1604318855 None] casted to osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 Jul 13 13:58:35 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-63928565-757c-42cd-9ddf-83f087d41703 tempest-CreateVolumesFromImageTest-1604318855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-9e2681f3-5990-4083-be61-0f798f9c873e 1073741824 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:58:35 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-60a26dc3-0436-402e-832f-5017b179372e tempest-CreateVolumesFromImageTest-1604318855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71bdbfdc-2aa9-40ec-a2a8-d9c81413a024) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f9968be0-682c-4bdc-a9d4-b30db4a35088', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:58:35 devstack sudo[98720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-9e2681f3-5990-4083-be61-0f798f9c873e 1073741824 Jul 13 13:58:35 devstack sudo[98720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:58:35 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-60a26dc3-0436-402e-832f-5017b179372e tempest-CreateVolumesFromImageTest-1604318855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad5b318d-5d84-41b7-bb08-676dcc577b45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:58:35 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-60a26dc3-0436-402e-832f-5017b179372e tempest-CreateVolumesFromImageTest-1604318855 None] Volume volume-f9968be0-682c-4bdc-a9d4-b30db4a35088 (f9968be0-682c-4bdc-a9d4-b30db4a35088): created successfully Jul 13 13:58:35 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-60a26dc3-0436-402e-832f-5017b179372e tempest-CreateVolumesFromImageTest-1604318855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad5b318d-5d84-41b7-bb08-676dcc577b45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:58:35 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-60a26dc3-0436-402e-832f-5017b179372e tempest-CreateVolumesFromImageTest-1604318855 None] Flow 'volume_create_manager' (4212e1a5-2755-4a69-ac02-63cd8f285c47) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 13:58:35 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-60a26dc3-0436-402e-832f-5017b179372e tempest-CreateVolumesFromImageTest-1604318855 None] Created volume successfully. Jul 13 13:58:35 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-1eaf6474-1c72-4310-b7ea-64fd371a7827 tempest-CreateVolumesFromImageTest-1604318855 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 13:58:35 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-1eaf6474-1c72-4310-b7ea-64fd371a7827 tempest-CreateVolumesFromImageTest-1604318855 None] Flow 'volume_create_manager' (b49d5099-70ff-492c-9d94-45c2c7762d1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 13:58:35 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-1eaf6474-1c72-4310-b7ea-64fd371a7827 tempest-CreateVolumesFromImageTest-1604318855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f590133b-0759-42f5-95dd-035beb74d26e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:58:35 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-1eaf6474-1c72-4310-b7ea-64fd371a7827 tempest-CreateVolumesFromImageTest-1604318855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f590133b-0759-42f5-95dd-035beb74d26e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T11:58:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1092133054',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18cb4122-4218-4ed7-ad1c-3b1fe7fdebb4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41b8e9a188e747f88f2157d643dc3cd1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T11:58:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T11:58:35Z,use_quota=True,user_id='52d23dbce9c1422c8ce067bb1d34439c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1147de8b-623b-426c-a13d-7fc824a80f67),volume_type_id=1147de8b-623b-426c-a13d-7fc824a80f67)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:58:35 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-1eaf6474-1c72-4310-b7ea-64fd371a7827 tempest-CreateVolumesFromImageTest-1604318855 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (683b938a-9c9e-4491-b06d-0eeb487d92c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:58:35 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-1eaf6474-1c72-4310-b7ea-64fd371a7827 tempest-CreateVolumesFromImageTest-1604318855 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (683b938a-9c9e-4491-b06d-0eeb487d92c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:58:35 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-1eaf6474-1c72-4310-b7ea-64fd371a7827 tempest-CreateVolumesFromImageTest-1604318855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2c63634-ade5-4948-aaa8-199d8b27147b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:58:35 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-1eaf6474-1c72-4310-b7ea-64fd371a7827 tempest-CreateVolumesFromImageTest-1604318855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2c63634-ade5-4948-aaa8-199d8b27147b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '18cb4122-4218-4ed7-ad1c-3b1fe7fdebb4', 'volume_name': 'volume-18cb4122-4218-4ed7-ad1c-3b1fe7fdebb4', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:58:35 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-1eaf6474-1c72-4310-b7ea-64fd371a7827 tempest-CreateVolumesFromImageTest-1604318855 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95cafa7a-8121-447b-ac29-022cab01d3f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:58:35 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-1eaf6474-1c72-4310-b7ea-64fd371a7827 tempest-CreateVolumesFromImageTest-1604318855 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95cafa7a-8121-447b-ac29-022cab01d3f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:58:35 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-1eaf6474-1c72-4310-b7ea-64fd371a7827 tempest-CreateVolumesFromImageTest-1604318855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b484baf-8f63-4bd8-b26f-af7cb94437cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:58:35 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-1eaf6474-1c72-4310-b7ea-64fd371a7827 tempest-CreateVolumesFromImageTest-1604318855 None] Volume 18cb4122-4218-4ed7-ad1c-3b1fe7fdebb4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-18cb4122-4218-4ed7-ad1c-3b1fe7fdebb4', 'volume_size': 1} Jul 13 13:58:35 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-1eaf6474-1c72-4310-b7ea-64fd371a7827 tempest-CreateVolumesFromImageTest-1604318855 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:58:35 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-bb3c4915-a042-488a-a2c7-89550be81f82 tempest-CreateVolumesFromImageTest-1604318855 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 13:58:35 devstack sudo[98720]: pam_unix(sudo:session): session closed for user root Jul 13 13:58:35 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-bb3c4915-a042-488a-a2c7-89550be81f82 tempest-CreateVolumesFromImageTest-1604318855 None] Flow 'volume_create_manager' (826c89ed-9ad7-4cea-8f67-c0f0e0673a2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 13:58:35 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-bb3c4915-a042-488a-a2c7-89550be81f82 tempest-CreateVolumesFromImageTest-1604318855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5882cc60-ffa7-496a-8ca2-314ee7885ab1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:58:35 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-63928565-757c-42cd-9ddf-83f087d41703 tempest-CreateVolumesFromImageTest-1604318855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-9e2681f3-5990-4083-be61-0f798f9c873e 1073741824" returned: 0 in 0.827s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:58:35 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-bb3c4915-a042-488a-a2c7-89550be81f82 tempest-CreateVolumesFromImageTest-1604318855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5882cc60-ffa7-496a-8ca2-314ee7885ab1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T11:58:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-304268989',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d58f6f9-5b77-48cb-9b15-f08745f7bedb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41b8e9a188e747f88f2157d643dc3cd1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T11:58:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T11:58:36Z,use_quota=True,user_id='52d23dbce9c1422c8ce067bb1d34439c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1147de8b-623b-426c-a13d-7fc824a80f67),volume_type_id=1147de8b-623b-426c-a13d-7fc824a80f67)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:58:35 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-bb3c4915-a042-488a-a2c7-89550be81f82 tempest-CreateVolumesFromImageTest-1604318855 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18a99a09-bf51-4f10-a167-73ae2c11b5b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:58:35 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-bb3c4915-a042-488a-a2c7-89550be81f82 tempest-CreateVolumesFromImageTest-1604318855 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18a99a09-bf51-4f10-a167-73ae2c11b5b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:58:35 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-bb3c4915-a042-488a-a2c7-89550be81f82 tempest-CreateVolumesFromImageTest-1604318855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ef80505-2d4a-4307-83c5-d2308ef79941) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:58:35 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-bb3c4915-a042-488a-a2c7-89550be81f82 tempest-CreateVolumesFromImageTest-1604318855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ef80505-2d4a-4307-83c5-d2308ef79941) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8d58f6f9-5b77-48cb-9b15-f08745f7bedb', 'volume_name': 'volume-8d58f6f9-5b77-48cb-9b15-f08745f7bedb', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:58:35 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-bb3c4915-a042-488a-a2c7-89550be81f82 tempest-CreateVolumesFromImageTest-1604318855 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (231b26ad-b50a-4fc0-93b7-7278fbd5f612) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:58:35 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-bb3c4915-a042-488a-a2c7-89550be81f82 tempest-CreateVolumesFromImageTest-1604318855 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (231b26ad-b50a-4fc0-93b7-7278fbd5f612) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:58:35 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-bb3c4915-a042-488a-a2c7-89550be81f82 tempest-CreateVolumesFromImageTest-1604318855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8b91a7c-0eb4-4800-9421-182233be8f9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:58:36 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-bb3c4915-a042-488a-a2c7-89550be81f82 tempest-CreateVolumesFromImageTest-1604318855 None] Volume 8d58f6f9-5b77-48cb-9b15-f08745f7bedb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8d58f6f9-5b77-48cb-9b15-f08745f7bedb', 'volume_size': 1} Jul 13 13:58:36 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-bb3c4915-a042-488a-a2c7-89550be81f82 tempest-CreateVolumesFromImageTest-1604318855 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:58:36 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-63928565-757c-42cd-9ddf-83f087d41703 tempest-CreateVolumesFromImageTest-1604318855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-9e2681f3-5990-4083-be61-0f798f9c873e {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:58:36 devstack sudo[98726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-9e2681f3-5990-4083-be61-0f798f9c873e Jul 13 13:58:36 devstack sudo[98726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:58:36 devstack sudo[98726]: pam_unix(sudo:session): session closed for user root Jul 13 13:58:36 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-63928565-757c-42cd-9ddf-83f087d41703 tempest-CreateVolumesFromImageTest-1604318855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-9e2681f3-5990-4083-be61-0f798f9c873e" returned: 0 in 0.315s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:58:36 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-63928565-757c-42cd-9ddf-83f087d41703 tempest-CreateVolumesFromImageTest-1604318855 None] <== create_volume: return (1316ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'} {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 13 13:58:36 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-63928565-757c-42cd-9ddf-83f087d41703 tempest-CreateVolumesFromImageTest-1604318855 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.321s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:58:36 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-92df3ef6-04c4-422e-9ba1-abfecbf9347c tempest-CreateVolumesFromImageTest-1604318855 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.573s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:58:36 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-92df3ef6-04c4-422e-9ba1-abfecbf9347c tempest-CreateVolumesFromImageTest-1604318855 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T11:58:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1823771912',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f668556-7967-4cac-835d-7ab05097370b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41b8e9a188e747f88f2157d643dc3cd1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T11:58:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T11:58:35Z,use_quota=True,user_id='52d23dbce9c1422c8ce067bb1d34439c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1147de8b-623b-426c-a13d-7fc824a80f67),volume_type_id=1147de8b-623b-426c-a13d-7fc824a80f67)}" {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 13 13:58:36 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-92df3ef6-04c4-422e-9ba1-abfecbf9347c tempest-CreateVolumesFromImageTest-1604318855 None] Creating volume 8f668556-7967-4cac-835d-7ab05097370b {{(pid=87098) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 13 13:58:36 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-92df3ef6-04c4-422e-9ba1-abfecbf9347c tempest-CreateVolumesFromImageTest-1604318855 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:58:36 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-92df3ef6-04c4-422e-9ba1-abfecbf9347c tempest-CreateVolumesFromImageTest-1604318855 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:58:36 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-92df3ef6-04c4-422e-9ba1-abfecbf9347c tempest-CreateVolumesFromImageTest-1604318855 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 13:58:36 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-92df3ef6-04c4-422e-9ba1-abfecbf9347c tempest-CreateVolumesFromImageTest-1604318855 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 13:58:36 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-92df3ef6-04c4-422e-9ba1-abfecbf9347c tempest-CreateVolumesFromImageTest-1604318855 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:58:36 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-92df3ef6-04c4-422e-9ba1-abfecbf9347c tempest-CreateVolumesFromImageTest-1604318855 None] Selected osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 13:58:36 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-92df3ef6-04c4-422e-9ba1-abfecbf9347c tempest-CreateVolumesFromImageTest-1604318855 None] casted to osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 Jul 13 13:58:36 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-92df3ef6-04c4-422e-9ba1-abfecbf9347c tempest-CreateVolumesFromImageTest-1604318855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-8f668556-7967-4cac-835d-7ab05097370b 1073741824 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:58:36 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-63928565-757c-42cd-9ddf-83f087d41703 tempest-CreateVolumesFromImageTest-1604318855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f087d255-3974-412f-abde-7a5b23c36a6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9e2681f3-5990-4083-be61-0f798f9c873e', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:58:36 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-63928565-757c-42cd-9ddf-83f087d41703 tempest-CreateVolumesFromImageTest-1604318855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1cbcbe63-6904-49f8-9e10-5604149c82d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:58:36 devstack sudo[98729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-8f668556-7967-4cac-835d-7ab05097370b 1073741824 Jul 13 13:58:36 devstack sudo[98729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:58:36 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-63928565-757c-42cd-9ddf-83f087d41703 tempest-CreateVolumesFromImageTest-1604318855 None] Volume volume-9e2681f3-5990-4083-be61-0f798f9c873e (9e2681f3-5990-4083-be61-0f798f9c873e): created successfully Jul 13 13:58:36 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-63928565-757c-42cd-9ddf-83f087d41703 tempest-CreateVolumesFromImageTest-1604318855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1cbcbe63-6904-49f8-9e10-5604149c82d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:58:36 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-63928565-757c-42cd-9ddf-83f087d41703 tempest-CreateVolumesFromImageTest-1604318855 None] Flow 'volume_create_manager' (77202dc4-4121-4551-afd0-fcdc55aa5660) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 13:58:36 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-63928565-757c-42cd-9ddf-83f087d41703 tempest-CreateVolumesFromImageTest-1604318855 None] Created volume successfully. Jul 13 13:58:36 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-5405aabe-fd5a-423c-b4f2-823ce0fbfe0a tempest-GroupsV314Test-1132626347 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 13:58:36 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-5405aabe-fd5a-423c-b4f2-823ce0fbfe0a tempest-GroupsV314Test-1132626347 None] Flow 'volume_create_manager' (649018c9-2974-4aad-bc9b-1eb886c9f287) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 13:58:36 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-5405aabe-fd5a-423c-b4f2-823ce0fbfe0a tempest-GroupsV314Test-1132626347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d98e198-20c6-4b98-8d87-bdf7cbbb16be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:58:36 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-5405aabe-fd5a-423c-b4f2-823ce0fbfe0a tempest-GroupsV314Test-1132626347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d98e198-20c6-4b98-8d87-bdf7cbbb16be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T11:58:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1352118373',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=5d1cf52f-3b3b-4730-bd3d-5bdf0871456c,host='devstack@QuobyteHD#QuobyteHD',id=fb76c14a-a177-4ea4-aa62-734b9f8c5417,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='401278b6f94d47d1a8a26d14a7e85f0a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T11:58:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T11:58:37Z,use_quota=True,user_id='f88f80b9020649689b4dc740796585db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e320d438-1576-4e74-bf59-8e1beafc68d3),volume_type_id=e320d438-1576-4e74-bf59-8e1beafc68d3)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:58:36 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-5405aabe-fd5a-423c-b4f2-823ce0fbfe0a tempest-GroupsV314Test-1132626347 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (959029ce-a02e-4c34-a86a-2d012c1becfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:58:36 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-5405aabe-fd5a-423c-b4f2-823ce0fbfe0a tempest-GroupsV314Test-1132626347 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (959029ce-a02e-4c34-a86a-2d012c1becfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:58:36 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-5405aabe-fd5a-423c-b4f2-823ce0fbfe0a tempest-GroupsV314Test-1132626347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76a92b12-4aa5-4683-a1c4-c4b15612494c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:58:36 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-5405aabe-fd5a-423c-b4f2-823ce0fbfe0a tempest-GroupsV314Test-1132626347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76a92b12-4aa5-4683-a1c4-c4b15612494c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fb76c14a-a177-4ea4-aa62-734b9f8c5417', 'volume_name': 'volume-fb76c14a-a177-4ea4-aa62-734b9f8c5417', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:58:36 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-5405aabe-fd5a-423c-b4f2-823ce0fbfe0a tempest-GroupsV314Test-1132626347 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d388a44-332b-4685-a2ef-7dc851377143) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:58:36 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-5405aabe-fd5a-423c-b4f2-823ce0fbfe0a tempest-GroupsV314Test-1132626347 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d388a44-332b-4685-a2ef-7dc851377143) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:58:36 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-5405aabe-fd5a-423c-b4f2-823ce0fbfe0a tempest-GroupsV314Test-1132626347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a32fe5c-66eb-450c-9d6a-601fce25541a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:58:36 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-5405aabe-fd5a-423c-b4f2-823ce0fbfe0a tempest-GroupsV314Test-1132626347 None] Volume fb76c14a-a177-4ea4-aa62-734b9f8c5417: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fb76c14a-a177-4ea4-aa62-734b9f8c5417', 'volume_size': 1} Jul 13 13:58:36 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-5405aabe-fd5a-423c-b4f2-823ce0fbfe0a tempest-GroupsV314Test-1132626347 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:58:37 devstack sudo[98729]: pam_unix(sudo:session): session closed for user root Jul 13 13:58:37 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-92df3ef6-04c4-422e-9ba1-abfecbf9347c tempest-CreateVolumesFromImageTest-1604318855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-8f668556-7967-4cac-835d-7ab05097370b 1073741824" returned: 0 in 0.822s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:58:37 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-92df3ef6-04c4-422e-9ba1-abfecbf9347c tempest-CreateVolumesFromImageTest-1604318855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-8f668556-7967-4cac-835d-7ab05097370b {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:58:37 devstack sudo[98736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-8f668556-7967-4cac-835d-7ab05097370b Jul 13 13:58:37 devstack sudo[98736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:58:37 devstack sudo[98736]: pam_unix(sudo:session): session closed for user root Jul 13 13:58:37 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-92df3ef6-04c4-422e-9ba1-abfecbf9347c tempest-CreateVolumesFromImageTest-1604318855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-8f668556-7967-4cac-835d-7ab05097370b" returned: 0 in 0.338s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:58:37 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-92df3ef6-04c4-422e-9ba1-abfecbf9347c tempest-CreateVolumesFromImageTest-1604318855 None] <== create_volume: return (1222ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'} {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 13 13:58:37 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-92df3ef6-04c4-422e-9ba1-abfecbf9347c tempest-CreateVolumesFromImageTest-1604318855 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.225s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:58:37 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-1eaf6474-1c72-4310-b7ea-64fd371a7827 tempest-CreateVolumesFromImageTest-1604318855 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.127s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:58:37 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-1eaf6474-1c72-4310-b7ea-64fd371a7827 tempest-CreateVolumesFromImageTest-1604318855 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T11:58:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1092133054',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18cb4122-4218-4ed7-ad1c-3b1fe7fdebb4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41b8e9a188e747f88f2157d643dc3cd1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T11:58:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T11:58:35Z,use_quota=True,user_id='52d23dbce9c1422c8ce067bb1d34439c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1147de8b-623b-426c-a13d-7fc824a80f67),volume_type_id=1147de8b-623b-426c-a13d-7fc824a80f67)}" {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 13 13:58:37 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-1eaf6474-1c72-4310-b7ea-64fd371a7827 tempest-CreateVolumesFromImageTest-1604318855 None] Creating volume 18cb4122-4218-4ed7-ad1c-3b1fe7fdebb4 {{(pid=87098) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 13 13:58:37 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-1eaf6474-1c72-4310-b7ea-64fd371a7827 tempest-CreateVolumesFromImageTest-1604318855 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:58:37 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-1eaf6474-1c72-4310-b7ea-64fd371a7827 tempest-CreateVolumesFromImageTest-1604318855 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:58:37 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-1eaf6474-1c72-4310-b7ea-64fd371a7827 tempest-CreateVolumesFromImageTest-1604318855 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 13:58:37 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-1eaf6474-1c72-4310-b7ea-64fd371a7827 tempest-CreateVolumesFromImageTest-1604318855 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 13:58:37 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-1eaf6474-1c72-4310-b7ea-64fd371a7827 tempest-CreateVolumesFromImageTest-1604318855 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:58:37 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-1eaf6474-1c72-4310-b7ea-64fd371a7827 tempest-CreateVolumesFromImageTest-1604318855 None] Selected osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 13:58:37 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-1eaf6474-1c72-4310-b7ea-64fd371a7827 tempest-CreateVolumesFromImageTest-1604318855 None] casted to osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 Jul 13 13:58:37 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-1eaf6474-1c72-4310-b7ea-64fd371a7827 tempest-CreateVolumesFromImageTest-1604318855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-18cb4122-4218-4ed7-ad1c-3b1fe7fdebb4 1073741824 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:58:37 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-92df3ef6-04c4-422e-9ba1-abfecbf9347c tempest-CreateVolumesFromImageTest-1604318855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b78860b-ab54-4505-a862-2a693db56215) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8f668556-7967-4cac-835d-7ab05097370b', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:58:37 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-92df3ef6-04c4-422e-9ba1-abfecbf9347c tempest-CreateVolumesFromImageTest-1604318855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (751aedf9-e10b-4741-abb0-1cc11261ef6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:58:37 devstack sudo[98739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-18cb4122-4218-4ed7-ad1c-3b1fe7fdebb4 1073741824 Jul 13 13:58:37 devstack sudo[98739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:58:37 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-92df3ef6-04c4-422e-9ba1-abfecbf9347c tempest-CreateVolumesFromImageTest-1604318855 None] Volume volume-8f668556-7967-4cac-835d-7ab05097370b (8f668556-7967-4cac-835d-7ab05097370b): created successfully Jul 13 13:58:37 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-92df3ef6-04c4-422e-9ba1-abfecbf9347c tempest-CreateVolumesFromImageTest-1604318855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (751aedf9-e10b-4741-abb0-1cc11261ef6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:58:37 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-92df3ef6-04c4-422e-9ba1-abfecbf9347c tempest-CreateVolumesFromImageTest-1604318855 None] Flow 'volume_create_manager' (e2642d0b-e902-4a8b-8ec3-a44932a5ce20) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 13:58:37 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-92df3ef6-04c4-422e-9ba1-abfecbf9347c tempest-CreateVolumesFromImageTest-1604318855 None] Created volume successfully. Jul 13 13:58:38 devstack sudo[98739]: pam_unix(sudo:session): session closed for user root Jul 13 13:58:38 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-1eaf6474-1c72-4310-b7ea-64fd371a7827 tempest-CreateVolumesFromImageTest-1604318855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-18cb4122-4218-4ed7-ad1c-3b1fe7fdebb4 1073741824" returned: 0 in 0.562s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:58:38 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-1eaf6474-1c72-4310-b7ea-64fd371a7827 tempest-CreateVolumesFromImageTest-1604318855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-18cb4122-4218-4ed7-ad1c-3b1fe7fdebb4 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:58:38 devstack sudo[98745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-18cb4122-4218-4ed7-ad1c-3b1fe7fdebb4 Jul 13 13:58:38 devstack sudo[98745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:58:38 devstack sudo[98745]: pam_unix(sudo:session): session closed for user root Jul 13 13:58:38 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-1eaf6474-1c72-4310-b7ea-64fd371a7827 tempest-CreateVolumesFromImageTest-1604318855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-18cb4122-4218-4ed7-ad1c-3b1fe7fdebb4" returned: 0 in 0.301s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:58:38 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-1eaf6474-1c72-4310-b7ea-64fd371a7827 tempest-CreateVolumesFromImageTest-1604318855 None] <== create_volume: return (918ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'} {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 13 13:58:38 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-1eaf6474-1c72-4310-b7ea-64fd371a7827 tempest-CreateVolumesFromImageTest-1604318855 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.921s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:58:38 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-bb3c4915-a042-488a-a2c7-89550be81f82 tempest-CreateVolumesFromImageTest-1604318855 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.515s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:58:38 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-bb3c4915-a042-488a-a2c7-89550be81f82 tempest-CreateVolumesFromImageTest-1604318855 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T11:58:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-304268989',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d58f6f9-5b77-48cb-9b15-f08745f7bedb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41b8e9a188e747f88f2157d643dc3cd1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T11:58:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T11:58:36Z,use_quota=True,user_id='52d23dbce9c1422c8ce067bb1d34439c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1147de8b-623b-426c-a13d-7fc824a80f67),volume_type_id=1147de8b-623b-426c-a13d-7fc824a80f67)}" {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 13 13:58:38 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-bb3c4915-a042-488a-a2c7-89550be81f82 tempest-CreateVolumesFromImageTest-1604318855 None] Creating volume 8d58f6f9-5b77-48cb-9b15-f08745f7bedb {{(pid=87098) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 13 13:58:38 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-bb3c4915-a042-488a-a2c7-89550be81f82 tempest-CreateVolumesFromImageTest-1604318855 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:58:38 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-bb3c4915-a042-488a-a2c7-89550be81f82 tempest-CreateVolumesFromImageTest-1604318855 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:58:38 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-bb3c4915-a042-488a-a2c7-89550be81f82 tempest-CreateVolumesFromImageTest-1604318855 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 13:58:38 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-bb3c4915-a042-488a-a2c7-89550be81f82 tempest-CreateVolumesFromImageTest-1604318855 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 13:58:38 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-bb3c4915-a042-488a-a2c7-89550be81f82 tempest-CreateVolumesFromImageTest-1604318855 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:58:38 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-bb3c4915-a042-488a-a2c7-89550be81f82 tempest-CreateVolumesFromImageTest-1604318855 None] Selected osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 13:58:38 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-bb3c4915-a042-488a-a2c7-89550be81f82 tempest-CreateVolumesFromImageTest-1604318855 None] casted to osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 Jul 13 13:58:38 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-bb3c4915-a042-488a-a2c7-89550be81f82 tempest-CreateVolumesFromImageTest-1604318855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-8d58f6f9-5b77-48cb-9b15-f08745f7bedb 1073741824 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:58:38 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-1eaf6474-1c72-4310-b7ea-64fd371a7827 tempest-CreateVolumesFromImageTest-1604318855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b484baf-8f63-4bd8-b26f-af7cb94437cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-18cb4122-4218-4ed7-ad1c-3b1fe7fdebb4', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:58:38 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-1eaf6474-1c72-4310-b7ea-64fd371a7827 tempest-CreateVolumesFromImageTest-1604318855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d67c1099-0e5a-406a-86dd-f85386c98790) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:58:38 devstack sudo[98748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-8d58f6f9-5b77-48cb-9b15-f08745f7bedb 1073741824 Jul 13 13:58:38 devstack sudo[98748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:58:38 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-1eaf6474-1c72-4310-b7ea-64fd371a7827 tempest-CreateVolumesFromImageTest-1604318855 None] Volume volume-18cb4122-4218-4ed7-ad1c-3b1fe7fdebb4 (18cb4122-4218-4ed7-ad1c-3b1fe7fdebb4): created successfully Jul 13 13:58:38 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-1eaf6474-1c72-4310-b7ea-64fd371a7827 tempest-CreateVolumesFromImageTest-1604318855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d67c1099-0e5a-406a-86dd-f85386c98790) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:58:38 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-1eaf6474-1c72-4310-b7ea-64fd371a7827 tempest-CreateVolumesFromImageTest-1604318855 None] Flow 'volume_create_manager' (b49d5099-70ff-492c-9d94-45c2c7762d1c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 13:58:38 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-1eaf6474-1c72-4310-b7ea-64fd371a7827 tempest-CreateVolumesFromImageTest-1604318855 None] Created volume successfully. Jul 13 13:58:39 devstack sudo[98748]: pam_unix(sudo:session): session closed for user root Jul 13 13:58:39 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-bb3c4915-a042-488a-a2c7-89550be81f82 tempest-CreateVolumesFromImageTest-1604318855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-8d58f6f9-5b77-48cb-9b15-f08745f7bedb 1073741824" returned: 0 in 0.705s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:58:39 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-bb3c4915-a042-488a-a2c7-89550be81f82 tempest-CreateVolumesFromImageTest-1604318855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-8d58f6f9-5b77-48cb-9b15-f08745f7bedb {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:58:39 devstack sudo[98754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-8d58f6f9-5b77-48cb-9b15-f08745f7bedb Jul 13 13:58:39 devstack sudo[98754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:58:39 devstack sudo[98754]: pam_unix(sudo:session): session closed for user root Jul 13 13:58:39 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-bb3c4915-a042-488a-a2c7-89550be81f82 tempest-CreateVolumesFromImageTest-1604318855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-8d58f6f9-5b77-48cb-9b15-f08745f7bedb" returned: 0 in 0.273s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:58:39 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-bb3c4915-a042-488a-a2c7-89550be81f82 tempest-CreateVolumesFromImageTest-1604318855 None] <== create_volume: return (1025ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'} {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 13 13:58:39 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-bb3c4915-a042-488a-a2c7-89550be81f82 tempest-CreateVolumesFromImageTest-1604318855 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.033s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:58:39 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-5405aabe-fd5a-423c-b4f2-823ce0fbfe0a tempest-GroupsV314Test-1132626347 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.617s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:58:39 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-5405aabe-fd5a-423c-b4f2-823ce0fbfe0a tempest-GroupsV314Test-1132626347 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=5d1cf52f-3b3b-4730-bd3d-5bdf0871456c,created_at=2026-07-13T11:58:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1352118373',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=5d1cf52f-3b3b-4730-bd3d-5bdf0871456c,host='devstack@QuobyteHD#QuobyteHD',id=fb76c14a-a177-4ea4-aa62-734b9f8c5417,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='401278b6f94d47d1a8a26d14a7e85f0a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T11:58:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T11:58:37Z,use_quota=True,user_id='f88f80b9020649689b4dc740796585db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e320d438-1576-4e74-bf59-8e1beafc68d3),volume_type_id=e320d438-1576-4e74-bf59-8e1beafc68d3)}" {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 13 13:58:39 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-5405aabe-fd5a-423c-b4f2-823ce0fbfe0a tempest-GroupsV314Test-1132626347 None] Creating volume fb76c14a-a177-4ea4-aa62-734b9f8c5417 {{(pid=87098) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 13 13:58:39 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-5405aabe-fd5a-423c-b4f2-823ce0fbfe0a tempest-GroupsV314Test-1132626347 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:58:39 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-5405aabe-fd5a-423c-b4f2-823ce0fbfe0a tempest-GroupsV314Test-1132626347 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:58:39 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-5405aabe-fd5a-423c-b4f2-823ce0fbfe0a tempest-GroupsV314Test-1132626347 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 13:58:39 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-5405aabe-fd5a-423c-b4f2-823ce0fbfe0a tempest-GroupsV314Test-1132626347 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 13:58:39 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-5405aabe-fd5a-423c-b4f2-823ce0fbfe0a tempest-GroupsV314Test-1132626347 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:58:39 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-5405aabe-fd5a-423c-b4f2-823ce0fbfe0a tempest-GroupsV314Test-1132626347 None] Selected osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 13:58:39 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-5405aabe-fd5a-423c-b4f2-823ce0fbfe0a tempest-GroupsV314Test-1132626347 None] casted to osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 Jul 13 13:58:39 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-5405aabe-fd5a-423c-b4f2-823ce0fbfe0a tempest-GroupsV314Test-1132626347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-fb76c14a-a177-4ea4-aa62-734b9f8c5417 1073741824 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:58:39 devstack sudo[98757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-fb76c14a-a177-4ea4-aa62-734b9f8c5417 1073741824 Jul 13 13:58:39 devstack sudo[98757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:58:39 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-bb3c4915-a042-488a-a2c7-89550be81f82 tempest-CreateVolumesFromImageTest-1604318855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8b91a7c-0eb4-4800-9421-182233be8f9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8d58f6f9-5b77-48cb-9b15-f08745f7bedb', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:58:39 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-bb3c4915-a042-488a-a2c7-89550be81f82 tempest-CreateVolumesFromImageTest-1604318855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9e1878e-8501-4978-94b8-a830aa415d86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:58:39 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-bb3c4915-a042-488a-a2c7-89550be81f82 tempest-CreateVolumesFromImageTest-1604318855 None] Volume volume-8d58f6f9-5b77-48cb-9b15-f08745f7bedb (8d58f6f9-5b77-48cb-9b15-f08745f7bedb): created successfully Jul 13 13:58:39 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-bb3c4915-a042-488a-a2c7-89550be81f82 tempest-CreateVolumesFromImageTest-1604318855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9e1878e-8501-4978-94b8-a830aa415d86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:58:39 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-bb3c4915-a042-488a-a2c7-89550be81f82 tempest-CreateVolumesFromImageTest-1604318855 None] Flow 'volume_create_manager' (826c89ed-9ad7-4cea-8f67-c0f0e0673a2c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 13:58:39 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-bb3c4915-a042-488a-a2c7-89550be81f82 tempest-CreateVolumesFromImageTest-1604318855 None] Created volume successfully. Jul 13 13:58:40 devstack sudo[98757]: pam_unix(sudo:session): session closed for user root Jul 13 13:58:40 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-5405aabe-fd5a-423c-b4f2-823ce0fbfe0a tempest-GroupsV314Test-1132626347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-fb76c14a-a177-4ea4-aa62-734b9f8c5417 1073741824" returned: 0 in 0.686s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:58:40 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-5405aabe-fd5a-423c-b4f2-823ce0fbfe0a tempest-GroupsV314Test-1132626347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-fb76c14a-a177-4ea4-aa62-734b9f8c5417 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:58:40 devstack sudo[98763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-fb76c14a-a177-4ea4-aa62-734b9f8c5417 Jul 13 13:58:40 devstack sudo[98763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:58:40 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-6596edca-41f7-4eac-8bcf-99a0d4463c53 tempest-CreateVolumesFromImageTest-1604318855 None] Acquiring lock "cinder-8d58f6f9-5b77-48cb-9b15-f08745f7bedb-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 13:58:40 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-6596edca-41f7-4eac-8bcf-99a0d4463c53 tempest-CreateVolumesFromImageTest-1604318855 None] Lock "cinder-8d58f6f9-5b77-48cb-9b15-f08745f7bedb-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 13:58:40 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-6596edca-41f7-4eac-8bcf-99a0d4463c53 tempest-CreateVolumesFromImageTest-1604318855 None] Acquiring lock "cinder-quobyte-8d58f6f9-5b77-48cb-9b15-f08745f7bedb" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 13:58:40 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-6596edca-41f7-4eac-8bcf-99a0d4463c53 tempest-CreateVolumesFromImageTest-1604318855 None] Lock "cinder-quobyte-8d58f6f9-5b77-48cb-9b15-f08745f7bedb" acquired by "delete_volume" :: waited 0.030s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 13:58:40 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[38b85709-c3c8-464a-ac69-0c89329fddff]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 13:58:40 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-6596edca-41f7-4eac-8bcf-99a0d4463c53 tempest-CreateVolumesFromImageTest-1604318855 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-8d58f6f9-5b77-48cb-9b15-f08745f7bedb {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:58:40 devstack sudo[98766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-8d58f6f9-5b77-48cb-9b15-f08745f7bedb Jul 13 13:58:40 devstack sudo[98766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:58:40 devstack sudo[98763]: pam_unix(sudo:session): session closed for user root Jul 13 13:58:40 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-5405aabe-fd5a-423c-b4f2-823ce0fbfe0a tempest-GroupsV314Test-1132626347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-fb76c14a-a177-4ea4-aa62-734b9f8c5417" returned: 0 in 0.460s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:58:40 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-5405aabe-fd5a-423c-b4f2-823ce0fbfe0a tempest-GroupsV314Test-1132626347 None] <== create_volume: return (1202ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'} {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 13 13:58:40 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-5405aabe-fd5a-423c-b4f2-823ce0fbfe0a tempest-GroupsV314Test-1132626347 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.206s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:58:40 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-5405aabe-fd5a-423c-b4f2-823ce0fbfe0a tempest-GroupsV314Test-1132626347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a32fe5c-66eb-450c-9d6a-601fce25541a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fb76c14a-a177-4ea4-aa62-734b9f8c5417', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:58:40 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-5405aabe-fd5a-423c-b4f2-823ce0fbfe0a tempest-GroupsV314Test-1132626347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4955cbf8-777c-4d67-a1ed-0808b60ad3be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:58:40 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-5405aabe-fd5a-423c-b4f2-823ce0fbfe0a tempest-GroupsV314Test-1132626347 None] Volume volume-fb76c14a-a177-4ea4-aa62-734b9f8c5417 (fb76c14a-a177-4ea4-aa62-734b9f8c5417): created successfully Jul 13 13:58:40 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-5405aabe-fd5a-423c-b4f2-823ce0fbfe0a tempest-GroupsV314Test-1132626347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4955cbf8-777c-4d67-a1ed-0808b60ad3be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:58:40 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-5405aabe-fd5a-423c-b4f2-823ce0fbfe0a tempest-GroupsV314Test-1132626347 None] Flow 'volume_create_manager' (649018c9-2974-4aad-bc9b-1eb886c9f287) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 13:58:40 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-5405aabe-fd5a-423c-b4f2-823ce0fbfe0a tempest-GroupsV314Test-1132626347 None] Created volume successfully. Jul 13 13:58:41 devstack sudo[98766]: pam_unix(sudo:session): session closed for user root Jul 13 13:58:41 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-6596edca-41f7-4eac-8bcf-99a0d4463c53 tempest-CreateVolumesFromImageTest-1604318855 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-8d58f6f9-5b77-48cb-9b15-f08745f7bedb" returned: 0 in 0.519s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:58:41 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-6596edca-41f7-4eac-8bcf-99a0d4463c53 tempest-CreateVolumesFromImageTest-1604318855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-8d58f6f9-5b77-48cb-9b15-f08745f7bedb {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:58:41 devstack sudo[98772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-8d58f6f9-5b77-48cb-9b15-f08745f7bedb Jul 13 13:58:41 devstack sudo[98772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:58:41 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-50aa881d-8409-41c1-b096-f54b1d6f643b tempest-VolumesSnapshotTestJSON-2010930921 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 13:58:41 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-50aa881d-8409-41c1-b096-f54b1d6f643b tempest-VolumesSnapshotTestJSON-2010930921 None] Flow 'volume_create_manager' (9da9b056-7f0e-449d-9faf-49a973e405a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 13:58:41 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-50aa881d-8409-41c1-b096-f54b1d6f643b tempest-VolumesSnapshotTestJSON-2010930921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b440c4d-55ce-43f8-bd6f-2b30e734dbec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:58:41 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-50aa881d-8409-41c1-b096-f54b1d6f643b tempest-VolumesSnapshotTestJSON-2010930921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b440c4d-55ce-43f8-bd6f-2b30e734dbec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T11:58:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-392008118',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ceab0c9b-2879-496d-8815-600b6fb9e092,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8897ab25feb4d999872fbe658460fa6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T11:58:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T11:58:41Z,use_quota=True,user_id='a6f445ef8dc04c7b92c04febd3515b27',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1147de8b-623b-426c-a13d-7fc824a80f67),volume_type_id=1147de8b-623b-426c-a13d-7fc824a80f67)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:58:41 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-50aa881d-8409-41c1-b096-f54b1d6f643b tempest-VolumesSnapshotTestJSON-2010930921 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32e96db5-24a6-4610-a2e1-84d5c75dbdee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:58:41 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-50aa881d-8409-41c1-b096-f54b1d6f643b tempest-VolumesSnapshotTestJSON-2010930921 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32e96db5-24a6-4610-a2e1-84d5c75dbdee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:58:41 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-50aa881d-8409-41c1-b096-f54b1d6f643b tempest-VolumesSnapshotTestJSON-2010930921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae606dfd-af84-40e3-8fb4-c5ace164eab9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:58:41 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-50aa881d-8409-41c1-b096-f54b1d6f643b tempest-VolumesSnapshotTestJSON-2010930921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae606dfd-af84-40e3-8fb4-c5ace164eab9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ceab0c9b-2879-496d-8815-600b6fb9e092', 'volume_name': 'volume-ceab0c9b-2879-496d-8815-600b6fb9e092', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:58:41 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-50aa881d-8409-41c1-b096-f54b1d6f643b tempest-VolumesSnapshotTestJSON-2010930921 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2bf931f-8587-4de5-a279-76b420e3327d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:58:41 devstack sudo[98772]: pam_unix(sudo:session): session closed for user root Jul 13 13:58:41 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-50aa881d-8409-41c1-b096-f54b1d6f643b tempest-VolumesSnapshotTestJSON-2010930921 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2bf931f-8587-4de5-a279-76b420e3327d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:58:41 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-50aa881d-8409-41c1-b096-f54b1d6f643b tempest-VolumesSnapshotTestJSON-2010930921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72deb1df-09dd-4bea-bde0-8eb75e62c1b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:58:41 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-50aa881d-8409-41c1-b096-f54b1d6f643b tempest-VolumesSnapshotTestJSON-2010930921 None] Volume ceab0c9b-2879-496d-8815-600b6fb9e092: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ceab0c9b-2879-496d-8815-600b6fb9e092', 'volume_size': 1} Jul 13 13:58:41 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-50aa881d-8409-41c1-b096-f54b1d6f643b tempest-VolumesSnapshotTestJSON-2010930921 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:58:41 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-50aa881d-8409-41c1-b096-f54b1d6f643b tempest-VolumesSnapshotTestJSON-2010930921 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:58:41 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-50aa881d-8409-41c1-b096-f54b1d6f643b tempest-VolumesSnapshotTestJSON-2010930921 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T11:58:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-392008118',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ceab0c9b-2879-496d-8815-600b6fb9e092,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8897ab25feb4d999872fbe658460fa6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T11:58:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T11:58:41Z,use_quota=True,user_id='a6f445ef8dc04c7b92c04febd3515b27',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1147de8b-623b-426c-a13d-7fc824a80f67),volume_type_id=1147de8b-623b-426c-a13d-7fc824a80f67)}" {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 13 13:58:41 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-50aa881d-8409-41c1-b096-f54b1d6f643b tempest-VolumesSnapshotTestJSON-2010930921 None] Creating volume ceab0c9b-2879-496d-8815-600b6fb9e092 {{(pid=87098) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 13 13:58:41 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-50aa881d-8409-41c1-b096-f54b1d6f643b tempest-VolumesSnapshotTestJSON-2010930921 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:58:41 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-50aa881d-8409-41c1-b096-f54b1d6f643b tempest-VolumesSnapshotTestJSON-2010930921 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:58:41 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-50aa881d-8409-41c1-b096-f54b1d6f643b tempest-VolumesSnapshotTestJSON-2010930921 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 13:58:41 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-50aa881d-8409-41c1-b096-f54b1d6f643b tempest-VolumesSnapshotTestJSON-2010930921 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 13:58:41 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-50aa881d-8409-41c1-b096-f54b1d6f643b tempest-VolumesSnapshotTestJSON-2010930921 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:58:41 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-50aa881d-8409-41c1-b096-f54b1d6f643b tempest-VolumesSnapshotTestJSON-2010930921 None] Selected osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 13:58:41 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-50aa881d-8409-41c1-b096-f54b1d6f643b tempest-VolumesSnapshotTestJSON-2010930921 None] casted to osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 Jul 13 13:58:41 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-50aa881d-8409-41c1-b096-f54b1d6f643b tempest-VolumesSnapshotTestJSON-2010930921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-ceab0c9b-2879-496d-8815-600b6fb9e092 1073741824 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:58:41 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-6596edca-41f7-4eac-8bcf-99a0d4463c53 tempest-CreateVolumesFromImageTest-1604318855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-8d58f6f9-5b77-48cb-9b15-f08745f7bedb" returned: 0 in 0.381s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:58:41 devstack sudo[98775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-ceab0c9b-2879-496d-8815-600b6fb9e092 1073741824 Jul 13 13:58:41 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-6596edca-41f7-4eac-8bcf-99a0d4463c53 tempest-CreateVolumesFromImageTest-1604318855 None] Lock "cinder-quobyte-8d58f6f9-5b77-48cb-9b15-f08745f7bedb" released by "delete_volume" :: held 0.971s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 13:58:41 devstack sudo[98775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:58:41 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-6596edca-41f7-4eac-8bcf-99a0d4463c53 tempest-CreateVolumesFromImageTest-1604318855 None] Created reservations ['e499c1da-8ace-46dc-9391-415da055fa64', 'c263f812-dd57-4618-8389-667b27c73833', 'bd89e495-02a8-4304-bf91-83d386c4f7e9', '85a95ac8-423b-4616-8c49-c2349cf978d4'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 13:58:41 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-6596edca-41f7-4eac-8bcf-99a0d4463c53 tempest-CreateVolumesFromImageTest-1604318855 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:58:41 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-6596edca-41f7-4eac-8bcf-99a0d4463c53 tempest-CreateVolumesFromImageTest-1604318855 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:58:41 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-6596edca-41f7-4eac-8bcf-99a0d4463c53 tempest-CreateVolumesFromImageTest-1604318855 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 13:58:41 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-6596edca-41f7-4eac-8bcf-99a0d4463c53 tempest-CreateVolumesFromImageTest-1604318855 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 13:58:41 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-6596edca-41f7-4eac-8bcf-99a0d4463c53 tempest-CreateVolumesFromImageTest-1604318855 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:58:41 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-6596edca-41f7-4eac-8bcf-99a0d4463c53 tempest-CreateVolumesFromImageTest-1604318855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:58:41 devstack sudo[98777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 Jul 13 13:58:41 devstack sudo[98777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:58:42 devstack sudo[98777]: pam_unix(sudo:session): session closed for user root Jul 13 13:58:42 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-6596edca-41f7-4eac-8bcf-99a0d4463c53 tempest-CreateVolumesFromImageTest-1604318855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78" returned: 0 in 0.386s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:58:42 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-6596edca-41f7-4eac-8bcf-99a0d4463c53 tempest-CreateVolumesFromImageTest-1604318855 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 13:58:42 devstack sudo[98775]: pam_unix(sudo:session): session closed for user root Jul 13 13:58:42 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-6596edca-41f7-4eac-8bcf-99a0d4463c53 tempest-CreateVolumesFromImageTest-1604318855 None] Deleted volume successfully. Jul 13 13:58:42 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-50aa881d-8409-41c1-b096-f54b1d6f643b tempest-VolumesSnapshotTestJSON-2010930921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-ceab0c9b-2879-496d-8815-600b6fb9e092 1073741824" returned: 0 in 0.608s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:58:42 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-6596edca-41f7-4eac-8bcf-99a0d4463c53 tempest-CreateVolumesFromImageTest-1604318855 None] Lock "cinder-8d58f6f9-5b77-48cb-9b15-f08745f7bedb-delete_volume" released by "delete_volume" :: held 1.663s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 13:58:42 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-50aa881d-8409-41c1-b096-f54b1d6f643b tempest-VolumesSnapshotTestJSON-2010930921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-ceab0c9b-2879-496d-8815-600b6fb9e092 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:58:42 devstack sudo[98784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-ceab0c9b-2879-496d-8815-600b6fb9e092 Jul 13 13:58:42 devstack sudo[98784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:58:42 devstack sudo[98784]: pam_unix(sudo:session): session closed for user root Jul 13 13:58:42 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-50aa881d-8409-41c1-b096-f54b1d6f643b tempest-VolumesSnapshotTestJSON-2010930921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-ceab0c9b-2879-496d-8815-600b6fb9e092" returned: 0 in 0.302s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:58:42 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-50aa881d-8409-41c1-b096-f54b1d6f643b tempest-VolumesSnapshotTestJSON-2010930921 None] <== create_volume: return (962ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'} {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 13 13:58:42 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-50aa881d-8409-41c1-b096-f54b1d6f643b tempest-VolumesSnapshotTestJSON-2010930921 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.964s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:58:42 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-50aa881d-8409-41c1-b096-f54b1d6f643b tempest-VolumesSnapshotTestJSON-2010930921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72deb1df-09dd-4bea-bde0-8eb75e62c1b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ceab0c9b-2879-496d-8815-600b6fb9e092', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:58:42 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-50aa881d-8409-41c1-b096-f54b1d6f643b tempest-VolumesSnapshotTestJSON-2010930921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38819835-7843-437c-9b15-9d7fb0934423) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:58:42 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-50aa881d-8409-41c1-b096-f54b1d6f643b tempest-VolumesSnapshotTestJSON-2010930921 None] Volume volume-ceab0c9b-2879-496d-8815-600b6fb9e092 (ceab0c9b-2879-496d-8815-600b6fb9e092): created successfully Jul 13 13:58:42 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-50aa881d-8409-41c1-b096-f54b1d6f643b tempest-VolumesSnapshotTestJSON-2010930921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38819835-7843-437c-9b15-9d7fb0934423) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:58:42 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-50aa881d-8409-41c1-b096-f54b1d6f643b tempest-VolumesSnapshotTestJSON-2010930921 None] Flow 'volume_create_manager' (9da9b056-7f0e-449d-9faf-49a973e405a5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 13:58:42 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-50aa881d-8409-41c1-b096-f54b1d6f643b tempest-VolumesSnapshotTestJSON-2010930921 None] Created volume successfully. Jul 13 13:58:42 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-83fb09ae-ec8f-4ecb-9e24-6ce246e6724f tempest-GroupsV314Test-1132626347 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:58:42 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-83fb09ae-ec8f-4ecb-9e24-6ce246e6724f tempest-GroupsV314Test-1132626347 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:58:42 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-83fb09ae-ec8f-4ecb-9e24-6ce246e6724f tempest-GroupsV314Test-1132626347 None] Cloning volume fb76c14a-a177-4ea4-aa62-734b9f8c5417 to volume 251589d3-8100-434d-9777-422a47d4bde0 Jul 13 13:58:42 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-83fb09ae-ec8f-4ecb-9e24-6ce246e6724f tempest-GroupsV314Test-1132626347 None] Creating offline snapshot a7b29d1f-57ed-46e3-8c6d-6a1fa47d49b2 of volume fb76c14a-a177-4ea4-aa62-734b9f8c5417 {{(pid=87098) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 13 13:58:42 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d040587-cd6c-4dde-acbc-c1a02abac33e]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 13:58:42 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-83fb09ae-ec8f-4ecb-9e24-6ce246e6724f tempest-GroupsV314Test-1132626347 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-fb76c14a-a177-4ea4-aa62-734b9f8c5417 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:58:42 devstack sudo[98787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-fb76c14a-a177-4ea4-aa62-734b9f8c5417 Jul 13 13:58:42 devstack sudo[98787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:58:42 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-6552653a-7d43-478c-8bbe-ca29ea70a086 tempest-CreateVolumesFromImageTest-1604318855 None] Acquiring lock "cinder-18cb4122-4218-4ed7-ad1c-3b1fe7fdebb4-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 13:58:42 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-6552653a-7d43-478c-8bbe-ca29ea70a086 tempest-CreateVolumesFromImageTest-1604318855 None] Lock "cinder-18cb4122-4218-4ed7-ad1c-3b1fe7fdebb4-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 13:58:42 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-6552653a-7d43-478c-8bbe-ca29ea70a086 tempest-CreateVolumesFromImageTest-1604318855 None] Acquiring lock "cinder-quobyte-18cb4122-4218-4ed7-ad1c-3b1fe7fdebb4" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 13:58:42 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-6552653a-7d43-478c-8bbe-ca29ea70a086 tempest-CreateVolumesFromImageTest-1604318855 None] Lock "cinder-quobyte-18cb4122-4218-4ed7-ad1c-3b1fe7fdebb4" acquired by "delete_volume" :: waited 0.026s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 13:58:42 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[9969cf76-cee6-4985-b880-8d35d8ea9093]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 13:58:42 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-6552653a-7d43-478c-8bbe-ca29ea70a086 tempest-CreateVolumesFromImageTest-1604318855 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-18cb4122-4218-4ed7-ad1c-3b1fe7fdebb4 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:58:43 devstack sudo[98787]: pam_unix(sudo:session): session closed for user root Jul 13 13:58:43 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-83fb09ae-ec8f-4ecb-9e24-6ce246e6724f tempest-GroupsV314Test-1132626347 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-fb76c14a-a177-4ea4-aa62-734b9f8c5417" returned: 0 in 0.531s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:58:43 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-83fb09ae-ec8f-4ecb-9e24-6ce246e6724f tempest-GroupsV314Test-1132626347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-fb76c14a-a177-4ea4-aa62-734b9f8c5417,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-fb76c14a-a177-4ea4-aa62-734b9f8c5417.a7b29d1f-57ed-46e3-8c6d-6a1fa47d49b2 1G {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:58:43 devstack sudo[98791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-18cb4122-4218-4ed7-ad1c-3b1fe7fdebb4 Jul 13 13:58:43 devstack sudo[98791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:58:43 devstack sudo[98798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-fb76c14a-a177-4ea4-aa62-734b9f8c5417,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-fb76c14a-a177-4ea4-aa62-734b9f8c5417.a7b29d1f-57ed-46e3-8c6d-6a1fa47d49b2 1G Jul 13 13:58:43 devstack sudo[98798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:58:43 devstack sudo[98791]: pam_unix(sudo:session): session closed for user root Jul 13 13:58:43 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-6552653a-7d43-478c-8bbe-ca29ea70a086 tempest-CreateVolumesFromImageTest-1604318855 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-18cb4122-4218-4ed7-ad1c-3b1fe7fdebb4" returned: 0 in 0.439s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:58:43 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-6552653a-7d43-478c-8bbe-ca29ea70a086 tempest-CreateVolumesFromImageTest-1604318855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-18cb4122-4218-4ed7-ad1c-3b1fe7fdebb4 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:58:43 devstack sudo[98806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-18cb4122-4218-4ed7-ad1c-3b1fe7fdebb4 Jul 13 13:58:43 devstack sudo[98806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:58:43 devstack sudo[98798]: pam_unix(sudo:session): session closed for user root Jul 13 13:58:43 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-83fb09ae-ec8f-4ecb-9e24-6ce246e6724f tempest-GroupsV314Test-1132626347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-fb76c14a-a177-4ea4-aa62-734b9f8c5417,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-fb76c14a-a177-4ea4-aa62-734b9f8c5417.a7b29d1f-57ed-46e3-8c6d-6a1fa47d49b2 1G" returned: 0 in 0.539s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:58:43 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-83fb09ae-ec8f-4ecb-9e24-6ce246e6724f tempest-GroupsV314Test-1132626347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fb76c14a-a177-4ea4-aa62-734b9f8c5417 -F qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-fb76c14a-a177-4ea4-aa62-734b9f8c5417.a7b29d1f-57ed-46e3-8c6d-6a1fa47d49b2 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:58:43 devstack sudo[98809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fb76c14a-a177-4ea4-aa62-734b9f8c5417 -F qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-fb76c14a-a177-4ea4-aa62-734b9f8c5417.a7b29d1f-57ed-46e3-8c6d-6a1fa47d49b2 Jul 13 13:58:43 devstack sudo[98809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:58:43 devstack sudo[98806]: pam_unix(sudo:session): session closed for user root Jul 13 13:58:43 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-6552653a-7d43-478c-8bbe-ca29ea70a086 tempest-CreateVolumesFromImageTest-1604318855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-18cb4122-4218-4ed7-ad1c-3b1fe7fdebb4" returned: 0 in 0.365s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:58:43 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-6552653a-7d43-478c-8bbe-ca29ea70a086 tempest-CreateVolumesFromImageTest-1604318855 None] Lock "cinder-quobyte-18cb4122-4218-4ed7-ad1c-3b1fe7fdebb4" released by "delete_volume" :: held 0.871s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 13:58:43 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-1b3cde33-6783-42df-a84f-815fbae4b5ed tempest-VolumesSnapshotTestJSON-2010930921 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:58:43 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-6552653a-7d43-478c-8bbe-ca29ea70a086 tempest-CreateVolumesFromImageTest-1604318855 None] Created reservations ['05fbf989-d0c1-4dc8-990f-af3e7398f5e9', 'c89106db-b39d-45e3-b7b2-de1873c6b036', '7b9636f3-4033-4e62-9556-55ae28013d8d', '870a1c00-64d8-45ce-be7d-14a376b20052'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 13:58:43 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-6552653a-7d43-478c-8bbe-ca29ea70a086 tempest-CreateVolumesFromImageTest-1604318855 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:58:43 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-6552653a-7d43-478c-8bbe-ca29ea70a086 tempest-CreateVolumesFromImageTest-1604318855 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:58:43 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-6552653a-7d43-478c-8bbe-ca29ea70a086 tempest-CreateVolumesFromImageTest-1604318855 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 13:58:43 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-6552653a-7d43-478c-8bbe-ca29ea70a086 tempest-CreateVolumesFromImageTest-1604318855 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 13:58:43 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-6552653a-7d43-478c-8bbe-ca29ea70a086 tempest-CreateVolumesFromImageTest-1604318855 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:58:43 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-6552653a-7d43-478c-8bbe-ca29ea70a086 tempest-CreateVolumesFromImageTest-1604318855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:58:44 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-4411a351-1387-41d2-848f-2d0cf10da3bd tempest-CreateVolumesFromImageTest-1604318855 None] Acquiring lock "cinder-8f668556-7967-4cac-835d-7ab05097370b-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 13:58:44 devstack sudo[98815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 Jul 13 13:58:44 devstack sudo[98815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:58:44 devstack sudo[98809]: pam_unix(sudo:session): session closed for user root Jul 13 13:58:44 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-4411a351-1387-41d2-848f-2d0cf10da3bd tempest-CreateVolumesFromImageTest-1604318855 None] Lock "cinder-8f668556-7967-4cac-835d-7ab05097370b-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 13:58:44 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-83fb09ae-ec8f-4ecb-9e24-6ce246e6724f tempest-GroupsV314Test-1132626347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fb76c14a-a177-4ea4-aa62-734b9f8c5417 -F qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-fb76c14a-a177-4ea4-aa62-734b9f8c5417.a7b29d1f-57ed-46e3-8c6d-6a1fa47d49b2" returned: 0 in 0.459s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:58:44 devstack cinder-volume[87098]: WARNING cinder.volume.drivers.remotefs [None req-83fb09ae-ec8f-4ecb-9e24-6ce246e6724f tempest-GroupsV314Test-1132626347 None] /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-fb76c14a-a177-4ea4-aa62-734b9f8c5417.a7b29d1f-57ed-46e3-8c6d-6a1fa47d49b2 is being set with open permissions: ugo+rw: NotImplementedError Jul 13 13:58:44 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-83fb09ae-ec8f-4ecb-9e24-6ce246e6724f tempest-GroupsV314Test-1132626347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-fb76c14a-a177-4ea4-aa62-734b9f8c5417.a7b29d1f-57ed-46e3-8c6d-6a1fa47d49b2 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:58:44 devstack sudo[98817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-fb76c14a-a177-4ea4-aa62-734b9f8c5417.a7b29d1f-57ed-46e3-8c6d-6a1fa47d49b2 Jul 13 13:58:44 devstack sudo[98817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:58:44 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-4411a351-1387-41d2-848f-2d0cf10da3bd tempest-CreateVolumesFromImageTest-1604318855 None] Acquiring lock "cinder-quobyte-8f668556-7967-4cac-835d-7ab05097370b" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 13:58:44 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-4411a351-1387-41d2-848f-2d0cf10da3bd tempest-CreateVolumesFromImageTest-1604318855 None] Lock "cinder-quobyte-8f668556-7967-4cac-835d-7ab05097370b" acquired by "delete_volume" :: waited 0.030s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 13:58:44 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[87e24db6-3093-4484-b61d-e9c152073c59]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 13:58:44 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-4411a351-1387-41d2-848f-2d0cf10da3bd tempest-CreateVolumesFromImageTest-1604318855 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-8f668556-7967-4cac-835d-7ab05097370b {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:58:44 devstack sudo[98815]: pam_unix(sudo:session): session closed for user root Jul 13 13:58:44 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-6552653a-7d43-478c-8bbe-ca29ea70a086 tempest-CreateVolumesFromImageTest-1604318855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78" returned: 0 in 0.334s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:58:44 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-6552653a-7d43-478c-8bbe-ca29ea70a086 tempest-CreateVolumesFromImageTest-1604318855 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 13:58:44 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-6552653a-7d43-478c-8bbe-ca29ea70a086 tempest-CreateVolumesFromImageTest-1604318855 None] Deleted volume successfully. Jul 13 13:58:44 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-6552653a-7d43-478c-8bbe-ca29ea70a086 tempest-CreateVolumesFromImageTest-1604318855 None] Lock "cinder-18cb4122-4218-4ed7-ad1c-3b1fe7fdebb4-delete_volume" released by "delete_volume" :: held 1.632s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 13:58:44 devstack sudo[98820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-8f668556-7967-4cac-835d-7ab05097370b Jul 13 13:58:44 devstack sudo[98820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:58:44 devstack sudo[98817]: pam_unix(sudo:session): session closed for user root Jul 13 13:58:44 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-83fb09ae-ec8f-4ecb-9e24-6ce246e6724f tempest-GroupsV314Test-1132626347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-fb76c14a-a177-4ea4-aa62-734b9f8c5417.a7b29d1f-57ed-46e3-8c6d-6a1fa47d49b2" returned: 0 in 0.430s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:58:44 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-83fb09ae-ec8f-4ecb-9e24-6ce246e6724f tempest-GroupsV314Test-1132626347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-fb76c14a-a177-4ea4-aa62-734b9f8c5417.info {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:58:44 devstack sudo[98823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-fb76c14a-a177-4ea4-aa62-734b9f8c5417.info Jul 13 13:58:44 devstack sudo[98823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:58:44 devstack sudo[98820]: pam_unix(sudo:session): session closed for user root Jul 13 13:58:44 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-4411a351-1387-41d2-848f-2d0cf10da3bd tempest-CreateVolumesFromImageTest-1604318855 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-8f668556-7967-4cac-835d-7ab05097370b" returned: 0 in 0.508s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:58:44 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-4411a351-1387-41d2-848f-2d0cf10da3bd tempest-CreateVolumesFromImageTest-1604318855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-8f668556-7967-4cac-835d-7ab05097370b {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:58:44 devstack sudo[98828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-8f668556-7967-4cac-835d-7ab05097370b Jul 13 13:58:44 devstack sudo[98828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:58:44 devstack sudo[98823]: pam_unix(sudo:session): session closed for user root Jul 13 13:58:44 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-83fb09ae-ec8f-4ecb-9e24-6ce246e6724f tempest-GroupsV314Test-1132626347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-fb76c14a-a177-4ea4-aa62-734b9f8c5417.info" returned: 0 in 0.313s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:58:44 devstack cinder-volume[87098]: WARNING cinder.volume.drivers.remotefs [None req-83fb09ae-ec8f-4ecb-9e24-6ce246e6724f tempest-GroupsV314Test-1132626347 None] /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-fb76c14a-a177-4ea4-aa62-734b9f8c5417.info is being set with open permissions: ugo+rw: NotImplementedError Jul 13 13:58:44 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-83fb09ae-ec8f-4ecb-9e24-6ce246e6724f tempest-GroupsV314Test-1132626347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-fb76c14a-a177-4ea4-aa62-734b9f8c5417.info {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:58:44 devstack sudo[98831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-fb76c14a-a177-4ea4-aa62-734b9f8c5417.info Jul 13 13:58:44 devstack sudo[98831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:58:45 devstack sudo[98828]: pam_unix(sudo:session): session closed for user root Jul 13 13:58:45 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-4411a351-1387-41d2-848f-2d0cf10da3bd tempest-CreateVolumesFromImageTest-1604318855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-8f668556-7967-4cac-835d-7ab05097370b" returned: 0 in 0.292s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:58:45 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-4411a351-1387-41d2-848f-2d0cf10da3bd tempest-CreateVolumesFromImageTest-1604318855 None] Lock "cinder-quobyte-8f668556-7967-4cac-835d-7ab05097370b" released by "delete_volume" :: held 0.868s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 13:58:45 devstack sudo[98831]: pam_unix(sudo:session): session closed for user root Jul 13 13:58:45 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-4411a351-1387-41d2-848f-2d0cf10da3bd tempest-CreateVolumesFromImageTest-1604318855 None] Created reservations ['89099d0a-396a-4b62-a31a-ee3415721d20', 'fce5f99e-930b-4a36-8d11-41f007731dfd', '102a55a7-743f-4543-a61e-649147496956', '95d94134-a3dc-44c8-8780-87c844008dd2'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 13:58:45 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-83fb09ae-ec8f-4ecb-9e24-6ce246e6724f tempest-GroupsV314Test-1132626347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-fb76c14a-a177-4ea4-aa62-734b9f8c5417.info" returned: 0 in 0.270s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:58:45 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-83fb09ae-ec8f-4ecb-9e24-6ce246e6724f tempest-GroupsV314Test-1132626347 None] Acquiring lock "cinder-quobyte-251589d3-8100-434d-9777-422a47d4bde0" by "_copy_volume_from_snapshot" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 13:58:45 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-83fb09ae-ec8f-4ecb-9e24-6ce246e6724f tempest-GroupsV314Test-1132626347 None] Lock "cinder-quobyte-251589d3-8100-434d-9777-422a47d4bde0" acquired by "_copy_volume_from_snapshot" :: waited 0.031s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 13:58:45 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-83fb09ae-ec8f-4ecb-9e24-6ce246e6724f tempest-GroupsV314Test-1132626347 None] snapshot: a7b29d1f-57ed-46e3-8c6d-6a1fa47d49b2, volume: 251589d3-8100-434d-9777-422a47d4bde0, {{(pid=87098) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 13 13:58:45 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-83fb09ae-ec8f-4ecb-9e24-6ce246e6724f tempest-GroupsV314Test-1132626347 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:58:45 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-83fb09ae-ec8f-4ecb-9e24-6ce246e6724f tempest-GroupsV314Test-1132626347 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:58:45 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-83fb09ae-ec8f-4ecb-9e24-6ce246e6724f tempest-GroupsV314Test-1132626347 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 13:58:45 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-83fb09ae-ec8f-4ecb-9e24-6ce246e6724f tempest-GroupsV314Test-1132626347 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 13:58:45 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-83fb09ae-ec8f-4ecb-9e24-6ce246e6724f tempest-GroupsV314Test-1132626347 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:58:45 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6e3c7db-eb11-4ff5-914d-b4c71cac58c6]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 13:58:45 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-83fb09ae-ec8f-4ecb-9e24-6ce246e6724f tempest-GroupsV314Test-1132626347 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-fb76c14a-a177-4ea4-aa62-734b9f8c5417.a7b29d1f-57ed-46e3-8c6d-6a1fa47d49b2 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:58:45 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-4411a351-1387-41d2-848f-2d0cf10da3bd tempest-CreateVolumesFromImageTest-1604318855 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:58:45 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-4411a351-1387-41d2-848f-2d0cf10da3bd tempest-CreateVolumesFromImageTest-1604318855 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:58:45 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-4411a351-1387-41d2-848f-2d0cf10da3bd tempest-CreateVolumesFromImageTest-1604318855 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 13:58:45 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-4411a351-1387-41d2-848f-2d0cf10da3bd tempest-CreateVolumesFromImageTest-1604318855 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 13:58:45 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-4411a351-1387-41d2-848f-2d0cf10da3bd tempest-CreateVolumesFromImageTest-1604318855 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:58:45 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-4411a351-1387-41d2-848f-2d0cf10da3bd tempest-CreateVolumesFromImageTest-1604318855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:58:45 devstack sudo[98836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 Jul 13 13:58:45 devstack sudo[98836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:58:45 devstack sudo[98835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-fb76c14a-a177-4ea4-aa62-734b9f8c5417.a7b29d1f-57ed-46e3-8c6d-6a1fa47d49b2 Jul 13 13:58:45 devstack sudo[98835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:58:45 devstack sudo[98836]: pam_unix(sudo:session): session closed for user root Jul 13 13:58:45 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-4411a351-1387-41d2-848f-2d0cf10da3bd tempest-CreateVolumesFromImageTest-1604318855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78" returned: 0 in 0.300s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:58:45 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-4411a351-1387-41d2-848f-2d0cf10da3bd tempest-CreateVolumesFromImageTest-1604318855 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 13:58:45 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-4411a351-1387-41d2-848f-2d0cf10da3bd tempest-CreateVolumesFromImageTest-1604318855 None] Deleted volume successfully. Jul 13 13:58:45 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-4411a351-1387-41d2-848f-2d0cf10da3bd tempest-CreateVolumesFromImageTest-1604318855 None] Lock "cinder-8f668556-7967-4cac-835d-7ab05097370b-delete_volume" released by "delete_volume" :: held 1.566s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 13:58:45 devstack sudo[98835]: pam_unix(sudo:session): session closed for user root Jul 13 13:58:45 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-83fb09ae-ec8f-4ecb-9e24-6ce246e6724f tempest-GroupsV314Test-1132626347 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-fb76c14a-a177-4ea4-aa62-734b9f8c5417.a7b29d1f-57ed-46e3-8c6d-6a1fa47d49b2" returned: 0 in 0.450s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:58:45 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-83fb09ae-ec8f-4ecb-9e24-6ce246e6724f tempest-GroupsV314Test-1132626347 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fb76c14a-a177-4ea4-aa62-734b9f8c5417(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87098) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 13 13:58:45 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-83fb09ae-ec8f-4ecb-9e24-6ce246e6724f tempest-GroupsV314Test-1132626347 None] will copy from snapshot at /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-fb76c14a-a177-4ea4-aa62-734b9f8c5417 {{(pid=87098) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 13 13:58:45 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-83fb09ae-ec8f-4ecb-9e24-6ce246e6724f tempest-GroupsV314Test-1132626347 None] Creating direct copy from snapshot {{(pid=87098) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 13 13:58:45 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffb730c9-88fa-4383-a307-33ca8d195fcc]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 13:58:45 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-83fb09ae-ec8f-4ecb-9e24-6ce246e6724f tempest-GroupsV314Test-1132626347 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-fb76c14a-a177-4ea4-aa62-734b9f8c5417 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:58:45 devstack sudo[98844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-fb76c14a-a177-4ea4-aa62-734b9f8c5417 Jul 13 13:58:45 devstack sudo[98844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:58:46 devstack sudo[98844]: pam_unix(sudo:session): session closed for user root Jul 13 13:58:46 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-83fb09ae-ec8f-4ecb-9e24-6ce246e6724f tempest-GroupsV314Test-1132626347 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-fb76c14a-a177-4ea4-aa62-734b9f8c5417" returned: 0 in 0.386s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:58:46 devstack cinder-volume[87098]: DEBUG cinder.utils [None req-83fb09ae-ec8f-4ecb-9e24-6ce246e6724f tempest-GroupsV314Test-1132626347 None] Path /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-251589d3-8100-434d-9777-422a47d4bde0 not found in is_blk_device check {{(pid=87098) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 13 13:58:46 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-83fb09ae-ec8f-4ecb-9e24-6ce246e6724f tempest-GroupsV314Test-1132626347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-fb76c14a-a177-4ea4-aa62-734b9f8c5417 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-251589d3-8100-434d-9777-422a47d4bde0 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:58:46 devstack sudo[98849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-fb76c14a-a177-4ea4-aa62-734b9f8c5417 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-251589d3-8100-434d-9777-422a47d4bde0 Jul 13 13:58:46 devstack sudo[98849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:58:46 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-d5f6f2e2-07e6-481e-9cf6-457de96b8d70 tempest-CreateVolumesFromImageTest-1604318855 None] Acquiring lock "cinder-9e2681f3-5990-4083-be61-0f798f9c873e-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 13:58:46 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-d5f6f2e2-07e6-481e-9cf6-457de96b8d70 tempest-CreateVolumesFromImageTest-1604318855 None] Lock "cinder-9e2681f3-5990-4083-be61-0f798f9c873e-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 13:58:46 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-d5f6f2e2-07e6-481e-9cf6-457de96b8d70 tempest-CreateVolumesFromImageTest-1604318855 None] Acquiring lock "cinder-quobyte-9e2681f3-5990-4083-be61-0f798f9c873e" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 13:58:46 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-d5f6f2e2-07e6-481e-9cf6-457de96b8d70 tempest-CreateVolumesFromImageTest-1604318855 None] Lock "cinder-quobyte-9e2681f3-5990-4083-be61-0f798f9c873e" acquired by "delete_volume" :: waited 0.024s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 13:58:46 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb7bdedf-c491-410f-bbcf-5e46b6fdeeaf]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 13:58:46 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-d5f6f2e2-07e6-481e-9cf6-457de96b8d70 tempest-CreateVolumesFromImageTest-1604318855 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-9e2681f3-5990-4083-be61-0f798f9c873e {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:58:46 devstack sudo[98854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-9e2681f3-5990-4083-be61-0f798f9c873e Jul 13 13:58:46 devstack sudo[98854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:58:47 devstack sudo[98854]: pam_unix(sudo:session): session closed for user root Jul 13 13:58:47 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-d5f6f2e2-07e6-481e-9cf6-457de96b8d70 tempest-CreateVolumesFromImageTest-1604318855 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-9e2681f3-5990-4083-be61-0f798f9c873e" returned: 0 in 0.738s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:58:47 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-d5f6f2e2-07e6-481e-9cf6-457de96b8d70 tempest-CreateVolumesFromImageTest-1604318855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-9e2681f3-5990-4083-be61-0f798f9c873e {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:58:47 devstack sudo[98867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-9e2681f3-5990-4083-be61-0f798f9c873e Jul 13 13:58:47 devstack sudo[98867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:58:48 devstack sudo[98867]: pam_unix(sudo:session): session closed for user root Jul 13 13:58:48 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-d5f6f2e2-07e6-481e-9cf6-457de96b8d70 tempest-CreateVolumesFromImageTest-1604318855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-9e2681f3-5990-4083-be61-0f798f9c873e" returned: 0 in 0.815s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:58:48 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-d5f6f2e2-07e6-481e-9cf6-457de96b8d70 tempest-CreateVolumesFromImageTest-1604318855 None] Lock "cinder-quobyte-9e2681f3-5990-4083-be61-0f798f9c873e" released by "delete_volume" :: held 1.634s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 13:58:48 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-d5f6f2e2-07e6-481e-9cf6-457de96b8d70 tempest-CreateVolumesFromImageTest-1604318855 None] Created reservations ['12071c2c-309c-4d61-96f5-99b5f2096d41', 'aad29fb8-08ff-43a3-8526-de242f7bfffe', '8a260a95-21e8-4eec-8dbe-189f2d78514e', '5fecd387-bef8-41c7-a7dc-bbc09b1a20b4'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 13:58:48 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-d5f6f2e2-07e6-481e-9cf6-457de96b8d70 tempest-CreateVolumesFromImageTest-1604318855 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:58:48 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-d5f6f2e2-07e6-481e-9cf6-457de96b8d70 tempest-CreateVolumesFromImageTest-1604318855 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:58:48 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-d5f6f2e2-07e6-481e-9cf6-457de96b8d70 tempest-CreateVolumesFromImageTest-1604318855 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 13:58:48 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-d5f6f2e2-07e6-481e-9cf6-457de96b8d70 tempest-CreateVolumesFromImageTest-1604318855 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 13:58:48 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-d5f6f2e2-07e6-481e-9cf6-457de96b8d70 tempest-CreateVolumesFromImageTest-1604318855 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:58:48 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-d5f6f2e2-07e6-481e-9cf6-457de96b8d70 tempest-CreateVolumesFromImageTest-1604318855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:58:48 devstack sudo[98871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 Jul 13 13:58:48 devstack sudo[98871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:58:48 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-8b8b076b-8f34-4c10-87a7-d81d152d30ca tempest-CreateVolumesFromImageTest-1604318855 None] Acquiring lock "cinder-f9968be0-682c-4bdc-a9d4-b30db4a35088-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 13:58:48 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-8b8b076b-8f34-4c10-87a7-d81d152d30ca tempest-CreateVolumesFromImageTest-1604318855 None] Lock "cinder-f9968be0-682c-4bdc-a9d4-b30db4a35088-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 13:58:49 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-8b8b076b-8f34-4c10-87a7-d81d152d30ca tempest-CreateVolumesFromImageTest-1604318855 None] Acquiring lock "cinder-quobyte-f9968be0-682c-4bdc-a9d4-b30db4a35088" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 13:58:49 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-8b8b076b-8f34-4c10-87a7-d81d152d30ca tempest-CreateVolumesFromImageTest-1604318855 None] Lock "cinder-quobyte-f9968be0-682c-4bdc-a9d4-b30db4a35088" acquired by "delete_volume" :: waited 0.027s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 13:58:49 devstack sudo[98871]: pam_unix(sudo:session): session closed for user root Jul 13 13:58:49 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-d5f6f2e2-07e6-481e-9cf6-457de96b8d70 tempest-CreateVolumesFromImageTest-1604318855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78" returned: 0 in 0.789s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:58:49 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-d5f6f2e2-07e6-481e-9cf6-457de96b8d70 tempest-CreateVolumesFromImageTest-1604318855 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 13:58:49 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-d5f6f2e2-07e6-481e-9cf6-457de96b8d70 tempest-CreateVolumesFromImageTest-1604318855 None] Deleted volume successfully. Jul 13 13:58:49 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e925bda-3221-4df7-89f8-bd150f171c25]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 13:58:49 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-8b8b076b-8f34-4c10-87a7-d81d152d30ca tempest-CreateVolumesFromImageTest-1604318855 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-f9968be0-682c-4bdc-a9d4-b30db4a35088 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:58:49 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-d5f6f2e2-07e6-481e-9cf6-457de96b8d70 tempest-CreateVolumesFromImageTest-1604318855 None] Lock "cinder-9e2681f3-5990-4083-be61-0f798f9c873e-delete_volume" released by "delete_volume" :: held 2.929s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 13:58:49 devstack sudo[98874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-f9968be0-682c-4bdc-a9d4-b30db4a35088 Jul 13 13:58:49 devstack sudo[98874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:58:50 devstack sudo[98874]: pam_unix(sudo:session): session closed for user root Jul 13 13:58:50 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-8b8b076b-8f34-4c10-87a7-d81d152d30ca tempest-CreateVolumesFromImageTest-1604318855 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-f9968be0-682c-4bdc-a9d4-b30db4a35088" returned: 0 in 0.903s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:58:50 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-8b8b076b-8f34-4c10-87a7-d81d152d30ca tempest-CreateVolumesFromImageTest-1604318855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-f9968be0-682c-4bdc-a9d4-b30db4a35088 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:58:50 devstack sudo[98879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-f9968be0-682c-4bdc-a9d4-b30db4a35088 Jul 13 13:58:50 devstack sudo[98879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:58:50 devstack sudo[98879]: pam_unix(sudo:session): session closed for user root Jul 13 13:58:50 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-8b8b076b-8f34-4c10-87a7-d81d152d30ca tempest-CreateVolumesFromImageTest-1604318855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-f9968be0-682c-4bdc-a9d4-b30db4a35088" returned: 0 in 0.472s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:58:50 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-8b8b076b-8f34-4c10-87a7-d81d152d30ca tempest-CreateVolumesFromImageTest-1604318855 None] Lock "cinder-quobyte-f9968be0-682c-4bdc-a9d4-b30db4a35088" released by "delete_volume" :: held 1.515s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 13:58:50 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-8b8b076b-8f34-4c10-87a7-d81d152d30ca tempest-CreateVolumesFromImageTest-1604318855 None] Created reservations ['cf942787-f142-4b63-a8e4-8760c422692b', 'ec2c54eb-aca5-431d-89a3-79db729c7b06', '1fc5f035-898e-4a2e-9bc1-763741e01269', 'e3cf42ea-f174-4ef1-ab91-3e5dd4d9d62a'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 13:58:50 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-8b8b076b-8f34-4c10-87a7-d81d152d30ca tempest-CreateVolumesFromImageTest-1604318855 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:58:50 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-8b8b076b-8f34-4c10-87a7-d81d152d30ca tempest-CreateVolumesFromImageTest-1604318855 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:58:50 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-8b8b076b-8f34-4c10-87a7-d81d152d30ca tempest-CreateVolumesFromImageTest-1604318855 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 13:58:50 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-8b8b076b-8f34-4c10-87a7-d81d152d30ca tempest-CreateVolumesFromImageTest-1604318855 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 13:58:50 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-8b8b076b-8f34-4c10-87a7-d81d152d30ca tempest-CreateVolumesFromImageTest-1604318855 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:58:50 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-8b8b076b-8f34-4c10-87a7-d81d152d30ca tempest-CreateVolumesFromImageTest-1604318855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:58:50 devstack sudo[98882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 Jul 13 13:58:50 devstack sudo[98882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:58:51 devstack sudo[98882]: pam_unix(sudo:session): session closed for user root Jul 13 13:58:51 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-8b8b076b-8f34-4c10-87a7-d81d152d30ca tempest-CreateVolumesFromImageTest-1604318855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78" returned: 0 in 0.600s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:58:51 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-8b8b076b-8f34-4c10-87a7-d81d152d30ca tempest-CreateVolumesFromImageTest-1604318855 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 13:58:51 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-8b8b076b-8f34-4c10-87a7-d81d152d30ca tempest-CreateVolumesFromImageTest-1604318855 None] Deleted volume successfully. Jul 13 13:58:51 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-8b8b076b-8f34-4c10-87a7-d81d152d30ca tempest-CreateVolumesFromImageTest-1604318855 None] Lock "cinder-f9968be0-682c-4bdc-a9d4-b30db4a35088-delete_volume" released by "delete_volume" :: held 2.607s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 13:58:51 devstack sudo[98849]: pam_unix(sudo:session): session closed for user root Jul 13 13:58:51 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-83fb09ae-ec8f-4ecb-9e24-6ce246e6724f tempest-GroupsV314Test-1132626347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-fb76c14a-a177-4ea4-aa62-734b9f8c5417 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-251589d3-8100-434d-9777-422a47d4bde0" returned: 0 in 5.754s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:58:51 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a890980-a512-4adc-ae66-a0483247fdb0]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 13:58:51 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-83fb09ae-ec8f-4ecb-9e24-6ce246e6724f tempest-GroupsV314Test-1132626347 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-fb76c14a-a177-4ea4-aa62-734b9f8c5417 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:58:52 devstack sudo[98885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-fb76c14a-a177-4ea4-aa62-734b9f8c5417 Jul 13 13:58:52 devstack sudo[98885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:58:52 devstack sudo[98885]: pam_unix(sudo:session): session closed for user root Jul 13 13:58:52 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-83fb09ae-ec8f-4ecb-9e24-6ce246e6724f tempest-GroupsV314Test-1132626347 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-fb76c14a-a177-4ea4-aa62-734b9f8c5417" returned: 0 in 0.622s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:58:52 devstack cinder-volume[87098]: DEBUG cinder.image.image_utils [None req-83fb09ae-ec8f-4ecb-9e24-6ce246e6724f tempest-GroupsV314Test-1132626347 None] Image conversion details: src /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-fb76c14a-a177-4ea4-aa62-734b9f8c5417, size 1024.00 MB, duration 5.75 sec, destination /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-251589d3-8100-434d-9777-422a47d4bde0 {{(pid=87098) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 13 13:58:52 devstack cinder-volume[87098]: INFO cinder.image.image_utils [None req-83fb09ae-ec8f-4ecb-9e24-6ce246e6724f tempest-GroupsV314Test-1132626347 None] Converted 1024.00 MB image at 177.94 MB/s Jul 13 13:58:52 devstack cinder-volume[87098]: WARNING cinder.volume.drivers.remotefs [None req-83fb09ae-ec8f-4ecb-9e24-6ce246e6724f tempest-GroupsV314Test-1132626347 None] /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-251589d3-8100-434d-9777-422a47d4bde0 is being set with open permissions: ugo+rw: NotImplementedError Jul 13 13:58:52 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-83fb09ae-ec8f-4ecb-9e24-6ce246e6724f tempest-GroupsV314Test-1132626347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-251589d3-8100-434d-9777-422a47d4bde0 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:58:52 devstack sudo[98890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-251589d3-8100-434d-9777-422a47d4bde0 Jul 13 13:58:52 devstack sudo[98890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:58:52 devstack sudo[98890]: pam_unix(sudo:session): session closed for user root Jul 13 13:58:52 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-83fb09ae-ec8f-4ecb-9e24-6ce246e6724f tempest-GroupsV314Test-1132626347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-251589d3-8100-434d-9777-422a47d4bde0" returned: 0 in 0.268s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:58:52 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-83fb09ae-ec8f-4ecb-9e24-6ce246e6724f tempest-GroupsV314Test-1132626347 None] Lock "cinder-quobyte-251589d3-8100-434d-9777-422a47d4bde0" released by "_copy_volume_from_snapshot" :: held 7.593s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 13:58:52 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-83fb09ae-ec8f-4ecb-9e24-6ce246e6724f tempest-GroupsV314Test-1132626347 None] Acquiring lock "cinder-quobyte-a7b29d1f-57ed-46e3-8c6d-6a1fa47d49b2" by "_delete_snapshot" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 13:58:52 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-83fb09ae-ec8f-4ecb-9e24-6ce246e6724f tempest-GroupsV314Test-1132626347 None] Lock "cinder-quobyte-a7b29d1f-57ed-46e3-8c6d-6a1fa47d49b2" acquired by "_delete_snapshot" :: waited 0.067s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 13:58:52 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-83fb09ae-ec8f-4ecb-9e24-6ce246e6724f tempest-GroupsV314Test-1132626347 None] Deleting offline snapshot a7b29d1f-57ed-46e3-8c6d-6a1fa47d49b2 of volume fb76c14a-a177-4ea4-aa62-734b9f8c5417 {{(pid=87098) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 13 13:58:52 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-83fb09ae-ec8f-4ecb-9e24-6ce246e6724f tempest-GroupsV314Test-1132626347 None] snapshot_file for this snap is: volume-fb76c14a-a177-4ea4-aa62-734b9f8c5417.a7b29d1f-57ed-46e3-8c6d-6a1fa47d49b2 {{(pid=87098) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 13 13:58:52 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[6598e862-c04a-49eb-88fc-aef1b8f06c56]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 13:58:52 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-83fb09ae-ec8f-4ecb-9e24-6ce246e6724f tempest-GroupsV314Test-1132626347 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-fb76c14a-a177-4ea4-aa62-734b9f8c5417.a7b29d1f-57ed-46e3-8c6d-6a1fa47d49b2 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:58:53 devstack sudo[98893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-fb76c14a-a177-4ea4-aa62-734b9f8c5417.a7b29d1f-57ed-46e3-8c6d-6a1fa47d49b2 Jul 13 13:58:53 devstack sudo[98893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:58:53 devstack sudo[98893]: pam_unix(sudo:session): session closed for user root Jul 13 13:58:53 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-83fb09ae-ec8f-4ecb-9e24-6ce246e6724f tempest-GroupsV314Test-1132626347 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-fb76c14a-a177-4ea4-aa62-734b9f8c5417.a7b29d1f-57ed-46e3-8c6d-6a1fa47d49b2" returned: 0 in 0.420s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:58:53 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-83fb09ae-ec8f-4ecb-9e24-6ce246e6724f tempest-GroupsV314Test-1132626347 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fb76c14a-a177-4ea4-aa62-734b9f8c5417(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87098) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 13 13:58:53 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0da6deb-5a61-414a-b673-1ea162ba9392]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 13:58:53 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-83fb09ae-ec8f-4ecb-9e24-6ce246e6724f tempest-GroupsV314Test-1132626347 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-fb76c14a-a177-4ea4-aa62-734b9f8c5417 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:58:53 devstack sudo[98898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-fb76c14a-a177-4ea4-aa62-734b9f8c5417 Jul 13 13:58:53 devstack sudo[98898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:58:53 devstack sudo[98898]: pam_unix(sudo:session): session closed for user root Jul 13 13:58:53 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-83fb09ae-ec8f-4ecb-9e24-6ce246e6724f tempest-GroupsV314Test-1132626347 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-fb76c14a-a177-4ea4-aa62-734b9f8c5417" returned: 0 in 0.454s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:58:53 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-83fb09ae-ec8f-4ecb-9e24-6ce246e6724f tempest-GroupsV314Test-1132626347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-fb76c14a-a177-4ea4-aa62-734b9f8c5417.a7b29d1f-57ed-46e3-8c6d-6a1fa47d49b2 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:58:53 devstack sudo[98903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-fb76c14a-a177-4ea4-aa62-734b9f8c5417.a7b29d1f-57ed-46e3-8c6d-6a1fa47d49b2 Jul 13 13:58:53 devstack sudo[98903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:58:54 devstack sudo[98903]: pam_unix(sudo:session): session closed for user root Jul 13 13:58:54 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-83fb09ae-ec8f-4ecb-9e24-6ce246e6724f tempest-GroupsV314Test-1132626347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-fb76c14a-a177-4ea4-aa62-734b9f8c5417.a7b29d1f-57ed-46e3-8c6d-6a1fa47d49b2" returned: 0 in 0.406s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:58:54 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-83fb09ae-ec8f-4ecb-9e24-6ce246e6724f tempest-GroupsV314Test-1132626347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-fb76c14a-a177-4ea4-aa62-734b9f8c5417.a7b29d1f-57ed-46e3-8c6d-6a1fa47d49b2 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:58:54 devstack sudo[98910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-fb76c14a-a177-4ea4-aa62-734b9f8c5417.a7b29d1f-57ed-46e3-8c6d-6a1fa47d49b2 Jul 13 13:58:54 devstack sudo[98910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:58:54 devstack sudo[98910]: pam_unix(sudo:session): session closed for user root Jul 13 13:58:54 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-83fb09ae-ec8f-4ecb-9e24-6ce246e6724f tempest-GroupsV314Test-1132626347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-fb76c14a-a177-4ea4-aa62-734b9f8c5417.a7b29d1f-57ed-46e3-8c6d-6a1fa47d49b2" returned: 0 in 0.281s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:58:54 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-83fb09ae-ec8f-4ecb-9e24-6ce246e6724f tempest-GroupsV314Test-1132626347 None] Lock "cinder-quobyte-a7b29d1f-57ed-46e3-8c6d-6a1fa47d49b2" released by "_delete_snapshot" :: held 1.696s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 13:58:54 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-83fb09ae-ec8f-4ecb-9e24-6ce246e6724f tempest-GroupsV314Test-1132626347 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 12.108s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:58:54 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-1b3cde33-6783-42df-a84f-815fbae4b5ed tempest-VolumesSnapshotTestJSON-2010930921 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 10.813s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:58:54 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-1b3cde33-6783-42df-a84f-815fbae4b5ed tempest-VolumesSnapshotTestJSON-2010930921 None] Creating offline snapshot e0a558b0-631e-45c8-8c8f-848bd551b3dd of volume ceab0c9b-2879-496d-8815-600b6fb9e092 {{(pid=87098) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 13 13:58:54 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[7142af92-1e70-48d6-8df3-b2acf87263c2]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 13:58:54 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-1b3cde33-6783-42df-a84f-815fbae4b5ed tempest-VolumesSnapshotTestJSON-2010930921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-ceab0c9b-2879-496d-8815-600b6fb9e092 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:58:54 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-83fb09ae-ec8f-4ecb-9e24-6ce246e6724f tempest-GroupsV314Test-1132626347 None] Create group from source-group-5d1cf52f-3b3b-4730-bd3d-5bdf0871456c completed successfully. Jul 13 13:58:54 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-4d5672ac-82e2-490e-950f-8f7bcfa73bad tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 13:58:54 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-4d5672ac-82e2-490e-950f-8f7bcfa73bad tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] Flow 'volume_create_manager' (cbc8714e-8be0-49e6-819e-1b076ade7b65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 13:58:54 devstack sudo[98913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-ceab0c9b-2879-496d-8815-600b6fb9e092 Jul 13 13:58:54 devstack sudo[98913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:58:54 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-4d5672ac-82e2-490e-950f-8f7bcfa73bad tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6def558e-f0d3-43c8-a121-f5a4c223ea97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:58:54 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-4d5672ac-82e2-490e-950f-8f7bcfa73bad tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6def558e-f0d3-43c8-a121-f5a4c223ea97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T11:58:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2041754554',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7a748cb-279f-4e7e-b2c5-523afabb731b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00394ef75ede414796272efe347ea65b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T11:58:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T11:58:55Z,use_quota=True,user_id='465d81cd99ff43da9d129fab824b1778',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1147de8b-623b-426c-a13d-7fc824a80f67),volume_type_id=1147de8b-623b-426c-a13d-7fc824a80f67)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:58:54 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-4d5672ac-82e2-490e-950f-8f7bcfa73bad tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28892730-b9eb-4781-bdee-00d764167fe6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:58:54 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-4d5672ac-82e2-490e-950f-8f7bcfa73bad tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28892730-b9eb-4781-bdee-00d764167fe6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:58:54 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-4d5672ac-82e2-490e-950f-8f7bcfa73bad tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (376a7004-3ee2-4b45-9d2e-6d73f8a2b470) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:58:54 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-4d5672ac-82e2-490e-950f-8f7bcfa73bad tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (376a7004-3ee2-4b45-9d2e-6d73f8a2b470) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a7a748cb-279f-4e7e-b2c5-523afabb731b', 'volume_name': 'volume-a7a748cb-279f-4e7e-b2c5-523afabb731b', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:58:54 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-4d5672ac-82e2-490e-950f-8f7bcfa73bad tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2d7cddd-9031-495f-a35c-7d156b9690bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:58:54 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-4d5672ac-82e2-490e-950f-8f7bcfa73bad tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2d7cddd-9031-495f-a35c-7d156b9690bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:58:54 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-4d5672ac-82e2-490e-950f-8f7bcfa73bad tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d37ea292-e871-4eec-a350-c8628d292f6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:58:54 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-4d5672ac-82e2-490e-950f-8f7bcfa73bad tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] Volume a7a748cb-279f-4e7e-b2c5-523afabb731b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a7a748cb-279f-4e7e-b2c5-523afabb731b', 'volume_size': 1} Jul 13 13:58:54 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-4d5672ac-82e2-490e-950f-8f7bcfa73bad tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:58:55 devstack sudo[98913]: pam_unix(sudo:session): session closed for user root Jul 13 13:58:55 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-1b3cde33-6783-42df-a84f-815fbae4b5ed tempest-VolumesSnapshotTestJSON-2010930921 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-ceab0c9b-2879-496d-8815-600b6fb9e092" returned: 0 in 0.435s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:58:55 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-1b3cde33-6783-42df-a84f-815fbae4b5ed tempest-VolumesSnapshotTestJSON-2010930921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-ceab0c9b-2879-496d-8815-600b6fb9e092,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-ceab0c9b-2879-496d-8815-600b6fb9e092.e0a558b0-631e-45c8-8c8f-848bd551b3dd 1G {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:58:55 devstack sudo[98918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-ceab0c9b-2879-496d-8815-600b6fb9e092,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-ceab0c9b-2879-496d-8815-600b6fb9e092.e0a558b0-631e-45c8-8c8f-848bd551b3dd 1G Jul 13 13:58:55 devstack sudo[98918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:58:55 devstack sudo[98918]: pam_unix(sudo:session): session closed for user root Jul 13 13:58:55 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-1b3cde33-6783-42df-a84f-815fbae4b5ed tempest-VolumesSnapshotTestJSON-2010930921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-ceab0c9b-2879-496d-8815-600b6fb9e092,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-ceab0c9b-2879-496d-8815-600b6fb9e092.e0a558b0-631e-45c8-8c8f-848bd551b3dd 1G" returned: 0 in 0.459s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:58:55 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-1b3cde33-6783-42df-a84f-815fbae4b5ed tempest-VolumesSnapshotTestJSON-2010930921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ceab0c9b-2879-496d-8815-600b6fb9e092 -F qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-ceab0c9b-2879-496d-8815-600b6fb9e092.e0a558b0-631e-45c8-8c8f-848bd551b3dd {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:58:55 devstack sudo[98924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ceab0c9b-2879-496d-8815-600b6fb9e092 -F qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-ceab0c9b-2879-496d-8815-600b6fb9e092.e0a558b0-631e-45c8-8c8f-848bd551b3dd Jul 13 13:58:55 devstack sudo[98924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:58:55 devstack sudo[98924]: pam_unix(sudo:session): session closed for user root Jul 13 13:58:55 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-1b3cde33-6783-42df-a84f-815fbae4b5ed tempest-VolumesSnapshotTestJSON-2010930921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ceab0c9b-2879-496d-8815-600b6fb9e092 -F qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-ceab0c9b-2879-496d-8815-600b6fb9e092.e0a558b0-631e-45c8-8c8f-848bd551b3dd" returned: 0 in 0.333s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:58:55 devstack cinder-volume[87098]: WARNING cinder.volume.drivers.remotefs [None req-1b3cde33-6783-42df-a84f-815fbae4b5ed tempest-VolumesSnapshotTestJSON-2010930921 None] /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-ceab0c9b-2879-496d-8815-600b6fb9e092.e0a558b0-631e-45c8-8c8f-848bd551b3dd is being set with open permissions: ugo+rw Jul 13 13:58:55 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-1b3cde33-6783-42df-a84f-815fbae4b5ed tempest-VolumesSnapshotTestJSON-2010930921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-ceab0c9b-2879-496d-8815-600b6fb9e092.e0a558b0-631e-45c8-8c8f-848bd551b3dd {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:58:55 devstack sudo[98929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-ceab0c9b-2879-496d-8815-600b6fb9e092.e0a558b0-631e-45c8-8c8f-848bd551b3dd Jul 13 13:58:55 devstack sudo[98929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:58:55 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-e055b9e9-1f0b-45f9-8a82-6e205d1d76c3 tempest-GroupsV314Test-1132626347 None] Acquiring lock "cinder-quobyte-251589d3-8100-434d-9777-422a47d4bde0" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 13:58:56 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-e055b9e9-1f0b-45f9-8a82-6e205d1d76c3 tempest-GroupsV314Test-1132626347 None] Lock "cinder-quobyte-251589d3-8100-434d-9777-422a47d4bde0" acquired by "delete_volume" :: waited 0.019s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 13:58:56 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b70f93c-5e75-4a1a-aa58-e8d8b9d0ffad]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 13:58:56 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-e055b9e9-1f0b-45f9-8a82-6e205d1d76c3 tempest-GroupsV314Test-1132626347 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-251589d3-8100-434d-9777-422a47d4bde0 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:58:56 devstack sudo[98931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-251589d3-8100-434d-9777-422a47d4bde0 Jul 13 13:58:56 devstack sudo[98931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:58:56 devstack sudo[98929]: pam_unix(sudo:session): session closed for user root Jul 13 13:58:56 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-1b3cde33-6783-42df-a84f-815fbae4b5ed tempest-VolumesSnapshotTestJSON-2010930921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-ceab0c9b-2879-496d-8815-600b6fb9e092.e0a558b0-631e-45c8-8c8f-848bd551b3dd" returned: 0 in 0.276s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:58:56 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-1b3cde33-6783-42df-a84f-815fbae4b5ed tempest-VolumesSnapshotTestJSON-2010930921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-ceab0c9b-2879-496d-8815-600b6fb9e092.info {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:58:56 devstack sudo[98934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-ceab0c9b-2879-496d-8815-600b6fb9e092.info Jul 13 13:58:56 devstack sudo[98934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:58:56 devstack sudo[98931]: pam_unix(sudo:session): session closed for user root Jul 13 13:58:56 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-e055b9e9-1f0b-45f9-8a82-6e205d1d76c3 tempest-GroupsV314Test-1132626347 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-251589d3-8100-434d-9777-422a47d4bde0" returned: 0 in 0.400s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:58:56 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-e055b9e9-1f0b-45f9-8a82-6e205d1d76c3 tempest-GroupsV314Test-1132626347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-251589d3-8100-434d-9777-422a47d4bde0 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:58:56 devstack sudo[98940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-251589d3-8100-434d-9777-422a47d4bde0 Jul 13 13:58:56 devstack sudo[98940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:58:56 devstack sudo[98934]: pam_unix(sudo:session): session closed for user root Jul 13 13:58:56 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-1b3cde33-6783-42df-a84f-815fbae4b5ed tempest-VolumesSnapshotTestJSON-2010930921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-ceab0c9b-2879-496d-8815-600b6fb9e092.info" returned: 0 in 0.356s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:58:56 devstack cinder-volume[87098]: WARNING cinder.volume.drivers.remotefs [None req-1b3cde33-6783-42df-a84f-815fbae4b5ed tempest-VolumesSnapshotTestJSON-2010930921 None] /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-ceab0c9b-2879-496d-8815-600b6fb9e092.info is being set with open permissions: ugo+rw Jul 13 13:58:56 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-1b3cde33-6783-42df-a84f-815fbae4b5ed tempest-VolumesSnapshotTestJSON-2010930921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-ceab0c9b-2879-496d-8815-600b6fb9e092.info {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:58:56 devstack sudo[98943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-ceab0c9b-2879-496d-8815-600b6fb9e092.info Jul 13 13:58:56 devstack sudo[98943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:58:56 devstack sudo[98940]: pam_unix(sudo:session): session closed for user root Jul 13 13:58:56 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-e055b9e9-1f0b-45f9-8a82-6e205d1d76c3 tempest-GroupsV314Test-1132626347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-251589d3-8100-434d-9777-422a47d4bde0" returned: 0 in 0.404s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:58:56 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-e055b9e9-1f0b-45f9-8a82-6e205d1d76c3 tempest-GroupsV314Test-1132626347 None] Lock "cinder-quobyte-251589d3-8100-434d-9777-422a47d4bde0" released by "delete_volume" :: held 0.863s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 13:58:56 devstack sudo[98943]: pam_unix(sudo:session): session closed for user root Jul 13 13:58:56 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-1b3cde33-6783-42df-a84f-815fbae4b5ed tempest-VolumesSnapshotTestJSON-2010930921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-ceab0c9b-2879-496d-8815-600b6fb9e092.info" returned: 0 in 0.319s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:58:56 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-1b3cde33-6783-42df-a84f-815fbae4b5ed tempest-VolumesSnapshotTestJSON-2010930921 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.325s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:58:56 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-4d5672ac-82e2-490e-950f-8f7bcfa73bad tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.014s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:58:56 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-4d5672ac-82e2-490e-950f-8f7bcfa73bad tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T11:58:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2041754554',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7a748cb-279f-4e7e-b2c5-523afabb731b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00394ef75ede414796272efe347ea65b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T11:58:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T11:58:55Z,use_quota=True,user_id='465d81cd99ff43da9d129fab824b1778',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1147de8b-623b-426c-a13d-7fc824a80f67),volume_type_id=1147de8b-623b-426c-a13d-7fc824a80f67)}" {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 13 13:58:56 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-4d5672ac-82e2-490e-950f-8f7bcfa73bad tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] Creating volume a7a748cb-279f-4e7e-b2c5-523afabb731b {{(pid=87098) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 13 13:58:56 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-4d5672ac-82e2-490e-950f-8f7bcfa73bad tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:58:56 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-4d5672ac-82e2-490e-950f-8f7bcfa73bad tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:58:56 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-4d5672ac-82e2-490e-950f-8f7bcfa73bad tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 13:58:56 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-4d5672ac-82e2-490e-950f-8f7bcfa73bad tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 13:58:56 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-4d5672ac-82e2-490e-950f-8f7bcfa73bad tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:58:56 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-4d5672ac-82e2-490e-950f-8f7bcfa73bad tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] Selected osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 13:58:56 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-4d5672ac-82e2-490e-950f-8f7bcfa73bad tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] casted to osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 Jul 13 13:58:56 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-4d5672ac-82e2-490e-950f-8f7bcfa73bad tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-a7a748cb-279f-4e7e-b2c5-523afabb731b 1073741824 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:58:56 devstack sudo[98948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-a7a748cb-279f-4e7e-b2c5-523afabb731b 1073741824 Jul 13 13:58:56 devstack sudo[98948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:58:56 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-e055b9e9-1f0b-45f9-8a82-6e205d1d76c3 tempest-GroupsV314Test-1132626347 None] Created reservations ['4eb769db-aa4a-4db1-8840-f9a040a4678c'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 13:58:57 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-1b3cde33-6783-42df-a84f-815fbae4b5ed tempest-VolumesSnapshotTestJSON-2010930921 None] Create snapshot completed successfully Jul 13 13:58:57 devstack cinder-volume[87098]: WARNING cinder.quota [None req-e055b9e9-1f0b-45f9-8a82-6e205d1d76c3 tempest-GroupsV314Test-1132626347 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-229508391 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-229508391, it is now deprecated. Please use the default quota class for default quota. Jul 13 13:58:57 devstack cinder-volume[87098]: WARNING cinder.quota [None req-e055b9e9-1f0b-45f9-8a82-6e205d1d76c3 tempest-GroupsV314Test-1132626347 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-229508391 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-229508391, it is now deprecated. Please use the default quota class for default quota. Jul 13 13:58:57 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-e055b9e9-1f0b-45f9-8a82-6e205d1d76c3 tempest-GroupsV314Test-1132626347 None] Created reservations ['948287c5-8662-4d0f-896c-db8b005dfe90', '705f16bc-4110-4a71-b311-c9457744f46d', '5f681638-f1fa-423a-8412-f6eed3fd3186', 'fa595bc3-8ca1-4503-a210-66b37c0c79f5'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 13:58:57 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-e055b9e9-1f0b-45f9-8a82-6e205d1d76c3 tempest-GroupsV314Test-1132626347 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:58:57 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-e055b9e9-1f0b-45f9-8a82-6e205d1d76c3 tempest-GroupsV314Test-1132626347 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:58:57 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-e055b9e9-1f0b-45f9-8a82-6e205d1d76c3 tempest-GroupsV314Test-1132626347 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 13:58:57 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-e055b9e9-1f0b-45f9-8a82-6e205d1d76c3 tempest-GroupsV314Test-1132626347 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 13:58:57 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-e055b9e9-1f0b-45f9-8a82-6e205d1d76c3 tempest-GroupsV314Test-1132626347 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:58:57 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-e055b9e9-1f0b-45f9-8a82-6e205d1d76c3 tempest-GroupsV314Test-1132626347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:58:57 devstack sudo[98950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 Jul 13 13:58:57 devstack sudo[98950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:58:57 devstack sudo[98950]: pam_unix(sudo:session): session closed for user root Jul 13 13:58:57 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-e055b9e9-1f0b-45f9-8a82-6e205d1d76c3 tempest-GroupsV314Test-1132626347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78" returned: 0 in 0.295s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:58:57 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-e055b9e9-1f0b-45f9-8a82-6e205d1d76c3 tempest-GroupsV314Test-1132626347 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 13:58:57 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-e055b9e9-1f0b-45f9-8a82-6e205d1d76c3 tempest-GroupsV314Test-1132626347 None] Delete group completed successfully. Jul 13 13:58:57 devstack sudo[98948]: pam_unix(sudo:session): session closed for user root Jul 13 13:58:57 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-4d5672ac-82e2-490e-950f-8f7bcfa73bad tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-a7a748cb-279f-4e7e-b2c5-523afabb731b 1073741824" returned: 0 in 0.533s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:58:57 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-91d38363-832a-4452-944b-47ec96deb529 tempest-GroupsV314Test-1132626347 None] Acquiring lock "cinder-quobyte-fb76c14a-a177-4ea4-aa62-734b9f8c5417" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 13:58:57 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-4d5672ac-82e2-490e-950f-8f7bcfa73bad tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-a7a748cb-279f-4e7e-b2c5-523afabb731b {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:58:57 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-91d38363-832a-4452-944b-47ec96deb529 tempest-GroupsV314Test-1132626347 None] Lock "cinder-quobyte-fb76c14a-a177-4ea4-aa62-734b9f8c5417" acquired by "delete_volume" :: waited 0.049s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 13:58:57 devstack sudo[98957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-a7a748cb-279f-4e7e-b2c5-523afabb731b Jul 13 13:58:57 devstack sudo[98957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:58:57 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2c33d74-6dd3-4983-942a-40306a658ffe]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 13:58:57 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-91d38363-832a-4452-944b-47ec96deb529 tempest-GroupsV314Test-1132626347 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-fb76c14a-a177-4ea4-aa62-734b9f8c5417 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:58:57 devstack sudo[98959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-fb76c14a-a177-4ea4-aa62-734b9f8c5417 Jul 13 13:58:57 devstack sudo[98959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:58:57 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-0fc250d1-a29d-4201-ac63-5f9ee5ba5fcf tempest-VolumesSnapshotTestJSON-2010930921 None] Acquiring lock "cinder-e0a558b0-631e-45c8-8c8f-848bd551b3dd-delete_snapshot" by "delete_snapshot" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 13:58:57 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-0fc250d1-a29d-4201-ac63-5f9ee5ba5fcf tempest-VolumesSnapshotTestJSON-2010930921 None] Lock "cinder-e0a558b0-631e-45c8-8c8f-848bd551b3dd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.046s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 13:58:58 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-0fc250d1-a29d-4201-ac63-5f9ee5ba5fcf tempest-VolumesSnapshotTestJSON-2010930921 None] Acquiring lock "cinder-quobyte-ceab0c9b-2879-496d-8815-600b6fb9e092" by "delete_snapshot" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 13:58:58 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-0fc250d1-a29d-4201-ac63-5f9ee5ba5fcf tempest-VolumesSnapshotTestJSON-2010930921 None] Lock "cinder-quobyte-ceab0c9b-2879-496d-8815-600b6fb9e092" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 13:58:58 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-0fc250d1-a29d-4201-ac63-5f9ee5ba5fcf tempest-VolumesSnapshotTestJSON-2010930921 None] Acquiring lock "cinder-quobyte-e0a558b0-631e-45c8-8c8f-848bd551b3dd" by "_delete_snapshot" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 13:58:58 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-0fc250d1-a29d-4201-ac63-5f9ee5ba5fcf tempest-VolumesSnapshotTestJSON-2010930921 None] Lock "cinder-quobyte-e0a558b0-631e-45c8-8c8f-848bd551b3dd" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 13:58:58 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-0fc250d1-a29d-4201-ac63-5f9ee5ba5fcf tempest-VolumesSnapshotTestJSON-2010930921 None] Deleting offline snapshot e0a558b0-631e-45c8-8c8f-848bd551b3dd of volume ceab0c9b-2879-496d-8815-600b6fb9e092 {{(pid=87098) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 13 13:58:58 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-0fc250d1-a29d-4201-ac63-5f9ee5ba5fcf tempest-VolumesSnapshotTestJSON-2010930921 None] snapshot_file for this snap is: volume-ceab0c9b-2879-496d-8815-600b6fb9e092.e0a558b0-631e-45c8-8c8f-848bd551b3dd {{(pid=87098) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 13 13:58:58 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[25a22d46-5409-4094-950c-ec881b2bf132]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 13:58:58 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-0fc250d1-a29d-4201-ac63-5f9ee5ba5fcf tempest-VolumesSnapshotTestJSON-2010930921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-ceab0c9b-2879-496d-8815-600b6fb9e092.e0a558b0-631e-45c8-8c8f-848bd551b3dd {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:58:58 devstack sudo[98959]: pam_unix(sudo:session): session closed for user root Jul 13 13:58:58 devstack sudo[98957]: pam_unix(sudo:session): session closed for user root Jul 13 13:58:58 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-91d38363-832a-4452-944b-47ec96deb529 tempest-GroupsV314Test-1132626347 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-fb76c14a-a177-4ea4-aa62-734b9f8c5417" returned: 0 in 0.443s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:58:58 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-91d38363-832a-4452-944b-47ec96deb529 tempest-GroupsV314Test-1132626347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-fb76c14a-a177-4ea4-aa62-734b9f8c5417 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:58:58 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-4d5672ac-82e2-490e-950f-8f7bcfa73bad tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-a7a748cb-279f-4e7e-b2c5-523afabb731b" returned: 0 in 0.574s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:58:58 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-4d5672ac-82e2-490e-950f-8f7bcfa73bad tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] <== create_volume: return (1201ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'} {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 13 13:58:58 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-4d5672ac-82e2-490e-950f-8f7bcfa73bad tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.205s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:58:58 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-4d5672ac-82e2-490e-950f-8f7bcfa73bad tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d37ea292-e871-4eec-a350-c8628d292f6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a7a748cb-279f-4e7e-b2c5-523afabb731b', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:58:58 devstack sudo[98966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-fb76c14a-a177-4ea4-aa62-734b9f8c5417 Jul 13 13:58:58 devstack sudo[98966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:58:58 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-4d5672ac-82e2-490e-950f-8f7bcfa73bad tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0f840c0-ba40-4cf4-961a-80b1b5f160a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:58:58 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-4d5672ac-82e2-490e-950f-8f7bcfa73bad tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] Volume volume-a7a748cb-279f-4e7e-b2c5-523afabb731b (a7a748cb-279f-4e7e-b2c5-523afabb731b): created successfully Jul 13 13:58:58 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-4d5672ac-82e2-490e-950f-8f7bcfa73bad tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0f840c0-ba40-4cf4-961a-80b1b5f160a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:58:58 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-4d5672ac-82e2-490e-950f-8f7bcfa73bad tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] Flow 'volume_create_manager' (cbc8714e-8be0-49e6-819e-1b076ade7b65) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 13:58:58 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-4d5672ac-82e2-490e-950f-8f7bcfa73bad tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] Created volume successfully. Jul 13 13:58:58 devstack sudo[98965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-ceab0c9b-2879-496d-8815-600b6fb9e092.e0a558b0-631e-45c8-8c8f-848bd551b3dd Jul 13 13:58:58 devstack sudo[98965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:58:58 devstack sudo[98966]: pam_unix(sudo:session): session closed for user root Jul 13 13:58:58 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-91d38363-832a-4452-944b-47ec96deb529 tempest-GroupsV314Test-1132626347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-fb76c14a-a177-4ea4-aa62-734b9f8c5417" returned: 0 in 0.302s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:58:58 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-91d38363-832a-4452-944b-47ec96deb529 tempest-GroupsV314Test-1132626347 None] Lock "cinder-quobyte-fb76c14a-a177-4ea4-aa62-734b9f8c5417" released by "delete_volume" :: held 0.848s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 13:58:58 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-91d38363-832a-4452-944b-47ec96deb529 tempest-GroupsV314Test-1132626347 None] Created reservations ['2ee24a22-c674-4136-8ec5-a3964670bccb'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 13:58:58 devstack sudo[98965]: pam_unix(sudo:session): session closed for user root Jul 13 13:58:58 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-0fc250d1-a29d-4201-ac63-5f9ee5ba5fcf tempest-VolumesSnapshotTestJSON-2010930921 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-ceab0c9b-2879-496d-8815-600b6fb9e092.e0a558b0-631e-45c8-8c8f-848bd551b3dd" returned: 0 in 0.473s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:58:58 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-0fc250d1-a29d-4201-ac63-5f9ee5ba5fcf tempest-VolumesSnapshotTestJSON-2010930921 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ceab0c9b-2879-496d-8815-600b6fb9e092(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87098) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 13 13:58:58 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[26efda7b-38cb-4e98-94b0-76ee60fc79d9]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 13:58:58 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-0fc250d1-a29d-4201-ac63-5f9ee5ba5fcf tempest-VolumesSnapshotTestJSON-2010930921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-ceab0c9b-2879-496d-8815-600b6fb9e092 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:58:58 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-91d38363-832a-4452-944b-47ec96deb529 tempest-GroupsV314Test-1132626347 None] Created reservations ['290caa89-7264-4652-a995-a003ac992727', '19a90aaa-b9a7-4cd5-ae1a-a2b8a1ef4a96', '94acf3b9-b4d2-41b7-95b7-bdc8105b8632', '2c23ad95-c718-49c1-8429-24231abacdf5'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 13:58:58 devstack sudo[98973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-ceab0c9b-2879-496d-8815-600b6fb9e092 Jul 13 13:58:58 devstack sudo[98973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:58:58 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-91d38363-832a-4452-944b-47ec96deb529 tempest-GroupsV314Test-1132626347 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:58:58 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-91d38363-832a-4452-944b-47ec96deb529 tempest-GroupsV314Test-1132626347 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:58:58 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-91d38363-832a-4452-944b-47ec96deb529 tempest-GroupsV314Test-1132626347 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 13:58:58 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-91d38363-832a-4452-944b-47ec96deb529 tempest-GroupsV314Test-1132626347 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 13:58:58 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-91d38363-832a-4452-944b-47ec96deb529 tempest-GroupsV314Test-1132626347 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:58:58 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-91d38363-832a-4452-944b-47ec96deb529 tempest-GroupsV314Test-1132626347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:58:58 devstack sudo[98975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 Jul 13 13:58:58 devstack sudo[98975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:58:59 devstack sudo[98975]: pam_unix(sudo:session): session closed for user root Jul 13 13:58:59 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-91d38363-832a-4452-944b-47ec96deb529 tempest-GroupsV314Test-1132626347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78" returned: 0 in 0.490s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:58:59 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-91d38363-832a-4452-944b-47ec96deb529 tempest-GroupsV314Test-1132626347 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 13:58:59 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-91d38363-832a-4452-944b-47ec96deb529 tempest-GroupsV314Test-1132626347 None] Delete group completed successfully. Jul 13 13:58:59 devstack sudo[98973]: pam_unix(sudo:session): session closed for user root Jul 13 13:58:59 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-0fc250d1-a29d-4201-ac63-5f9ee5ba5fcf tempest-VolumesSnapshotTestJSON-2010930921 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-ceab0c9b-2879-496d-8815-600b6fb9e092" returned: 0 in 0.695s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:58:59 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-0fc250d1-a29d-4201-ac63-5f9ee5ba5fcf tempest-VolumesSnapshotTestJSON-2010930921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-ceab0c9b-2879-496d-8815-600b6fb9e092.e0a558b0-631e-45c8-8c8f-848bd551b3dd {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:58:59 devstack sudo[98981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-ceab0c9b-2879-496d-8815-600b6fb9e092.e0a558b0-631e-45c8-8c8f-848bd551b3dd Jul 13 13:58:59 devstack sudo[98981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:58:59 devstack sudo[98981]: pam_unix(sudo:session): session closed for user root Jul 13 13:58:59 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-0fc250d1-a29d-4201-ac63-5f9ee5ba5fcf tempest-VolumesSnapshotTestJSON-2010930921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-ceab0c9b-2879-496d-8815-600b6fb9e092.e0a558b0-631e-45c8-8c8f-848bd551b3dd" returned: 0 in 0.542s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:58:59 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-0fc250d1-a29d-4201-ac63-5f9ee5ba5fcf tempest-VolumesSnapshotTestJSON-2010930921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-ceab0c9b-2879-496d-8815-600b6fb9e092.e0a558b0-631e-45c8-8c8f-848bd551b3dd {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:58:59 devstack sudo[98986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-ceab0c9b-2879-496d-8815-600b6fb9e092.e0a558b0-631e-45c8-8c8f-848bd551b3dd Jul 13 13:58:59 devstack sudo[98986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:59:00 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-2038c778-31ae-4d65-822b-419f0915365c tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 13:59:00 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-2038c778-31ae-4d65-822b-419f0915365c tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] Flow 'volume_create_manager' (e92501e0-3c36-4575-93d4-1c8cbbcc6a8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 13:59:00 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-2038c778-31ae-4d65-822b-419f0915365c tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (208bce17-6402-4113-b03e-882fc7c14710) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:59:00 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-2038c778-31ae-4d65-822b-419f0915365c tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (208bce17-6402-4113-b03e-882fc7c14710) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T11:58:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-127137237',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=511b3757-4952-4c7b-8029-114a3b2aa418,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00394ef75ede414796272efe347ea65b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T11:59:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T11:59:00Z,use_quota=True,user_id='465d81cd99ff43da9d129fab824b1778',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1147de8b-623b-426c-a13d-7fc824a80f67),volume_type_id=1147de8b-623b-426c-a13d-7fc824a80f67)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:59:00 devstack sudo[98986]: pam_unix(sudo:session): session closed for user root Jul 13 13:59:00 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-2038c778-31ae-4d65-822b-419f0915365c tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31814eca-dc61-4d2c-bcd1-dcb295562f37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:59:00 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-2038c778-31ae-4d65-822b-419f0915365c tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31814eca-dc61-4d2c-bcd1-dcb295562f37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:59:00 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-2038c778-31ae-4d65-822b-419f0915365c tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56f8fd23-abaf-4f03-8472-966ba89a9375) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:59:00 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-2038c778-31ae-4d65-822b-419f0915365c tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56f8fd23-abaf-4f03-8472-966ba89a9375) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '511b3757-4952-4c7b-8029-114a3b2aa418', 'volume_name': 'volume-511b3757-4952-4c7b-8029-114a3b2aa418', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:59:00 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-2038c778-31ae-4d65-822b-419f0915365c tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e498856-56e3-40ff-8b5d-c09413737966) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:59:00 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-2038c778-31ae-4d65-822b-419f0915365c tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e498856-56e3-40ff-8b5d-c09413737966) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:59:00 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-2038c778-31ae-4d65-822b-419f0915365c tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f5652d7-632f-4ef2-90fd-f688e85464d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:59:00 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-2038c778-31ae-4d65-822b-419f0915365c tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] Volume 511b3757-4952-4c7b-8029-114a3b2aa418: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-511b3757-4952-4c7b-8029-114a3b2aa418', 'volume_size': 1} Jul 13 13:59:00 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-2038c778-31ae-4d65-822b-419f0915365c tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:59:00 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-2038c778-31ae-4d65-822b-419f0915365c tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:59:00 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-2038c778-31ae-4d65-822b-419f0915365c tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T11:58:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-127137237',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=511b3757-4952-4c7b-8029-114a3b2aa418,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00394ef75ede414796272efe347ea65b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T11:59:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T11:59:00Z,use_quota=True,user_id='465d81cd99ff43da9d129fab824b1778',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1147de8b-623b-426c-a13d-7fc824a80f67),volume_type_id=1147de8b-623b-426c-a13d-7fc824a80f67)}" {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 13 13:59:00 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-2038c778-31ae-4d65-822b-419f0915365c tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] Creating volume 511b3757-4952-4c7b-8029-114a3b2aa418 {{(pid=87098) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 13 13:59:00 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-2038c778-31ae-4d65-822b-419f0915365c tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:59:00 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-2038c778-31ae-4d65-822b-419f0915365c tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:59:00 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-2038c778-31ae-4d65-822b-419f0915365c tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 13:59:00 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-2038c778-31ae-4d65-822b-419f0915365c tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 13:59:00 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-2038c778-31ae-4d65-822b-419f0915365c tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:59:00 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-2038c778-31ae-4d65-822b-419f0915365c tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] Selected osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 13:59:00 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-2038c778-31ae-4d65-822b-419f0915365c tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] casted to osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 Jul 13 13:59:00 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-2038c778-31ae-4d65-822b-419f0915365c tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-511b3757-4952-4c7b-8029-114a3b2aa418 1073741824 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:59:00 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-0fc250d1-a29d-4201-ac63-5f9ee5ba5fcf tempest-VolumesSnapshotTestJSON-2010930921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-ceab0c9b-2879-496d-8815-600b6fb9e092.e0a558b0-631e-45c8-8c8f-848bd551b3dd" returned: 0 in 0.458s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:59:00 devstack sudo[98989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-511b3757-4952-4c7b-8029-114a3b2aa418 1073741824 Jul 13 13:59:00 devstack sudo[98989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:59:00 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-0fc250d1-a29d-4201-ac63-5f9ee5ba5fcf tempest-VolumesSnapshotTestJSON-2010930921 None] Lock "cinder-quobyte-e0a558b0-631e-45c8-8c8f-848bd551b3dd" released by "_delete_snapshot" :: held 2.372s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 13:59:00 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-0fc250d1-a29d-4201-ac63-5f9ee5ba5fcf tempest-VolumesSnapshotTestJSON-2010930921 None] Lock "cinder-quobyte-ceab0c9b-2879-496d-8815-600b6fb9e092" released by "delete_snapshot" :: held 2.402s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 13:59:00 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-0fc250d1-a29d-4201-ac63-5f9ee5ba5fcf tempest-VolumesSnapshotTestJSON-2010930921 None] Created reservations ['9a586382-a989-4558-8102-242f1f0bd9bc', '4cc5c26f-d5c4-43ff-a53f-df7227b23ad8', '6cc09523-9c32-419c-883d-a389b5ee4b0a', '13379b6f-9318-40ee-8d2e-f4596bba9a89'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 13:59:00 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-0fc250d1-a29d-4201-ac63-5f9ee5ba5fcf tempest-VolumesSnapshotTestJSON-2010930921 None] Delete snapshot completed successfully. Jul 13 13:59:00 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-0fc250d1-a29d-4201-ac63-5f9ee5ba5fcf tempest-VolumesSnapshotTestJSON-2010930921 None] Lock "cinder-e0a558b0-631e-45c8-8c8f-848bd551b3dd-delete_snapshot" released by "delete_snapshot" :: held 2.801s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 13:59:00 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-aac695e6-aac2-4686-a7ed-cb6a77db179d tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 13:59:01 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-aac695e6-aac2-4686-a7ed-cb6a77db179d tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] Flow 'volume_create_manager' (919f4bcb-2e8b-4a13-aca6-1385cf26b574) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 13:59:01 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-aac695e6-aac2-4686-a7ed-cb6a77db179d tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a645efd5-0b23-4ef7-a3b5-6c21b6ef5194) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:59:01 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-aac695e6-aac2-4686-a7ed-cb6a77db179d tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a645efd5-0b23-4ef7-a3b5-6c21b6ef5194) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T11:59:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-319589973',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08d03499-dcab-4efc-90ea-2ec26683005b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00394ef75ede414796272efe347ea65b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T11:59:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T11:59:01Z,use_quota=True,user_id='465d81cd99ff43da9d129fab824b1778',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1147de8b-623b-426c-a13d-7fc824a80f67),volume_type_id=1147de8b-623b-426c-a13d-7fc824a80f67)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:59:01 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-aac695e6-aac2-4686-a7ed-cb6a77db179d tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca926864-a927-4be5-94c0-387302a68a3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:59:01 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-aac695e6-aac2-4686-a7ed-cb6a77db179d tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca926864-a927-4be5-94c0-387302a68a3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:59:01 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-aac695e6-aac2-4686-a7ed-cb6a77db179d tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ecab1f06-5498-4262-b5b6-098b4a45231c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:59:01 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-aac695e6-aac2-4686-a7ed-cb6a77db179d tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ecab1f06-5498-4262-b5b6-098b4a45231c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '08d03499-dcab-4efc-90ea-2ec26683005b', 'volume_name': 'volume-08d03499-dcab-4efc-90ea-2ec26683005b', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:59:01 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-aac695e6-aac2-4686-a7ed-cb6a77db179d tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (408597e0-e7b8-49f4-ab59-69eba6a0334a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:59:01 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-aac695e6-aac2-4686-a7ed-cb6a77db179d tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (408597e0-e7b8-49f4-ab59-69eba6a0334a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:59:01 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-aac695e6-aac2-4686-a7ed-cb6a77db179d tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d70dfb6-37cc-4714-bb60-6d07b5b8b17a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:59:01 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-aac695e6-aac2-4686-a7ed-cb6a77db179d tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] Volume 08d03499-dcab-4efc-90ea-2ec26683005b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-08d03499-dcab-4efc-90ea-2ec26683005b', 'volume_size': 1} Jul 13 13:59:01 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-aac695e6-aac2-4686-a7ed-cb6a77db179d tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:59:01 devstack sudo[98989]: pam_unix(sudo:session): session closed for user root Jul 13 13:59:01 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-2038c778-31ae-4d65-822b-419f0915365c tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-511b3757-4952-4c7b-8029-114a3b2aa418 1073741824" returned: 0 in 0.843s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:59:01 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-2038c778-31ae-4d65-822b-419f0915365c tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-511b3757-4952-4c7b-8029-114a3b2aa418 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:59:01 devstack sudo[98996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-511b3757-4952-4c7b-8029-114a3b2aa418 Jul 13 13:59:01 devstack sudo[98996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:59:01 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-c2f81e0f-dd2c-4af6-beb1-1890042752be tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 13:59:01 devstack sudo[98996]: pam_unix(sudo:session): session closed for user root Jul 13 13:59:01 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-c2f81e0f-dd2c-4af6-beb1-1890042752be tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] Flow 'volume_create_manager' (daf49b2c-5ccd-4865-8be3-4b2d50deadfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 13:59:01 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-c2f81e0f-dd2c-4af6-beb1-1890042752be tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71582550-24e9-4a31-b0cc-e244d6d79464) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:59:01 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-2038c778-31ae-4d65-822b-419f0915365c tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-511b3757-4952-4c7b-8029-114a3b2aa418" returned: 0 in 0.528s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:59:01 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-2038c778-31ae-4d65-822b-419f0915365c tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] <== create_volume: return (1428ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'} {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 13 13:59:01 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-2038c778-31ae-4d65-822b-419f0915365c tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.430s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:59:01 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-aac695e6-aac2-4686-a7ed-cb6a77db179d tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.627s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:59:01 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-aac695e6-aac2-4686-a7ed-cb6a77db179d tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T11:59:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-319589973',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08d03499-dcab-4efc-90ea-2ec26683005b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00394ef75ede414796272efe347ea65b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T11:59:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T11:59:01Z,use_quota=True,user_id='465d81cd99ff43da9d129fab824b1778',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1147de8b-623b-426c-a13d-7fc824a80f67),volume_type_id=1147de8b-623b-426c-a13d-7fc824a80f67)}" {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 13 13:59:01 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-aac695e6-aac2-4686-a7ed-cb6a77db179d tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] Creating volume 08d03499-dcab-4efc-90ea-2ec26683005b {{(pid=87098) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 13 13:59:01 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-aac695e6-aac2-4686-a7ed-cb6a77db179d tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:59:01 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-aac695e6-aac2-4686-a7ed-cb6a77db179d tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:59:01 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-aac695e6-aac2-4686-a7ed-cb6a77db179d tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 13:59:01 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-aac695e6-aac2-4686-a7ed-cb6a77db179d tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 13:59:01 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-aac695e6-aac2-4686-a7ed-cb6a77db179d tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:59:01 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-aac695e6-aac2-4686-a7ed-cb6a77db179d tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] Selected osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 13:59:01 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-aac695e6-aac2-4686-a7ed-cb6a77db179d tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] casted to osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 Jul 13 13:59:01 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-aac695e6-aac2-4686-a7ed-cb6a77db179d tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-08d03499-dcab-4efc-90ea-2ec26683005b 1073741824 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:59:01 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-c2f81e0f-dd2c-4af6-beb1-1890042752be tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71582550-24e9-4a31-b0cc-e244d6d79464) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T11:59:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-209222115',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2cbffa2c-4083-4ca5-b54a-fbad9639f7bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00394ef75ede414796272efe347ea65b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T11:59:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T11:59:01Z,use_quota=True,user_id='465d81cd99ff43da9d129fab824b1778',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1147de8b-623b-426c-a13d-7fc824a80f67),volume_type_id=1147de8b-623b-426c-a13d-7fc824a80f67)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:59:01 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-c2f81e0f-dd2c-4af6-beb1-1890042752be tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f705863a-c2ca-4c87-9c1b-065b5be9e3cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:59:01 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-c2f81e0f-dd2c-4af6-beb1-1890042752be tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f705863a-c2ca-4c87-9c1b-065b5be9e3cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:59:01 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-c2f81e0f-dd2c-4af6-beb1-1890042752be tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d29fd9ae-70a4-4f32-b13e-42fb9a35cc5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:59:01 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-c2f81e0f-dd2c-4af6-beb1-1890042752be tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d29fd9ae-70a4-4f32-b13e-42fb9a35cc5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2cbffa2c-4083-4ca5-b54a-fbad9639f7bb', 'volume_name': 'volume-2cbffa2c-4083-4ca5-b54a-fbad9639f7bb', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:59:01 devstack sudo[98999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-08d03499-dcab-4efc-90ea-2ec26683005b 1073741824 Jul 13 13:59:01 devstack sudo[98999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:59:01 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-c2f81e0f-dd2c-4af6-beb1-1890042752be tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e969784a-40a4-4b78-8e99-8aebfdd6bbb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:59:01 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-c2f81e0f-dd2c-4af6-beb1-1890042752be tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e969784a-40a4-4b78-8e99-8aebfdd6bbb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:59:01 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-c2f81e0f-dd2c-4af6-beb1-1890042752be tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b93d9977-488b-4f16-8602-57ea0d0486bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:59:01 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-c2f81e0f-dd2c-4af6-beb1-1890042752be tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] Volume 2cbffa2c-4083-4ca5-b54a-fbad9639f7bb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2cbffa2c-4083-4ca5-b54a-fbad9639f7bb', 'volume_size': 1} Jul 13 13:59:01 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-c2f81e0f-dd2c-4af6-beb1-1890042752be tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:59:01 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-2038c778-31ae-4d65-822b-419f0915365c tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f5652d7-632f-4ef2-90fd-f688e85464d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-511b3757-4952-4c7b-8029-114a3b2aa418', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:59:01 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-2038c778-31ae-4d65-822b-419f0915365c tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29851f18-0ae2-4f06-8e16-79846330d52d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:59:01 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-2038c778-31ae-4d65-822b-419f0915365c tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] Volume volume-511b3757-4952-4c7b-8029-114a3b2aa418 (511b3757-4952-4c7b-8029-114a3b2aa418): created successfully Jul 13 13:59:01 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-2038c778-31ae-4d65-822b-419f0915365c tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29851f18-0ae2-4f06-8e16-79846330d52d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:59:01 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-2038c778-31ae-4d65-822b-419f0915365c tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] Flow 'volume_create_manager' (e92501e0-3c36-4575-93d4-1c8cbbcc6a8c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 13:59:01 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-2038c778-31ae-4d65-822b-419f0915365c tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] Created volume successfully. Jul 13 13:59:02 devstack sudo[98999]: pam_unix(sudo:session): session closed for user root Jul 13 13:59:02 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-aac695e6-aac2-4686-a7ed-cb6a77db179d tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-08d03499-dcab-4efc-90ea-2ec26683005b 1073741824" returned: 0 in 0.721s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:59:02 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-dc1fe4b3-69ee-4522-bdc9-e003e9263f92 tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 13:59:02 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-dc1fe4b3-69ee-4522-bdc9-e003e9263f92 tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] Flow 'volume_create_manager' (c47162f1-27f2-44cc-b27e-ca07b489742e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 13:59:02 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-dc1fe4b3-69ee-4522-bdc9-e003e9263f92 tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cfedb200-abde-4e51-8ea3-0e4007f89d57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:59:02 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-aac695e6-aac2-4686-a7ed-cb6a77db179d tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-08d03499-dcab-4efc-90ea-2ec26683005b {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:59:02 devstack sudo[99007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-08d03499-dcab-4efc-90ea-2ec26683005b Jul 13 13:59:02 devstack sudo[99007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:59:02 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-dc1fe4b3-69ee-4522-bdc9-e003e9263f92 tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cfedb200-abde-4e51-8ea3-0e4007f89d57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T11:59:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1799821485',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6151b4cb-2601-4e86-b5d2-dc7a16e4a8be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00394ef75ede414796272efe347ea65b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T11:59:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T11:59:02Z,use_quota=True,user_id='465d81cd99ff43da9d129fab824b1778',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1147de8b-623b-426c-a13d-7fc824a80f67),volume_type_id=1147de8b-623b-426c-a13d-7fc824a80f67)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:59:02 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-dc1fe4b3-69ee-4522-bdc9-e003e9263f92 tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b73c5b42-96f2-403e-962e-fbb4a4556b73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:59:02 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-dc1fe4b3-69ee-4522-bdc9-e003e9263f92 tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b73c5b42-96f2-403e-962e-fbb4a4556b73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:59:02 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-dc1fe4b3-69ee-4522-bdc9-e003e9263f92 tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7e7a093-a3e4-45c5-9507-7c02b609b404) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:59:02 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-dc1fe4b3-69ee-4522-bdc9-e003e9263f92 tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7e7a093-a3e4-45c5-9507-7c02b609b404) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6151b4cb-2601-4e86-b5d2-dc7a16e4a8be', 'volume_name': 'volume-6151b4cb-2601-4e86-b5d2-dc7a16e4a8be', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:59:02 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-dc1fe4b3-69ee-4522-bdc9-e003e9263f92 tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b8fb51f-2590-4846-91d0-9945de05314b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:59:02 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-dc1fe4b3-69ee-4522-bdc9-e003e9263f92 tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b8fb51f-2590-4846-91d0-9945de05314b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:59:02 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-dc1fe4b3-69ee-4522-bdc9-e003e9263f92 tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35562d16-444d-4a46-b38f-c43b18c08388) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:59:02 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-dc1fe4b3-69ee-4522-bdc9-e003e9263f92 tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] Volume 6151b4cb-2601-4e86-b5d2-dc7a16e4a8be: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6151b4cb-2601-4e86-b5d2-dc7a16e4a8be', 'volume_size': 1} Jul 13 13:59:02 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-dc1fe4b3-69ee-4522-bdc9-e003e9263f92 tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:59:02 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-f83644ad-beb8-406b-8a7e-9a91b7f0aa9a tempest-VolumesSnapshotTestJSON-2010930921 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 13:59:02 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-f83644ad-beb8-406b-8a7e-9a91b7f0aa9a tempest-VolumesSnapshotTestJSON-2010930921 None] Flow 'volume_create_manager' (3c225142-525c-4a66-835a-865f5de08cd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 13:59:02 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-f83644ad-beb8-406b-8a7e-9a91b7f0aa9a tempest-VolumesSnapshotTestJSON-2010930921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e8bfdd8-7eb2-4a5c-bc42-e63223bf95e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:59:02 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-f83644ad-beb8-406b-8a7e-9a91b7f0aa9a tempest-VolumesSnapshotTestJSON-2010930921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e8bfdd8-7eb2-4a5c-bc42-e63223bf95e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T11:59:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-570935192',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=301c9eea-6c8d-49b9-82aa-9b185b62ea95,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8897ab25feb4d999872fbe658460fa6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T11:59:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T11:59:03Z,use_quota=True,user_id='a6f445ef8dc04c7b92c04febd3515b27',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1147de8b-623b-426c-a13d-7fc824a80f67),volume_type_id=1147de8b-623b-426c-a13d-7fc824a80f67)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:59:02 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-f83644ad-beb8-406b-8a7e-9a91b7f0aa9a tempest-VolumesSnapshotTestJSON-2010930921 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46ea00f1-ba46-4686-86d9-7ac39b287f50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:59:02 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-f83644ad-beb8-406b-8a7e-9a91b7f0aa9a tempest-VolumesSnapshotTestJSON-2010930921 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46ea00f1-ba46-4686-86d9-7ac39b287f50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:59:02 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-f83644ad-beb8-406b-8a7e-9a91b7f0aa9a tempest-VolumesSnapshotTestJSON-2010930921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (424d06fd-478c-477d-81fd-92c89e2b5379) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:59:02 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-f83644ad-beb8-406b-8a7e-9a91b7f0aa9a tempest-VolumesSnapshotTestJSON-2010930921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (424d06fd-478c-477d-81fd-92c89e2b5379) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '301c9eea-6c8d-49b9-82aa-9b185b62ea95', 'volume_name': 'volume-301c9eea-6c8d-49b9-82aa-9b185b62ea95', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:59:02 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-f83644ad-beb8-406b-8a7e-9a91b7f0aa9a tempest-VolumesSnapshotTestJSON-2010930921 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be066ec2-a2be-45b1-80f2-91309167c5ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:59:02 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-f83644ad-beb8-406b-8a7e-9a91b7f0aa9a tempest-VolumesSnapshotTestJSON-2010930921 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be066ec2-a2be-45b1-80f2-91309167c5ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:59:02 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-f83644ad-beb8-406b-8a7e-9a91b7f0aa9a tempest-VolumesSnapshotTestJSON-2010930921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bce330ae-8444-44f6-ac68-7dde3128f1c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:59:02 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-f83644ad-beb8-406b-8a7e-9a91b7f0aa9a tempest-VolumesSnapshotTestJSON-2010930921 None] Volume 301c9eea-6c8d-49b9-82aa-9b185b62ea95: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-301c9eea-6c8d-49b9-82aa-9b185b62ea95', 'volume_size': 1} Jul 13 13:59:02 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-f83644ad-beb8-406b-8a7e-9a91b7f0aa9a tempest-VolumesSnapshotTestJSON-2010930921 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:59:02 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-15f22f19-0dd5-43d3-9857-12de0db492a1 tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 13:59:02 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-15f22f19-0dd5-43d3-9857-12de0db492a1 tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] Flow 'volume_create_manager' (d77b3d42-d2df-454b-a687-809f02fbd91a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 13:59:02 devstack sudo[99007]: pam_unix(sudo:session): session closed for user root Jul 13 13:59:02 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-15f22f19-0dd5-43d3-9857-12de0db492a1 tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (207ce0eb-f7e1-4e0d-b7cd-4cc87c7bb46c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:59:02 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-aac695e6-aac2-4686-a7ed-cb6a77db179d tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-08d03499-dcab-4efc-90ea-2ec26683005b" returned: 0 in 0.434s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:59:02 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-aac695e6-aac2-4686-a7ed-cb6a77db179d tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] <== create_volume: return (1273ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'} {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 13 13:59:02 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-aac695e6-aac2-4686-a7ed-cb6a77db179d tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.276s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:59:03 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-c2f81e0f-dd2c-4af6-beb1-1890042752be tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.165s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:59:03 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-c2f81e0f-dd2c-4af6-beb1-1890042752be tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T11:59:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-209222115',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2cbffa2c-4083-4ca5-b54a-fbad9639f7bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00394ef75ede414796272efe347ea65b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T11:59:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T11:59:01Z,use_quota=True,user_id='465d81cd99ff43da9d129fab824b1778',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1147de8b-623b-426c-a13d-7fc824a80f67),volume_type_id=1147de8b-623b-426c-a13d-7fc824a80f67)}" {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 13 13:59:03 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-c2f81e0f-dd2c-4af6-beb1-1890042752be tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] Creating volume 2cbffa2c-4083-4ca5-b54a-fbad9639f7bb {{(pid=87098) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 13 13:59:03 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-c2f81e0f-dd2c-4af6-beb1-1890042752be tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:59:03 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-c2f81e0f-dd2c-4af6-beb1-1890042752be tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:59:03 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-c2f81e0f-dd2c-4af6-beb1-1890042752be tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 13:59:03 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-c2f81e0f-dd2c-4af6-beb1-1890042752be tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 13:59:03 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-c2f81e0f-dd2c-4af6-beb1-1890042752be tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:59:03 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-c2f81e0f-dd2c-4af6-beb1-1890042752be tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] Selected osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 13:59:03 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-c2f81e0f-dd2c-4af6-beb1-1890042752be tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] casted to osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 Jul 13 13:59:03 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-c2f81e0f-dd2c-4af6-beb1-1890042752be tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-2cbffa2c-4083-4ca5-b54a-fbad9639f7bb 1073741824 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:59:03 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-15f22f19-0dd5-43d3-9857-12de0db492a1 tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (207ce0eb-f7e1-4e0d-b7cd-4cc87c7bb46c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T11:59:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-247932391',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04925fa1-4aba-4a2f-814f-a64015f8ce00,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00394ef75ede414796272efe347ea65b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T11:59:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T11:59:03Z,use_quota=True,user_id='465d81cd99ff43da9d129fab824b1778',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1147de8b-623b-426c-a13d-7fc824a80f67),volume_type_id=1147de8b-623b-426c-a13d-7fc824a80f67)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:59:03 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-15f22f19-0dd5-43d3-9857-12de0db492a1 tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ffc56b99-9adc-4f39-8d37-a357af7be8c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:59:03 devstack sudo[99010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-2cbffa2c-4083-4ca5-b54a-fbad9639f7bb 1073741824 Jul 13 13:59:03 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-15f22f19-0dd5-43d3-9857-12de0db492a1 tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ffc56b99-9adc-4f39-8d37-a357af7be8c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:59:03 devstack sudo[99010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:59:03 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-15f22f19-0dd5-43d3-9857-12de0db492a1 tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (090d6e97-8efd-4cbc-b03e-59495a7ab594) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:59:03 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-15f22f19-0dd5-43d3-9857-12de0db492a1 tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (090d6e97-8efd-4cbc-b03e-59495a7ab594) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '04925fa1-4aba-4a2f-814f-a64015f8ce00', 'volume_name': 'volume-04925fa1-4aba-4a2f-814f-a64015f8ce00', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:59:03 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-15f22f19-0dd5-43d3-9857-12de0db492a1 tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7579ae3-a95a-405f-bacc-ec724d969e43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:59:03 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-15f22f19-0dd5-43d3-9857-12de0db492a1 tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7579ae3-a95a-405f-bacc-ec724d969e43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:59:03 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-15f22f19-0dd5-43d3-9857-12de0db492a1 tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4fbc0abf-b0b3-4b40-8de4-cbc7d6778e03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:59:03 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-15f22f19-0dd5-43d3-9857-12de0db492a1 tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] Volume 04925fa1-4aba-4a2f-814f-a64015f8ce00: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-04925fa1-4aba-4a2f-814f-a64015f8ce00', 'volume_size': 1} Jul 13 13:59:03 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-15f22f19-0dd5-43d3-9857-12de0db492a1 tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:59:03 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-aac695e6-aac2-4686-a7ed-cb6a77db179d tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d70dfb6-37cc-4714-bb60-6d07b5b8b17a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-08d03499-dcab-4efc-90ea-2ec26683005b', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:59:03 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-aac695e6-aac2-4686-a7ed-cb6a77db179d tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c4ab7f0-d795-4632-9923-2b0a84eb34d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:59:03 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-aac695e6-aac2-4686-a7ed-cb6a77db179d tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] Volume volume-08d03499-dcab-4efc-90ea-2ec26683005b (08d03499-dcab-4efc-90ea-2ec26683005b): created successfully Jul 13 13:59:03 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-aac695e6-aac2-4686-a7ed-cb6a77db179d tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c4ab7f0-d795-4632-9923-2b0a84eb34d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:59:03 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-aac695e6-aac2-4686-a7ed-cb6a77db179d tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] Flow 'volume_create_manager' (919f4bcb-2e8b-4a13-aca6-1385cf26b574) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 13:59:03 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-aac695e6-aac2-4686-a7ed-cb6a77db179d tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] Created volume successfully. Jul 13 13:59:03 devstack sudo[99010]: pam_unix(sudo:session): session closed for user root Jul 13 13:59:03 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-c2f81e0f-dd2c-4af6-beb1-1890042752be tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-2cbffa2c-4083-4ca5-b54a-fbad9639f7bb 1073741824" returned: 0 in 0.643s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:59:03 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-c2f81e0f-dd2c-4af6-beb1-1890042752be tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-2cbffa2c-4083-4ca5-b54a-fbad9639f7bb {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:59:03 devstack sudo[99016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-2cbffa2c-4083-4ca5-b54a-fbad9639f7bb Jul 13 13:59:03 devstack sudo[99016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:59:04 devstack sudo[99016]: pam_unix(sudo:session): session closed for user root Jul 13 13:59:04 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-c2f81e0f-dd2c-4af6-beb1-1890042752be tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-2cbffa2c-4083-4ca5-b54a-fbad9639f7bb" returned: 0 in 0.434s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:59:04 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-c2f81e0f-dd2c-4af6-beb1-1890042752be tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] <== create_volume: return (1147ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'} {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 13 13:59:04 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-c2f81e0f-dd2c-4af6-beb1-1890042752be tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.154s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:59:04 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-dc1fe4b3-69ee-4522-bdc9-e003e9263f92 tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.469s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:59:04 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-dc1fe4b3-69ee-4522-bdc9-e003e9263f92 tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T11:59:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1799821485',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6151b4cb-2601-4e86-b5d2-dc7a16e4a8be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00394ef75ede414796272efe347ea65b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T11:59:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T11:59:02Z,use_quota=True,user_id='465d81cd99ff43da9d129fab824b1778',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1147de8b-623b-426c-a13d-7fc824a80f67),volume_type_id=1147de8b-623b-426c-a13d-7fc824a80f67)}" {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 13 13:59:04 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-dc1fe4b3-69ee-4522-bdc9-e003e9263f92 tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] Creating volume 6151b4cb-2601-4e86-b5d2-dc7a16e4a8be {{(pid=87098) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 13 13:59:04 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-dc1fe4b3-69ee-4522-bdc9-e003e9263f92 tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:59:04 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-dc1fe4b3-69ee-4522-bdc9-e003e9263f92 tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:59:04 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-dc1fe4b3-69ee-4522-bdc9-e003e9263f92 tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 13:59:04 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-dc1fe4b3-69ee-4522-bdc9-e003e9263f92 tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 13:59:04 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-dc1fe4b3-69ee-4522-bdc9-e003e9263f92 tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:59:04 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-dc1fe4b3-69ee-4522-bdc9-e003e9263f92 tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] Selected osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 13:59:04 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-dc1fe4b3-69ee-4522-bdc9-e003e9263f92 tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] casted to osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 Jul 13 13:59:04 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-dc1fe4b3-69ee-4522-bdc9-e003e9263f92 tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-6151b4cb-2601-4e86-b5d2-dc7a16e4a8be 1073741824 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:59:04 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-c2f81e0f-dd2c-4af6-beb1-1890042752be tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b93d9977-488b-4f16-8602-57ea0d0486bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2cbffa2c-4083-4ca5-b54a-fbad9639f7bb', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:59:04 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-c2f81e0f-dd2c-4af6-beb1-1890042752be tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5318bcda-c937-45c9-b46f-f59c37e63ed0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:59:04 devstack sudo[99019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-6151b4cb-2601-4e86-b5d2-dc7a16e4a8be 1073741824 Jul 13 13:59:04 devstack sudo[99019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:59:04 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-c2f81e0f-dd2c-4af6-beb1-1890042752be tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] Volume volume-2cbffa2c-4083-4ca5-b54a-fbad9639f7bb (2cbffa2c-4083-4ca5-b54a-fbad9639f7bb): created successfully Jul 13 13:59:04 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-c2f81e0f-dd2c-4af6-beb1-1890042752be tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5318bcda-c937-45c9-b46f-f59c37e63ed0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:59:04 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-c2f81e0f-dd2c-4af6-beb1-1890042752be tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] Flow 'volume_create_manager' (daf49b2c-5ccd-4865-8be3-4b2d50deadfe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 13:59:04 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-c2f81e0f-dd2c-4af6-beb1-1890042752be tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] Created volume successfully. Jul 13 13:59:04 devstack sudo[99019]: pam_unix(sudo:session): session closed for user root Jul 13 13:59:04 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-dc1fe4b3-69ee-4522-bdc9-e003e9263f92 tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-6151b4cb-2601-4e86-b5d2-dc7a16e4a8be 1073741824" returned: 0 in 0.566s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:59:04 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-dc1fe4b3-69ee-4522-bdc9-e003e9263f92 tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-6151b4cb-2601-4e86-b5d2-dc7a16e4a8be {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:59:04 devstack sudo[99025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-6151b4cb-2601-4e86-b5d2-dc7a16e4a8be Jul 13 13:59:04 devstack sudo[99025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:59:05 devstack sudo[99025]: pam_unix(sudo:session): session closed for user root Jul 13 13:59:05 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-dc1fe4b3-69ee-4522-bdc9-e003e9263f92 tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-6151b4cb-2601-4e86-b5d2-dc7a16e4a8be" returned: 0 in 0.282s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:59:05 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-dc1fe4b3-69ee-4522-bdc9-e003e9263f92 tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] <== create_volume: return (907ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'} {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 13 13:59:05 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-dc1fe4b3-69ee-4522-bdc9-e003e9263f92 tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.913s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:59:05 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-f83644ad-beb8-406b-8a7e-9a91b7f0aa9a tempest-VolumesSnapshotTestJSON-2010930921 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.185s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:59:05 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-f83644ad-beb8-406b-8a7e-9a91b7f0aa9a tempest-VolumesSnapshotTestJSON-2010930921 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T11:59:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-570935192',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=301c9eea-6c8d-49b9-82aa-9b185b62ea95,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8897ab25feb4d999872fbe658460fa6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T11:59:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T11:59:03Z,use_quota=True,user_id='a6f445ef8dc04c7b92c04febd3515b27',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1147de8b-623b-426c-a13d-7fc824a80f67),volume_type_id=1147de8b-623b-426c-a13d-7fc824a80f67)}" {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 13 13:59:05 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-f83644ad-beb8-406b-8a7e-9a91b7f0aa9a tempest-VolumesSnapshotTestJSON-2010930921 None] Creating volume 301c9eea-6c8d-49b9-82aa-9b185b62ea95 {{(pid=87098) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 13 13:59:05 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-f83644ad-beb8-406b-8a7e-9a91b7f0aa9a tempest-VolumesSnapshotTestJSON-2010930921 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:59:05 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-f83644ad-beb8-406b-8a7e-9a91b7f0aa9a tempest-VolumesSnapshotTestJSON-2010930921 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:59:05 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-f83644ad-beb8-406b-8a7e-9a91b7f0aa9a tempest-VolumesSnapshotTestJSON-2010930921 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 13:59:05 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-f83644ad-beb8-406b-8a7e-9a91b7f0aa9a tempest-VolumesSnapshotTestJSON-2010930921 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 13:59:05 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-f83644ad-beb8-406b-8a7e-9a91b7f0aa9a tempest-VolumesSnapshotTestJSON-2010930921 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:59:05 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-f83644ad-beb8-406b-8a7e-9a91b7f0aa9a tempest-VolumesSnapshotTestJSON-2010930921 None] Selected osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 13:59:05 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-f83644ad-beb8-406b-8a7e-9a91b7f0aa9a tempest-VolumesSnapshotTestJSON-2010930921 None] casted to osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 Jul 13 13:59:05 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-f83644ad-beb8-406b-8a7e-9a91b7f0aa9a tempest-VolumesSnapshotTestJSON-2010930921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-301c9eea-6c8d-49b9-82aa-9b185b62ea95 1073741824 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:59:05 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-dc1fe4b3-69ee-4522-bdc9-e003e9263f92 tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35562d16-444d-4a46-b38f-c43b18c08388) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6151b4cb-2601-4e86-b5d2-dc7a16e4a8be', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:59:05 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-dc1fe4b3-69ee-4522-bdc9-e003e9263f92 tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b75f85c-6868-4821-86eb-1a5d0c84d441) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:59:05 devstack sudo[99028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-301c9eea-6c8d-49b9-82aa-9b185b62ea95 1073741824 Jul 13 13:59:05 devstack sudo[99028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:59:05 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-dc1fe4b3-69ee-4522-bdc9-e003e9263f92 tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] Volume volume-6151b4cb-2601-4e86-b5d2-dc7a16e4a8be (6151b4cb-2601-4e86-b5d2-dc7a16e4a8be): created successfully Jul 13 13:59:05 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-dc1fe4b3-69ee-4522-bdc9-e003e9263f92 tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b75f85c-6868-4821-86eb-1a5d0c84d441) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:59:05 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-dc1fe4b3-69ee-4522-bdc9-e003e9263f92 tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] Flow 'volume_create_manager' (c47162f1-27f2-44cc-b27e-ca07b489742e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 13:59:05 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-dc1fe4b3-69ee-4522-bdc9-e003e9263f92 tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] Created volume successfully. Jul 13 13:59:05 devstack sudo[99028]: pam_unix(sudo:session): session closed for user root Jul 13 13:59:05 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-f83644ad-beb8-406b-8a7e-9a91b7f0aa9a tempest-VolumesSnapshotTestJSON-2010930921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-301c9eea-6c8d-49b9-82aa-9b185b62ea95 1073741824" returned: 0 in 0.629s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:59:05 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-f83644ad-beb8-406b-8a7e-9a91b7f0aa9a tempest-VolumesSnapshotTestJSON-2010930921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-301c9eea-6c8d-49b9-82aa-9b185b62ea95 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:59:05 devstack sudo[99035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-301c9eea-6c8d-49b9-82aa-9b185b62ea95 Jul 13 13:59:05 devstack sudo[99035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:59:06 devstack sudo[99035]: pam_unix(sudo:session): session closed for user root Jul 13 13:59:06 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-f83644ad-beb8-406b-8a7e-9a91b7f0aa9a tempest-VolumesSnapshotTestJSON-2010930921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-301c9eea-6c8d-49b9-82aa-9b185b62ea95" returned: 0 in 0.294s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:59:06 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-f83644ad-beb8-406b-8a7e-9a91b7f0aa9a tempest-VolumesSnapshotTestJSON-2010930921 None] <== create_volume: return (986ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'} {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 13 13:59:06 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-f83644ad-beb8-406b-8a7e-9a91b7f0aa9a tempest-VolumesSnapshotTestJSON-2010930921 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.990s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:59:06 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-15f22f19-0dd5-43d3-9857-12de0db492a1 tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:59:06 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-15f22f19-0dd5-43d3-9857-12de0db492a1 tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T11:59:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-247932391',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04925fa1-4aba-4a2f-814f-a64015f8ce00,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00394ef75ede414796272efe347ea65b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T11:59:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T11:59:03Z,use_quota=True,user_id='465d81cd99ff43da9d129fab824b1778',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1147de8b-623b-426c-a13d-7fc824a80f67),volume_type_id=1147de8b-623b-426c-a13d-7fc824a80f67)}" {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 13 13:59:06 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-15f22f19-0dd5-43d3-9857-12de0db492a1 tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] Creating volume 04925fa1-4aba-4a2f-814f-a64015f8ce00 {{(pid=87098) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 13 13:59:06 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-15f22f19-0dd5-43d3-9857-12de0db492a1 tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:59:06 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-15f22f19-0dd5-43d3-9857-12de0db492a1 tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:59:06 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-15f22f19-0dd5-43d3-9857-12de0db492a1 tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 13:59:06 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-15f22f19-0dd5-43d3-9857-12de0db492a1 tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 13:59:06 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-15f22f19-0dd5-43d3-9857-12de0db492a1 tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:59:06 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-15f22f19-0dd5-43d3-9857-12de0db492a1 tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] Selected osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 13:59:06 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-15f22f19-0dd5-43d3-9857-12de0db492a1 tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] casted to osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 Jul 13 13:59:06 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-15f22f19-0dd5-43d3-9857-12de0db492a1 tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-04925fa1-4aba-4a2f-814f-a64015f8ce00 1073741824 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:59:06 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-f83644ad-beb8-406b-8a7e-9a91b7f0aa9a tempest-VolumesSnapshotTestJSON-2010930921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bce330ae-8444-44f6-ac68-7dde3128f1c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-301c9eea-6c8d-49b9-82aa-9b185b62ea95', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:59:06 devstack sudo[99038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-04925fa1-4aba-4a2f-814f-a64015f8ce00 1073741824 Jul 13 13:59:06 devstack sudo[99038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:59:06 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-f83644ad-beb8-406b-8a7e-9a91b7f0aa9a tempest-VolumesSnapshotTestJSON-2010930921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3418939-7132-4d31-89a3-259aa3362299) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:59:06 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-f83644ad-beb8-406b-8a7e-9a91b7f0aa9a tempest-VolumesSnapshotTestJSON-2010930921 None] Volume volume-301c9eea-6c8d-49b9-82aa-9b185b62ea95 (301c9eea-6c8d-49b9-82aa-9b185b62ea95): created successfully Jul 13 13:59:06 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-f83644ad-beb8-406b-8a7e-9a91b7f0aa9a tempest-VolumesSnapshotTestJSON-2010930921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3418939-7132-4d31-89a3-259aa3362299) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:59:06 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-f83644ad-beb8-406b-8a7e-9a91b7f0aa9a tempest-VolumesSnapshotTestJSON-2010930921 None] Flow 'volume_create_manager' (3c225142-525c-4a66-835a-865f5de08cd9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 13:59:06 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-f83644ad-beb8-406b-8a7e-9a91b7f0aa9a tempest-VolumesSnapshotTestJSON-2010930921 None] Created volume successfully. Jul 13 13:59:06 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-4635b967-f79d-4e7b-b96c-7eb072dbce24 tempest-VolumesSnapshotTestJSON-2010930921 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:59:06 devstack sudo[99038]: pam_unix(sudo:session): session closed for user root Jul 13 13:59:06 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-15f22f19-0dd5-43d3-9857-12de0db492a1 tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-04925fa1-4aba-4a2f-814f-a64015f8ce00 1073741824" returned: 0 in 0.680s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:59:06 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-15f22f19-0dd5-43d3-9857-12de0db492a1 tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-04925fa1-4aba-4a2f-814f-a64015f8ce00 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:59:06 devstack sudo[99045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-04925fa1-4aba-4a2f-814f-a64015f8ce00 Jul 13 13:59:06 devstack sudo[99045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:59:07 devstack sudo[99045]: pam_unix(sudo:session): session closed for user root Jul 13 13:59:07 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-15f22f19-0dd5-43d3-9857-12de0db492a1 tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-04925fa1-4aba-4a2f-814f-a64015f8ce00" returned: 0 in 0.320s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:59:07 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-15f22f19-0dd5-43d3-9857-12de0db492a1 tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] <== create_volume: return (1059ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'} {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 13 13:59:07 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-15f22f19-0dd5-43d3-9857-12de0db492a1 tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.063s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:59:07 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-4635b967-f79d-4e7b-b96c-7eb072dbce24 tempest-VolumesSnapshotTestJSON-2010930921 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.420s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:59:07 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-15f22f19-0dd5-43d3-9857-12de0db492a1 tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4fbc0abf-b0b3-4b40-8de4-cbc7d6778e03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-04925fa1-4aba-4a2f-814f-a64015f8ce00', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:59:07 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-15f22f19-0dd5-43d3-9857-12de0db492a1 tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee37ae76-5663-4466-952e-6571130b4912) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:59:07 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-4635b967-f79d-4e7b-b96c-7eb072dbce24 tempest-VolumesSnapshotTestJSON-2010930921 None] Creating offline snapshot 293b2940-82c9-44f3-b789-981fd7e92936 of volume 301c9eea-6c8d-49b9-82aa-9b185b62ea95 {{(pid=87098) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 13 13:59:07 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-15f22f19-0dd5-43d3-9857-12de0db492a1 tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] Volume volume-04925fa1-4aba-4a2f-814f-a64015f8ce00 (04925fa1-4aba-4a2f-814f-a64015f8ce00): created successfully Jul 13 13:59:07 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-15f22f19-0dd5-43d3-9857-12de0db492a1 tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee37ae76-5663-4466-952e-6571130b4912) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:59:07 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-15f22f19-0dd5-43d3-9857-12de0db492a1 tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] Flow 'volume_create_manager' (d77b3d42-d2df-454b-a687-809f02fbd91a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 13:59:07 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[130c35d3-b210-4c58-96a1-09a9e9865340]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 13:59:07 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-4635b967-f79d-4e7b-b96c-7eb072dbce24 tempest-VolumesSnapshotTestJSON-2010930921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-301c9eea-6c8d-49b9-82aa-9b185b62ea95 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:59:07 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-15f22f19-0dd5-43d3-9857-12de0db492a1 tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] Created volume successfully. Jul 13 13:59:07 devstack sudo[99048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-301c9eea-6c8d-49b9-82aa-9b185b62ea95 Jul 13 13:59:07 devstack sudo[99048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:59:07 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-384cf7a7-9109-404a-93ee-60d82b759fef tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] Acquiring lock "cinder-04925fa1-4aba-4a2f-814f-a64015f8ce00-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 13:59:07 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-384cf7a7-9109-404a-93ee-60d82b759fef tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] Lock "cinder-04925fa1-4aba-4a2f-814f-a64015f8ce00-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 13:59:07 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-384cf7a7-9109-404a-93ee-60d82b759fef tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] Acquiring lock "cinder-quobyte-04925fa1-4aba-4a2f-814f-a64015f8ce00" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 13:59:07 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-384cf7a7-9109-404a-93ee-60d82b759fef tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] Lock "cinder-quobyte-04925fa1-4aba-4a2f-814f-a64015f8ce00" acquired by "delete_volume" :: waited 0.018s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 13:59:07 devstack sudo[99048]: pam_unix(sudo:session): session closed for user root Jul 13 13:59:07 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-4635b967-f79d-4e7b-b96c-7eb072dbce24 tempest-VolumesSnapshotTestJSON-2010930921 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-301c9eea-6c8d-49b9-82aa-9b185b62ea95" returned: 0 in 0.540s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:59:07 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-4635b967-f79d-4e7b-b96c-7eb072dbce24 tempest-VolumesSnapshotTestJSON-2010930921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-301c9eea-6c8d-49b9-82aa-9b185b62ea95,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-301c9eea-6c8d-49b9-82aa-9b185b62ea95.293b2940-82c9-44f3-b789-981fd7e92936 1G {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:59:07 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[af5ca054-db1d-480e-b2df-d7d5d8c39b27]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 13:59:07 devstack sudo[99053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-301c9eea-6c8d-49b9-82aa-9b185b62ea95,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-301c9eea-6c8d-49b9-82aa-9b185b62ea95.293b2940-82c9-44f3-b789-981fd7e92936 1G Jul 13 13:59:07 devstack sudo[99053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:59:07 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-384cf7a7-9109-404a-93ee-60d82b759fef tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-04925fa1-4aba-4a2f-814f-a64015f8ce00 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:59:07 devstack sudo[99055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-04925fa1-4aba-4a2f-814f-a64015f8ce00 Jul 13 13:59:07 devstack sudo[99055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:59:08 devstack sudo[99053]: pam_unix(sudo:session): session closed for user root Jul 13 13:59:08 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-4635b967-f79d-4e7b-b96c-7eb072dbce24 tempest-VolumesSnapshotTestJSON-2010930921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-301c9eea-6c8d-49b9-82aa-9b185b62ea95,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-301c9eea-6c8d-49b9-82aa-9b185b62ea95.293b2940-82c9-44f3-b789-981fd7e92936 1G" returned: 0 in 0.473s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:59:08 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-4635b967-f79d-4e7b-b96c-7eb072dbce24 tempest-VolumesSnapshotTestJSON-2010930921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-301c9eea-6c8d-49b9-82aa-9b185b62ea95 -F qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-301c9eea-6c8d-49b9-82aa-9b185b62ea95.293b2940-82c9-44f3-b789-981fd7e92936 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:59:08 devstack sudo[99063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-301c9eea-6c8d-49b9-82aa-9b185b62ea95 -F qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-301c9eea-6c8d-49b9-82aa-9b185b62ea95.293b2940-82c9-44f3-b789-981fd7e92936 Jul 13 13:59:08 devstack sudo[99063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:59:08 devstack sudo[99055]: pam_unix(sudo:session): session closed for user root Jul 13 13:59:08 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-384cf7a7-9109-404a-93ee-60d82b759fef tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-04925fa1-4aba-4a2f-814f-a64015f8ce00" returned: 0 in 0.540s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:59:08 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-384cf7a7-9109-404a-93ee-60d82b759fef tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-04925fa1-4aba-4a2f-814f-a64015f8ce00 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:59:08 devstack sudo[99066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-04925fa1-4aba-4a2f-814f-a64015f8ce00 Jul 13 13:59:08 devstack sudo[99066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:59:08 devstack sudo[99066]: pam_unix(sudo:session): session closed for user root Jul 13 13:59:08 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-384cf7a7-9109-404a-93ee-60d82b759fef tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-04925fa1-4aba-4a2f-814f-a64015f8ce00" returned: 0 in 0.314s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:59:08 devstack sudo[99063]: pam_unix(sudo:session): session closed for user root Jul 13 13:59:08 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-384cf7a7-9109-404a-93ee-60d82b759fef tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] Lock "cinder-quobyte-04925fa1-4aba-4a2f-814f-a64015f8ce00" released by "delete_volume" :: held 0.924s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 13:59:08 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-4635b967-f79d-4e7b-b96c-7eb072dbce24 tempest-VolumesSnapshotTestJSON-2010930921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-301c9eea-6c8d-49b9-82aa-9b185b62ea95 -F qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-301c9eea-6c8d-49b9-82aa-9b185b62ea95.293b2940-82c9-44f3-b789-981fd7e92936" returned: 0 in 0.440s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:59:08 devstack cinder-volume[87098]: WARNING cinder.volume.drivers.remotefs [None req-4635b967-f79d-4e7b-b96c-7eb072dbce24 tempest-VolumesSnapshotTestJSON-2010930921 None] /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-301c9eea-6c8d-49b9-82aa-9b185b62ea95.293b2940-82c9-44f3-b789-981fd7e92936 is being set with open permissions: ugo+rw Jul 13 13:59:08 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-4635b967-f79d-4e7b-b96c-7eb072dbce24 tempest-VolumesSnapshotTestJSON-2010930921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-301c9eea-6c8d-49b9-82aa-9b185b62ea95.293b2940-82c9-44f3-b789-981fd7e92936 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:59:08 devstack sudo[99106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-301c9eea-6c8d-49b9-82aa-9b185b62ea95.293b2940-82c9-44f3-b789-981fd7e92936 Jul 13 13:59:08 devstack sudo[99106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:59:08 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-384cf7a7-9109-404a-93ee-60d82b759fef tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] Created reservations ['bfb84ce1-ac7e-4d97-a2d3-14f2523e1bc3', '23d8ddd2-b04b-4d4d-bfb8-f2908817c18b', 'cbcb656e-2e43-4fb8-ba2a-9aeeac945f33', '2eef34fc-8c57-4a3b-b3e9-ea6d670598f8'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 13:59:08 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-384cf7a7-9109-404a-93ee-60d82b759fef tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:59:08 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-384cf7a7-9109-404a-93ee-60d82b759fef tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:59:08 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-384cf7a7-9109-404a-93ee-60d82b759fef tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 13:59:08 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-384cf7a7-9109-404a-93ee-60d82b759fef tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 13:59:08 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-384cf7a7-9109-404a-93ee-60d82b759fef tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:59:08 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-384cf7a7-9109-404a-93ee-60d82b759fef tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:59:09 devstack sudo[99110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 Jul 13 13:59:09 devstack sudo[99110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:59:09 devstack sudo[99106]: pam_unix(sudo:session): session closed for user root Jul 13 13:59:09 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-4635b967-f79d-4e7b-b96c-7eb072dbce24 tempest-VolumesSnapshotTestJSON-2010930921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-301c9eea-6c8d-49b9-82aa-9b185b62ea95.293b2940-82c9-44f3-b789-981fd7e92936" returned: 0 in 0.396s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:59:09 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-4635b967-f79d-4e7b-b96c-7eb072dbce24 tempest-VolumesSnapshotTestJSON-2010930921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-301c9eea-6c8d-49b9-82aa-9b185b62ea95.info {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:59:09 devstack sudo[99113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-301c9eea-6c8d-49b9-82aa-9b185b62ea95.info Jul 13 13:59:09 devstack sudo[99113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:59:09 devstack sudo[99110]: pam_unix(sudo:session): session closed for user root Jul 13 13:59:09 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-384cf7a7-9109-404a-93ee-60d82b759fef tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78" returned: 0 in 0.315s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:59:09 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-384cf7a7-9109-404a-93ee-60d82b759fef tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 13:59:09 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-384cf7a7-9109-404a-93ee-60d82b759fef tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] Deleted volume successfully. Jul 13 13:59:09 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-384cf7a7-9109-404a-93ee-60d82b759fef tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] Lock "cinder-04925fa1-4aba-4a2f-814f-a64015f8ce00-delete_volume" released by "delete_volume" :: held 1.670s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 13:59:09 devstack sudo[99113]: pam_unix(sudo:session): session closed for user root Jul 13 13:59:09 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-4635b967-f79d-4e7b-b96c-7eb072dbce24 tempest-VolumesSnapshotTestJSON-2010930921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-301c9eea-6c8d-49b9-82aa-9b185b62ea95.info" returned: 0 in 0.354s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:59:09 devstack cinder-volume[87098]: WARNING cinder.volume.drivers.remotefs [None req-4635b967-f79d-4e7b-b96c-7eb072dbce24 tempest-VolumesSnapshotTestJSON-2010930921 None] /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-301c9eea-6c8d-49b9-82aa-9b185b62ea95.info is being set with open permissions: ugo+rw Jul 13 13:59:09 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-4635b967-f79d-4e7b-b96c-7eb072dbce24 tempest-VolumesSnapshotTestJSON-2010930921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-301c9eea-6c8d-49b9-82aa-9b185b62ea95.info {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:59:09 devstack sudo[99117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-301c9eea-6c8d-49b9-82aa-9b185b62ea95.info Jul 13 13:59:09 devstack sudo[99117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:59:09 devstack sudo[99117]: pam_unix(sudo:session): session closed for user root Jul 13 13:59:09 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-4635b967-f79d-4e7b-b96c-7eb072dbce24 tempest-VolumesSnapshotTestJSON-2010930921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-301c9eea-6c8d-49b9-82aa-9b185b62ea95.info" returned: 0 in 0.302s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:59:09 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-4635b967-f79d-4e7b-b96c-7eb072dbce24 tempest-VolumesSnapshotTestJSON-2010930921 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.659s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:59:09 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-4635b967-f79d-4e7b-b96c-7eb072dbce24 tempest-VolumesSnapshotTestJSON-2010930921 None] Create snapshot completed successfully Jul 13 13:59:09 devstack cinder-volume[87098]: DEBUG dbcounter [-] [87098] Writing DB stats cinder:SELECT=182,cinder:UPDATE=223,cinder:DELETE=18,cinder:INSERT=48 {{(pid=87098) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 13 13:59:09 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-175c475f-35e2-4e6c-9287-1ed864ec7231 tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] Acquiring lock "cinder-6151b4cb-2601-4e86-b5d2-dc7a16e4a8be-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 13:59:10 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-175c475f-35e2-4e6c-9287-1ed864ec7231 tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] Lock "cinder-6151b4cb-2601-4e86-b5d2-dc7a16e4a8be-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 13:59:10 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-175c475f-35e2-4e6c-9287-1ed864ec7231 tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] Acquiring lock "cinder-quobyte-6151b4cb-2601-4e86-b5d2-dc7a16e4a8be" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 13:59:10 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-175c475f-35e2-4e6c-9287-1ed864ec7231 tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] Lock "cinder-quobyte-6151b4cb-2601-4e86-b5d2-dc7a16e4a8be" acquired by "delete_volume" :: waited 0.028s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 13:59:10 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[24691081-03fe-4a22-a59e-76ab252a2358]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 13:59:10 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-175c475f-35e2-4e6c-9287-1ed864ec7231 tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-6151b4cb-2601-4e86-b5d2-dc7a16e4a8be {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:59:10 devstack sudo[99120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-6151b4cb-2601-4e86-b5d2-dc7a16e4a8be Jul 13 13:59:10 devstack sudo[99120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:59:10 devstack sudo[99120]: pam_unix(sudo:session): session closed for user root Jul 13 13:59:10 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-175c475f-35e2-4e6c-9287-1ed864ec7231 tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-6151b4cb-2601-4e86-b5d2-dc7a16e4a8be" returned: 0 in 0.471s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:59:10 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-175c475f-35e2-4e6c-9287-1ed864ec7231 tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-6151b4cb-2601-4e86-b5d2-dc7a16e4a8be {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:59:10 devstack sudo[99127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-6151b4cb-2601-4e86-b5d2-dc7a16e4a8be Jul 13 13:59:10 devstack sudo[99127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:59:10 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-c8828d9c-d350-4f99-b2dd-c56d08823296 tempest-VolumesSnapshotTestJSON-2010930921 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 13:59:10 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-c8828d9c-d350-4f99-b2dd-c56d08823296 tempest-VolumesSnapshotTestJSON-2010930921 None] Flow 'volume_create_manager' (03f829df-04b7-4911-9ebd-b0bb143811bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 13:59:10 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-c8828d9c-d350-4f99-b2dd-c56d08823296 tempest-VolumesSnapshotTestJSON-2010930921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca616290-b3e2-4a21-937d-5f184c865992) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:59:10 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-c8828d9c-d350-4f99-b2dd-c56d08823296 tempest-VolumesSnapshotTestJSON-2010930921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca616290-b3e2-4a21-937d-5f184c865992) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T11:59:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1829338734',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2802eb6-59f1-4a07-bf00-429ae67c3c68,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8897ab25feb4d999872fbe658460fa6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T11:59:11Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=293b2940-82c9-44f3-b789-981fd7e92936,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T11:59:11Z,use_quota=True,user_id='a6f445ef8dc04c7b92c04febd3515b27',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1147de8b-623b-426c-a13d-7fc824a80f67),volume_type_id=1147de8b-623b-426c-a13d-7fc824a80f67)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:59:10 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-c8828d9c-d350-4f99-b2dd-c56d08823296 tempest-VolumesSnapshotTestJSON-2010930921 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1eb733e-37f1-4803-b5f0-c6bd78056128) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:59:10 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-c8828d9c-d350-4f99-b2dd-c56d08823296 tempest-VolumesSnapshotTestJSON-2010930921 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1eb733e-37f1-4803-b5f0-c6bd78056128) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:59:10 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-c8828d9c-d350-4f99-b2dd-c56d08823296 tempest-VolumesSnapshotTestJSON-2010930921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ff7180a-682b-41c7-9fef-6e208e440cd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:59:10 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-c8828d9c-d350-4f99-b2dd-c56d08823296 tempest-VolumesSnapshotTestJSON-2010930921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ff7180a-682b-41c7-9fef-6e208e440cd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'e2802eb6-59f1-4a07-bf00-429ae67c3c68', 'volume_name': 'volume-e2802eb6-59f1-4a07-bf00-429ae67c3c68', 'volume_size': 2, 'snapshot_id': '293b2940-82c9-44f3-b789-981fd7e92936'}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:59:10 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-c8828d9c-d350-4f99-b2dd-c56d08823296 tempest-VolumesSnapshotTestJSON-2010930921 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c908135-3183-43df-a236-fd287170d00c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:59:10 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-c8828d9c-d350-4f99-b2dd-c56d08823296 tempest-VolumesSnapshotTestJSON-2010930921 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c908135-3183-43df-a236-fd287170d00c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:59:10 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-c8828d9c-d350-4f99-b2dd-c56d08823296 tempest-VolumesSnapshotTestJSON-2010930921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63fe97a5-ec6d-48fa-88c6-d71588107081) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:59:10 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-c8828d9c-d350-4f99-b2dd-c56d08823296 tempest-VolumesSnapshotTestJSON-2010930921 None] Volume e2802eb6-59f1-4a07-bf00-429ae67c3c68: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-e2802eb6-59f1-4a07-bf00-429ae67c3c68', 'volume_size': 2, 'snapshot_id': '293b2940-82c9-44f3-b789-981fd7e92936'} Jul 13 13:59:10 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-c8828d9c-d350-4f99-b2dd-c56d08823296 tempest-VolumesSnapshotTestJSON-2010930921 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:59:10 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-c8828d9c-d350-4f99-b2dd-c56d08823296 tempest-VolumesSnapshotTestJSON-2010930921 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.002s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:59:10 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-c8828d9c-d350-4f99-b2dd-c56d08823296 tempest-VolumesSnapshotTestJSON-2010930921 None] Acquiring lock "cinder-quobyte-293b2940-82c9-44f3-b789-981fd7e92936-e2802eb6-59f1-4a07-bf00-429ae67c3c68" by "_create_volume_from_snapshot" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 13:59:10 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-c8828d9c-d350-4f99-b2dd-c56d08823296 tempest-VolumesSnapshotTestJSON-2010930921 None] Lock "cinder-quobyte-293b2940-82c9-44f3-b789-981fd7e92936-e2802eb6-59f1-4a07-bf00-429ae67c3c68" acquired by "_create_volume_from_snapshot" :: waited 0.025s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 13:59:10 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-c8828d9c-d350-4f99-b2dd-c56d08823296 tempest-VolumesSnapshotTestJSON-2010930921 None] Creating volume e2802eb6-59f1-4a07-bf00-429ae67c3c68 from snapshot 293b2940-82c9-44f3-b789-981fd7e92936 {{(pid=87098) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 13 13:59:10 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-c8828d9c-d350-4f99-b2dd-c56d08823296 tempest-VolumesSnapshotTestJSON-2010930921 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:59:10 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-c8828d9c-d350-4f99-b2dd-c56d08823296 tempest-VolumesSnapshotTestJSON-2010930921 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:59:10 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-c8828d9c-d350-4f99-b2dd-c56d08823296 tempest-VolumesSnapshotTestJSON-2010930921 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 13:59:10 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-c8828d9c-d350-4f99-b2dd-c56d08823296 tempest-VolumesSnapshotTestJSON-2010930921 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 13:59:10 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-c8828d9c-d350-4f99-b2dd-c56d08823296 tempest-VolumesSnapshotTestJSON-2010930921 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:59:10 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-c8828d9c-d350-4f99-b2dd-c56d08823296 tempest-VolumesSnapshotTestJSON-2010930921 None] Selected osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 13:59:10 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-c8828d9c-d350-4f99-b2dd-c56d08823296 tempest-VolumesSnapshotTestJSON-2010930921 None] Acquiring lock "cinder-quobyte-e2802eb6-59f1-4a07-bf00-429ae67c3c68" by "_copy_volume_from_snapshot" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 13:59:10 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-c8828d9c-d350-4f99-b2dd-c56d08823296 tempest-VolumesSnapshotTestJSON-2010930921 None] Lock "cinder-quobyte-e2802eb6-59f1-4a07-bf00-429ae67c3c68" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 13:59:10 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-c8828d9c-d350-4f99-b2dd-c56d08823296 tempest-VolumesSnapshotTestJSON-2010930921 None] snapshot: 293b2940-82c9-44f3-b789-981fd7e92936, volume: e2802eb6-59f1-4a07-bf00-429ae67c3c68, {{(pid=87098) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 13 13:59:11 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-c8828d9c-d350-4f99-b2dd-c56d08823296 tempest-VolumesSnapshotTestJSON-2010930921 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:59:11 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-c8828d9c-d350-4f99-b2dd-c56d08823296 tempest-VolumesSnapshotTestJSON-2010930921 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:59:11 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-c8828d9c-d350-4f99-b2dd-c56d08823296 tempest-VolumesSnapshotTestJSON-2010930921 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 13:59:11 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-c8828d9c-d350-4f99-b2dd-c56d08823296 tempest-VolumesSnapshotTestJSON-2010930921 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 13:59:11 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-c8828d9c-d350-4f99-b2dd-c56d08823296 tempest-VolumesSnapshotTestJSON-2010930921 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:59:11 devstack sudo[99127]: pam_unix(sudo:session): session closed for user root Jul 13 13:59:11 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-175c475f-35e2-4e6c-9287-1ed864ec7231 tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-6151b4cb-2601-4e86-b5d2-dc7a16e4a8be" returned: 0 in 0.481s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:59:11 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[02b01675-0c23-4723-a48e-867a5532054f]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 13:59:11 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-175c475f-35e2-4e6c-9287-1ed864ec7231 tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] Lock "cinder-quobyte-6151b4cb-2601-4e86-b5d2-dc7a16e4a8be" released by "delete_volume" :: held 1.007s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 13:59:11 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-c8828d9c-d350-4f99-b2dd-c56d08823296 tempest-VolumesSnapshotTestJSON-2010930921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-301c9eea-6c8d-49b9-82aa-9b185b62ea95.293b2940-82c9-44f3-b789-981fd7e92936 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:59:11 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-175c475f-35e2-4e6c-9287-1ed864ec7231 tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] Created reservations ['788883a4-ee85-4630-8b54-d1972b29bfaf', '16326524-9ca0-4d49-9f5f-aa081dad99f4', '2a26a807-f1c6-48ee-b74e-135ac4b4d235', '30a5f2e8-567b-44b4-b662-f60fa1471f26'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 13:59:11 devstack sudo[99130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-301c9eea-6c8d-49b9-82aa-9b185b62ea95.293b2940-82c9-44f3-b789-981fd7e92936 Jul 13 13:59:11 devstack sudo[99130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:59:11 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-175c475f-35e2-4e6c-9287-1ed864ec7231 tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:59:11 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-175c475f-35e2-4e6c-9287-1ed864ec7231 tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:59:11 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-175c475f-35e2-4e6c-9287-1ed864ec7231 tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 13:59:11 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-175c475f-35e2-4e6c-9287-1ed864ec7231 tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 13:59:11 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-175c475f-35e2-4e6c-9287-1ed864ec7231 tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:59:11 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-175c475f-35e2-4e6c-9287-1ed864ec7231 tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:59:11 devstack sudo[99132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 Jul 13 13:59:11 devstack sudo[99132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:59:11 devstack sudo[99130]: pam_unix(sudo:session): session closed for user root Jul 13 13:59:11 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-c8828d9c-d350-4f99-b2dd-c56d08823296 tempest-VolumesSnapshotTestJSON-2010930921 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-301c9eea-6c8d-49b9-82aa-9b185b62ea95.293b2940-82c9-44f3-b789-981fd7e92936" returned: 0 in 0.539s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:59:11 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-c8828d9c-d350-4f99-b2dd-c56d08823296 tempest-VolumesSnapshotTestJSON-2010930921 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-301c9eea-6c8d-49b9-82aa-9b185b62ea95(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87098) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 13 13:59:11 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-c8828d9c-d350-4f99-b2dd-c56d08823296 tempest-VolumesSnapshotTestJSON-2010930921 None] will copy from snapshot at /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-301c9eea-6c8d-49b9-82aa-9b185b62ea95 {{(pid=87098) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 13 13:59:11 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-c8828d9c-d350-4f99-b2dd-c56d08823296 tempest-VolumesSnapshotTestJSON-2010930921 None] Creating direct copy from snapshot {{(pid=87098) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 13 13:59:11 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e48573c-a69e-45c7-99df-42eaef0267ee]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 13:59:11 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-c8828d9c-d350-4f99-b2dd-c56d08823296 tempest-VolumesSnapshotTestJSON-2010930921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-301c9eea-6c8d-49b9-82aa-9b185b62ea95 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:59:11 devstack sudo[99132]: pam_unix(sudo:session): session closed for user root Jul 13 13:59:11 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-175c475f-35e2-4e6c-9287-1ed864ec7231 tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78" returned: 0 in 0.322s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:59:11 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-175c475f-35e2-4e6c-9287-1ed864ec7231 tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 13:59:11 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-175c475f-35e2-4e6c-9287-1ed864ec7231 tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] Deleted volume successfully. Jul 13 13:59:11 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-175c475f-35e2-4e6c-9287-1ed864ec7231 tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] Lock "cinder-6151b4cb-2601-4e86-b5d2-dc7a16e4a8be-delete_volume" released by "delete_volume" :: held 1.728s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 13:59:11 devstack sudo[99139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-301c9eea-6c8d-49b9-82aa-9b185b62ea95 Jul 13 13:59:11 devstack sudo[99139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:59:12 devstack sudo[99139]: pam_unix(sudo:session): session closed for user root Jul 13 13:59:12 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-c8828d9c-d350-4f99-b2dd-c56d08823296 tempest-VolumesSnapshotTestJSON-2010930921 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-301c9eea-6c8d-49b9-82aa-9b185b62ea95" returned: 0 in 0.475s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:59:12 devstack cinder-volume[87098]: DEBUG cinder.utils [None req-c8828d9c-d350-4f99-b2dd-c56d08823296 tempest-VolumesSnapshotTestJSON-2010930921 None] Path /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-e2802eb6-59f1-4a07-bf00-429ae67c3c68 not found in is_blk_device check {{(pid=87098) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 13 13:59:12 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-c8828d9c-d350-4f99-b2dd-c56d08823296 tempest-VolumesSnapshotTestJSON-2010930921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-301c9eea-6c8d-49b9-82aa-9b185b62ea95 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-e2802eb6-59f1-4a07-bf00-429ae67c3c68 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:59:12 devstack sudo[99144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-301c9eea-6c8d-49b9-82aa-9b185b62ea95 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-e2802eb6-59f1-4a07-bf00-429ae67c3c68 Jul 13 13:59:12 devstack sudo[99144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:59:12 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-91d928b2-eaab-470a-8f92-0a7ac4d7244a tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] Acquiring lock "cinder-2cbffa2c-4083-4ca5-b54a-fbad9639f7bb-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 13:59:12 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-91d928b2-eaab-470a-8f92-0a7ac4d7244a tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] Lock "cinder-2cbffa2c-4083-4ca5-b54a-fbad9639f7bb-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 13:59:12 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-91d928b2-eaab-470a-8f92-0a7ac4d7244a tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] Acquiring lock "cinder-quobyte-2cbffa2c-4083-4ca5-b54a-fbad9639f7bb" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 13:59:12 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-91d928b2-eaab-470a-8f92-0a7ac4d7244a tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] Lock "cinder-quobyte-2cbffa2c-4083-4ca5-b54a-fbad9639f7bb" acquired by "delete_volume" :: waited 0.021s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 13:59:12 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f9031dc-9b2d-45eb-a258-5ceabf316304]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 13:59:12 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-91d928b2-eaab-470a-8f92-0a7ac4d7244a tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-2cbffa2c-4083-4ca5-b54a-fbad9639f7bb {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:59:12 devstack sudo[99149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-2cbffa2c-4083-4ca5-b54a-fbad9639f7bb Jul 13 13:59:12 devstack sudo[99149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:59:13 devstack sudo[99149]: pam_unix(sudo:session): session closed for user root Jul 13 13:59:13 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-91d928b2-eaab-470a-8f92-0a7ac4d7244a tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-2cbffa2c-4083-4ca5-b54a-fbad9639f7bb" returned: 0 in 1.164s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:59:13 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-91d928b2-eaab-470a-8f92-0a7ac4d7244a tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-2cbffa2c-4083-4ca5-b54a-fbad9639f7bb {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:59:13 devstack sudo[99161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-2cbffa2c-4083-4ca5-b54a-fbad9639f7bb Jul 13 13:59:13 devstack sudo[99161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:59:14 devstack sudo[99161]: pam_unix(sudo:session): session closed for user root Jul 13 13:59:14 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-91d928b2-eaab-470a-8f92-0a7ac4d7244a tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-2cbffa2c-4083-4ca5-b54a-fbad9639f7bb" returned: 0 in 0.747s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:59:14 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-91d928b2-eaab-470a-8f92-0a7ac4d7244a tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] Lock "cinder-quobyte-2cbffa2c-4083-4ca5-b54a-fbad9639f7bb" released by "delete_volume" :: held 1.999s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 13:59:14 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-91d928b2-eaab-470a-8f92-0a7ac4d7244a tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] Created reservations ['6dda3524-1008-433c-92a3-4db721a33018', '9bbe4ff3-62b5-4484-aef8-1c9c55b042ff', '1e7a7cf9-f6f1-4504-98fc-35eb7da4e009', '2a2b5328-1a29-4c68-bcef-5f15ad17a7c3'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 13:59:14 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-91d928b2-eaab-470a-8f92-0a7ac4d7244a tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:59:14 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-91d928b2-eaab-470a-8f92-0a7ac4d7244a tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:59:14 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-91d928b2-eaab-470a-8f92-0a7ac4d7244a tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 13:59:15 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-91d928b2-eaab-470a-8f92-0a7ac4d7244a tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 13:59:15 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-91d928b2-eaab-470a-8f92-0a7ac4d7244a tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.037s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:59:15 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-91d928b2-eaab-470a-8f92-0a7ac4d7244a tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:59:15 devstack sudo[99165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 Jul 13 13:59:15 devstack sudo[99165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:59:15 devstack sudo[99165]: pam_unix(sudo:session): session closed for user root Jul 13 13:59:15 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-91d928b2-eaab-470a-8f92-0a7ac4d7244a tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78" returned: 0 in 0.639s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:59:15 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-91d928b2-eaab-470a-8f92-0a7ac4d7244a tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 13:59:15 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-91d928b2-eaab-470a-8f92-0a7ac4d7244a tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] Deleted volume successfully. Jul 13 13:59:15 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-91d928b2-eaab-470a-8f92-0a7ac4d7244a tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] Lock "cinder-2cbffa2c-4083-4ca5-b54a-fbad9639f7bb-delete_volume" released by "delete_volume" :: held 3.373s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 13:59:16 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-d62ed61c-7af6-4933-b0c3-ea0130d1a7d9 tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] Acquiring lock "cinder-08d03499-dcab-4efc-90ea-2ec26683005b-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 13:59:16 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-d62ed61c-7af6-4933-b0c3-ea0130d1a7d9 tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] Lock "cinder-08d03499-dcab-4efc-90ea-2ec26683005b-delete_volume" acquired by "delete_volume" :: waited 0.074s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 13:59:16 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-d62ed61c-7af6-4933-b0c3-ea0130d1a7d9 tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] Acquiring lock "cinder-quobyte-08d03499-dcab-4efc-90ea-2ec26683005b" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 13:59:16 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-d62ed61c-7af6-4933-b0c3-ea0130d1a7d9 tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] Lock "cinder-quobyte-08d03499-dcab-4efc-90ea-2ec26683005b" acquired by "delete_volume" :: waited 0.035s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 13:59:16 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[26838261-4e9c-49aa-9c28-99d67c6041b0]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 13:59:16 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-d62ed61c-7af6-4933-b0c3-ea0130d1a7d9 tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-08d03499-dcab-4efc-90ea-2ec26683005b {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:59:17 devstack sudo[99170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-08d03499-dcab-4efc-90ea-2ec26683005b Jul 13 13:59:17 devstack sudo[99170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:59:17 devstack sudo[99170]: pam_unix(sudo:session): session closed for user root Jul 13 13:59:17 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-d62ed61c-7af6-4933-b0c3-ea0130d1a7d9 tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-08d03499-dcab-4efc-90ea-2ec26683005b" returned: 0 in 1.100s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:59:17 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-d62ed61c-7af6-4933-b0c3-ea0130d1a7d9 tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-08d03499-dcab-4efc-90ea-2ec26683005b {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:59:17 devstack sudo[99175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-08d03499-dcab-4efc-90ea-2ec26683005b Jul 13 13:59:17 devstack sudo[99175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:59:18 devstack sudo[99175]: pam_unix(sudo:session): session closed for user root Jul 13 13:59:18 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-d62ed61c-7af6-4933-b0c3-ea0130d1a7d9 tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-08d03499-dcab-4efc-90ea-2ec26683005b" returned: 0 in 0.797s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:59:18 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-d62ed61c-7af6-4933-b0c3-ea0130d1a7d9 tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] Lock "cinder-quobyte-08d03499-dcab-4efc-90ea-2ec26683005b" released by "delete_volume" :: held 2.003s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 13:59:18 devstack sudo[99144]: pam_unix(sudo:session): session closed for user root Jul 13 13:59:18 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-c8828d9c-d350-4f99-b2dd-c56d08823296 tempest-VolumesSnapshotTestJSON-2010930921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-301c9eea-6c8d-49b9-82aa-9b185b62ea95 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-e2802eb6-59f1-4a07-bf00-429ae67c3c68" returned: 0 in 6.559s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:59:18 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[730e1bb4-bad6-4c1b-9d98-9b47fd0e603d]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 13:59:18 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-c8828d9c-d350-4f99-b2dd-c56d08823296 tempest-VolumesSnapshotTestJSON-2010930921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-301c9eea-6c8d-49b9-82aa-9b185b62ea95 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:59:18 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-d62ed61c-7af6-4933-b0c3-ea0130d1a7d9 tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] Created reservations ['259f1876-9d89-47a3-acb4-254c70854eee', '6598df96-5f24-4e95-a3db-5f93374a8470', '91143e93-dcbb-4f5d-9758-2e7d22361420', 'ae0cd786-4723-4df6-8dcb-ae744e76a437'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 13:59:18 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-d62ed61c-7af6-4933-b0c3-ea0130d1a7d9 tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:59:18 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-d62ed61c-7af6-4933-b0c3-ea0130d1a7d9 tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:59:18 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-d62ed61c-7af6-4933-b0c3-ea0130d1a7d9 tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 13:59:18 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-d62ed61c-7af6-4933-b0c3-ea0130d1a7d9 tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 13:59:18 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-d62ed61c-7af6-4933-b0c3-ea0130d1a7d9 tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:59:18 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-d62ed61c-7af6-4933-b0c3-ea0130d1a7d9 tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:59:18 devstack sudo[99186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-301c9eea-6c8d-49b9-82aa-9b185b62ea95 Jul 13 13:59:18 devstack sudo[99186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:59:18 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-0b855a29-b58a-4216-9e46-3b7e1b878fb4 tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] Acquiring lock "cinder-511b3757-4952-4c7b-8029-114a3b2aa418-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 13:59:18 devstack sudo[99188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 Jul 13 13:59:18 devstack sudo[99188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:59:18 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-0b855a29-b58a-4216-9e46-3b7e1b878fb4 tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] Lock "cinder-511b3757-4952-4c7b-8029-114a3b2aa418-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 13:59:19 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-0b855a29-b58a-4216-9e46-3b7e1b878fb4 tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] Acquiring lock "cinder-quobyte-511b3757-4952-4c7b-8029-114a3b2aa418" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 13:59:19 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-0b855a29-b58a-4216-9e46-3b7e1b878fb4 tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] Lock "cinder-quobyte-511b3757-4952-4c7b-8029-114a3b2aa418" acquired by "delete_volume" :: waited 0.018s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 13:59:19 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[66e42bed-ce91-4882-a4c5-e3bb85295068]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 13:59:19 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-0b855a29-b58a-4216-9e46-3b7e1b878fb4 tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-511b3757-4952-4c7b-8029-114a3b2aa418 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:59:19 devstack sudo[99190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-511b3757-4952-4c7b-8029-114a3b2aa418 Jul 13 13:59:19 devstack sudo[99190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:59:19 devstack sudo[99188]: pam_unix(sudo:session): session closed for user root Jul 13 13:59:19 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-d62ed61c-7af6-4933-b0c3-ea0130d1a7d9 tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78" returned: 0 in 0.429s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:59:19 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-d62ed61c-7af6-4933-b0c3-ea0130d1a7d9 tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 13:59:19 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-d62ed61c-7af6-4933-b0c3-ea0130d1a7d9 tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] Deleted volume successfully. Jul 13 13:59:19 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-d62ed61c-7af6-4933-b0c3-ea0130d1a7d9 tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] Lock "cinder-08d03499-dcab-4efc-90ea-2ec26683005b-delete_volume" released by "delete_volume" :: held 2.880s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 13:59:19 devstack sudo[99186]: pam_unix(sudo:session): session closed for user root Jul 13 13:59:19 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-c8828d9c-d350-4f99-b2dd-c56d08823296 tempest-VolumesSnapshotTestJSON-2010930921 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-301c9eea-6c8d-49b9-82aa-9b185b62ea95" returned: 0 in 0.924s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:59:19 devstack cinder-volume[87098]: DEBUG cinder.image.image_utils [None req-c8828d9c-d350-4f99-b2dd-c56d08823296 tempest-VolumesSnapshotTestJSON-2010930921 None] Image conversion details: src /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-301c9eea-6c8d-49b9-82aa-9b185b62ea95, size 1024.00 MB, duration 6.56 sec, destination /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-e2802eb6-59f1-4a07-bf00-429ae67c3c68 {{(pid=87098) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 13 13:59:19 devstack cinder-volume[87098]: INFO cinder.image.image_utils [None req-c8828d9c-d350-4f99-b2dd-c56d08823296 tempest-VolumesSnapshotTestJSON-2010930921 None] Converted 1024.00 MB image at 156.09 MB/s Jul 13 13:59:19 devstack cinder-volume[87098]: WARNING cinder.volume.drivers.remotefs [None req-c8828d9c-d350-4f99-b2dd-c56d08823296 tempest-VolumesSnapshotTestJSON-2010930921 None] /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-e2802eb6-59f1-4a07-bf00-429ae67c3c68 is being set with open permissions: ugo+rw Jul 13 13:59:19 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-c8828d9c-d350-4f99-b2dd-c56d08823296 tempest-VolumesSnapshotTestJSON-2010930921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-e2802eb6-59f1-4a07-bf00-429ae67c3c68 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:59:19 devstack sudo[99190]: pam_unix(sudo:session): session closed for user root Jul 13 13:59:19 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-0b855a29-b58a-4216-9e46-3b7e1b878fb4 tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-511b3757-4952-4c7b-8029-114a3b2aa418" returned: 0 in 0.587s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:59:19 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-0b855a29-b58a-4216-9e46-3b7e1b878fb4 tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-511b3757-4952-4c7b-8029-114a3b2aa418 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:59:19 devstack sudo[99201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-e2802eb6-59f1-4a07-bf00-429ae67c3c68 Jul 13 13:59:19 devstack sudo[99201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:59:19 devstack sudo[99203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-511b3757-4952-4c7b-8029-114a3b2aa418 Jul 13 13:59:19 devstack sudo[99203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:59:19 devstack sudo[99201]: pam_unix(sudo:session): session closed for user root Jul 13 13:59:19 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-c8828d9c-d350-4f99-b2dd-c56d08823296 tempest-VolumesSnapshotTestJSON-2010930921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-e2802eb6-59f1-4a07-bf00-429ae67c3c68" returned: 0 in 0.333s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:59:20 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-c8828d9c-d350-4f99-b2dd-c56d08823296 tempest-VolumesSnapshotTestJSON-2010930921 None] Lock "cinder-quobyte-e2802eb6-59f1-4a07-bf00-429ae67c3c68" released by "_copy_volume_from_snapshot" :: held 9.021s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 13:59:20 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-c8828d9c-d350-4f99-b2dd-c56d08823296 tempest-VolumesSnapshotTestJSON-2010930921 None] Lock "cinder-quobyte-293b2940-82c9-44f3-b789-981fd7e92936-e2802eb6-59f1-4a07-bf00-429ae67c3c68" released by "_create_volume_from_snapshot" :: held 9.076s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 13:59:20 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-c8828d9c-d350-4f99-b2dd-c56d08823296 tempest-VolumesSnapshotTestJSON-2010930921 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.103s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:59:20 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-c8828d9c-d350-4f99-b2dd-c56d08823296 tempest-VolumesSnapshotTestJSON-2010930921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63fe97a5-ec6d-48fa-88c6-d71588107081) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e2802eb6-59f1-4a07-bf00-429ae67c3c68', 'volume_size': 2, 'snapshot_id': '293b2940-82c9-44f3-b789-981fd7e92936'}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:59:20 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-c8828d9c-d350-4f99-b2dd-c56d08823296 tempest-VolumesSnapshotTestJSON-2010930921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18c9e64a-f935-4793-99d3-9792afd16d27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:59:20 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-c8828d9c-d350-4f99-b2dd-c56d08823296 tempest-VolumesSnapshotTestJSON-2010930921 None] Volume volume-e2802eb6-59f1-4a07-bf00-429ae67c3c68 (e2802eb6-59f1-4a07-bf00-429ae67c3c68): created successfully Jul 13 13:59:20 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-c8828d9c-d350-4f99-b2dd-c56d08823296 tempest-VolumesSnapshotTestJSON-2010930921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18c9e64a-f935-4793-99d3-9792afd16d27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:59:20 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-c8828d9c-d350-4f99-b2dd-c56d08823296 tempest-VolumesSnapshotTestJSON-2010930921 None] Flow 'volume_create_manager' (03f829df-04b7-4911-9ebd-b0bb143811bf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 13:59:20 devstack sudo[99203]: pam_unix(sudo:session): session closed for user root Jul 13 13:59:20 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-0b855a29-b58a-4216-9e46-3b7e1b878fb4 tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-511b3757-4952-4c7b-8029-114a3b2aa418" returned: 0 in 0.423s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:59:20 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-c8828d9c-d350-4f99-b2dd-c56d08823296 tempest-VolumesSnapshotTestJSON-2010930921 None] Created volume successfully. Jul 13 13:59:20 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-0b855a29-b58a-4216-9e46-3b7e1b878fb4 tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] Lock "cinder-quobyte-511b3757-4952-4c7b-8029-114a3b2aa418" released by "delete_volume" :: held 1.086s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 13:59:20 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-0b855a29-b58a-4216-9e46-3b7e1b878fb4 tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] Created reservations ['b5694175-5950-4e0a-8e7b-e2b5c49462db', '05898b68-eca1-4370-b682-97544ec53f22', '28705909-f91e-4a0b-a34c-d968d94d6ec5', '602622aa-2dcd-426b-a6b2-06bbcc59b4db'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 13:59:20 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-0b855a29-b58a-4216-9e46-3b7e1b878fb4 tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:59:20 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-0b855a29-b58a-4216-9e46-3b7e1b878fb4 tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:59:20 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-0b855a29-b58a-4216-9e46-3b7e1b878fb4 tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 13:59:20 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-0b855a29-b58a-4216-9e46-3b7e1b878fb4 tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 13:59:20 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-0b855a29-b58a-4216-9e46-3b7e1b878fb4 tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:59:20 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-0b855a29-b58a-4216-9e46-3b7e1b878fb4 tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:59:20 devstack sudo[99207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 Jul 13 13:59:20 devstack sudo[99207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:59:20 devstack sudo[99207]: pam_unix(sudo:session): session closed for user root Jul 13 13:59:20 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-0b855a29-b58a-4216-9e46-3b7e1b878fb4 tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78" returned: 0 in 0.290s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:59:20 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-0b855a29-b58a-4216-9e46-3b7e1b878fb4 tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 13:59:20 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-0b855a29-b58a-4216-9e46-3b7e1b878fb4 tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] Deleted volume successfully. Jul 13 13:59:20 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-0b855a29-b58a-4216-9e46-3b7e1b878fb4 tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] Lock "cinder-511b3757-4952-4c7b-8029-114a3b2aa418-delete_volume" released by "delete_volume" :: held 1.611s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 13:59:21 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-bb32d6f2-13cb-4308-8bcf-5d1e76abcf1d tempest-VolumesSnapshotTestJSON-2010930921 None] Acquiring lock "cinder-e2802eb6-59f1-4a07-bf00-429ae67c3c68-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 13:59:21 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-bb32d6f2-13cb-4308-8bcf-5d1e76abcf1d tempest-VolumesSnapshotTestJSON-2010930921 None] Lock "cinder-e2802eb6-59f1-4a07-bf00-429ae67c3c68-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 13:59:21 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-bb32d6f2-13cb-4308-8bcf-5d1e76abcf1d tempest-VolumesSnapshotTestJSON-2010930921 None] Acquiring lock "cinder-quobyte-e2802eb6-59f1-4a07-bf00-429ae67c3c68" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 13:59:21 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-bb32d6f2-13cb-4308-8bcf-5d1e76abcf1d tempest-VolumesSnapshotTestJSON-2010930921 None] Lock "cinder-quobyte-e2802eb6-59f1-4a07-bf00-429ae67c3c68" acquired by "delete_volume" :: waited 0.024s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 13:59:21 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ddfa9d5-8c4d-4ff9-af30-09a53a820c93]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 13:59:21 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-bb32d6f2-13cb-4308-8bcf-5d1e76abcf1d tempest-VolumesSnapshotTestJSON-2010930921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-e2802eb6-59f1-4a07-bf00-429ae67c3c68 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:59:21 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-31b734ad-fb4d-4a07-83a8-8e3aaf13d082 tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] Acquiring lock "cinder-a7a748cb-279f-4e7e-b2c5-523afabb731b-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 13:59:21 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-31b734ad-fb4d-4a07-83a8-8e3aaf13d082 tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] Lock "cinder-a7a748cb-279f-4e7e-b2c5-523afabb731b-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 13:59:21 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-31b734ad-fb4d-4a07-83a8-8e3aaf13d082 tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] Acquiring lock "cinder-quobyte-a7a748cb-279f-4e7e-b2c5-523afabb731b" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 13:59:21 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-31b734ad-fb4d-4a07-83a8-8e3aaf13d082 tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] Lock "cinder-quobyte-a7a748cb-279f-4e7e-b2c5-523afabb731b" acquired by "delete_volume" :: waited 0.028s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 13:59:21 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d2cb92a-0dfe-46d7-b8c2-fcd710323f0f]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 13:59:21 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-31b734ad-fb4d-4a07-83a8-8e3aaf13d082 tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-a7a748cb-279f-4e7e-b2c5-523afabb731b {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:59:21 devstack sudo[99210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-e2802eb6-59f1-4a07-bf00-429ae67c3c68 Jul 13 13:59:21 devstack sudo[99210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:59:21 devstack sudo[99211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-a7a748cb-279f-4e7e-b2c5-523afabb731b Jul 13 13:59:21 devstack sudo[99211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:59:21 devstack sudo[99210]: pam_unix(sudo:session): session closed for user root Jul 13 13:59:21 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-bb32d6f2-13cb-4308-8bcf-5d1e76abcf1d tempest-VolumesSnapshotTestJSON-2010930921 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-e2802eb6-59f1-4a07-bf00-429ae67c3c68" returned: 0 in 0.551s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:59:21 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-bb32d6f2-13cb-4308-8bcf-5d1e76abcf1d tempest-VolumesSnapshotTestJSON-2010930921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-e2802eb6-59f1-4a07-bf00-429ae67c3c68 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:59:21 devstack sudo[99217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-e2802eb6-59f1-4a07-bf00-429ae67c3c68 Jul 13 13:59:21 devstack sudo[99217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:59:21 devstack sudo[99211]: pam_unix(sudo:session): session closed for user root Jul 13 13:59:21 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-31b734ad-fb4d-4a07-83a8-8e3aaf13d082 tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-a7a748cb-279f-4e7e-b2c5-523afabb731b" returned: 0 in 0.506s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:59:21 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-31b734ad-fb4d-4a07-83a8-8e3aaf13d082 tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-a7a748cb-279f-4e7e-b2c5-523afabb731b {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:59:22 devstack sudo[99222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-a7a748cb-279f-4e7e-b2c5-523afabb731b Jul 13 13:59:22 devstack sudo[99222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:59:22 devstack sudo[99217]: pam_unix(sudo:session): session closed for user root Jul 13 13:59:22 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-bb32d6f2-13cb-4308-8bcf-5d1e76abcf1d tempest-VolumesSnapshotTestJSON-2010930921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-e2802eb6-59f1-4a07-bf00-429ae67c3c68" returned: 0 in 0.298s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:59:22 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-bb32d6f2-13cb-4308-8bcf-5d1e76abcf1d tempest-VolumesSnapshotTestJSON-2010930921 None] Lock "cinder-quobyte-e2802eb6-59f1-4a07-bf00-429ae67c3c68" released by "delete_volume" :: held 0.908s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 13:59:22 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-bb32d6f2-13cb-4308-8bcf-5d1e76abcf1d tempest-VolumesSnapshotTestJSON-2010930921 None] Created reservations ['ba13761a-b5bd-4a30-ba26-a1159ffdd0ae', '26b720a0-bb79-4257-bdd9-802bdf8f2bc3', '0cc48e50-372b-4ea3-b212-1c788417972e', 'e00c20f5-ed23-4caf-a63a-e990a849a050'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 13:59:22 devstack sudo[99222]: pam_unix(sudo:session): session closed for user root Jul 13 13:59:22 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-31b734ad-fb4d-4a07-83a8-8e3aaf13d082 tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-a7a748cb-279f-4e7e-b2c5-523afabb731b" returned: 0 in 0.341s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:59:22 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-31b734ad-fb4d-4a07-83a8-8e3aaf13d082 tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] Lock "cinder-quobyte-a7a748cb-279f-4e7e-b2c5-523afabb731b" released by "delete_volume" :: held 0.923s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 13:59:22 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-bb32d6f2-13cb-4308-8bcf-5d1e76abcf1d tempest-VolumesSnapshotTestJSON-2010930921 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:59:22 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-bb32d6f2-13cb-4308-8bcf-5d1e76abcf1d tempest-VolumesSnapshotTestJSON-2010930921 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:59:22 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-bb32d6f2-13cb-4308-8bcf-5d1e76abcf1d tempest-VolumesSnapshotTestJSON-2010930921 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 13:59:22 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-bb32d6f2-13cb-4308-8bcf-5d1e76abcf1d tempest-VolumesSnapshotTestJSON-2010930921 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 13:59:22 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-bb32d6f2-13cb-4308-8bcf-5d1e76abcf1d tempest-VolumesSnapshotTestJSON-2010930921 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:59:22 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-bb32d6f2-13cb-4308-8bcf-5d1e76abcf1d tempest-VolumesSnapshotTestJSON-2010930921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:59:22 devstack sudo[99226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 Jul 13 13:59:22 devstack sudo[99226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:59:22 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-31b734ad-fb4d-4a07-83a8-8e3aaf13d082 tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] Created reservations ['cc621098-3b21-4298-a7fb-8c83963e5f54', 'e5ad5a3c-09d5-4ec0-bbb1-4fab352b7100', '797264df-47ce-4f8a-9842-e505220fd7ef', 'ffc6dde5-9246-4e66-aaf9-c7cdb7752392'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 13:59:22 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-16811734-9d66-4cdb-83ec-ae4b65441720 tempest-VolumesSnapshotTestJSON-2010930921 None] Acquiring lock "cinder-293b2940-82c9-44f3-b789-981fd7e92936-delete_snapshot" by "delete_snapshot" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 13:59:22 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-16811734-9d66-4cdb-83ec-ae4b65441720 tempest-VolumesSnapshotTestJSON-2010930921 None] Lock "cinder-293b2940-82c9-44f3-b789-981fd7e92936-delete_snapshot" acquired by "delete_snapshot" :: waited 0.054s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 13:59:22 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-16811734-9d66-4cdb-83ec-ae4b65441720 tempest-VolumesSnapshotTestJSON-2010930921 None] Acquiring lock "cinder-quobyte-301c9eea-6c8d-49b9-82aa-9b185b62ea95" by "delete_snapshot" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 13:59:22 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-16811734-9d66-4cdb-83ec-ae4b65441720 tempest-VolumesSnapshotTestJSON-2010930921 None] Lock "cinder-quobyte-301c9eea-6c8d-49b9-82aa-9b185b62ea95" acquired by "delete_snapshot" :: waited 0.035s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 13:59:22 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-16811734-9d66-4cdb-83ec-ae4b65441720 tempest-VolumesSnapshotTestJSON-2010930921 None] Acquiring lock "cinder-quobyte-293b2940-82c9-44f3-b789-981fd7e92936" by "_delete_snapshot" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 13:59:22 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-31b734ad-fb4d-4a07-83a8-8e3aaf13d082 tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:59:22 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-31b734ad-fb4d-4a07-83a8-8e3aaf13d082 tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:59:22 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-31b734ad-fb4d-4a07-83a8-8e3aaf13d082 tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 13:59:22 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-31b734ad-fb4d-4a07-83a8-8e3aaf13d082 tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 13:59:22 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-31b734ad-fb4d-4a07-83a8-8e3aaf13d082 tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:59:22 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-31b734ad-fb4d-4a07-83a8-8e3aaf13d082 tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:59:22 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-16811734-9d66-4cdb-83ec-ae4b65441720 tempest-VolumesSnapshotTestJSON-2010930921 None] Lock "cinder-quobyte-293b2940-82c9-44f3-b789-981fd7e92936" acquired by "_delete_snapshot" :: waited 0.066s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 13:59:22 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-16811734-9d66-4cdb-83ec-ae4b65441720 tempest-VolumesSnapshotTestJSON-2010930921 None] Deleting offline snapshot 293b2940-82c9-44f3-b789-981fd7e92936 of volume 301c9eea-6c8d-49b9-82aa-9b185b62ea95 {{(pid=87098) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 13 13:59:22 devstack sudo[99228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 Jul 13 13:59:22 devstack sudo[99228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:59:22 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-16811734-9d66-4cdb-83ec-ae4b65441720 tempest-VolumesSnapshotTestJSON-2010930921 None] snapshot_file for this snap is: volume-301c9eea-6c8d-49b9-82aa-9b185b62ea95.293b2940-82c9-44f3-b789-981fd7e92936 {{(pid=87098) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 13 13:59:22 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[b866f69e-dd72-4455-8f8d-c227a7ec067b]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 13:59:22 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-16811734-9d66-4cdb-83ec-ae4b65441720 tempest-VolumesSnapshotTestJSON-2010930921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-301c9eea-6c8d-49b9-82aa-9b185b62ea95.293b2940-82c9-44f3-b789-981fd7e92936 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:59:22 devstack sudo[99226]: pam_unix(sudo:session): session closed for user root Jul 13 13:59:22 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-bb32d6f2-13cb-4308-8bcf-5d1e76abcf1d tempest-VolumesSnapshotTestJSON-2010930921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78" returned: 0 in 0.396s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:59:22 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-bb32d6f2-13cb-4308-8bcf-5d1e76abcf1d tempest-VolumesSnapshotTestJSON-2010930921 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 13:59:22 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-bb32d6f2-13cb-4308-8bcf-5d1e76abcf1d tempest-VolumesSnapshotTestJSON-2010930921 None] Deleted volume successfully. Jul 13 13:59:22 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-bb32d6f2-13cb-4308-8bcf-5d1e76abcf1d tempest-VolumesSnapshotTestJSON-2010930921 None] Lock "cinder-e2802eb6-59f1-4a07-bf00-429ae67c3c68-delete_volume" released by "delete_volume" :: held 1.627s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 13:59:22 devstack sudo[99231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-301c9eea-6c8d-49b9-82aa-9b185b62ea95.293b2940-82c9-44f3-b789-981fd7e92936 Jul 13 13:59:22 devstack sudo[99231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:59:22 devstack sudo[99228]: pam_unix(sudo:session): session closed for user root Jul 13 13:59:22 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-31b734ad-fb4d-4a07-83a8-8e3aaf13d082 tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78" returned: 0 in 0.345s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:59:22 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-31b734ad-fb4d-4a07-83a8-8e3aaf13d082 tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 13:59:22 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-31b734ad-fb4d-4a07-83a8-8e3aaf13d082 tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] Deleted volume successfully. Jul 13 13:59:23 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-31b734ad-fb4d-4a07-83a8-8e3aaf13d082 tempest-CreateVolumesFromSourceVolumeTest-1567021254 None] Lock "cinder-a7a748cb-279f-4e7e-b2c5-523afabb731b-delete_volume" released by "delete_volume" :: held 1.662s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 13:59:23 devstack sudo[99231]: pam_unix(sudo:session): session closed for user root Jul 13 13:59:23 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-16811734-9d66-4cdb-83ec-ae4b65441720 tempest-VolumesSnapshotTestJSON-2010930921 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-301c9eea-6c8d-49b9-82aa-9b185b62ea95.293b2940-82c9-44f3-b789-981fd7e92936" returned: 0 in 0.475s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:59:23 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-16811734-9d66-4cdb-83ec-ae4b65441720 tempest-VolumesSnapshotTestJSON-2010930921 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-301c9eea-6c8d-49b9-82aa-9b185b62ea95(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87098) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 13 13:59:23 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[24b61e12-3f3b-4670-bb04-a8d34aed71a3]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 13:59:23 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-16811734-9d66-4cdb-83ec-ae4b65441720 tempest-VolumesSnapshotTestJSON-2010930921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-301c9eea-6c8d-49b9-82aa-9b185b62ea95 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:59:23 devstack sudo[99237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-301c9eea-6c8d-49b9-82aa-9b185b62ea95 Jul 13 13:59:23 devstack sudo[99237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:59:23 devstack sudo[99237]: pam_unix(sudo:session): session closed for user root Jul 13 13:59:23 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-16811734-9d66-4cdb-83ec-ae4b65441720 tempest-VolumesSnapshotTestJSON-2010930921 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-301c9eea-6c8d-49b9-82aa-9b185b62ea95" returned: 0 in 0.442s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:59:23 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-16811734-9d66-4cdb-83ec-ae4b65441720 tempest-VolumesSnapshotTestJSON-2010930921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-301c9eea-6c8d-49b9-82aa-9b185b62ea95.293b2940-82c9-44f3-b789-981fd7e92936 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:59:23 devstack sudo[99242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-301c9eea-6c8d-49b9-82aa-9b185b62ea95.293b2940-82c9-44f3-b789-981fd7e92936 Jul 13 13:59:23 devstack sudo[99242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:59:24 devstack sudo[99242]: pam_unix(sudo:session): session closed for user root Jul 13 13:59:24 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-16811734-9d66-4cdb-83ec-ae4b65441720 tempest-VolumesSnapshotTestJSON-2010930921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-301c9eea-6c8d-49b9-82aa-9b185b62ea95.293b2940-82c9-44f3-b789-981fd7e92936" returned: 0 in 0.430s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:59:24 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-16811734-9d66-4cdb-83ec-ae4b65441720 tempest-VolumesSnapshotTestJSON-2010930921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-301c9eea-6c8d-49b9-82aa-9b185b62ea95.293b2940-82c9-44f3-b789-981fd7e92936 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:59:24 devstack sudo[99251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-301c9eea-6c8d-49b9-82aa-9b185b62ea95.293b2940-82c9-44f3-b789-981fd7e92936 Jul 13 13:59:24 devstack sudo[99251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:59:24 devstack sudo[99251]: pam_unix(sudo:session): session closed for user root Jul 13 13:59:24 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-16811734-9d66-4cdb-83ec-ae4b65441720 tempest-VolumesSnapshotTestJSON-2010930921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-301c9eea-6c8d-49b9-82aa-9b185b62ea95.293b2940-82c9-44f3-b789-981fd7e92936" returned: 0 in 0.290s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:59:24 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-16811734-9d66-4cdb-83ec-ae4b65441720 tempest-VolumesSnapshotTestJSON-2010930921 None] Lock "cinder-quobyte-293b2940-82c9-44f3-b789-981fd7e92936" released by "_delete_snapshot" :: held 1.785s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 13:59:24 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-16811734-9d66-4cdb-83ec-ae4b65441720 tempest-VolumesSnapshotTestJSON-2010930921 None] Lock "cinder-quobyte-301c9eea-6c8d-49b9-82aa-9b185b62ea95" released by "delete_snapshot" :: held 1.869s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 13:59:24 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-16811734-9d66-4cdb-83ec-ae4b65441720 tempest-VolumesSnapshotTestJSON-2010930921 None] Created reservations ['6fa9ce0c-225b-4c6c-bded-531b22899d53', 'bb90a8f1-dc32-4075-8f5f-e6fde19dc4fc', '3de995da-1ee2-42d6-bb62-3c5f22f3185b', 'baced632-c845-47cd-9dd4-03bd545bd3a4'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 13:59:24 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-16811734-9d66-4cdb-83ec-ae4b65441720 tempest-VolumesSnapshotTestJSON-2010930921 None] Delete snapshot completed successfully. Jul 13 13:59:24 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-16811734-9d66-4cdb-83ec-ae4b65441720 tempest-VolumesSnapshotTestJSON-2010930921 None] Lock "cinder-293b2940-82c9-44f3-b789-981fd7e92936-delete_snapshot" released by "delete_snapshot" :: held 2.158s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 13:59:24 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-033fd3bb-809a-4c9f-85c6-db8db11b49ce tempest-VolumesSnapshotTestJSON-2010930921 None] Acquiring lock "cinder-301c9eea-6c8d-49b9-82aa-9b185b62ea95-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 13:59:24 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-033fd3bb-809a-4c9f-85c6-db8db11b49ce tempest-VolumesSnapshotTestJSON-2010930921 None] Lock "cinder-301c9eea-6c8d-49b9-82aa-9b185b62ea95-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 13:59:24 devstack cinder-volume[87098]: DEBUG dbcounter [-] [87098] Writing DB stats cinder:SELECT=167,cinder:INSERT=50,cinder:UPDATE=223,cinder:DELETE=16 {{(pid=87098) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 13 13:59:24 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-033fd3bb-809a-4c9f-85c6-db8db11b49ce tempest-VolumesSnapshotTestJSON-2010930921 None] Acquiring lock "cinder-quobyte-301c9eea-6c8d-49b9-82aa-9b185b62ea95" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 13:59:24 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-033fd3bb-809a-4c9f-85c6-db8db11b49ce tempest-VolumesSnapshotTestJSON-2010930921 None] Lock "cinder-quobyte-301c9eea-6c8d-49b9-82aa-9b185b62ea95" acquired by "delete_volume" :: waited 0.023s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 13:59:25 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[0859d4de-43ed-4e52-b974-56eebd00d26a]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 13:59:25 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-033fd3bb-809a-4c9f-85c6-db8db11b49ce tempest-VolumesSnapshotTestJSON-2010930921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-301c9eea-6c8d-49b9-82aa-9b185b62ea95 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:59:25 devstack sudo[99257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-301c9eea-6c8d-49b9-82aa-9b185b62ea95 Jul 13 13:59:25 devstack sudo[99257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:59:25 devstack sudo[99257]: pam_unix(sudo:session): session closed for user root Jul 13 13:59:25 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-033fd3bb-809a-4c9f-85c6-db8db11b49ce tempest-VolumesSnapshotTestJSON-2010930921 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-301c9eea-6c8d-49b9-82aa-9b185b62ea95" returned: 0 in 0.471s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:59:25 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-033fd3bb-809a-4c9f-85c6-db8db11b49ce tempest-VolumesSnapshotTestJSON-2010930921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-301c9eea-6c8d-49b9-82aa-9b185b62ea95 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:59:25 devstack sudo[99263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-301c9eea-6c8d-49b9-82aa-9b185b62ea95 Jul 13 13:59:25 devstack sudo[99263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:59:25 devstack sudo[99263]: pam_unix(sudo:session): session closed for user root Jul 13 13:59:25 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-033fd3bb-809a-4c9f-85c6-db8db11b49ce tempest-VolumesSnapshotTestJSON-2010930921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-301c9eea-6c8d-49b9-82aa-9b185b62ea95" returned: 0 in 0.314s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:59:25 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-033fd3bb-809a-4c9f-85c6-db8db11b49ce tempest-VolumesSnapshotTestJSON-2010930921 None] Lock "cinder-quobyte-301c9eea-6c8d-49b9-82aa-9b185b62ea95" released by "delete_volume" :: held 0.871s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 13:59:25 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-033fd3bb-809a-4c9f-85c6-db8db11b49ce tempest-VolumesSnapshotTestJSON-2010930921 None] Created reservations ['02264f71-1960-4e07-9089-09e5d7452084', '569cee7b-76fb-4693-bfd2-3c09038e517b', '8e0b5a37-ef7a-4961-9fc0-1a8570471bf3', '7f6c1fe5-4b09-44cf-b24c-ebdbd9c73d37'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 13:59:26 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-033fd3bb-809a-4c9f-85c6-db8db11b49ce tempest-VolumesSnapshotTestJSON-2010930921 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:59:26 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-033fd3bb-809a-4c9f-85c6-db8db11b49ce tempest-VolumesSnapshotTestJSON-2010930921 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:59:26 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-033fd3bb-809a-4c9f-85c6-db8db11b49ce tempest-VolumesSnapshotTestJSON-2010930921 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 13:59:26 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-033fd3bb-809a-4c9f-85c6-db8db11b49ce tempest-VolumesSnapshotTestJSON-2010930921 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 13:59:26 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-033fd3bb-809a-4c9f-85c6-db8db11b49ce tempest-VolumesSnapshotTestJSON-2010930921 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:59:26 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-033fd3bb-809a-4c9f-85c6-db8db11b49ce tempest-VolumesSnapshotTestJSON-2010930921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:59:26 devstack sudo[99266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 Jul 13 13:59:26 devstack sudo[99266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:59:26 devstack sudo[99266]: pam_unix(sudo:session): session closed for user root Jul 13 13:59:26 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-033fd3bb-809a-4c9f-85c6-db8db11b49ce tempest-VolumesSnapshotTestJSON-2010930921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78" returned: 0 in 0.341s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:59:26 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-033fd3bb-809a-4c9f-85c6-db8db11b49ce tempest-VolumesSnapshotTestJSON-2010930921 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 13:59:26 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-033fd3bb-809a-4c9f-85c6-db8db11b49ce tempest-VolumesSnapshotTestJSON-2010930921 None] Deleted volume successfully. Jul 13 13:59:26 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-033fd3bb-809a-4c9f-85c6-db8db11b49ce tempest-VolumesSnapshotTestJSON-2010930921 None] Lock "cinder-301c9eea-6c8d-49b9-82aa-9b185b62ea95-delete_volume" released by "delete_volume" :: held 1.570s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 13:59:27 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-b850b900-593a-43bf-8feb-d8c8dc089ad2 tempest-VolumesSnapshotTestJSON-2010930921 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 13:59:27 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-b850b900-593a-43bf-8feb-d8c8dc089ad2 tempest-VolumesSnapshotTestJSON-2010930921 None] Flow 'volume_create_manager' (c13a824e-cbd4-4d1f-8f94-a48bd3c4e220) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 13:59:27 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-b850b900-593a-43bf-8feb-d8c8dc089ad2 tempest-VolumesSnapshotTestJSON-2010930921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72d2da58-c8c1-41fd-943f-298327436285) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:59:27 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-b850b900-593a-43bf-8feb-d8c8dc089ad2 tempest-VolumesSnapshotTestJSON-2010930921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72d2da58-c8c1-41fd-943f-298327436285) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T11:59:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-160344188',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c94aaf5-d714-4dca-9c04-5530c8e943f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8897ab25feb4d999872fbe658460fa6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T11:59:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T11:59:27Z,use_quota=True,user_id='a6f445ef8dc04c7b92c04febd3515b27',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1147de8b-623b-426c-a13d-7fc824a80f67),volume_type_id=1147de8b-623b-426c-a13d-7fc824a80f67)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:59:27 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-b850b900-593a-43bf-8feb-d8c8dc089ad2 tempest-VolumesSnapshotTestJSON-2010930921 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f840e92-1c98-4d80-ab8e-d3887719df19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:59:27 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-b850b900-593a-43bf-8feb-d8c8dc089ad2 tempest-VolumesSnapshotTestJSON-2010930921 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f840e92-1c98-4d80-ab8e-d3887719df19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:59:27 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-b850b900-593a-43bf-8feb-d8c8dc089ad2 tempest-VolumesSnapshotTestJSON-2010930921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94ffac5e-7966-4306-82e4-9175fad8cf28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:59:27 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-b850b900-593a-43bf-8feb-d8c8dc089ad2 tempest-VolumesSnapshotTestJSON-2010930921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94ffac5e-7966-4306-82e4-9175fad8cf28) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4c94aaf5-d714-4dca-9c04-5530c8e943f8', 'volume_name': 'volume-4c94aaf5-d714-4dca-9c04-5530c8e943f8', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:59:27 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-b850b900-593a-43bf-8feb-d8c8dc089ad2 tempest-VolumesSnapshotTestJSON-2010930921 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d541806-ff8c-47dc-a692-133610a01bde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:59:27 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-b850b900-593a-43bf-8feb-d8c8dc089ad2 tempest-VolumesSnapshotTestJSON-2010930921 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d541806-ff8c-47dc-a692-133610a01bde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:59:27 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-b850b900-593a-43bf-8feb-d8c8dc089ad2 tempest-VolumesSnapshotTestJSON-2010930921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af1d4c22-3a52-40aa-95d0-814c6451c07f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:59:27 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-b850b900-593a-43bf-8feb-d8c8dc089ad2 tempest-VolumesSnapshotTestJSON-2010930921 None] Volume 4c94aaf5-d714-4dca-9c04-5530c8e943f8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4c94aaf5-d714-4dca-9c04-5530c8e943f8', 'volume_size': 1} Jul 13 13:59:27 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-b850b900-593a-43bf-8feb-d8c8dc089ad2 tempest-VolumesSnapshotTestJSON-2010930921 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:59:27 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-b850b900-593a-43bf-8feb-d8c8dc089ad2 tempest-VolumesSnapshotTestJSON-2010930921 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:59:27 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-b850b900-593a-43bf-8feb-d8c8dc089ad2 tempest-VolumesSnapshotTestJSON-2010930921 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T11:59:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-160344188',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c94aaf5-d714-4dca-9c04-5530c8e943f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8897ab25feb4d999872fbe658460fa6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T11:59:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T11:59:27Z,use_quota=True,user_id='a6f445ef8dc04c7b92c04febd3515b27',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1147de8b-623b-426c-a13d-7fc824a80f67),volume_type_id=1147de8b-623b-426c-a13d-7fc824a80f67)}" {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 13 13:59:27 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-b850b900-593a-43bf-8feb-d8c8dc089ad2 tempest-VolumesSnapshotTestJSON-2010930921 None] Creating volume 4c94aaf5-d714-4dca-9c04-5530c8e943f8 {{(pid=87098) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 13 13:59:27 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-b850b900-593a-43bf-8feb-d8c8dc089ad2 tempest-VolumesSnapshotTestJSON-2010930921 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:59:27 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-b850b900-593a-43bf-8feb-d8c8dc089ad2 tempest-VolumesSnapshotTestJSON-2010930921 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:59:27 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-b850b900-593a-43bf-8feb-d8c8dc089ad2 tempest-VolumesSnapshotTestJSON-2010930921 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 13:59:27 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-b850b900-593a-43bf-8feb-d8c8dc089ad2 tempest-VolumesSnapshotTestJSON-2010930921 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 13:59:27 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-b850b900-593a-43bf-8feb-d8c8dc089ad2 tempest-VolumesSnapshotTestJSON-2010930921 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:59:27 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-b850b900-593a-43bf-8feb-d8c8dc089ad2 tempest-VolumesSnapshotTestJSON-2010930921 None] Selected osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 13:59:27 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-b850b900-593a-43bf-8feb-d8c8dc089ad2 tempest-VolumesSnapshotTestJSON-2010930921 None] casted to osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 Jul 13 13:59:27 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-b850b900-593a-43bf-8feb-d8c8dc089ad2 tempest-VolumesSnapshotTestJSON-2010930921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-4c94aaf5-d714-4dca-9c04-5530c8e943f8 1073741824 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:59:27 devstack sudo[99270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-4c94aaf5-d714-4dca-9c04-5530c8e943f8 1073741824 Jul 13 13:59:27 devstack sudo[99270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:59:27 devstack sudo[99270]: pam_unix(sudo:session): session closed for user root Jul 13 13:59:27 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-b850b900-593a-43bf-8feb-d8c8dc089ad2 tempest-VolumesSnapshotTestJSON-2010930921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-4c94aaf5-d714-4dca-9c04-5530c8e943f8 1073741824" returned: 0 in 0.700s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:59:27 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-b850b900-593a-43bf-8feb-d8c8dc089ad2 tempest-VolumesSnapshotTestJSON-2010930921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-4c94aaf5-d714-4dca-9c04-5530c8e943f8 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:59:28 devstack sudo[99286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-4c94aaf5-d714-4dca-9c04-5530c8e943f8 Jul 13 13:59:28 devstack sudo[99286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:59:28 devstack sudo[99286]: pam_unix(sudo:session): session closed for user root Jul 13 13:59:28 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-b850b900-593a-43bf-8feb-d8c8dc089ad2 tempest-VolumesSnapshotTestJSON-2010930921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-4c94aaf5-d714-4dca-9c04-5530c8e943f8" returned: 0 in 0.333s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:59:28 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-b850b900-593a-43bf-8feb-d8c8dc089ad2 tempest-VolumesSnapshotTestJSON-2010930921 None] <== create_volume: return (1144ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'} {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 13 13:59:28 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-b850b900-593a-43bf-8feb-d8c8dc089ad2 tempest-VolumesSnapshotTestJSON-2010930921 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.147s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:59:28 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-b850b900-593a-43bf-8feb-d8c8dc089ad2 tempest-VolumesSnapshotTestJSON-2010930921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af1d4c22-3a52-40aa-95d0-814c6451c07f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4c94aaf5-d714-4dca-9c04-5530c8e943f8', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:59:28 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-b850b900-593a-43bf-8feb-d8c8dc089ad2 tempest-VolumesSnapshotTestJSON-2010930921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dec2ccb6-c5ff-4d10-82ca-f2a43eb43768) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:59:28 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-b850b900-593a-43bf-8feb-d8c8dc089ad2 tempest-VolumesSnapshotTestJSON-2010930921 None] Volume volume-4c94aaf5-d714-4dca-9c04-5530c8e943f8 (4c94aaf5-d714-4dca-9c04-5530c8e943f8): created successfully Jul 13 13:59:28 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-b850b900-593a-43bf-8feb-d8c8dc089ad2 tempest-VolumesSnapshotTestJSON-2010930921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dec2ccb6-c5ff-4d10-82ca-f2a43eb43768) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:59:28 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-b850b900-593a-43bf-8feb-d8c8dc089ad2 tempest-VolumesSnapshotTestJSON-2010930921 None] Flow 'volume_create_manager' (c13a824e-cbd4-4d1f-8f94-a48bd3c4e220) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 13:59:28 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-b850b900-593a-43bf-8feb-d8c8dc089ad2 tempest-VolumesSnapshotTestJSON-2010930921 None] Created volume successfully. Jul 13 13:59:29 devstack cinder-volume[87098]: DEBUG oslo_service.periodic_task [None req-727a1692-ea28-4a77-b327-0d94e8f01efb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87098) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 13 13:59:29 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-727a1692-ea28-4a77-b327-0d94e8f01efb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:59:29 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-727a1692-ea28-4a77-b327-0d94e8f01efb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:59:29 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-727a1692-ea28-4a77-b327-0d94e8f01efb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 13:59:29 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-727a1692-ea28-4a77-b327-0d94e8f01efb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 13:59:29 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-727a1692-ea28-4a77-b327-0d94e8f01efb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:59:29 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-727a1692-ea28-4a77-b327-0d94e8f01efb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:59:29 devstack sudo[99297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 Jul 13 13:59:29 devstack sudo[99297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:59:29 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-53785424-05aa-434e-a55c-002be0e3db23 tempest-ProjectReaderTests-630293705 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 13:59:29 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-53785424-05aa-434e-a55c-002be0e3db23 tempest-ProjectReaderTests-630293705 None] Flow 'volume_create_manager' (0e14a644-35de-438a-9312-1189ce047897) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 13:59:29 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-53785424-05aa-434e-a55c-002be0e3db23 tempest-ProjectReaderTests-630293705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49ab6cf1-0c4b-40dc-b388-2aa253512a5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:59:29 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-53785424-05aa-434e-a55c-002be0e3db23 tempest-ProjectReaderTests-630293705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49ab6cf1-0c4b-40dc-b388-2aa253512a5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T11:59:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1507792876',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e25cc3f0-8d67-4dea-be72-2ca8f7d3daa5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66fac89a08a9403ebd313bca8f11e9b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T11:59:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T11:59:29Z,use_quota=True,user_id='9610b3443d82426f903081749355c972',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1147de8b-623b-426c-a13d-7fc824a80f67),volume_type_id=1147de8b-623b-426c-a13d-7fc824a80f67)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:59:29 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-53785424-05aa-434e-a55c-002be0e3db23 tempest-ProjectReaderTests-630293705 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb4ebd04-61ab-4f3f-bb16-5ac5ef5c85e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:59:29 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-53785424-05aa-434e-a55c-002be0e3db23 tempest-ProjectReaderTests-630293705 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb4ebd04-61ab-4f3f-bb16-5ac5ef5c85e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:59:29 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-53785424-05aa-434e-a55c-002be0e3db23 tempest-ProjectReaderTests-630293705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (032a8e39-1247-4250-87a3-46c29b83460b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:59:29 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-53785424-05aa-434e-a55c-002be0e3db23 tempest-ProjectReaderTests-630293705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (032a8e39-1247-4250-87a3-46c29b83460b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e25cc3f0-8d67-4dea-be72-2ca8f7d3daa5', 'volume_name': 'volume-e25cc3f0-8d67-4dea-be72-2ca8f7d3daa5', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:59:29 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-53785424-05aa-434e-a55c-002be0e3db23 tempest-ProjectReaderTests-630293705 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a336c941-0b98-4560-872c-6f0e1330a179) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:59:29 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-53785424-05aa-434e-a55c-002be0e3db23 tempest-ProjectReaderTests-630293705 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a336c941-0b98-4560-872c-6f0e1330a179) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:59:29 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-53785424-05aa-434e-a55c-002be0e3db23 tempest-ProjectReaderTests-630293705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a4c94f6-a546-4d5a-81b6-fad8cbaafef4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:59:29 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-53785424-05aa-434e-a55c-002be0e3db23 tempest-ProjectReaderTests-630293705 None] Volume e25cc3f0-8d67-4dea-be72-2ca8f7d3daa5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e25cc3f0-8d67-4dea-be72-2ca8f7d3daa5', 'volume_size': 1} Jul 13 13:59:29 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-53785424-05aa-434e-a55c-002be0e3db23 tempest-ProjectReaderTests-630293705 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:59:29 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-53785424-05aa-434e-a55c-002be0e3db23 tempest-ProjectReaderTests-630293705 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:59:29 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-53785424-05aa-434e-a55c-002be0e3db23 tempest-ProjectReaderTests-630293705 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T11:59:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1507792876',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e25cc3f0-8d67-4dea-be72-2ca8f7d3daa5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66fac89a08a9403ebd313bca8f11e9b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T11:59:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T11:59:29Z,use_quota=True,user_id='9610b3443d82426f903081749355c972',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1147de8b-623b-426c-a13d-7fc824a80f67),volume_type_id=1147de8b-623b-426c-a13d-7fc824a80f67)}" {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 13 13:59:29 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-53785424-05aa-434e-a55c-002be0e3db23 tempest-ProjectReaderTests-630293705 None] Creating volume e25cc3f0-8d67-4dea-be72-2ca8f7d3daa5 {{(pid=87098) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 13 13:59:29 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-53785424-05aa-434e-a55c-002be0e3db23 tempest-ProjectReaderTests-630293705 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:59:29 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-53785424-05aa-434e-a55c-002be0e3db23 tempest-ProjectReaderTests-630293705 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:59:29 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-53785424-05aa-434e-a55c-002be0e3db23 tempest-ProjectReaderTests-630293705 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 13:59:29 devstack sudo[99297]: pam_unix(sudo:session): session closed for user root Jul 13 13:59:29 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-53785424-05aa-434e-a55c-002be0e3db23 tempest-ProjectReaderTests-630293705 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 13:59:29 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-53785424-05aa-434e-a55c-002be0e3db23 tempest-ProjectReaderTests-630293705 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:59:29 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-53785424-05aa-434e-a55c-002be0e3db23 tempest-ProjectReaderTests-630293705 None] Selected osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 13:59:29 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-53785424-05aa-434e-a55c-002be0e3db23 tempest-ProjectReaderTests-630293705 None] casted to osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 Jul 13 13:59:29 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-53785424-05aa-434e-a55c-002be0e3db23 tempest-ProjectReaderTests-630293705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-e25cc3f0-8d67-4dea-be72-2ca8f7d3daa5 1073741824 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:59:29 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-727a1692-ea28-4a77-b327-0d94e8f01efb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78" returned: 0 in 0.351s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:59:29 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-727a1692-ea28-4a77-b327-0d94e8f01efb None None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 13:59:29 devstack cinder-volume[87098]: DEBUG oslo_service.periodic_task [None req-727a1692-ea28-4a77-b327-0d94e8f01efb None None] Running periodic task VolumeManager._thread_info {{(pid=87098) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 13 13:59:29 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-727a1692-ea28-4a77-b327-0d94e8f01efb None None] thread count: 28 {{(pid=87098) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 13 13:59:29 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-727a1692-ea28-4a77-b327-0d94e8f01efb None None] thread info: [<_MainThread(MainThread, started 127988054597760)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87098) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 13 13:59:29 devstack sudo[99300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-e25cc3f0-8d67-4dea-be72-2ca8f7d3daa5 1073741824 Jul 13 13:59:29 devstack sudo[99300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:59:29 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-00129afe-d7c8-4fc1-baf1-511dfa36c511 tempest-VolumeQuotasAdminTestJSON-266319514 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 13:59:29 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-00129afe-d7c8-4fc1-baf1-511dfa36c511 tempest-VolumeQuotasAdminTestJSON-266319514 None] Flow 'volume_create_manager' (cc3049c5-30f1-4a1b-8d54-6c46c711e0c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 13:59:29 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-00129afe-d7c8-4fc1-baf1-511dfa36c511 tempest-VolumeQuotasAdminTestJSON-266319514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5a53771-cc54-4fd7-8278-dcbc59f66062) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:59:29 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-00129afe-d7c8-4fc1-baf1-511dfa36c511 tempest-VolumeQuotasAdminTestJSON-266319514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5a53771-cc54-4fd7-8278-dcbc59f66062) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T11:59:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1075363657',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be01d87b-9932-4a73-b03a-3f3772186432,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4725fe9dfcd4bb8b3512a2fc5657d11',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T11:59:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T11:59:29Z,use_quota=True,user_id='d6ab33c31ee04f598c66cdbde0727c6c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1147de8b-623b-426c-a13d-7fc824a80f67),volume_type_id=1147de8b-623b-426c-a13d-7fc824a80f67)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:59:29 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-00129afe-d7c8-4fc1-baf1-511dfa36c511 tempest-VolumeQuotasAdminTestJSON-266319514 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4749e2ae-c17d-416d-a26c-306c627852c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:59:29 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-00129afe-d7c8-4fc1-baf1-511dfa36c511 tempest-VolumeQuotasAdminTestJSON-266319514 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4749e2ae-c17d-416d-a26c-306c627852c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:59:29 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-00129afe-d7c8-4fc1-baf1-511dfa36c511 tempest-VolumeQuotasAdminTestJSON-266319514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e6e91ba-f7b4-4646-9a86-0cff3d472f4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:59:29 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-00129afe-d7c8-4fc1-baf1-511dfa36c511 tempest-VolumeQuotasAdminTestJSON-266319514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e6e91ba-f7b4-4646-9a86-0cff3d472f4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'be01d87b-9932-4a73-b03a-3f3772186432', 'volume_name': 'volume-be01d87b-9932-4a73-b03a-3f3772186432', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:59:29 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-00129afe-d7c8-4fc1-baf1-511dfa36c511 tempest-VolumeQuotasAdminTestJSON-266319514 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9aef20ed-cf33-43c0-bcd9-ba345d1a30c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:59:29 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-00129afe-d7c8-4fc1-baf1-511dfa36c511 tempest-VolumeQuotasAdminTestJSON-266319514 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9aef20ed-cf33-43c0-bcd9-ba345d1a30c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:59:29 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-00129afe-d7c8-4fc1-baf1-511dfa36c511 tempest-VolumeQuotasAdminTestJSON-266319514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29545a6a-54e3-4502-81d8-6e9400e81b3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:59:29 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-00129afe-d7c8-4fc1-baf1-511dfa36c511 tempest-VolumeQuotasAdminTestJSON-266319514 None] Volume be01d87b-9932-4a73-b03a-3f3772186432: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-be01d87b-9932-4a73-b03a-3f3772186432', 'volume_size': 1} Jul 13 13:59:29 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-00129afe-d7c8-4fc1-baf1-511dfa36c511 tempest-VolumeQuotasAdminTestJSON-266319514 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:59:29 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-7a385cd6-e8b8-494d-8308-1478825fc69e tempest-VolumesSnapshotTestJSON-2010930921 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:59:29 devstack sudo[99300]: pam_unix(sudo:session): session closed for user root Jul 13 13:59:29 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-53785424-05aa-434e-a55c-002be0e3db23 tempest-ProjectReaderTests-630293705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-e25cc3f0-8d67-4dea-be72-2ca8f7d3daa5 1073741824" returned: 0 in 0.518s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:59:29 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-53785424-05aa-434e-a55c-002be0e3db23 tempest-ProjectReaderTests-630293705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-e25cc3f0-8d67-4dea-be72-2ca8f7d3daa5 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:59:29 devstack sudo[99306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-e25cc3f0-8d67-4dea-be72-2ca8f7d3daa5 Jul 13 13:59:29 devstack sudo[99306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:59:30 devstack sudo[99306]: pam_unix(sudo:session): session closed for user root Jul 13 13:59:30 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-53785424-05aa-434e-a55c-002be0e3db23 tempest-ProjectReaderTests-630293705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-e25cc3f0-8d67-4dea-be72-2ca8f7d3daa5" returned: 0 in 0.272s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:59:30 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-53785424-05aa-434e-a55c-002be0e3db23 tempest-ProjectReaderTests-630293705 None] <== create_volume: return (846ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'} {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 13 13:59:30 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-53785424-05aa-434e-a55c-002be0e3db23 tempest-ProjectReaderTests-630293705 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.849s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:59:30 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-00129afe-d7c8-4fc1-baf1-511dfa36c511 tempest-VolumeQuotasAdminTestJSON-266319514 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.634s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:59:30 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-00129afe-d7c8-4fc1-baf1-511dfa36c511 tempest-VolumeQuotasAdminTestJSON-266319514 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T11:59:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1075363657',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be01d87b-9932-4a73-b03a-3f3772186432,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4725fe9dfcd4bb8b3512a2fc5657d11',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T11:59:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T11:59:29Z,use_quota=True,user_id='d6ab33c31ee04f598c66cdbde0727c6c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1147de8b-623b-426c-a13d-7fc824a80f67),volume_type_id=1147de8b-623b-426c-a13d-7fc824a80f67)}" {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 13 13:59:30 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-00129afe-d7c8-4fc1-baf1-511dfa36c511 tempest-VolumeQuotasAdminTestJSON-266319514 None] Creating volume be01d87b-9932-4a73-b03a-3f3772186432 {{(pid=87098) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 13 13:59:30 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-00129afe-d7c8-4fc1-baf1-511dfa36c511 tempest-VolumeQuotasAdminTestJSON-266319514 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:59:30 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-00129afe-d7c8-4fc1-baf1-511dfa36c511 tempest-VolumeQuotasAdminTestJSON-266319514 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:59:30 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-00129afe-d7c8-4fc1-baf1-511dfa36c511 tempest-VolumeQuotasAdminTestJSON-266319514 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 13:59:30 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-00129afe-d7c8-4fc1-baf1-511dfa36c511 tempest-VolumeQuotasAdminTestJSON-266319514 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 13:59:30 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-00129afe-d7c8-4fc1-baf1-511dfa36c511 tempest-VolumeQuotasAdminTestJSON-266319514 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:59:30 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-00129afe-d7c8-4fc1-baf1-511dfa36c511 tempest-VolumeQuotasAdminTestJSON-266319514 None] Selected osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 13:59:30 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-00129afe-d7c8-4fc1-baf1-511dfa36c511 tempest-VolumeQuotasAdminTestJSON-266319514 None] casted to osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 Jul 13 13:59:30 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-00129afe-d7c8-4fc1-baf1-511dfa36c511 tempest-VolumeQuotasAdminTestJSON-266319514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-be01d87b-9932-4a73-b03a-3f3772186432 1073741824 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:59:30 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-53785424-05aa-434e-a55c-002be0e3db23 tempest-ProjectReaderTests-630293705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a4c94f6-a546-4d5a-81b6-fad8cbaafef4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e25cc3f0-8d67-4dea-be72-2ca8f7d3daa5', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:59:30 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-53785424-05aa-434e-a55c-002be0e3db23 tempest-ProjectReaderTests-630293705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49cac2ff-c3e2-405d-9a40-e6430f1ac77a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:59:30 devstack sudo[99310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-be01d87b-9932-4a73-b03a-3f3772186432 1073741824 Jul 13 13:59:30 devstack sudo[99310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:59:30 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-53785424-05aa-434e-a55c-002be0e3db23 tempest-ProjectReaderTests-630293705 None] Volume volume-e25cc3f0-8d67-4dea-be72-2ca8f7d3daa5 (e25cc3f0-8d67-4dea-be72-2ca8f7d3daa5): created successfully Jul 13 13:59:30 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-53785424-05aa-434e-a55c-002be0e3db23 tempest-ProjectReaderTests-630293705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49cac2ff-c3e2-405d-9a40-e6430f1ac77a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:59:30 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-53785424-05aa-434e-a55c-002be0e3db23 tempest-ProjectReaderTests-630293705 None] Flow 'volume_create_manager' (0e14a644-35de-438a-9312-1189ce047897) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 13:59:30 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-53785424-05aa-434e-a55c-002be0e3db23 tempest-ProjectReaderTests-630293705 None] Created volume successfully. Jul 13 13:59:30 devstack sudo[99310]: pam_unix(sudo:session): session closed for user root Jul 13 13:59:30 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-00129afe-d7c8-4fc1-baf1-511dfa36c511 tempest-VolumeQuotasAdminTestJSON-266319514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-be01d87b-9932-4a73-b03a-3f3772186432 1073741824" returned: 0 in 0.654s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:59:30 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-00129afe-d7c8-4fc1-baf1-511dfa36c511 tempest-VolumeQuotasAdminTestJSON-266319514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-be01d87b-9932-4a73-b03a-3f3772186432 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:59:30 devstack sudo[99334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-be01d87b-9932-4a73-b03a-3f3772186432 Jul 13 13:59:30 devstack sudo[99334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:59:31 devstack sudo[99334]: pam_unix(sudo:session): session closed for user root Jul 13 13:59:31 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-00129afe-d7c8-4fc1-baf1-511dfa36c511 tempest-VolumeQuotasAdminTestJSON-266319514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-be01d87b-9932-4a73-b03a-3f3772186432" returned: 0 in 0.462s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:59:31 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-00129afe-d7c8-4fc1-baf1-511dfa36c511 tempest-VolumeQuotasAdminTestJSON-266319514 None] <== create_volume: return (1181ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'} {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 13 13:59:31 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-00129afe-d7c8-4fc1-baf1-511dfa36c511 tempest-VolumeQuotasAdminTestJSON-266319514 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.187s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:59:31 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-7a385cd6-e8b8-494d-8308-1478825fc69e tempest-VolumesSnapshotTestJSON-2010930921 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.794s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:59:31 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-7a385cd6-e8b8-494d-8308-1478825fc69e tempest-VolumesSnapshotTestJSON-2010930921 None] Creating offline snapshot 866f23b9-502a-4e64-b437-5cfaf7369349 of volume 4c94aaf5-d714-4dca-9c04-5530c8e943f8 {{(pid=87098) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 13 13:59:31 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-00129afe-d7c8-4fc1-baf1-511dfa36c511 tempest-VolumeQuotasAdminTestJSON-266319514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29545a6a-54e3-4502-81d8-6e9400e81b3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-be01d87b-9932-4a73-b03a-3f3772186432', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:59:31 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-00129afe-d7c8-4fc1-baf1-511dfa36c511 tempest-VolumeQuotasAdminTestJSON-266319514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a2cdd2c-4b08-4286-bba5-235835480412) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:59:31 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc1cbdd2-80bd-473a-b7a4-bbb7b59d0738]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 13:59:31 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-7a385cd6-e8b8-494d-8308-1478825fc69e tempest-VolumesSnapshotTestJSON-2010930921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-4c94aaf5-d714-4dca-9c04-5530c8e943f8 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:59:31 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-00129afe-d7c8-4fc1-baf1-511dfa36c511 tempest-VolumeQuotasAdminTestJSON-266319514 None] Volume volume-be01d87b-9932-4a73-b03a-3f3772186432 (be01d87b-9932-4a73-b03a-3f3772186432): created successfully Jul 13 13:59:31 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-00129afe-d7c8-4fc1-baf1-511dfa36c511 tempest-VolumeQuotasAdminTestJSON-266319514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a2cdd2c-4b08-4286-bba5-235835480412) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:59:31 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-00129afe-d7c8-4fc1-baf1-511dfa36c511 tempest-VolumeQuotasAdminTestJSON-266319514 None] Flow 'volume_create_manager' (cc3049c5-30f1-4a1b-8d54-6c46c711e0c1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 13:59:31 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-476be7d2-3cc0-4188-a548-1fa59d1dd9de tempest-ProjectReaderTests-630293705 None] Acquiring lock "cinder-e25cc3f0-8d67-4dea-be72-2ca8f7d3daa5-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 13:59:31 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-00129afe-d7c8-4fc1-baf1-511dfa36c511 tempest-VolumeQuotasAdminTestJSON-266319514 None] Created volume successfully. Jul 13 13:59:31 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-476be7d2-3cc0-4188-a548-1fa59d1dd9de tempest-ProjectReaderTests-630293705 None] Lock "cinder-e25cc3f0-8d67-4dea-be72-2ca8f7d3daa5-delete_volume" acquired by "delete_volume" :: waited 0.070s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 13:59:31 devstack sudo[99377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-4c94aaf5-d714-4dca-9c04-5530c8e943f8 Jul 13 13:59:31 devstack sudo[99377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:59:31 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-476be7d2-3cc0-4188-a548-1fa59d1dd9de tempest-ProjectReaderTests-630293705 None] Acquiring lock "cinder-quobyte-e25cc3f0-8d67-4dea-be72-2ca8f7d3daa5" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 13:59:31 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-476be7d2-3cc0-4188-a548-1fa59d1dd9de tempest-ProjectReaderTests-630293705 None] Lock "cinder-quobyte-e25cc3f0-8d67-4dea-be72-2ca8f7d3daa5" acquired by "delete_volume" :: waited 0.075s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 13:59:31 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ee0098c-7c57-4dea-9821-0e24d1655df7]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 13:59:31 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-476be7d2-3cc0-4188-a548-1fa59d1dd9de tempest-ProjectReaderTests-630293705 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-e25cc3f0-8d67-4dea-be72-2ca8f7d3daa5 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:59:32 devstack sudo[99386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-e25cc3f0-8d67-4dea-be72-2ca8f7d3daa5 Jul 13 13:59:32 devstack sudo[99386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:59:32 devstack sudo[99377]: pam_unix(sudo:session): session closed for user root Jul 13 13:59:32 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-7a385cd6-e8b8-494d-8308-1478825fc69e tempest-VolumesSnapshotTestJSON-2010930921 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-4c94aaf5-d714-4dca-9c04-5530c8e943f8" returned: 0 in 0.601s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:59:32 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-7a385cd6-e8b8-494d-8308-1478825fc69e tempest-VolumesSnapshotTestJSON-2010930921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-4c94aaf5-d714-4dca-9c04-5530c8e943f8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-4c94aaf5-d714-4dca-9c04-5530c8e943f8.866f23b9-502a-4e64-b437-5cfaf7369349 1G {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:59:32 devstack sudo[99393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-4c94aaf5-d714-4dca-9c04-5530c8e943f8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-4c94aaf5-d714-4dca-9c04-5530c8e943f8.866f23b9-502a-4e64-b437-5cfaf7369349 1G Jul 13 13:59:32 devstack sudo[99393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:59:32 devstack sudo[99386]: pam_unix(sudo:session): session closed for user root Jul 13 13:59:32 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-476be7d2-3cc0-4188-a548-1fa59d1dd9de tempest-ProjectReaderTests-630293705 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-e25cc3f0-8d67-4dea-be72-2ca8f7d3daa5" returned: 0 in 0.434s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:59:32 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-476be7d2-3cc0-4188-a548-1fa59d1dd9de tempest-ProjectReaderTests-630293705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-e25cc3f0-8d67-4dea-be72-2ca8f7d3daa5 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:59:32 devstack sudo[99401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-e25cc3f0-8d67-4dea-be72-2ca8f7d3daa5 Jul 13 13:59:32 devstack sudo[99401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:59:32 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-5e6948ec-1a0f-4b22-a136-de3e07b4f3da tempest-VolumeQuotasAdminTestJSON-266319514 None] Acquiring lock "cinder-be01d87b-9932-4a73-b03a-3f3772186432-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 13:59:32 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-5e6948ec-1a0f-4b22-a136-de3e07b4f3da tempest-VolumeQuotasAdminTestJSON-266319514 None] Lock "cinder-be01d87b-9932-4a73-b03a-3f3772186432-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 13:59:32 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-5e6948ec-1a0f-4b22-a136-de3e07b4f3da tempest-VolumeQuotasAdminTestJSON-266319514 None] Acquiring lock "cinder-quobyte-be01d87b-9932-4a73-b03a-3f3772186432" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 13:59:32 devstack sudo[99401]: pam_unix(sudo:session): session closed for user root Jul 13 13:59:32 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-476be7d2-3cc0-4188-a548-1fa59d1dd9de tempest-ProjectReaderTests-630293705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-e25cc3f0-8d67-4dea-be72-2ca8f7d3daa5" returned: 0 in 0.438s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:59:32 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-5e6948ec-1a0f-4b22-a136-de3e07b4f3da tempest-VolumeQuotasAdminTestJSON-266319514 None] Lock "cinder-quobyte-be01d87b-9932-4a73-b03a-3f3772186432" acquired by "delete_volume" :: waited 0.040s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 13:59:32 devstack sudo[99393]: pam_unix(sudo:session): session closed for user root Jul 13 13:59:32 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-7a385cd6-e8b8-494d-8308-1478825fc69e tempest-VolumesSnapshotTestJSON-2010930921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-4c94aaf5-d714-4dca-9c04-5530c8e943f8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-4c94aaf5-d714-4dca-9c04-5530c8e943f8.866f23b9-502a-4e64-b437-5cfaf7369349 1G" returned: 0 in 0.760s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:59:32 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-7a385cd6-e8b8-494d-8308-1478825fc69e tempest-VolumesSnapshotTestJSON-2010930921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4c94aaf5-d714-4dca-9c04-5530c8e943f8 -F qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-4c94aaf5-d714-4dca-9c04-5530c8e943f8.866f23b9-502a-4e64-b437-5cfaf7369349 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:59:32 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-476be7d2-3cc0-4188-a548-1fa59d1dd9de tempest-ProjectReaderTests-630293705 None] Lock "cinder-quobyte-e25cc3f0-8d67-4dea-be72-2ca8f7d3daa5" released by "delete_volume" :: held 1.007s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 13:59:32 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcd2db9e-34b3-40a5-8941-1d2f75c92687]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 13:59:32 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-5e6948ec-1a0f-4b22-a136-de3e07b4f3da tempest-VolumeQuotasAdminTestJSON-266319514 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-be01d87b-9932-4a73-b03a-3f3772186432 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:59:32 devstack sudo[99407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4c94aaf5-d714-4dca-9c04-5530c8e943f8 -F qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-4c94aaf5-d714-4dca-9c04-5530c8e943f8.866f23b9-502a-4e64-b437-5cfaf7369349 Jul 13 13:59:32 devstack sudo[99407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:59:33 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-476be7d2-3cc0-4188-a548-1fa59d1dd9de tempest-ProjectReaderTests-630293705 None] Created reservations ['0ed2f59b-7a8b-454a-a62e-d0c0952d481a', 'dc0d1728-2a3c-40fc-8d61-984016e30065', '620f8f6c-47d7-49e3-90e4-049f8deb1360', '66b59b90-8d20-46d1-aff5-7aa8ac60ba2f'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 13:59:33 devstack sudo[99408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-be01d87b-9932-4a73-b03a-3f3772186432 Jul 13 13:59:33 devstack sudo[99408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:59:33 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-476be7d2-3cc0-4188-a548-1fa59d1dd9de tempest-ProjectReaderTests-630293705 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:59:33 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-476be7d2-3cc0-4188-a548-1fa59d1dd9de tempest-ProjectReaderTests-630293705 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:59:33 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-476be7d2-3cc0-4188-a548-1fa59d1dd9de tempest-ProjectReaderTests-630293705 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 13:59:33 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-476be7d2-3cc0-4188-a548-1fa59d1dd9de tempest-ProjectReaderTests-630293705 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 13:59:33 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-476be7d2-3cc0-4188-a548-1fa59d1dd9de tempest-ProjectReaderTests-630293705 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:59:33 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-476be7d2-3cc0-4188-a548-1fa59d1dd9de tempest-ProjectReaderTests-630293705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:59:33 devstack sudo[99411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 Jul 13 13:59:33 devstack sudo[99411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:59:33 devstack sudo[99407]: pam_unix(sudo:session): session closed for user root Jul 13 13:59:33 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-7a385cd6-e8b8-494d-8308-1478825fc69e tempest-VolumesSnapshotTestJSON-2010930921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4c94aaf5-d714-4dca-9c04-5530c8e943f8 -F qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-4c94aaf5-d714-4dca-9c04-5530c8e943f8.866f23b9-502a-4e64-b437-5cfaf7369349" returned: 0 in 0.395s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:59:33 devstack cinder-volume[87098]: WARNING cinder.volume.drivers.remotefs [None req-7a385cd6-e8b8-494d-8308-1478825fc69e tempest-VolumesSnapshotTestJSON-2010930921 None] /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-4c94aaf5-d714-4dca-9c04-5530c8e943f8.866f23b9-502a-4e64-b437-5cfaf7369349 is being set with open permissions: ugo+rw Jul 13 13:59:33 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-7a385cd6-e8b8-494d-8308-1478825fc69e tempest-VolumesSnapshotTestJSON-2010930921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-4c94aaf5-d714-4dca-9c04-5530c8e943f8.866f23b9-502a-4e64-b437-5cfaf7369349 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:59:33 devstack sudo[99416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-4c94aaf5-d714-4dca-9c04-5530c8e943f8.866f23b9-502a-4e64-b437-5cfaf7369349 Jul 13 13:59:33 devstack sudo[99416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:59:33 devstack sudo[99408]: pam_unix(sudo:session): session closed for user root Jul 13 13:59:33 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-5e6948ec-1a0f-4b22-a136-de3e07b4f3da tempest-VolumeQuotasAdminTestJSON-266319514 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-be01d87b-9932-4a73-b03a-3f3772186432" returned: 0 in 0.558s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:59:33 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-5e6948ec-1a0f-4b22-a136-de3e07b4f3da tempest-VolumeQuotasAdminTestJSON-266319514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-be01d87b-9932-4a73-b03a-3f3772186432 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:59:33 devstack sudo[99411]: pam_unix(sudo:session): session closed for user root Jul 13 13:59:33 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-476be7d2-3cc0-4188-a548-1fa59d1dd9de tempest-ProjectReaderTests-630293705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78" returned: 0 in 0.359s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:59:33 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-476be7d2-3cc0-4188-a548-1fa59d1dd9de tempest-ProjectReaderTests-630293705 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 13:59:33 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-476be7d2-3cc0-4188-a548-1fa59d1dd9de tempest-ProjectReaderTests-630293705 None] Deleted volume successfully. Jul 13 13:59:33 devstack sudo[99422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-be01d87b-9932-4a73-b03a-3f3772186432 Jul 13 13:59:33 devstack sudo[99422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:59:33 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-476be7d2-3cc0-4188-a548-1fa59d1dd9de tempest-ProjectReaderTests-630293705 None] Lock "cinder-e25cc3f0-8d67-4dea-be72-2ca8f7d3daa5-delete_volume" released by "delete_volume" :: held 1.889s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 13:59:33 devstack sudo[99416]: pam_unix(sudo:session): session closed for user root Jul 13 13:59:33 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-7a385cd6-e8b8-494d-8308-1478825fc69e tempest-VolumesSnapshotTestJSON-2010930921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-4c94aaf5-d714-4dca-9c04-5530c8e943f8.866f23b9-502a-4e64-b437-5cfaf7369349" returned: 0 in 0.337s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:59:33 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-7a385cd6-e8b8-494d-8308-1478825fc69e tempest-VolumesSnapshotTestJSON-2010930921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-4c94aaf5-d714-4dca-9c04-5530c8e943f8.info {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:59:33 devstack sudo[99425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-4c94aaf5-d714-4dca-9c04-5530c8e943f8.info Jul 13 13:59:33 devstack sudo[99425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:59:33 devstack sudo[99422]: pam_unix(sudo:session): session closed for user root Jul 13 13:59:33 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-5e6948ec-1a0f-4b22-a136-de3e07b4f3da tempest-VolumeQuotasAdminTestJSON-266319514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-be01d87b-9932-4a73-b03a-3f3772186432" returned: 0 in 0.411s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:59:33 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-5e6948ec-1a0f-4b22-a136-de3e07b4f3da tempest-VolumeQuotasAdminTestJSON-266319514 None] Lock "cinder-quobyte-be01d87b-9932-4a73-b03a-3f3772186432" released by "delete_volume" :: held 1.067s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 13:59:33 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-5e6948ec-1a0f-4b22-a136-de3e07b4f3da tempest-VolumeQuotasAdminTestJSON-266319514 None] Created reservations ['c161cdf3-27cc-471f-aee0-dde4dd2390a7', 'c0d1e05a-c610-45f7-91b7-4ce84483bd54', '1b4bf130-40ea-4d58-b442-5a91de51b8a8', '50f34c0a-316e-46b7-a7c9-6cdcc3e934b3'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 13:59:34 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-5e6948ec-1a0f-4b22-a136-de3e07b4f3da tempest-VolumeQuotasAdminTestJSON-266319514 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:59:34 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-5e6948ec-1a0f-4b22-a136-de3e07b4f3da tempest-VolumeQuotasAdminTestJSON-266319514 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:59:34 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-5e6948ec-1a0f-4b22-a136-de3e07b4f3da tempest-VolumeQuotasAdminTestJSON-266319514 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 13:59:34 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-5e6948ec-1a0f-4b22-a136-de3e07b4f3da tempest-VolumeQuotasAdminTestJSON-266319514 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 13:59:34 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-5e6948ec-1a0f-4b22-a136-de3e07b4f3da tempest-VolumeQuotasAdminTestJSON-266319514 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:59:34 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-5e6948ec-1a0f-4b22-a136-de3e07b4f3da tempest-VolumeQuotasAdminTestJSON-266319514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:59:34 devstack sudo[99428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 Jul 13 13:59:34 devstack sudo[99428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:59:34 devstack sudo[99425]: pam_unix(sudo:session): session closed for user root Jul 13 13:59:34 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-7a385cd6-e8b8-494d-8308-1478825fc69e tempest-VolumesSnapshotTestJSON-2010930921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-4c94aaf5-d714-4dca-9c04-5530c8e943f8.info" returned: 0 in 0.552s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:59:34 devstack cinder-volume[87098]: WARNING cinder.volume.drivers.remotefs [None req-7a385cd6-e8b8-494d-8308-1478825fc69e tempest-VolumesSnapshotTestJSON-2010930921 None] /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-4c94aaf5-d714-4dca-9c04-5530c8e943f8.info is being set with open permissions: ugo+rw Jul 13 13:59:34 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-7a385cd6-e8b8-494d-8308-1478825fc69e tempest-VolumesSnapshotTestJSON-2010930921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-4c94aaf5-d714-4dca-9c04-5530c8e943f8.info {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:59:34 devstack sudo[99431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-4c94aaf5-d714-4dca-9c04-5530c8e943f8.info Jul 13 13:59:34 devstack sudo[99431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:59:34 devstack sudo[99428]: pam_unix(sudo:session): session closed for user root Jul 13 13:59:34 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-5e6948ec-1a0f-4b22-a136-de3e07b4f3da tempest-VolumeQuotasAdminTestJSON-266319514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78" returned: 0 in 0.434s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:59:34 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-5e6948ec-1a0f-4b22-a136-de3e07b4f3da tempest-VolumeQuotasAdminTestJSON-266319514 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 13:59:34 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-5e6948ec-1a0f-4b22-a136-de3e07b4f3da tempest-VolumeQuotasAdminTestJSON-266319514 None] Deleted volume successfully. Jul 13 13:59:34 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-5e6948ec-1a0f-4b22-a136-de3e07b4f3da tempest-VolumeQuotasAdminTestJSON-266319514 None] Lock "cinder-be01d87b-9932-4a73-b03a-3f3772186432-delete_volume" released by "delete_volume" :: held 1.872s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 13:59:34 devstack sudo[99431]: pam_unix(sudo:session): session closed for user root Jul 13 13:59:34 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-7a385cd6-e8b8-494d-8308-1478825fc69e tempest-VolumesSnapshotTestJSON-2010930921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-4c94aaf5-d714-4dca-9c04-5530c8e943f8.info" returned: 0 in 0.489s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:59:34 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-7a385cd6-e8b8-494d-8308-1478825fc69e tempest-VolumesSnapshotTestJSON-2010930921 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.346s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:59:34 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-7a385cd6-e8b8-494d-8308-1478825fc69e tempest-VolumesSnapshotTestJSON-2010930921 None] Create snapshot completed successfully Jul 13 13:59:34 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-215680ea-3eb3-498a-9ac5-2156c86fbc85 tempest-ProjectReaderTests-630293705 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 13:59:34 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-215680ea-3eb3-498a-9ac5-2156c86fbc85 tempest-ProjectReaderTests-630293705 None] Flow 'volume_create_manager' (e8b61b23-f166-4f1c-b18b-f91d4b32b776) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 13:59:34 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-215680ea-3eb3-498a-9ac5-2156c86fbc85 tempest-ProjectReaderTests-630293705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (482fb1d4-ff03-45ac-a6b7-fc8342c9df62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:59:34 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-215680ea-3eb3-498a-9ac5-2156c86fbc85 tempest-ProjectReaderTests-630293705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (482fb1d4-ff03-45ac-a6b7-fc8342c9df62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T11:59:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1696116390',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d050d22-4be0-4e74-af3f-46677f1d7fcd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66fac89a08a9403ebd313bca8f11e9b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T11:59:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T11:59:35Z,use_quota=True,user_id='9610b3443d82426f903081749355c972',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1147de8b-623b-426c-a13d-7fc824a80f67),volume_type_id=1147de8b-623b-426c-a13d-7fc824a80f67)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:59:34 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-215680ea-3eb3-498a-9ac5-2156c86fbc85 tempest-ProjectReaderTests-630293705 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a75d3026-294b-4bb1-afa5-c41de599d02f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:59:34 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-215680ea-3eb3-498a-9ac5-2156c86fbc85 tempest-ProjectReaderTests-630293705 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a75d3026-294b-4bb1-afa5-c41de599d02f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:59:34 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-215680ea-3eb3-498a-9ac5-2156c86fbc85 tempest-ProjectReaderTests-630293705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (746ba7bb-c8e8-4643-8b98-84d33d2715fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:59:34 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-215680ea-3eb3-498a-9ac5-2156c86fbc85 tempest-ProjectReaderTests-630293705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (746ba7bb-c8e8-4643-8b98-84d33d2715fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3d050d22-4be0-4e74-af3f-46677f1d7fcd', 'volume_name': 'volume-3d050d22-4be0-4e74-af3f-46677f1d7fcd', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:59:34 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-215680ea-3eb3-498a-9ac5-2156c86fbc85 tempest-ProjectReaderTests-630293705 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85c1f8a2-bc98-4e98-ae40-ef0308bb59b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:59:34 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-215680ea-3eb3-498a-9ac5-2156c86fbc85 tempest-ProjectReaderTests-630293705 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85c1f8a2-bc98-4e98-ae40-ef0308bb59b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:59:34 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-215680ea-3eb3-498a-9ac5-2156c86fbc85 tempest-ProjectReaderTests-630293705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f38a189-0cc8-427b-b32a-35857f55ec80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:59:34 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-215680ea-3eb3-498a-9ac5-2156c86fbc85 tempest-ProjectReaderTests-630293705 None] Volume 3d050d22-4be0-4e74-af3f-46677f1d7fcd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3d050d22-4be0-4e74-af3f-46677f1d7fcd', 'volume_size': 1} Jul 13 13:59:34 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-215680ea-3eb3-498a-9ac5-2156c86fbc85 tempest-ProjectReaderTests-630293705 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:59:34 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-215680ea-3eb3-498a-9ac5-2156c86fbc85 tempest-ProjectReaderTests-630293705 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:59:34 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-215680ea-3eb3-498a-9ac5-2156c86fbc85 tempest-ProjectReaderTests-630293705 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T11:59:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1696116390',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d050d22-4be0-4e74-af3f-46677f1d7fcd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66fac89a08a9403ebd313bca8f11e9b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T11:59:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T11:59:35Z,use_quota=True,user_id='9610b3443d82426f903081749355c972',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1147de8b-623b-426c-a13d-7fc824a80f67),volume_type_id=1147de8b-623b-426c-a13d-7fc824a80f67)}" {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 13 13:59:34 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-215680ea-3eb3-498a-9ac5-2156c86fbc85 tempest-ProjectReaderTests-630293705 None] Creating volume 3d050d22-4be0-4e74-af3f-46677f1d7fcd {{(pid=87098) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 13 13:59:34 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-215680ea-3eb3-498a-9ac5-2156c86fbc85 tempest-ProjectReaderTests-630293705 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:59:34 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-215680ea-3eb3-498a-9ac5-2156c86fbc85 tempest-ProjectReaderTests-630293705 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:59:34 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-215680ea-3eb3-498a-9ac5-2156c86fbc85 tempest-ProjectReaderTests-630293705 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 13:59:35 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-215680ea-3eb3-498a-9ac5-2156c86fbc85 tempest-ProjectReaderTests-630293705 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 13:59:35 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-215680ea-3eb3-498a-9ac5-2156c86fbc85 tempest-ProjectReaderTests-630293705 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:59:35 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-215680ea-3eb3-498a-9ac5-2156c86fbc85 tempest-ProjectReaderTests-630293705 None] Selected osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 13:59:35 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-215680ea-3eb3-498a-9ac5-2156c86fbc85 tempest-ProjectReaderTests-630293705 None] casted to osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 Jul 13 13:59:35 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-215680ea-3eb3-498a-9ac5-2156c86fbc85 tempest-ProjectReaderTests-630293705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-3d050d22-4be0-4e74-af3f-46677f1d7fcd 1073741824 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:59:35 devstack sudo[99436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-3d050d22-4be0-4e74-af3f-46677f1d7fcd 1073741824 Jul 13 13:59:35 devstack sudo[99436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:59:35 devstack sudo[99436]: pam_unix(sudo:session): session closed for user root Jul 13 13:59:35 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-215680ea-3eb3-498a-9ac5-2156c86fbc85 tempest-ProjectReaderTests-630293705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-3d050d22-4be0-4e74-af3f-46677f1d7fcd 1073741824" returned: 0 in 0.651s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:59:35 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-215680ea-3eb3-498a-9ac5-2156c86fbc85 tempest-ProjectReaderTests-630293705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-3d050d22-4be0-4e74-af3f-46677f1d7fcd {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:59:35 devstack sudo[99443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-3d050d22-4be0-4e74-af3f-46677f1d7fcd Jul 13 13:59:35 devstack sudo[99443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:59:36 devstack sudo[99443]: pam_unix(sudo:session): session closed for user root Jul 13 13:59:36 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-215680ea-3eb3-498a-9ac5-2156c86fbc85 tempest-ProjectReaderTests-630293705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-3d050d22-4be0-4e74-af3f-46677f1d7fcd" returned: 0 in 0.443s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:59:36 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-215680ea-3eb3-498a-9ac5-2156c86fbc85 tempest-ProjectReaderTests-630293705 None] <== create_volume: return (1198ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'} {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 13 13:59:36 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-215680ea-3eb3-498a-9ac5-2156c86fbc85 tempest-ProjectReaderTests-630293705 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.203s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:59:36 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-215680ea-3eb3-498a-9ac5-2156c86fbc85 tempest-ProjectReaderTests-630293705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f38a189-0cc8-427b-b32a-35857f55ec80) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3d050d22-4be0-4e74-af3f-46677f1d7fcd', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:59:36 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-215680ea-3eb3-498a-9ac5-2156c86fbc85 tempest-ProjectReaderTests-630293705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (087bcfaf-1285-4c52-a116-0227c9158821) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:59:36 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-215680ea-3eb3-498a-9ac5-2156c86fbc85 tempest-ProjectReaderTests-630293705 None] Volume volume-3d050d22-4be0-4e74-af3f-46677f1d7fcd (3d050d22-4be0-4e74-af3f-46677f1d7fcd): created successfully Jul 13 13:59:36 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-215680ea-3eb3-498a-9ac5-2156c86fbc85 tempest-ProjectReaderTests-630293705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (087bcfaf-1285-4c52-a116-0227c9158821) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:59:36 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-215680ea-3eb3-498a-9ac5-2156c86fbc85 tempest-ProjectReaderTests-630293705 None] Flow 'volume_create_manager' (e8b61b23-f166-4f1c-b18b-f91d4b32b776) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 13:59:36 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-215680ea-3eb3-498a-9ac5-2156c86fbc85 tempest-ProjectReaderTests-630293705 None] Created volume successfully. Jul 13 13:59:36 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-3c36a0b9-1d0c-4218-9334-8d868b91b36d tempest-VolumesSnapshotTestJSON-2010930921 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 13:59:36 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-3c36a0b9-1d0c-4218-9334-8d868b91b36d tempest-VolumesSnapshotTestJSON-2010930921 None] Flow 'volume_create_manager' (292d3f9e-d15c-422d-80a7-bb6fd8100a15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 13:59:36 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-3c36a0b9-1d0c-4218-9334-8d868b91b36d tempest-VolumesSnapshotTestJSON-2010930921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fec3d501-1e35-4cba-ad73-a6c18ad774bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:59:36 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-eac3110c-11ae-439f-94d9-ce06dd13bc4d tempest-VolumeQuotasAdminTestJSON-266319514 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 13:59:36 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-eac3110c-11ae-439f-94d9-ce06dd13bc4d tempest-VolumeQuotasAdminTestJSON-266319514 None] Flow 'volume_create_manager' (f7396fc9-f911-4e3b-8ef0-9a0fd2834f84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 13:59:36 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-eac3110c-11ae-439f-94d9-ce06dd13bc4d tempest-VolumeQuotasAdminTestJSON-266319514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d86ad675-914c-4c7d-a90b-44731bdc8ca8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:59:36 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-3c36a0b9-1d0c-4218-9334-8d868b91b36d tempest-VolumesSnapshotTestJSON-2010930921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fec3d501-1e35-4cba-ad73-a6c18ad774bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T11:59:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1358524579',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f61fbe4f-ceb1-4b8a-9bd3-a9ecc65dfd21,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8897ab25feb4d999872fbe658460fa6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T11:59:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=866f23b9-502a-4e64-b437-5cfaf7369349,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T11:59:36Z,use_quota=True,user_id='a6f445ef8dc04c7b92c04febd3515b27',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1147de8b-623b-426c-a13d-7fc824a80f67),volume_type_id=1147de8b-623b-426c-a13d-7fc824a80f67)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:59:36 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-3c36a0b9-1d0c-4218-9334-8d868b91b36d tempest-VolumesSnapshotTestJSON-2010930921 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2dbbee83-4053-4157-be90-519e47d363e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:59:36 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-3c36a0b9-1d0c-4218-9334-8d868b91b36d tempest-VolumesSnapshotTestJSON-2010930921 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2dbbee83-4053-4157-be90-519e47d363e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:59:36 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-3c36a0b9-1d0c-4218-9334-8d868b91b36d tempest-VolumesSnapshotTestJSON-2010930921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de89b49f-4c0d-4687-8c90-4ca9a43e3925) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:59:36 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-3c36a0b9-1d0c-4218-9334-8d868b91b36d tempest-VolumesSnapshotTestJSON-2010930921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de89b49f-4c0d-4687-8c90-4ca9a43e3925) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'f61fbe4f-ceb1-4b8a-9bd3-a9ecc65dfd21', 'volume_name': 'volume-f61fbe4f-ceb1-4b8a-9bd3-a9ecc65dfd21', 'volume_size': 1, 'snapshot_id': '866f23b9-502a-4e64-b437-5cfaf7369349'}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:59:36 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-3c36a0b9-1d0c-4218-9334-8d868b91b36d tempest-VolumesSnapshotTestJSON-2010930921 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6bd2ab1a-c21e-4868-bb39-3fcd012ec82b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:59:36 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-3c36a0b9-1d0c-4218-9334-8d868b91b36d tempest-VolumesSnapshotTestJSON-2010930921 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6bd2ab1a-c21e-4868-bb39-3fcd012ec82b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:59:36 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-3c36a0b9-1d0c-4218-9334-8d868b91b36d tempest-VolumesSnapshotTestJSON-2010930921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5190cb5a-7610-4d75-9789-6c72447050b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:59:36 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-3c36a0b9-1d0c-4218-9334-8d868b91b36d tempest-VolumesSnapshotTestJSON-2010930921 None] Volume f61fbe4f-ceb1-4b8a-9bd3-a9ecc65dfd21: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-f61fbe4f-ceb1-4b8a-9bd3-a9ecc65dfd21', 'volume_size': 1, 'snapshot_id': '866f23b9-502a-4e64-b437-5cfaf7369349'} Jul 13 13:59:36 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-eac3110c-11ae-439f-94d9-ce06dd13bc4d tempest-VolumeQuotasAdminTestJSON-266319514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d86ad675-914c-4c7d-a90b-44731bdc8ca8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T11:59:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1584818769',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a352e45c-1598-4a3d-95b7-e94edfe1e544,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4725fe9dfcd4bb8b3512a2fc5657d11',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T11:59:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T11:59:36Z,use_quota=True,user_id='d6ab33c31ee04f598c66cdbde0727c6c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1147de8b-623b-426c-a13d-7fc824a80f67),volume_type_id=1147de8b-623b-426c-a13d-7fc824a80f67)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:59:36 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-eac3110c-11ae-439f-94d9-ce06dd13bc4d tempest-VolumeQuotasAdminTestJSON-266319514 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6539b1ab-cabf-4985-9366-622bf8e4999c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:59:36 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-eac3110c-11ae-439f-94d9-ce06dd13bc4d tempest-VolumeQuotasAdminTestJSON-266319514 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6539b1ab-cabf-4985-9366-622bf8e4999c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:59:36 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-eac3110c-11ae-439f-94d9-ce06dd13bc4d tempest-VolumeQuotasAdminTestJSON-266319514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (392d2d5d-a583-407d-818f-5b535805ed8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:59:36 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-eac3110c-11ae-439f-94d9-ce06dd13bc4d tempest-VolumeQuotasAdminTestJSON-266319514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (392d2d5d-a583-407d-818f-5b535805ed8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a352e45c-1598-4a3d-95b7-e94edfe1e544', 'volume_name': 'volume-a352e45c-1598-4a3d-95b7-e94edfe1e544', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:59:36 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-eac3110c-11ae-439f-94d9-ce06dd13bc4d tempest-VolumeQuotasAdminTestJSON-266319514 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f7d939e-32e3-4ad5-a8f9-daa0257c13b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:59:36 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-eac3110c-11ae-439f-94d9-ce06dd13bc4d tempest-VolumeQuotasAdminTestJSON-266319514 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f7d939e-32e3-4ad5-a8f9-daa0257c13b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:59:36 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-eac3110c-11ae-439f-94d9-ce06dd13bc4d tempest-VolumeQuotasAdminTestJSON-266319514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1341bca9-a041-4396-bff6-9fd98018695e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:59:36 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-eac3110c-11ae-439f-94d9-ce06dd13bc4d tempest-VolumeQuotasAdminTestJSON-266319514 None] Volume a352e45c-1598-4a3d-95b7-e94edfe1e544: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a352e45c-1598-4a3d-95b7-e94edfe1e544', 'volume_size': 1} Jul 13 13:59:36 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-eac3110c-11ae-439f-94d9-ce06dd13bc4d tempest-VolumeQuotasAdminTestJSON-266319514 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:59:36 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-eac3110c-11ae-439f-94d9-ce06dd13bc4d tempest-VolumeQuotasAdminTestJSON-266319514 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:59:36 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-eac3110c-11ae-439f-94d9-ce06dd13bc4d tempest-VolumeQuotasAdminTestJSON-266319514 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T11:59:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1584818769',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a352e45c-1598-4a3d-95b7-e94edfe1e544,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4725fe9dfcd4bb8b3512a2fc5657d11',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T11:59:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T11:59:36Z,use_quota=True,user_id='d6ab33c31ee04f598c66cdbde0727c6c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1147de8b-623b-426c-a13d-7fc824a80f67),volume_type_id=1147de8b-623b-426c-a13d-7fc824a80f67)}" {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 13 13:59:36 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-eac3110c-11ae-439f-94d9-ce06dd13bc4d tempest-VolumeQuotasAdminTestJSON-266319514 None] Creating volume a352e45c-1598-4a3d-95b7-e94edfe1e544 {{(pid=87098) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 13 13:59:36 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-eac3110c-11ae-439f-94d9-ce06dd13bc4d tempest-VolumeQuotasAdminTestJSON-266319514 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:59:36 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-eac3110c-11ae-439f-94d9-ce06dd13bc4d tempest-VolumeQuotasAdminTestJSON-266319514 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:59:36 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-eac3110c-11ae-439f-94d9-ce06dd13bc4d tempest-VolumeQuotasAdminTestJSON-266319514 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 13:59:36 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-eac3110c-11ae-439f-94d9-ce06dd13bc4d tempest-VolumeQuotasAdminTestJSON-266319514 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 13:59:36 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-eac3110c-11ae-439f-94d9-ce06dd13bc4d tempest-VolumeQuotasAdminTestJSON-266319514 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:59:36 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-eac3110c-11ae-439f-94d9-ce06dd13bc4d tempest-VolumeQuotasAdminTestJSON-266319514 None] Selected osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 13:59:36 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-eac3110c-11ae-439f-94d9-ce06dd13bc4d tempest-VolumeQuotasAdminTestJSON-266319514 None] casted to osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 Jul 13 13:59:36 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-eac3110c-11ae-439f-94d9-ce06dd13bc4d tempest-VolumeQuotasAdminTestJSON-266319514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-a352e45c-1598-4a3d-95b7-e94edfe1e544 1073741824 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:59:36 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-3c36a0b9-1d0c-4218-9334-8d868b91b36d tempest-VolumesSnapshotTestJSON-2010930921 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:59:36 devstack sudo[99447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-a352e45c-1598-4a3d-95b7-e94edfe1e544 1073741824 Jul 13 13:59:36 devstack sudo[99447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:59:37 devstack sudo[99447]: pam_unix(sudo:session): session closed for user root Jul 13 13:59:37 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-eac3110c-11ae-439f-94d9-ce06dd13bc4d tempest-VolumeQuotasAdminTestJSON-266319514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-a352e45c-1598-4a3d-95b7-e94edfe1e544 1073741824" returned: 0 in 0.478s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:59:37 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-eac3110c-11ae-439f-94d9-ce06dd13bc4d tempest-VolumeQuotasAdminTestJSON-266319514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-a352e45c-1598-4a3d-95b7-e94edfe1e544 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:59:37 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-84fdb4ba-a236-49ba-89d3-865670b91dc1 tempest-ProjectReaderTests-630293705 None] Acquiring lock "cinder-3d050d22-4be0-4e74-af3f-46677f1d7fcd-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 13:59:37 devstack sudo[99454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-a352e45c-1598-4a3d-95b7-e94edfe1e544 Jul 13 13:59:37 devstack sudo[99454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:59:37 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-84fdb4ba-a236-49ba-89d3-865670b91dc1 tempest-ProjectReaderTests-630293705 None] Lock "cinder-3d050d22-4be0-4e74-af3f-46677f1d7fcd-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 13:59:37 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-84fdb4ba-a236-49ba-89d3-865670b91dc1 tempest-ProjectReaderTests-630293705 None] Acquiring lock "cinder-quobyte-3d050d22-4be0-4e74-af3f-46677f1d7fcd" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 13:59:37 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-84fdb4ba-a236-49ba-89d3-865670b91dc1 tempest-ProjectReaderTests-630293705 None] Lock "cinder-quobyte-3d050d22-4be0-4e74-af3f-46677f1d7fcd" acquired by "delete_volume" :: waited 0.019s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 13:59:37 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[068aae3a-360b-4062-8c66-6ccac89f1eb5]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 13:59:37 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-84fdb4ba-a236-49ba-89d3-865670b91dc1 tempest-ProjectReaderTests-630293705 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-3d050d22-4be0-4e74-af3f-46677f1d7fcd {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:59:37 devstack sudo[99456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-3d050d22-4be0-4e74-af3f-46677f1d7fcd Jul 13 13:59:37 devstack sudo[99456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:59:37 devstack sudo[99454]: pam_unix(sudo:session): session closed for user root Jul 13 13:59:37 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-eac3110c-11ae-439f-94d9-ce06dd13bc4d tempest-VolumeQuotasAdminTestJSON-266319514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-a352e45c-1598-4a3d-95b7-e94edfe1e544" returned: 0 in 0.281s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:59:37 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-eac3110c-11ae-439f-94d9-ce06dd13bc4d tempest-VolumeQuotasAdminTestJSON-266319514 None] <== create_volume: return (811ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'} {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 13 13:59:37 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-eac3110c-11ae-439f-94d9-ce06dd13bc4d tempest-VolumeQuotasAdminTestJSON-266319514 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.814s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:59:37 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-3c36a0b9-1d0c-4218-9334-8d868b91b36d tempest-VolumesSnapshotTestJSON-2010930921 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.772s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:59:37 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-3c36a0b9-1d0c-4218-9334-8d868b91b36d tempest-VolumesSnapshotTestJSON-2010930921 None] Acquiring lock "cinder-quobyte-866f23b9-502a-4e64-b437-5cfaf7369349-f61fbe4f-ceb1-4b8a-9bd3-a9ecc65dfd21" by "_create_volume_from_snapshot" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 13:59:37 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-eac3110c-11ae-439f-94d9-ce06dd13bc4d tempest-VolumeQuotasAdminTestJSON-266319514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1341bca9-a041-4396-bff6-9fd98018695e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a352e45c-1598-4a3d-95b7-e94edfe1e544', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:59:37 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-eac3110c-11ae-439f-94d9-ce06dd13bc4d tempest-VolumeQuotasAdminTestJSON-266319514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c319924a-c541-492d-bc23-a5c81f493e13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:59:37 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-3c36a0b9-1d0c-4218-9334-8d868b91b36d tempest-VolumesSnapshotTestJSON-2010930921 None] Lock "cinder-quobyte-866f23b9-502a-4e64-b437-5cfaf7369349-f61fbe4f-ceb1-4b8a-9bd3-a9ecc65dfd21" acquired by "_create_volume_from_snapshot" :: waited 0.030s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 13:59:37 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-3c36a0b9-1d0c-4218-9334-8d868b91b36d tempest-VolumesSnapshotTestJSON-2010930921 None] Creating volume f61fbe4f-ceb1-4b8a-9bd3-a9ecc65dfd21 from snapshot 866f23b9-502a-4e64-b437-5cfaf7369349 {{(pid=87098) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 13 13:59:37 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-3c36a0b9-1d0c-4218-9334-8d868b91b36d tempest-VolumesSnapshotTestJSON-2010930921 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:59:37 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-3c36a0b9-1d0c-4218-9334-8d868b91b36d tempest-VolumesSnapshotTestJSON-2010930921 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:59:37 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-3c36a0b9-1d0c-4218-9334-8d868b91b36d tempest-VolumesSnapshotTestJSON-2010930921 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 13:59:37 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-3c36a0b9-1d0c-4218-9334-8d868b91b36d tempest-VolumesSnapshotTestJSON-2010930921 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 13:59:37 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-3c36a0b9-1d0c-4218-9334-8d868b91b36d tempest-VolumesSnapshotTestJSON-2010930921 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:59:37 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-3c36a0b9-1d0c-4218-9334-8d868b91b36d tempest-VolumesSnapshotTestJSON-2010930921 None] Selected osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 13:59:37 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-3c36a0b9-1d0c-4218-9334-8d868b91b36d tempest-VolumesSnapshotTestJSON-2010930921 None] Acquiring lock "cinder-quobyte-f61fbe4f-ceb1-4b8a-9bd3-a9ecc65dfd21" by "_copy_volume_from_snapshot" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 13:59:37 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-eac3110c-11ae-439f-94d9-ce06dd13bc4d tempest-VolumeQuotasAdminTestJSON-266319514 None] Volume volume-a352e45c-1598-4a3d-95b7-e94edfe1e544 (a352e45c-1598-4a3d-95b7-e94edfe1e544): created successfully Jul 13 13:59:37 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-eac3110c-11ae-439f-94d9-ce06dd13bc4d tempest-VolumeQuotasAdminTestJSON-266319514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c319924a-c541-492d-bc23-a5c81f493e13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:59:37 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-eac3110c-11ae-439f-94d9-ce06dd13bc4d tempest-VolumeQuotasAdminTestJSON-266319514 None] Flow 'volume_create_manager' (f7396fc9-f911-4e3b-8ef0-9a0fd2834f84) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 13:59:37 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-3c36a0b9-1d0c-4218-9334-8d868b91b36d tempest-VolumesSnapshotTestJSON-2010930921 None] Lock "cinder-quobyte-f61fbe4f-ceb1-4b8a-9bd3-a9ecc65dfd21" acquired by "_copy_volume_from_snapshot" :: waited 0.037s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 13:59:37 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-3c36a0b9-1d0c-4218-9334-8d868b91b36d tempest-VolumesSnapshotTestJSON-2010930921 None] snapshot: 866f23b9-502a-4e64-b437-5cfaf7369349, volume: f61fbe4f-ceb1-4b8a-9bd3-a9ecc65dfd21, {{(pid=87098) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 13 13:59:37 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-3c36a0b9-1d0c-4218-9334-8d868b91b36d tempest-VolumesSnapshotTestJSON-2010930921 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:59:37 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-3c36a0b9-1d0c-4218-9334-8d868b91b36d tempest-VolumesSnapshotTestJSON-2010930921 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:59:37 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-3c36a0b9-1d0c-4218-9334-8d868b91b36d tempest-VolumesSnapshotTestJSON-2010930921 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 13:59:37 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-3c36a0b9-1d0c-4218-9334-8d868b91b36d tempest-VolumesSnapshotTestJSON-2010930921 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 13:59:37 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-3c36a0b9-1d0c-4218-9334-8d868b91b36d tempest-VolumesSnapshotTestJSON-2010930921 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:59:37 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-eac3110c-11ae-439f-94d9-ce06dd13bc4d tempest-VolumeQuotasAdminTestJSON-266319514 None] Created volume successfully. Jul 13 13:59:37 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fb7b3df-ee32-4b15-8bae-76440105076f]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 13:59:37 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-3c36a0b9-1d0c-4218-9334-8d868b91b36d tempest-VolumesSnapshotTestJSON-2010930921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-4c94aaf5-d714-4dca-9c04-5530c8e943f8.866f23b9-502a-4e64-b437-5cfaf7369349 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:59:37 devstack sudo[99456]: pam_unix(sudo:session): session closed for user root Jul 13 13:59:37 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-84fdb4ba-a236-49ba-89d3-865670b91dc1 tempest-ProjectReaderTests-630293705 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-3d050d22-4be0-4e74-af3f-46677f1d7fcd" returned: 0 in 0.396s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:59:37 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-84fdb4ba-a236-49ba-89d3-865670b91dc1 tempest-ProjectReaderTests-630293705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-3d050d22-4be0-4e74-af3f-46677f1d7fcd {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:59:37 devstack sudo[99459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-4c94aaf5-d714-4dca-9c04-5530c8e943f8.866f23b9-502a-4e64-b437-5cfaf7369349 Jul 13 13:59:37 devstack sudo[99459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:59:37 devstack sudo[99463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-3d050d22-4be0-4e74-af3f-46677f1d7fcd Jul 13 13:59:37 devstack sudo[99463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:59:37 devstack sudo[99463]: pam_unix(sudo:session): session closed for user root Jul 13 13:59:37 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-84fdb4ba-a236-49ba-89d3-865670b91dc1 tempest-ProjectReaderTests-630293705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-3d050d22-4be0-4e74-af3f-46677f1d7fcd" returned: 0 in 0.270s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:59:37 devstack sudo[99459]: pam_unix(sudo:session): session closed for user root Jul 13 13:59:37 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-84fdb4ba-a236-49ba-89d3-865670b91dc1 tempest-ProjectReaderTests-630293705 None] Lock "cinder-quobyte-3d050d22-4be0-4e74-af3f-46677f1d7fcd" released by "delete_volume" :: held 0.714s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 13:59:37 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-3c36a0b9-1d0c-4218-9334-8d868b91b36d tempest-VolumesSnapshotTestJSON-2010930921 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-4c94aaf5-d714-4dca-9c04-5530c8e943f8.866f23b9-502a-4e64-b437-5cfaf7369349" returned: 0 in 0.413s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:59:37 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-3c36a0b9-1d0c-4218-9334-8d868b91b36d tempest-VolumesSnapshotTestJSON-2010930921 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4c94aaf5-d714-4dca-9c04-5530c8e943f8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87098) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 13 13:59:37 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-3c36a0b9-1d0c-4218-9334-8d868b91b36d tempest-VolumesSnapshotTestJSON-2010930921 None] will copy from snapshot at /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-4c94aaf5-d714-4dca-9c04-5530c8e943f8 {{(pid=87098) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 13 13:59:37 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-3c36a0b9-1d0c-4218-9334-8d868b91b36d tempest-VolumesSnapshotTestJSON-2010930921 None] Creating direct copy from snapshot {{(pid=87098) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 13 13:59:37 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[86142a1f-390d-48ed-a011-24e5c96268ce]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 13:59:37 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-3c36a0b9-1d0c-4218-9334-8d868b91b36d tempest-VolumesSnapshotTestJSON-2010930921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-4c94aaf5-d714-4dca-9c04-5530c8e943f8 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:59:37 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-84fdb4ba-a236-49ba-89d3-865670b91dc1 tempest-ProjectReaderTests-630293705 None] Created reservations ['56cfec3e-fd9d-4cd1-a238-6745f6c2ba00', 'd9a7aa30-626c-4a10-8b7c-2cfae3cfd4b3', '8ed1eea0-c1ef-4051-b3d6-774146b30344', 'e6d92d81-2bf1-4a58-81b7-7cb8c914a2a6'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 13:59:38 devstack sudo[99471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-4c94aaf5-d714-4dca-9c04-5530c8e943f8 Jul 13 13:59:38 devstack sudo[99471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:59:38 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-84fdb4ba-a236-49ba-89d3-865670b91dc1 tempest-ProjectReaderTests-630293705 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:59:38 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-84fdb4ba-a236-49ba-89d3-865670b91dc1 tempest-ProjectReaderTests-630293705 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:59:38 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-84fdb4ba-a236-49ba-89d3-865670b91dc1 tempest-ProjectReaderTests-630293705 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 13:59:38 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-84fdb4ba-a236-49ba-89d3-865670b91dc1 tempest-ProjectReaderTests-630293705 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 13:59:38 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-84fdb4ba-a236-49ba-89d3-865670b91dc1 tempest-ProjectReaderTests-630293705 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:59:38 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-84fdb4ba-a236-49ba-89d3-865670b91dc1 tempest-ProjectReaderTests-630293705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:59:38 devstack sudo[99473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 Jul 13 13:59:38 devstack sudo[99473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:59:38 devstack sudo[99473]: pam_unix(sudo:session): session closed for user root Jul 13 13:59:38 devstack sudo[99471]: pam_unix(sudo:session): session closed for user root Jul 13 13:59:38 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-84fdb4ba-a236-49ba-89d3-865670b91dc1 tempest-ProjectReaderTests-630293705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78" returned: 0 in 0.341s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:59:38 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-84fdb4ba-a236-49ba-89d3-865670b91dc1 tempest-ProjectReaderTests-630293705 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 13:59:38 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-3c36a0b9-1d0c-4218-9334-8d868b91b36d tempest-VolumesSnapshotTestJSON-2010930921 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-4c94aaf5-d714-4dca-9c04-5530c8e943f8" returned: 0 in 0.493s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:59:38 devstack cinder-volume[87098]: DEBUG cinder.utils [None req-3c36a0b9-1d0c-4218-9334-8d868b91b36d tempest-VolumesSnapshotTestJSON-2010930921 None] Path /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-f61fbe4f-ceb1-4b8a-9bd3-a9ecc65dfd21 not found in is_blk_device check {{(pid=87098) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 13 13:59:38 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-3c36a0b9-1d0c-4218-9334-8d868b91b36d tempest-VolumesSnapshotTestJSON-2010930921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-4c94aaf5-d714-4dca-9c04-5530c8e943f8 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-f61fbe4f-ceb1-4b8a-9bd3-a9ecc65dfd21 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:59:38 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-84fdb4ba-a236-49ba-89d3-865670b91dc1 tempest-ProjectReaderTests-630293705 None] Deleted volume successfully. Jul 13 13:59:38 devstack sudo[99479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-4c94aaf5-d714-4dca-9c04-5530c8e943f8 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-f61fbe4f-ceb1-4b8a-9bd3-a9ecc65dfd21 Jul 13 13:59:38 devstack sudo[99479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:59:38 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-84fdb4ba-a236-49ba-89d3-865670b91dc1 tempest-ProjectReaderTests-630293705 None] Lock "cinder-3d050d22-4be0-4e74-af3f-46677f1d7fcd-delete_volume" released by "delete_volume" :: held 1.361s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 13:59:38 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-6f3c3088-d1e1-48f0-bb39-7c6cc7d8c064 tempest-ProjectReaderTests-630293705 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 13:59:38 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-6f3c3088-d1e1-48f0-bb39-7c6cc7d8c064 tempest-ProjectReaderTests-630293705 None] Flow 'volume_create_manager' (70311551-4154-4401-a267-300874d644c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 13:59:38 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-6f3c3088-d1e1-48f0-bb39-7c6cc7d8c064 tempest-ProjectReaderTests-630293705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34cd82f0-cde5-45e7-bf4b-d63acfb910a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:59:39 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-6f3c3088-d1e1-48f0-bb39-7c6cc7d8c064 tempest-ProjectReaderTests-630293705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34cd82f0-cde5-45e7-bf4b-d63acfb910a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T11:59:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1650348223',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=993557dd-b48e-4bf2-a7be-a9daac1bb865,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66fac89a08a9403ebd313bca8f11e9b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T11:59:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T11:59:39Z,use_quota=True,user_id='9610b3443d82426f903081749355c972',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1147de8b-623b-426c-a13d-7fc824a80f67),volume_type_id=1147de8b-623b-426c-a13d-7fc824a80f67)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:59:39 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-6f3c3088-d1e1-48f0-bb39-7c6cc7d8c064 tempest-ProjectReaderTests-630293705 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (324e47d0-5a26-4c27-bf2c-d34e47ebd6de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:59:39 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-6f3c3088-d1e1-48f0-bb39-7c6cc7d8c064 tempest-ProjectReaderTests-630293705 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (324e47d0-5a26-4c27-bf2c-d34e47ebd6de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:59:39 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-6f3c3088-d1e1-48f0-bb39-7c6cc7d8c064 tempest-ProjectReaderTests-630293705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4a387b3-581c-43b9-affd-13c69cefd428) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:59:39 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-6f3c3088-d1e1-48f0-bb39-7c6cc7d8c064 tempest-ProjectReaderTests-630293705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4a387b3-581c-43b9-affd-13c69cefd428) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '993557dd-b48e-4bf2-a7be-a9daac1bb865', 'volume_name': 'volume-993557dd-b48e-4bf2-a7be-a9daac1bb865', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:59:39 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-6f3c3088-d1e1-48f0-bb39-7c6cc7d8c064 tempest-ProjectReaderTests-630293705 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24e9c386-5190-4b6b-b67b-e44ed1fc2c48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:59:39 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-6f3c3088-d1e1-48f0-bb39-7c6cc7d8c064 tempest-ProjectReaderTests-630293705 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24e9c386-5190-4b6b-b67b-e44ed1fc2c48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:59:39 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-6f3c3088-d1e1-48f0-bb39-7c6cc7d8c064 tempest-ProjectReaderTests-630293705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac20ef83-aecc-458d-a4b4-836c4c7442ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:59:39 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-6f3c3088-d1e1-48f0-bb39-7c6cc7d8c064 tempest-ProjectReaderTests-630293705 None] Volume 993557dd-b48e-4bf2-a7be-a9daac1bb865: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-993557dd-b48e-4bf2-a7be-a9daac1bb865', 'volume_size': 1} Jul 13 13:59:39 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-6f3c3088-d1e1-48f0-bb39-7c6cc7d8c064 tempest-ProjectReaderTests-630293705 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:59:39 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-33f709a7-d6d9-4873-b388-b009f178f55d tempest-VolumeQuotasAdminTestJSON-1732795362 None] Transfer volume completed successfully. Jul 13 13:59:40 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-b8da8bb3-7d09-4b71-b31f-fd52c353e760 tempest-VolumeQuotasAdminTestJSON-680355 None] Acquiring lock "cinder-a352e45c-1598-4a3d-95b7-e94edfe1e544-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 13:59:40 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-b8da8bb3-7d09-4b71-b31f-fd52c353e760 tempest-VolumeQuotasAdminTestJSON-680355 None] Lock "cinder-a352e45c-1598-4a3d-95b7-e94edfe1e544-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 13:59:40 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-b8da8bb3-7d09-4b71-b31f-fd52c353e760 tempest-VolumeQuotasAdminTestJSON-680355 None] Acquiring lock "cinder-quobyte-a352e45c-1598-4a3d-95b7-e94edfe1e544" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 13:59:40 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-b8da8bb3-7d09-4b71-b31f-fd52c353e760 tempest-VolumeQuotasAdminTestJSON-680355 None] Lock "cinder-quobyte-a352e45c-1598-4a3d-95b7-e94edfe1e544" acquired by "delete_volume" :: waited 0.081s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 13:59:41 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[cba84608-91ee-4830-b462-2df8a873375f]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 13:59:41 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-b8da8bb3-7d09-4b71-b31f-fd52c353e760 tempest-VolumeQuotasAdminTestJSON-680355 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-a352e45c-1598-4a3d-95b7-e94edfe1e544 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:59:41 devstack sudo[99491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-a352e45c-1598-4a3d-95b7-e94edfe1e544 Jul 13 13:59:41 devstack sudo[99491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:59:42 devstack sudo[99491]: pam_unix(sudo:session): session closed for user root Jul 13 13:59:42 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-b8da8bb3-7d09-4b71-b31f-fd52c353e760 tempest-VolumeQuotasAdminTestJSON-680355 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-a352e45c-1598-4a3d-95b7-e94edfe1e544" returned: 0 in 1.439s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:59:42 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-b8da8bb3-7d09-4b71-b31f-fd52c353e760 tempest-VolumeQuotasAdminTestJSON-680355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-a352e45c-1598-4a3d-95b7-e94edfe1e544 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:59:42 devstack sudo[99497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-a352e45c-1598-4a3d-95b7-e94edfe1e544 Jul 13 13:59:42 devstack sudo[99497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:59:43 devstack sudo[99497]: pam_unix(sudo:session): session closed for user root Jul 13 13:59:43 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-b8da8bb3-7d09-4b71-b31f-fd52c353e760 tempest-VolumeQuotasAdminTestJSON-680355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-a352e45c-1598-4a3d-95b7-e94edfe1e544" returned: 0 in 0.576s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:59:43 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-b8da8bb3-7d09-4b71-b31f-fd52c353e760 tempest-VolumeQuotasAdminTestJSON-680355 None] Lock "cinder-quobyte-a352e45c-1598-4a3d-95b7-e94edfe1e544" released by "delete_volume" :: held 2.167s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 13:59:43 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-b8da8bb3-7d09-4b71-b31f-fd52c353e760 tempest-VolumeQuotasAdminTestJSON-680355 None] Created reservations ['57021094-5c96-435f-9b73-795b6bfdda05', '335765a4-78cc-4416-a121-5406919f6182', '9888fc68-615a-4638-8b3a-ca4ebe265fed', '2a011c3e-2132-4ae4-be23-d84622c172f9'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 13:59:43 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-b8da8bb3-7d09-4b71-b31f-fd52c353e760 tempest-VolumeQuotasAdminTestJSON-680355 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:59:43 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-b8da8bb3-7d09-4b71-b31f-fd52c353e760 tempest-VolumeQuotasAdminTestJSON-680355 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:59:43 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-b8da8bb3-7d09-4b71-b31f-fd52c353e760 tempest-VolumeQuotasAdminTestJSON-680355 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 13:59:43 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-b8da8bb3-7d09-4b71-b31f-fd52c353e760 tempest-VolumeQuotasAdminTestJSON-680355 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 13:59:43 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-b8da8bb3-7d09-4b71-b31f-fd52c353e760 tempest-VolumeQuotasAdminTestJSON-680355 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:59:43 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-b8da8bb3-7d09-4b71-b31f-fd52c353e760 tempest-VolumeQuotasAdminTestJSON-680355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:59:43 devstack sudo[99501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 Jul 13 13:59:43 devstack sudo[99501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:59:44 devstack sudo[99501]: pam_unix(sudo:session): session closed for user root Jul 13 13:59:44 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-b8da8bb3-7d09-4b71-b31f-fd52c353e760 tempest-VolumeQuotasAdminTestJSON-680355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78" returned: 0 in 0.760s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:59:44 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-b8da8bb3-7d09-4b71-b31f-fd52c353e760 tempest-VolumeQuotasAdminTestJSON-680355 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 13:59:44 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-b8da8bb3-7d09-4b71-b31f-fd52c353e760 tempest-VolumeQuotasAdminTestJSON-680355 None] Deleted volume successfully. Jul 13 13:59:44 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-b8da8bb3-7d09-4b71-b31f-fd52c353e760 tempest-VolumeQuotasAdminTestJSON-680355 None] Lock "cinder-a352e45c-1598-4a3d-95b7-e94edfe1e544-delete_volume" released by "delete_volume" :: held 3.706s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 13:59:45 devstack sudo[99479]: pam_unix(sudo:session): session closed for user root Jul 13 13:59:45 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-3c36a0b9-1d0c-4218-9334-8d868b91b36d tempest-VolumesSnapshotTestJSON-2010930921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-4c94aaf5-d714-4dca-9c04-5530c8e943f8 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-f61fbe4f-ceb1-4b8a-9bd3-a9ecc65dfd21" returned: 0 in 6.824s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:59:45 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef0e6bc1-cf43-47e4-b308-df65c81c975e]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 13:59:45 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-3c36a0b9-1d0c-4218-9334-8d868b91b36d tempest-VolumesSnapshotTestJSON-2010930921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-4c94aaf5-d714-4dca-9c04-5530c8e943f8 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:59:45 devstack sudo[99525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-4c94aaf5-d714-4dca-9c04-5530c8e943f8 Jul 13 13:59:45 devstack sudo[99525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:59:45 devstack sudo[99525]: pam_unix(sudo:session): session closed for user root Jul 13 13:59:45 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-3c36a0b9-1d0c-4218-9334-8d868b91b36d tempest-VolumesSnapshotTestJSON-2010930921 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-4c94aaf5-d714-4dca-9c04-5530c8e943f8" returned: 0 in 0.588s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:59:45 devstack cinder-volume[87098]: DEBUG cinder.image.image_utils [None req-3c36a0b9-1d0c-4218-9334-8d868b91b36d tempest-VolumesSnapshotTestJSON-2010930921 None] Image conversion details: src /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-4c94aaf5-d714-4dca-9c04-5530c8e943f8, size 1024.00 MB, duration 6.82 sec, destination /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-f61fbe4f-ceb1-4b8a-9bd3-a9ecc65dfd21 {{(pid=87098) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 13 13:59:45 devstack cinder-volume[87098]: INFO cinder.image.image_utils [None req-3c36a0b9-1d0c-4218-9334-8d868b91b36d tempest-VolumesSnapshotTestJSON-2010930921 None] Converted 1024.00 MB image at 150.04 MB/s Jul 13 13:59:45 devstack cinder-volume[87098]: WARNING cinder.volume.drivers.remotefs [None req-3c36a0b9-1d0c-4218-9334-8d868b91b36d tempest-VolumesSnapshotTestJSON-2010930921 None] /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-f61fbe4f-ceb1-4b8a-9bd3-a9ecc65dfd21 is being set with open permissions: ugo+rw Jul 13 13:59:45 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-3c36a0b9-1d0c-4218-9334-8d868b91b36d tempest-VolumesSnapshotTestJSON-2010930921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-f61fbe4f-ceb1-4b8a-9bd3-a9ecc65dfd21 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:59:45 devstack sudo[99536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-f61fbe4f-ceb1-4b8a-9bd3-a9ecc65dfd21 Jul 13 13:59:45 devstack sudo[99536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:59:46 devstack sudo[99536]: pam_unix(sudo:session): session closed for user root Jul 13 13:59:46 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-3c36a0b9-1d0c-4218-9334-8d868b91b36d tempest-VolumesSnapshotTestJSON-2010930921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-f61fbe4f-ceb1-4b8a-9bd3-a9ecc65dfd21" returned: 0 in 0.282s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:59:46 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-3c36a0b9-1d0c-4218-9334-8d868b91b36d tempest-VolumesSnapshotTestJSON-2010930921 None] Lock "cinder-quobyte-f61fbe4f-ceb1-4b8a-9bd3-a9ecc65dfd21" released by "_copy_volume_from_snapshot" :: held 8.709s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 13:59:46 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-3c36a0b9-1d0c-4218-9334-8d868b91b36d tempest-VolumesSnapshotTestJSON-2010930921 None] Lock "cinder-quobyte-866f23b9-502a-4e64-b437-5cfaf7369349-f61fbe4f-ceb1-4b8a-9bd3-a9ecc65dfd21" released by "_create_volume_from_snapshot" :: held 8.766s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 13:59:46 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-3c36a0b9-1d0c-4218-9334-8d868b91b36d tempest-VolumesSnapshotTestJSON-2010930921 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.797s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:59:46 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-6f3c3088-d1e1-48f0-bb39-7c6cc7d8c064 tempest-ProjectReaderTests-630293705 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.081s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:59:46 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-6f3c3088-d1e1-48f0-bb39-7c6cc7d8c064 tempest-ProjectReaderTests-630293705 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T11:59:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1650348223',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=993557dd-b48e-4bf2-a7be-a9daac1bb865,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66fac89a08a9403ebd313bca8f11e9b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T11:59:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T11:59:39Z,use_quota=True,user_id='9610b3443d82426f903081749355c972',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1147de8b-623b-426c-a13d-7fc824a80f67),volume_type_id=1147de8b-623b-426c-a13d-7fc824a80f67)}" {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 13 13:59:46 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-6f3c3088-d1e1-48f0-bb39-7c6cc7d8c064 tempest-ProjectReaderTests-630293705 None] Creating volume 993557dd-b48e-4bf2-a7be-a9daac1bb865 {{(pid=87098) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 13 13:59:46 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-6f3c3088-d1e1-48f0-bb39-7c6cc7d8c064 tempest-ProjectReaderTests-630293705 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:59:46 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-6f3c3088-d1e1-48f0-bb39-7c6cc7d8c064 tempest-ProjectReaderTests-630293705 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:59:46 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-6f3c3088-d1e1-48f0-bb39-7c6cc7d8c064 tempest-ProjectReaderTests-630293705 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 13:59:46 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-6f3c3088-d1e1-48f0-bb39-7c6cc7d8c064 tempest-ProjectReaderTests-630293705 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 13:59:46 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-6f3c3088-d1e1-48f0-bb39-7c6cc7d8c064 tempest-ProjectReaderTests-630293705 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:59:46 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-6f3c3088-d1e1-48f0-bb39-7c6cc7d8c064 tempest-ProjectReaderTests-630293705 None] Selected osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 13:59:46 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-6f3c3088-d1e1-48f0-bb39-7c6cc7d8c064 tempest-ProjectReaderTests-630293705 None] casted to osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 Jul 13 13:59:46 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-6f3c3088-d1e1-48f0-bb39-7c6cc7d8c064 tempest-ProjectReaderTests-630293705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-993557dd-b48e-4bf2-a7be-a9daac1bb865 1073741824 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:59:46 devstack sudo[99539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-993557dd-b48e-4bf2-a7be-a9daac1bb865 1073741824 Jul 13 13:59:46 devstack sudo[99539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:59:46 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-3c36a0b9-1d0c-4218-9334-8d868b91b36d tempest-VolumesSnapshotTestJSON-2010930921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5190cb5a-7610-4d75-9789-6c72447050b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f61fbe4f-ceb1-4b8a-9bd3-a9ecc65dfd21', 'volume_size': 1, 'snapshot_id': '866f23b9-502a-4e64-b437-5cfaf7369349'}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:59:46 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-3c36a0b9-1d0c-4218-9334-8d868b91b36d tempest-VolumesSnapshotTestJSON-2010930921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f3ee770-7b51-4e97-8d85-c2d79b112ade) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:59:46 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-3c36a0b9-1d0c-4218-9334-8d868b91b36d tempest-VolumesSnapshotTestJSON-2010930921 None] Volume volume-f61fbe4f-ceb1-4b8a-9bd3-a9ecc65dfd21 (f61fbe4f-ceb1-4b8a-9bd3-a9ecc65dfd21): created successfully Jul 13 13:59:46 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-3c36a0b9-1d0c-4218-9334-8d868b91b36d tempest-VolumesSnapshotTestJSON-2010930921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f3ee770-7b51-4e97-8d85-c2d79b112ade) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:59:46 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-3c36a0b9-1d0c-4218-9334-8d868b91b36d tempest-VolumesSnapshotTestJSON-2010930921 None] Flow 'volume_create_manager' (292d3f9e-d15c-422d-80a7-bb6fd8100a15) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 13:59:46 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-3c36a0b9-1d0c-4218-9334-8d868b91b36d tempest-VolumesSnapshotTestJSON-2010930921 None] Created volume successfully. Jul 13 13:59:46 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-12b850b8-039e-47f0-9c09-c8c7c361a42a tempest-VolumesSnapshotTestJSON-2010930921 None] Acquiring lock "cinder-f61fbe4f-ceb1-4b8a-9bd3-a9ecc65dfd21-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 13:59:46 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-12b850b8-039e-47f0-9c09-c8c7c361a42a tempest-VolumesSnapshotTestJSON-2010930921 None] Lock "cinder-f61fbe4f-ceb1-4b8a-9bd3-a9ecc65dfd21-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 13:59:46 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-12b850b8-039e-47f0-9c09-c8c7c361a42a tempest-VolumesSnapshotTestJSON-2010930921 None] Acquiring lock "cinder-quobyte-f61fbe4f-ceb1-4b8a-9bd3-a9ecc65dfd21" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 13:59:46 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-12b850b8-039e-47f0-9c09-c8c7c361a42a tempest-VolumesSnapshotTestJSON-2010930921 None] Lock "cinder-quobyte-f61fbe4f-ceb1-4b8a-9bd3-a9ecc65dfd21" acquired by "delete_volume" :: waited 0.022s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 13:59:46 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[e80c32a4-7524-45f4-a397-5ea3bfe78618]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 13:59:46 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-12b850b8-039e-47f0-9c09-c8c7c361a42a tempest-VolumesSnapshotTestJSON-2010930921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-f61fbe4f-ceb1-4b8a-9bd3-a9ecc65dfd21 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:59:46 devstack sudo[99544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-f61fbe4f-ceb1-4b8a-9bd3-a9ecc65dfd21 Jul 13 13:59:46 devstack sudo[99544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:59:46 devstack sudo[99539]: pam_unix(sudo:session): session closed for user root Jul 13 13:59:46 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-6f3c3088-d1e1-48f0-bb39-7c6cc7d8c064 tempest-ProjectReaderTests-630293705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-993557dd-b48e-4bf2-a7be-a9daac1bb865 1073741824" returned: 0 in 0.560s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:59:46 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-6f3c3088-d1e1-48f0-bb39-7c6cc7d8c064 tempest-ProjectReaderTests-630293705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-993557dd-b48e-4bf2-a7be-a9daac1bb865 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:59:46 devstack sudo[99548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-993557dd-b48e-4bf2-a7be-a9daac1bb865 Jul 13 13:59:46 devstack sudo[99548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:59:47 devstack sudo[99544]: pam_unix(sudo:session): session closed for user root Jul 13 13:59:47 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-12b850b8-039e-47f0-9c09-c8c7c361a42a tempest-VolumesSnapshotTestJSON-2010930921 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-f61fbe4f-ceb1-4b8a-9bd3-a9ecc65dfd21" returned: 0 in 0.433s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:59:47 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-12b850b8-039e-47f0-9c09-c8c7c361a42a tempest-VolumesSnapshotTestJSON-2010930921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-f61fbe4f-ceb1-4b8a-9bd3-a9ecc65dfd21 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:59:47 devstack sudo[99553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-f61fbe4f-ceb1-4b8a-9bd3-a9ecc65dfd21 Jul 13 13:59:47 devstack sudo[99553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:59:47 devstack sudo[99548]: pam_unix(sudo:session): session closed for user root Jul 13 13:59:47 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-6f3c3088-d1e1-48f0-bb39-7c6cc7d8c064 tempest-ProjectReaderTests-630293705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-993557dd-b48e-4bf2-a7be-a9daac1bb865" returned: 0 in 0.317s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:59:47 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-6f3c3088-d1e1-48f0-bb39-7c6cc7d8c064 tempest-ProjectReaderTests-630293705 None] <== create_volume: return (954ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'} {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 13 13:59:47 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-6f3c3088-d1e1-48f0-bb39-7c6cc7d8c064 tempest-ProjectReaderTests-630293705 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.957s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:59:47 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-6f3c3088-d1e1-48f0-bb39-7c6cc7d8c064 tempest-ProjectReaderTests-630293705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac20ef83-aecc-458d-a4b4-836c4c7442ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-993557dd-b48e-4bf2-a7be-a9daac1bb865', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:59:47 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-6f3c3088-d1e1-48f0-bb39-7c6cc7d8c064 tempest-ProjectReaderTests-630293705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08d6ddf7-016a-444d-9ba0-6717e9d2dd91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:59:47 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-6f3c3088-d1e1-48f0-bb39-7c6cc7d8c064 tempest-ProjectReaderTests-630293705 None] Volume volume-993557dd-b48e-4bf2-a7be-a9daac1bb865 (993557dd-b48e-4bf2-a7be-a9daac1bb865): created successfully Jul 13 13:59:47 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-6f3c3088-d1e1-48f0-bb39-7c6cc7d8c064 tempest-ProjectReaderTests-630293705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08d6ddf7-016a-444d-9ba0-6717e9d2dd91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:59:47 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-6f3c3088-d1e1-48f0-bb39-7c6cc7d8c064 tempest-ProjectReaderTests-630293705 None] Flow 'volume_create_manager' (70311551-4154-4401-a267-300874d644c7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 13:59:47 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-6f3c3088-d1e1-48f0-bb39-7c6cc7d8c064 tempest-ProjectReaderTests-630293705 None] Created volume successfully. Jul 13 13:59:47 devstack sudo[99553]: pam_unix(sudo:session): session closed for user root Jul 13 13:59:47 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-12b850b8-039e-47f0-9c09-c8c7c361a42a tempest-VolumesSnapshotTestJSON-2010930921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-f61fbe4f-ceb1-4b8a-9bd3-a9ecc65dfd21" returned: 0 in 0.282s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:59:47 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-12b850b8-039e-47f0-9c09-c8c7c361a42a tempest-VolumesSnapshotTestJSON-2010930921 None] Lock "cinder-quobyte-f61fbe4f-ceb1-4b8a-9bd3-a9ecc65dfd21" released by "delete_volume" :: held 0.763s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 13:59:47 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-12b850b8-039e-47f0-9c09-c8c7c361a42a tempest-VolumesSnapshotTestJSON-2010930921 None] Created reservations ['601159c5-ecd8-4c4d-9e95-e904461500c3', '3385fb4b-657b-4a8b-9885-578a3b45ef05', '9ce64650-22d8-46a9-8826-6350252dc74c', 'c07152af-cd1f-48d4-b01a-94f88ceb9c23'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 13:59:47 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-12b850b8-039e-47f0-9c09-c8c7c361a42a tempest-VolumesSnapshotTestJSON-2010930921 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:59:47 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-12b850b8-039e-47f0-9c09-c8c7c361a42a tempest-VolumesSnapshotTestJSON-2010930921 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:59:47 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-12b850b8-039e-47f0-9c09-c8c7c361a42a tempest-VolumesSnapshotTestJSON-2010930921 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 13:59:47 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-12b850b8-039e-47f0-9c09-c8c7c361a42a tempest-VolumesSnapshotTestJSON-2010930921 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 13:59:47 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-12b850b8-039e-47f0-9c09-c8c7c361a42a tempest-VolumesSnapshotTestJSON-2010930921 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:59:47 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-12b850b8-039e-47f0-9c09-c8c7c361a42a tempest-VolumesSnapshotTestJSON-2010930921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:59:47 devstack sudo[99557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 Jul 13 13:59:47 devstack sudo[99557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:59:47 devstack sudo[99557]: pam_unix(sudo:session): session closed for user root Jul 13 13:59:47 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-12b850b8-039e-47f0-9c09-c8c7c361a42a tempest-VolumesSnapshotTestJSON-2010930921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78" returned: 0 in 0.254s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:59:47 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-12b850b8-039e-47f0-9c09-c8c7c361a42a tempest-VolumesSnapshotTestJSON-2010930921 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 13:59:47 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-5827a463-7f19-4442-a043-0c589f94bd9d tempest-VolumesSnapshotTestJSON-2010930921 None] Acquiring lock "cinder-866f23b9-502a-4e64-b437-5cfaf7369349-delete_snapshot" by "delete_snapshot" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 13:59:47 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-12b850b8-039e-47f0-9c09-c8c7c361a42a tempest-VolumesSnapshotTestJSON-2010930921 None] Deleted volume successfully. Jul 13 13:59:47 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-5827a463-7f19-4442-a043-0c589f94bd9d tempest-VolumesSnapshotTestJSON-2010930921 None] Lock "cinder-866f23b9-502a-4e64-b437-5cfaf7369349-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 13:59:47 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-5827a463-7f19-4442-a043-0c589f94bd9d tempest-VolumesSnapshotTestJSON-2010930921 None] Acquiring lock "cinder-quobyte-4c94aaf5-d714-4dca-9c04-5530c8e943f8" by "delete_snapshot" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 13:59:47 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-12b850b8-039e-47f0-9c09-c8c7c361a42a tempest-VolumesSnapshotTestJSON-2010930921 None] Lock "cinder-f61fbe4f-ceb1-4b8a-9bd3-a9ecc65dfd21-delete_volume" released by "delete_volume" :: held 1.254s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 13:59:47 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-5827a463-7f19-4442-a043-0c589f94bd9d tempest-VolumesSnapshotTestJSON-2010930921 None] Lock "cinder-quobyte-4c94aaf5-d714-4dca-9c04-5530c8e943f8" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 13:59:47 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-5827a463-7f19-4442-a043-0c589f94bd9d tempest-VolumesSnapshotTestJSON-2010930921 None] Acquiring lock "cinder-quobyte-866f23b9-502a-4e64-b437-5cfaf7369349" by "_delete_snapshot" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 13:59:47 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-5827a463-7f19-4442-a043-0c589f94bd9d tempest-VolumesSnapshotTestJSON-2010930921 None] Lock "cinder-quobyte-866f23b9-502a-4e64-b437-5cfaf7369349" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 13:59:47 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-5827a463-7f19-4442-a043-0c589f94bd9d tempest-VolumesSnapshotTestJSON-2010930921 None] Deleting offline snapshot 866f23b9-502a-4e64-b437-5cfaf7369349 of volume 4c94aaf5-d714-4dca-9c04-5530c8e943f8 {{(pid=87098) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 13 13:59:47 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-5827a463-7f19-4442-a043-0c589f94bd9d tempest-VolumesSnapshotTestJSON-2010930921 None] snapshot_file for this snap is: volume-4c94aaf5-d714-4dca-9c04-5530c8e943f8.866f23b9-502a-4e64-b437-5cfaf7369349 {{(pid=87098) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 13 13:59:47 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c81c93f-d9e2-4be8-9d10-d4a5c22f2781]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 13:59:47 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-5827a463-7f19-4442-a043-0c589f94bd9d tempest-VolumesSnapshotTestJSON-2010930921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-4c94aaf5-d714-4dca-9c04-5530c8e943f8.866f23b9-502a-4e64-b437-5cfaf7369349 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:59:47 devstack sudo[99560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-4c94aaf5-d714-4dca-9c04-5530c8e943f8.866f23b9-502a-4e64-b437-5cfaf7369349 Jul 13 13:59:47 devstack sudo[99560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:59:48 devstack sudo[99560]: pam_unix(sudo:session): session closed for user root Jul 13 13:59:48 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-5827a463-7f19-4442-a043-0c589f94bd9d tempest-VolumesSnapshotTestJSON-2010930921 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-4c94aaf5-d714-4dca-9c04-5530c8e943f8.866f23b9-502a-4e64-b437-5cfaf7369349" returned: 0 in 0.395s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:59:48 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-5827a463-7f19-4442-a043-0c589f94bd9d tempest-VolumesSnapshotTestJSON-2010930921 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4c94aaf5-d714-4dca-9c04-5530c8e943f8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87098) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 13 13:59:48 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bad6466-8743-484d-983a-d17a82a478e4]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 13:59:48 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-5827a463-7f19-4442-a043-0c589f94bd9d tempest-VolumesSnapshotTestJSON-2010930921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-4c94aaf5-d714-4dca-9c04-5530c8e943f8 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:59:48 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-440572d9-9e93-40c0-b75d-9cfe9370e0bf tempest-ProjectReaderTests-630293705 None] Acquiring lock "cinder-993557dd-b48e-4bf2-a7be-a9daac1bb865-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 13:59:48 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-440572d9-9e93-40c0-b75d-9cfe9370e0bf tempest-ProjectReaderTests-630293705 None] Lock "cinder-993557dd-b48e-4bf2-a7be-a9daac1bb865-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 13:59:48 devstack sudo[99566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-4c94aaf5-d714-4dca-9c04-5530c8e943f8 Jul 13 13:59:48 devstack sudo[99566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:59:48 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-440572d9-9e93-40c0-b75d-9cfe9370e0bf tempest-ProjectReaderTests-630293705 None] Acquiring lock "cinder-quobyte-993557dd-b48e-4bf2-a7be-a9daac1bb865" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 13:59:48 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-440572d9-9e93-40c0-b75d-9cfe9370e0bf tempest-ProjectReaderTests-630293705 None] Lock "cinder-quobyte-993557dd-b48e-4bf2-a7be-a9daac1bb865" acquired by "delete_volume" :: waited 0.025s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 13:59:48 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaf50848-ea33-43df-88f4-b16a7baa41b2]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 13:59:48 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-440572d9-9e93-40c0-b75d-9cfe9370e0bf tempest-ProjectReaderTests-630293705 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-993557dd-b48e-4bf2-a7be-a9daac1bb865 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:59:48 devstack sudo[99568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-993557dd-b48e-4bf2-a7be-a9daac1bb865 Jul 13 13:59:48 devstack sudo[99568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:59:48 devstack sudo[99566]: pam_unix(sudo:session): session closed for user root Jul 13 13:59:48 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-5827a463-7f19-4442-a043-0c589f94bd9d tempest-VolumesSnapshotTestJSON-2010930921 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-4c94aaf5-d714-4dca-9c04-5530c8e943f8" returned: 0 in 0.457s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:59:48 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-5827a463-7f19-4442-a043-0c589f94bd9d tempest-VolumesSnapshotTestJSON-2010930921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-4c94aaf5-d714-4dca-9c04-5530c8e943f8.866f23b9-502a-4e64-b437-5cfaf7369349 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:59:48 devstack sudo[99574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-4c94aaf5-d714-4dca-9c04-5530c8e943f8.866f23b9-502a-4e64-b437-5cfaf7369349 Jul 13 13:59:48 devstack sudo[99574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:59:48 devstack sudo[99568]: pam_unix(sudo:session): session closed for user root Jul 13 13:59:48 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-440572d9-9e93-40c0-b75d-9cfe9370e0bf tempest-ProjectReaderTests-630293705 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-993557dd-b48e-4bf2-a7be-a9daac1bb865" returned: 0 in 0.443s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:59:48 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-440572d9-9e93-40c0-b75d-9cfe9370e0bf tempest-ProjectReaderTests-630293705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-993557dd-b48e-4bf2-a7be-a9daac1bb865 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:59:48 devstack sudo[99579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-993557dd-b48e-4bf2-a7be-a9daac1bb865 Jul 13 13:59:48 devstack sudo[99579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:59:49 devstack sudo[99574]: pam_unix(sudo:session): session closed for user root Jul 13 13:59:49 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-5827a463-7f19-4442-a043-0c589f94bd9d tempest-VolumesSnapshotTestJSON-2010930921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-4c94aaf5-d714-4dca-9c04-5530c8e943f8.866f23b9-502a-4e64-b437-5cfaf7369349" returned: 0 in 0.407s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:59:49 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-5827a463-7f19-4442-a043-0c589f94bd9d tempest-VolumesSnapshotTestJSON-2010930921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-4c94aaf5-d714-4dca-9c04-5530c8e943f8.866f23b9-502a-4e64-b437-5cfaf7369349 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:59:49 devstack sudo[99584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-4c94aaf5-d714-4dca-9c04-5530c8e943f8.866f23b9-502a-4e64-b437-5cfaf7369349 Jul 13 13:59:49 devstack sudo[99584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:59:49 devstack sudo[99579]: pam_unix(sudo:session): session closed for user root Jul 13 13:59:49 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-440572d9-9e93-40c0-b75d-9cfe9370e0bf tempest-ProjectReaderTests-630293705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-993557dd-b48e-4bf2-a7be-a9daac1bb865" returned: 0 in 0.290s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:59:49 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-440572d9-9e93-40c0-b75d-9cfe9370e0bf tempest-ProjectReaderTests-630293705 None] Lock "cinder-quobyte-993557dd-b48e-4bf2-a7be-a9daac1bb865" released by "delete_volume" :: held 0.785s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 13:59:49 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-440572d9-9e93-40c0-b75d-9cfe9370e0bf tempest-ProjectReaderTests-630293705 None] Created reservations ['d9963d27-46af-4677-b612-bd5237c66dec', '9a231286-0ad3-4c92-b091-d4c675edc557', '5277e2e4-41b3-4a4e-86f6-4516420cb939', 'c18be6a0-7e66-4fa6-ba9b-9d5e4ebd8ae3'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 13:59:49 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-440572d9-9e93-40c0-b75d-9cfe9370e0bf tempest-ProjectReaderTests-630293705 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:59:49 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-440572d9-9e93-40c0-b75d-9cfe9370e0bf tempest-ProjectReaderTests-630293705 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:59:49 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-440572d9-9e93-40c0-b75d-9cfe9370e0bf tempest-ProjectReaderTests-630293705 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 13:59:49 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-440572d9-9e93-40c0-b75d-9cfe9370e0bf tempest-ProjectReaderTests-630293705 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 13:59:49 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-440572d9-9e93-40c0-b75d-9cfe9370e0bf tempest-ProjectReaderTests-630293705 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:59:49 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-440572d9-9e93-40c0-b75d-9cfe9370e0bf tempest-ProjectReaderTests-630293705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:59:49 devstack sudo[99588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 Jul 13 13:59:49 devstack sudo[99588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:59:49 devstack sudo[99584]: pam_unix(sudo:session): session closed for user root Jul 13 13:59:49 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-5827a463-7f19-4442-a043-0c589f94bd9d tempest-VolumesSnapshotTestJSON-2010930921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-4c94aaf5-d714-4dca-9c04-5530c8e943f8.866f23b9-502a-4e64-b437-5cfaf7369349" returned: 0 in 0.287s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:59:49 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-5827a463-7f19-4442-a043-0c589f94bd9d tempest-VolumesSnapshotTestJSON-2010930921 None] Lock "cinder-quobyte-866f23b9-502a-4e64-b437-5cfaf7369349" released by "_delete_snapshot" :: held 1.696s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 13:59:49 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-5827a463-7f19-4442-a043-0c589f94bd9d tempest-VolumesSnapshotTestJSON-2010930921 None] Lock "cinder-quobyte-4c94aaf5-d714-4dca-9c04-5530c8e943f8" released by "delete_snapshot" :: held 1.722s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 13:59:49 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-5827a463-7f19-4442-a043-0c589f94bd9d tempest-VolumesSnapshotTestJSON-2010930921 None] Created reservations ['d0d7260e-ac0b-4eb3-8bd1-cd1fdc5ebfb3', '3be096bb-9c57-4111-acdb-2830e820248d', 'ef1e33e9-7d13-4c8f-898e-1cc7b03a665a', '881025bb-d414-40a4-a07e-e18526aa8eb9'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 13:59:49 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-5827a463-7f19-4442-a043-0c589f94bd9d tempest-VolumesSnapshotTestJSON-2010930921 None] Delete snapshot completed successfully. Jul 13 13:59:49 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-5827a463-7f19-4442-a043-0c589f94bd9d tempest-VolumesSnapshotTestJSON-2010930921 None] Lock "cinder-866f23b9-502a-4e64-b437-5cfaf7369349-delete_snapshot" released by "delete_snapshot" :: held 1.892s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 13:59:49 devstack sudo[99588]: pam_unix(sudo:session): session closed for user root Jul 13 13:59:49 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-440572d9-9e93-40c0-b75d-9cfe9370e0bf tempest-ProjectReaderTests-630293705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78" returned: 0 in 0.341s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:59:49 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-440572d9-9e93-40c0-b75d-9cfe9370e0bf tempest-ProjectReaderTests-630293705 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 13:59:49 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-440572d9-9e93-40c0-b75d-9cfe9370e0bf tempest-ProjectReaderTests-630293705 None] Deleted volume successfully. Jul 13 13:59:49 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-440572d9-9e93-40c0-b75d-9cfe9370e0bf tempest-ProjectReaderTests-630293705 None] Lock "cinder-993557dd-b48e-4bf2-a7be-a9daac1bb865-delete_volume" released by "delete_volume" :: held 1.365s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 13:59:49 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-a04cc2ea-7977-4c4c-bed3-d3bcbe37bf0a tempest-VolumesSnapshotTestJSON-2010930921 None] Acquiring lock "cinder-4c94aaf5-d714-4dca-9c04-5530c8e943f8-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 13:59:49 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-a04cc2ea-7977-4c4c-bed3-d3bcbe37bf0a tempest-VolumesSnapshotTestJSON-2010930921 None] Lock "cinder-4c94aaf5-d714-4dca-9c04-5530c8e943f8-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 13:59:50 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-a04cc2ea-7977-4c4c-bed3-d3bcbe37bf0a tempest-VolumesSnapshotTestJSON-2010930921 None] Acquiring lock "cinder-quobyte-4c94aaf5-d714-4dca-9c04-5530c8e943f8" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 13:59:50 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-a04cc2ea-7977-4c4c-bed3-d3bcbe37bf0a tempest-VolumesSnapshotTestJSON-2010930921 None] Lock "cinder-quobyte-4c94aaf5-d714-4dca-9c04-5530c8e943f8" acquired by "delete_volume" :: waited 0.017s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 13:59:50 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f7d4e3f-886c-4002-88ac-052c03fbba40]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 13:59:50 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-a04cc2ea-7977-4c4c-bed3-d3bcbe37bf0a tempest-VolumesSnapshotTestJSON-2010930921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-4c94aaf5-d714-4dca-9c04-5530c8e943f8 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:59:50 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-d600e408-9003-404c-a04f-ed6c44c77d10 tempest-ProjectReaderTests-630293705 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 13:59:50 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-d600e408-9003-404c-a04f-ed6c44c77d10 tempest-ProjectReaderTests-630293705 None] Flow 'volume_create_manager' (b37442d9-62ea-4a18-9b6f-b4685fc3a1cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 13:59:50 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-d600e408-9003-404c-a04f-ed6c44c77d10 tempest-ProjectReaderTests-630293705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (048de136-3ac4-4b86-a331-8a4a11e77650) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:59:50 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-d600e408-9003-404c-a04f-ed6c44c77d10 tempest-ProjectReaderTests-630293705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (048de136-3ac4-4b86-a331-8a4a11e77650) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T11:59:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-403220854',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37f47d2f-cbce-4f94-8ee5-2c596d490224,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66fac89a08a9403ebd313bca8f11e9b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T11:59:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T11:59:50Z,use_quota=True,user_id='9610b3443d82426f903081749355c972',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1147de8b-623b-426c-a13d-7fc824a80f67),volume_type_id=1147de8b-623b-426c-a13d-7fc824a80f67)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:59:50 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-d600e408-9003-404c-a04f-ed6c44c77d10 tempest-ProjectReaderTests-630293705 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2fde20f-957a-4c37-a0ab-acc3a204e2c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:59:50 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-d600e408-9003-404c-a04f-ed6c44c77d10 tempest-ProjectReaderTests-630293705 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2fde20f-957a-4c37-a0ab-acc3a204e2c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:59:50 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-d600e408-9003-404c-a04f-ed6c44c77d10 tempest-ProjectReaderTests-630293705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72400800-6869-48d2-81d4-a91e0eb36c77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:59:50 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-d600e408-9003-404c-a04f-ed6c44c77d10 tempest-ProjectReaderTests-630293705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72400800-6869-48d2-81d4-a91e0eb36c77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '37f47d2f-cbce-4f94-8ee5-2c596d490224', 'volume_name': 'volume-37f47d2f-cbce-4f94-8ee5-2c596d490224', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:59:50 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-d600e408-9003-404c-a04f-ed6c44c77d10 tempest-ProjectReaderTests-630293705 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e924be07-9dfa-41e2-9167-26df2fc6acae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:59:50 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-d600e408-9003-404c-a04f-ed6c44c77d10 tempest-ProjectReaderTests-630293705 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e924be07-9dfa-41e2-9167-26df2fc6acae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:59:50 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-d600e408-9003-404c-a04f-ed6c44c77d10 tempest-ProjectReaderTests-630293705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79bde64f-b0af-471e-adc1-a5f4edd71a81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:59:50 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-d600e408-9003-404c-a04f-ed6c44c77d10 tempest-ProjectReaderTests-630293705 None] Volume 37f47d2f-cbce-4f94-8ee5-2c596d490224: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-37f47d2f-cbce-4f94-8ee5-2c596d490224', 'volume_size': 1} Jul 13 13:59:50 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-d600e408-9003-404c-a04f-ed6c44c77d10 tempest-ProjectReaderTests-630293705 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:59:50 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-d600e408-9003-404c-a04f-ed6c44c77d10 tempest-ProjectReaderTests-630293705 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:59:50 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-d600e408-9003-404c-a04f-ed6c44c77d10 tempest-ProjectReaderTests-630293705 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T11:59:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-403220854',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37f47d2f-cbce-4f94-8ee5-2c596d490224,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66fac89a08a9403ebd313bca8f11e9b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T11:59:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T11:59:50Z,use_quota=True,user_id='9610b3443d82426f903081749355c972',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1147de8b-623b-426c-a13d-7fc824a80f67),volume_type_id=1147de8b-623b-426c-a13d-7fc824a80f67)}" {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 13 13:59:50 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-d600e408-9003-404c-a04f-ed6c44c77d10 tempest-ProjectReaderTests-630293705 None] Creating volume 37f47d2f-cbce-4f94-8ee5-2c596d490224 {{(pid=87098) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 13 13:59:50 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-d600e408-9003-404c-a04f-ed6c44c77d10 tempest-ProjectReaderTests-630293705 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:59:50 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-d600e408-9003-404c-a04f-ed6c44c77d10 tempest-ProjectReaderTests-630293705 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:59:50 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-d600e408-9003-404c-a04f-ed6c44c77d10 tempest-ProjectReaderTests-630293705 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 13:59:50 devstack sudo[99591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-4c94aaf5-d714-4dca-9c04-5530c8e943f8 Jul 13 13:59:50 devstack sudo[99591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:59:50 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-d600e408-9003-404c-a04f-ed6c44c77d10 tempest-ProjectReaderTests-630293705 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 13:59:50 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-d600e408-9003-404c-a04f-ed6c44c77d10 tempest-ProjectReaderTests-630293705 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:59:50 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-d600e408-9003-404c-a04f-ed6c44c77d10 tempest-ProjectReaderTests-630293705 None] Selected osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 13:59:50 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-d600e408-9003-404c-a04f-ed6c44c77d10 tempest-ProjectReaderTests-630293705 None] casted to osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 Jul 13 13:59:50 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-d600e408-9003-404c-a04f-ed6c44c77d10 tempest-ProjectReaderTests-630293705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-37f47d2f-cbce-4f94-8ee5-2c596d490224 1073741824 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:59:50 devstack sudo[99593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-37f47d2f-cbce-4f94-8ee5-2c596d490224 1073741824 Jul 13 13:59:50 devstack sudo[99593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:59:50 devstack sudo[99591]: pam_unix(sudo:session): session closed for user root Jul 13 13:59:50 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-a04cc2ea-7977-4c4c-bed3-d3bcbe37bf0a tempest-VolumesSnapshotTestJSON-2010930921 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-4c94aaf5-d714-4dca-9c04-5530c8e943f8" returned: 0 in 0.415s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:59:50 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-a04cc2ea-7977-4c4c-bed3-d3bcbe37bf0a tempest-VolumesSnapshotTestJSON-2010930921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-4c94aaf5-d714-4dca-9c04-5530c8e943f8 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:59:50 devstack sudo[99601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-4c94aaf5-d714-4dca-9c04-5530c8e943f8 Jul 13 13:59:50 devstack sudo[99601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:59:50 devstack sudo[99593]: pam_unix(sudo:session): session closed for user root Jul 13 13:59:50 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-d600e408-9003-404c-a04f-ed6c44c77d10 tempest-ProjectReaderTests-630293705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-37f47d2f-cbce-4f94-8ee5-2c596d490224 1073741824" returned: 0 in 0.476s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:59:50 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-d600e408-9003-404c-a04f-ed6c44c77d10 tempest-ProjectReaderTests-630293705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-37f47d2f-cbce-4f94-8ee5-2c596d490224 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:59:50 devstack sudo[99605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-37f47d2f-cbce-4f94-8ee5-2c596d490224 Jul 13 13:59:50 devstack sudo[99605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:59:50 devstack sudo[99601]: pam_unix(sudo:session): session closed for user root Jul 13 13:59:50 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-a04cc2ea-7977-4c4c-bed3-d3bcbe37bf0a tempest-VolumesSnapshotTestJSON-2010930921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-4c94aaf5-d714-4dca-9c04-5530c8e943f8" returned: 0 in 0.278s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:59:50 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-a04cc2ea-7977-4c4c-bed3-d3bcbe37bf0a tempest-VolumesSnapshotTestJSON-2010930921 None] Lock "cinder-quobyte-4c94aaf5-d714-4dca-9c04-5530c8e943f8" released by "delete_volume" :: held 0.775s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 13:59:50 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-a04cc2ea-7977-4c4c-bed3-d3bcbe37bf0a tempest-VolumesSnapshotTestJSON-2010930921 None] Created reservations ['4ac19fc0-cea7-4b8c-99e4-17f9e56cf736', '1224d62c-cb64-4949-b42b-c374b2c624c4', '147ad451-e574-410d-8762-a4483b139651', '284c5d00-c01a-4a15-a765-9d67a37987cf'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 13:59:51 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-a04cc2ea-7977-4c4c-bed3-d3bcbe37bf0a tempest-VolumesSnapshotTestJSON-2010930921 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:59:51 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-a04cc2ea-7977-4c4c-bed3-d3bcbe37bf0a tempest-VolumesSnapshotTestJSON-2010930921 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:59:51 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-a04cc2ea-7977-4c4c-bed3-d3bcbe37bf0a tempest-VolumesSnapshotTestJSON-2010930921 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 13:59:51 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-a04cc2ea-7977-4c4c-bed3-d3bcbe37bf0a tempest-VolumesSnapshotTestJSON-2010930921 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 13:59:51 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-a04cc2ea-7977-4c4c-bed3-d3bcbe37bf0a tempest-VolumesSnapshotTestJSON-2010930921 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:59:51 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-a04cc2ea-7977-4c4c-bed3-d3bcbe37bf0a tempest-VolumesSnapshotTestJSON-2010930921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:59:51 devstack sudo[99608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 Jul 13 13:59:51 devstack sudo[99608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:59:51 devstack sudo[99605]: pam_unix(sudo:session): session closed for user root Jul 13 13:59:51 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-d600e408-9003-404c-a04f-ed6c44c77d10 tempest-ProjectReaderTests-630293705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-37f47d2f-cbce-4f94-8ee5-2c596d490224" returned: 0 in 0.367s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:59:51 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-d600e408-9003-404c-a04f-ed6c44c77d10 tempest-ProjectReaderTests-630293705 None] <== create_volume: return (890ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'} {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 13 13:59:51 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-d600e408-9003-404c-a04f-ed6c44c77d10 tempest-ProjectReaderTests-630293705 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.892s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:59:51 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-d600e408-9003-404c-a04f-ed6c44c77d10 tempest-ProjectReaderTests-630293705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79bde64f-b0af-471e-adc1-a5f4edd71a81) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-37f47d2f-cbce-4f94-8ee5-2c596d490224', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:59:51 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-d600e408-9003-404c-a04f-ed6c44c77d10 tempest-ProjectReaderTests-630293705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (398683c0-6aaf-4e36-a28d-fb21763176fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:59:51 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-d600e408-9003-404c-a04f-ed6c44c77d10 tempest-ProjectReaderTests-630293705 None] Volume volume-37f47d2f-cbce-4f94-8ee5-2c596d490224 (37f47d2f-cbce-4f94-8ee5-2c596d490224): created successfully Jul 13 13:59:51 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-d600e408-9003-404c-a04f-ed6c44c77d10 tempest-ProjectReaderTests-630293705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (398683c0-6aaf-4e36-a28d-fb21763176fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:59:51 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-d600e408-9003-404c-a04f-ed6c44c77d10 tempest-ProjectReaderTests-630293705 None] Flow 'volume_create_manager' (b37442d9-62ea-4a18-9b6f-b4685fc3a1cc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 13:59:51 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-d600e408-9003-404c-a04f-ed6c44c77d10 tempest-ProjectReaderTests-630293705 None] Created volume successfully. Jul 13 13:59:51 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-34da64f7-8f56-4eb3-8892-45b10143a57e tempest-VolumesSnapshotTestJSON-2010930921 None] Acquiring lock "cinder-ceab0c9b-2879-496d-8815-600b6fb9e092-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 13:59:51 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-34da64f7-8f56-4eb3-8892-45b10143a57e tempest-VolumesSnapshotTestJSON-2010930921 None] Lock "cinder-ceab0c9b-2879-496d-8815-600b6fb9e092-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 13:59:51 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-34da64f7-8f56-4eb3-8892-45b10143a57e tempest-VolumesSnapshotTestJSON-2010930921 None] Acquiring lock "cinder-quobyte-ceab0c9b-2879-496d-8815-600b6fb9e092" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 13:59:51 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-34da64f7-8f56-4eb3-8892-45b10143a57e tempest-VolumesSnapshotTestJSON-2010930921 None] Lock "cinder-quobyte-ceab0c9b-2879-496d-8815-600b6fb9e092" acquired by "delete_volume" :: waited 0.021s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 13:59:51 devstack sudo[99608]: pam_unix(sudo:session): session closed for user root Jul 13 13:59:51 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-a04cc2ea-7977-4c4c-bed3-d3bcbe37bf0a tempest-VolumesSnapshotTestJSON-2010930921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78" returned: 0 in 0.327s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:59:51 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-a04cc2ea-7977-4c4c-bed3-d3bcbe37bf0a tempest-VolumesSnapshotTestJSON-2010930921 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 13:59:51 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-a04cc2ea-7977-4c4c-bed3-d3bcbe37bf0a tempest-VolumesSnapshotTestJSON-2010930921 None] Deleted volume successfully. Jul 13 13:59:51 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ef90ec6-e03a-47bc-8a9c-c58bcde21663]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 13:59:51 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-34da64f7-8f56-4eb3-8892-45b10143a57e tempest-VolumesSnapshotTestJSON-2010930921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-ceab0c9b-2879-496d-8815-600b6fb9e092 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:59:51 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-a04cc2ea-7977-4c4c-bed3-d3bcbe37bf0a tempest-VolumesSnapshotTestJSON-2010930921 None] Lock "cinder-4c94aaf5-d714-4dca-9c04-5530c8e943f8-delete_volume" released by "delete_volume" :: held 1.430s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 13:59:51 devstack sudo[99611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-ceab0c9b-2879-496d-8815-600b6fb9e092 Jul 13 13:59:51 devstack sudo[99611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:59:51 devstack sudo[99611]: pam_unix(sudo:session): session closed for user root Jul 13 13:59:51 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-34da64f7-8f56-4eb3-8892-45b10143a57e tempest-VolumesSnapshotTestJSON-2010930921 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-ceab0c9b-2879-496d-8815-600b6fb9e092" returned: 0 in 0.405s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:59:51 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-34da64f7-8f56-4eb3-8892-45b10143a57e tempest-VolumesSnapshotTestJSON-2010930921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-ceab0c9b-2879-496d-8815-600b6fb9e092 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:59:51 devstack sudo[99616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-ceab0c9b-2879-496d-8815-600b6fb9e092 Jul 13 13:59:51 devstack sudo[99616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:59:52 devstack sudo[99616]: pam_unix(sudo:session): session closed for user root Jul 13 13:59:52 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-34da64f7-8f56-4eb3-8892-45b10143a57e tempest-VolumesSnapshotTestJSON-2010930921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-ceab0c9b-2879-496d-8815-600b6fb9e092" returned: 0 in 0.294s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:59:52 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-34da64f7-8f56-4eb3-8892-45b10143a57e tempest-VolumesSnapshotTestJSON-2010930921 None] Lock "cinder-quobyte-ceab0c9b-2879-496d-8815-600b6fb9e092" released by "delete_volume" :: held 0.779s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 13:59:52 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-34da64f7-8f56-4eb3-8892-45b10143a57e tempest-VolumesSnapshotTestJSON-2010930921 None] Created reservations ['6f00ff85-77a5-405c-a5cb-cea6c3858a09', '81ec19fb-fe25-4583-9da9-49a10657a76a', '6d784729-92d2-4cc1-9b2a-8b05c5bb619f', 'ba9d0652-3102-40c8-873a-20922cae17a4'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 13:59:52 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-c074cb54-de57-402f-b5dc-85e704939527 tempest-ProjectReaderTests-630293705 None] Acquiring lock "cinder-37f47d2f-cbce-4f94-8ee5-2c596d490224-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 13:59:52 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-c074cb54-de57-402f-b5dc-85e704939527 tempest-ProjectReaderTests-630293705 None] Lock "cinder-37f47d2f-cbce-4f94-8ee5-2c596d490224-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 13:59:52 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-34da64f7-8f56-4eb3-8892-45b10143a57e tempest-VolumesSnapshotTestJSON-2010930921 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:59:52 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-34da64f7-8f56-4eb3-8892-45b10143a57e tempest-VolumesSnapshotTestJSON-2010930921 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:59:52 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-34da64f7-8f56-4eb3-8892-45b10143a57e tempest-VolumesSnapshotTestJSON-2010930921 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 13:59:52 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-34da64f7-8f56-4eb3-8892-45b10143a57e tempest-VolumesSnapshotTestJSON-2010930921 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 13:59:52 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-34da64f7-8f56-4eb3-8892-45b10143a57e tempest-VolumesSnapshotTestJSON-2010930921 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:59:52 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-34da64f7-8f56-4eb3-8892-45b10143a57e tempest-VolumesSnapshotTestJSON-2010930921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:59:52 devstack sudo[99619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 Jul 13 13:59:52 devstack sudo[99619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:59:52 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-c074cb54-de57-402f-b5dc-85e704939527 tempest-ProjectReaderTests-630293705 None] Acquiring lock "cinder-quobyte-37f47d2f-cbce-4f94-8ee5-2c596d490224" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 13:59:52 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-c074cb54-de57-402f-b5dc-85e704939527 tempest-ProjectReaderTests-630293705 None] Lock "cinder-quobyte-37f47d2f-cbce-4f94-8ee5-2c596d490224" acquired by "delete_volume" :: waited 0.023s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 13:59:52 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[6069aa1f-ef42-40fe-acf4-5eea9ec690c2]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 13:59:52 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-c074cb54-de57-402f-b5dc-85e704939527 tempest-ProjectReaderTests-630293705 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-37f47d2f-cbce-4f94-8ee5-2c596d490224 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:59:52 devstack sudo[99621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-37f47d2f-cbce-4f94-8ee5-2c596d490224 Jul 13 13:59:52 devstack sudo[99621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:59:52 devstack sudo[99619]: pam_unix(sudo:session): session closed for user root Jul 13 13:59:52 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-34da64f7-8f56-4eb3-8892-45b10143a57e tempest-VolumesSnapshotTestJSON-2010930921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78" returned: 0 in 0.404s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:59:52 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-34da64f7-8f56-4eb3-8892-45b10143a57e tempest-VolumesSnapshotTestJSON-2010930921 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 13:59:52 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-34da64f7-8f56-4eb3-8892-45b10143a57e tempest-VolumesSnapshotTestJSON-2010930921 None] Deleted volume successfully. Jul 13 13:59:52 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-34da64f7-8f56-4eb3-8892-45b10143a57e tempest-VolumesSnapshotTestJSON-2010930921 None] Lock "cinder-ceab0c9b-2879-496d-8815-600b6fb9e092-delete_volume" released by "delete_volume" :: held 1.517s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 13:59:53 devstack sudo[99621]: pam_unix(sudo:session): session closed for user root Jul 13 13:59:53 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-c074cb54-de57-402f-b5dc-85e704939527 tempest-ProjectReaderTests-630293705 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-37f47d2f-cbce-4f94-8ee5-2c596d490224" returned: 0 in 0.614s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:59:53 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-c074cb54-de57-402f-b5dc-85e704939527 tempest-ProjectReaderTests-630293705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-37f47d2f-cbce-4f94-8ee5-2c596d490224 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:59:53 devstack sudo[99627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-37f47d2f-cbce-4f94-8ee5-2c596d490224 Jul 13 13:59:53 devstack sudo[99627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:59:53 devstack sudo[99627]: pam_unix(sudo:session): session closed for user root Jul 13 13:59:53 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-c074cb54-de57-402f-b5dc-85e704939527 tempest-ProjectReaderTests-630293705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-37f47d2f-cbce-4f94-8ee5-2c596d490224" returned: 0 in 0.288s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:59:53 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-c074cb54-de57-402f-b5dc-85e704939527 tempest-ProjectReaderTests-630293705 None] Lock "cinder-quobyte-37f47d2f-cbce-4f94-8ee5-2c596d490224" released by "delete_volume" :: held 0.963s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 13:59:53 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-c074cb54-de57-402f-b5dc-85e704939527 tempest-ProjectReaderTests-630293705 None] Created reservations ['acf7f88f-9723-454f-ba2f-eeb07054cf8e', 'e530464e-7172-4d03-bf02-aa8d8cef127e', 'c49b7deb-67e9-4674-a1b3-ea5d77fb0307', '482b3b4c-75b9-4b23-b0cb-e2659e79b652'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 13:59:53 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-c074cb54-de57-402f-b5dc-85e704939527 tempest-ProjectReaderTests-630293705 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:59:53 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-c074cb54-de57-402f-b5dc-85e704939527 tempest-ProjectReaderTests-630293705 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:59:53 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-c074cb54-de57-402f-b5dc-85e704939527 tempest-ProjectReaderTests-630293705 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 13:59:53 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-c074cb54-de57-402f-b5dc-85e704939527 tempest-ProjectReaderTests-630293705 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 13:59:53 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-c074cb54-de57-402f-b5dc-85e704939527 tempest-ProjectReaderTests-630293705 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:59:53 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-c074cb54-de57-402f-b5dc-85e704939527 tempest-ProjectReaderTests-630293705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:59:53 devstack sudo[99630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 Jul 13 13:59:53 devstack sudo[99630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:59:53 devstack sudo[99630]: pam_unix(sudo:session): session closed for user root Jul 13 13:59:53 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-c074cb54-de57-402f-b5dc-85e704939527 tempest-ProjectReaderTests-630293705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78" returned: 0 in 0.302s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:59:53 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-c074cb54-de57-402f-b5dc-85e704939527 tempest-ProjectReaderTests-630293705 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 13:59:53 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-c074cb54-de57-402f-b5dc-85e704939527 tempest-ProjectReaderTests-630293705 None] Deleted volume successfully. Jul 13 13:59:53 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-c074cb54-de57-402f-b5dc-85e704939527 tempest-ProjectReaderTests-630293705 None] Lock "cinder-37f47d2f-cbce-4f94-8ee5-2c596d490224-delete_volume" released by "delete_volume" :: held 1.619s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 13:59:57 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-d5a2713e-0082-4224-8cfb-5a2b369b5dd5 tempest-TestServerVolumeAttachScenarioOldVersion-1142723494 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 13:59:57 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-d5a2713e-0082-4224-8cfb-5a2b369b5dd5 tempest-TestServerVolumeAttachScenarioOldVersion-1142723494 None] Flow 'volume_create_manager' (5c396804-aa03-461b-95c1-56ec41ba259e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 13:59:57 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-d5a2713e-0082-4224-8cfb-5a2b369b5dd5 tempest-TestServerVolumeAttachScenarioOldVersion-1142723494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8bcba72e-01cf-4eee-9e3e-8a1afa63222a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:59:57 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-d5a2713e-0082-4224-8cfb-5a2b369b5dd5 tempest-TestServerVolumeAttachScenarioOldVersion-1142723494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8bcba72e-01cf-4eee-9e3e-8a1afa63222a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T11:59:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1244325508',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d04873d9-e2e1-4aad-8f67-75af419fb118,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5cd5bf8e936b470cb6a82624df64df62',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T11:59:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T11:59:57Z,use_quota=True,user_id='18ebc8030e3647a88960094f0cddd1ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1147de8b-623b-426c-a13d-7fc824a80f67),volume_type_id=1147de8b-623b-426c-a13d-7fc824a80f67)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:59:57 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-d5a2713e-0082-4224-8cfb-5a2b369b5dd5 tempest-TestServerVolumeAttachScenarioOldVersion-1142723494 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (153d9aeb-94a7-4a94-98d5-5578905955d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:59:57 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-d5a2713e-0082-4224-8cfb-5a2b369b5dd5 tempest-TestServerVolumeAttachScenarioOldVersion-1142723494 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (153d9aeb-94a7-4a94-98d5-5578905955d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:59:57 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-d5a2713e-0082-4224-8cfb-5a2b369b5dd5 tempest-TestServerVolumeAttachScenarioOldVersion-1142723494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94143eca-a85a-4d2d-98f0-50b8c4658eab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:59:57 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-d5a2713e-0082-4224-8cfb-5a2b369b5dd5 tempest-TestServerVolumeAttachScenarioOldVersion-1142723494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94143eca-a85a-4d2d-98f0-50b8c4658eab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd04873d9-e2e1-4aad-8f67-75af419fb118', 'volume_name': 'volume-d04873d9-e2e1-4aad-8f67-75af419fb118', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:59:57 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-d5a2713e-0082-4224-8cfb-5a2b369b5dd5 tempest-TestServerVolumeAttachScenarioOldVersion-1142723494 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e3c84f8-6d68-4d0f-beb1-f13bea2a537e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:59:57 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-d5a2713e-0082-4224-8cfb-5a2b369b5dd5 tempest-TestServerVolumeAttachScenarioOldVersion-1142723494 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e3c84f8-6d68-4d0f-beb1-f13bea2a537e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:59:57 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-d5a2713e-0082-4224-8cfb-5a2b369b5dd5 tempest-TestServerVolumeAttachScenarioOldVersion-1142723494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99fbdf72-dbe0-4181-8411-1565fb01a371) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:59:57 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-d5a2713e-0082-4224-8cfb-5a2b369b5dd5 tempest-TestServerVolumeAttachScenarioOldVersion-1142723494 None] Volume d04873d9-e2e1-4aad-8f67-75af419fb118: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d04873d9-e2e1-4aad-8f67-75af419fb118', 'volume_size': 1} Jul 13 13:59:57 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-d5a2713e-0082-4224-8cfb-5a2b369b5dd5 tempest-TestServerVolumeAttachScenarioOldVersion-1142723494 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:59:57 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-d5a2713e-0082-4224-8cfb-5a2b369b5dd5 tempest-TestServerVolumeAttachScenarioOldVersion-1142723494 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:59:57 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-d5a2713e-0082-4224-8cfb-5a2b369b5dd5 tempest-TestServerVolumeAttachScenarioOldVersion-1142723494 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T11:59:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1244325508',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d04873d9-e2e1-4aad-8f67-75af419fb118,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5cd5bf8e936b470cb6a82624df64df62',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T11:59:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T11:59:57Z,use_quota=True,user_id='18ebc8030e3647a88960094f0cddd1ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1147de8b-623b-426c-a13d-7fc824a80f67),volume_type_id=1147de8b-623b-426c-a13d-7fc824a80f67)}" {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 13 13:59:57 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-d5a2713e-0082-4224-8cfb-5a2b369b5dd5 tempest-TestServerVolumeAttachScenarioOldVersion-1142723494 None] Creating volume d04873d9-e2e1-4aad-8f67-75af419fb118 {{(pid=87098) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 13 13:59:57 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-d5a2713e-0082-4224-8cfb-5a2b369b5dd5 tempest-TestServerVolumeAttachScenarioOldVersion-1142723494 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:59:57 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-d5a2713e-0082-4224-8cfb-5a2b369b5dd5 tempest-TestServerVolumeAttachScenarioOldVersion-1142723494 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:59:57 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-d5a2713e-0082-4224-8cfb-5a2b369b5dd5 tempest-TestServerVolumeAttachScenarioOldVersion-1142723494 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 13:59:57 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-d5a2713e-0082-4224-8cfb-5a2b369b5dd5 tempest-TestServerVolumeAttachScenarioOldVersion-1142723494 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 13:59:57 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-d5a2713e-0082-4224-8cfb-5a2b369b5dd5 tempest-TestServerVolumeAttachScenarioOldVersion-1142723494 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:59:57 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-d5a2713e-0082-4224-8cfb-5a2b369b5dd5 tempest-TestServerVolumeAttachScenarioOldVersion-1142723494 None] Selected osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 13:59:57 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-d5a2713e-0082-4224-8cfb-5a2b369b5dd5 tempest-TestServerVolumeAttachScenarioOldVersion-1142723494 None] casted to osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 Jul 13 13:59:57 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-d5a2713e-0082-4224-8cfb-5a2b369b5dd5 tempest-TestServerVolumeAttachScenarioOldVersion-1142723494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-d04873d9-e2e1-4aad-8f67-75af419fb118 1073741824 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:59:57 devstack sudo[99638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-d04873d9-e2e1-4aad-8f67-75af419fb118 1073741824 Jul 13 13:59:57 devstack sudo[99638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:59:58 devstack sudo[99638]: pam_unix(sudo:session): session closed for user root Jul 13 13:59:58 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-d5a2713e-0082-4224-8cfb-5a2b369b5dd5 tempest-TestServerVolumeAttachScenarioOldVersion-1142723494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-d04873d9-e2e1-4aad-8f67-75af419fb118 1073741824" returned: 0 in 0.510s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:59:58 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-d5a2713e-0082-4224-8cfb-5a2b369b5dd5 tempest-TestServerVolumeAttachScenarioOldVersion-1142723494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-d04873d9-e2e1-4aad-8f67-75af419fb118 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:59:58 devstack sudo[99644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-d04873d9-e2e1-4aad-8f67-75af419fb118 Jul 13 13:59:58 devstack sudo[99644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 13:59:58 devstack sudo[99644]: pam_unix(sudo:session): session closed for user root Jul 13 13:59:58 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-d5a2713e-0082-4224-8cfb-5a2b369b5dd5 tempest-TestServerVolumeAttachScenarioOldVersion-1142723494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-d04873d9-e2e1-4aad-8f67-75af419fb118" returned: 0 in 0.268s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 13:59:58 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-d5a2713e-0082-4224-8cfb-5a2b369b5dd5 tempest-TestServerVolumeAttachScenarioOldVersion-1142723494 None] <== create_volume: return (829ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'} {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 13 13:59:58 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-d5a2713e-0082-4224-8cfb-5a2b369b5dd5 tempest-TestServerVolumeAttachScenarioOldVersion-1142723494 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.833s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:59:58 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-d5a2713e-0082-4224-8cfb-5a2b369b5dd5 tempest-TestServerVolumeAttachScenarioOldVersion-1142723494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99fbdf72-dbe0-4181-8411-1565fb01a371) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d04873d9-e2e1-4aad-8f67-75af419fb118', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:59:58 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-d5a2713e-0082-4224-8cfb-5a2b369b5dd5 tempest-TestServerVolumeAttachScenarioOldVersion-1142723494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef48b5fb-c403-4cea-90f2-3ccc80ef95eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:59:58 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-d5a2713e-0082-4224-8cfb-5a2b369b5dd5 tempest-TestServerVolumeAttachScenarioOldVersion-1142723494 None] Volume volume-d04873d9-e2e1-4aad-8f67-75af419fb118 (d04873d9-e2e1-4aad-8f67-75af419fb118): created successfully Jul 13 13:59:58 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-d5a2713e-0082-4224-8cfb-5a2b369b5dd5 tempest-TestServerVolumeAttachScenarioOldVersion-1142723494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef48b5fb-c403-4cea-90f2-3ccc80ef95eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:59:58 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-d5a2713e-0082-4224-8cfb-5a2b369b5dd5 tempest-TestServerVolumeAttachScenarioOldVersion-1142723494 None] Flow 'volume_create_manager' (5c396804-aa03-461b-95c1-56ec41ba259e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 13:59:58 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-d5a2713e-0082-4224-8cfb-5a2b369b5dd5 tempest-TestServerVolumeAttachScenarioOldVersion-1142723494 None] Created volume successfully. Jul 13 13:59:59 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-bfa9e602-2b67-4582-927f-e7a3521bb5c4 tempest-VolumesListAdminTestJSON-1238835600 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 13:59:59 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-bfa9e602-2b67-4582-927f-e7a3521bb5c4 tempest-VolumesListAdminTestJSON-1238835600 None] Flow 'volume_create_manager' (f217d046-a277-4cca-a2de-8159f8614005) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 13:59:59 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-bfa9e602-2b67-4582-927f-e7a3521bb5c4 tempest-VolumesListAdminTestJSON-1238835600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5ec82a3-473c-4445-8580-9b68a830c21b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:59:59 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-bfa9e602-2b67-4582-927f-e7a3521bb5c4 tempest-VolumesListAdminTestJSON-1238835600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5ec82a3-473c-4445-8580-9b68a830c21b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T11:59:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1445637547',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95cbda78-1320-4c46-825f-11cbcdd47aba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e0126cb4ff8453f9711962f728542b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T12:00:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T12:00:00Z,use_quota=True,user_id='bc915d69f03d4fc7940f8c899a69a98a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1147de8b-623b-426c-a13d-7fc824a80f67),volume_type_id=1147de8b-623b-426c-a13d-7fc824a80f67)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:59:59 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-bfa9e602-2b67-4582-927f-e7a3521bb5c4 tempest-VolumesListAdminTestJSON-1238835600 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7a8c211-26d4-4e0f-9791-84f3fac8483c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:59:59 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-bfa9e602-2b67-4582-927f-e7a3521bb5c4 tempest-VolumesListAdminTestJSON-1238835600 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7a8c211-26d4-4e0f-9791-84f3fac8483c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:59:59 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-bfa9e602-2b67-4582-927f-e7a3521bb5c4 tempest-VolumesListAdminTestJSON-1238835600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18f5acb0-5882-403c-a673-73338668dbc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:59:59 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-bfa9e602-2b67-4582-927f-e7a3521bb5c4 tempest-VolumesListAdminTestJSON-1238835600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18f5acb0-5882-403c-a673-73338668dbc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '95cbda78-1320-4c46-825f-11cbcdd47aba', 'volume_name': 'volume-95cbda78-1320-4c46-825f-11cbcdd47aba', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:59:59 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-bfa9e602-2b67-4582-927f-e7a3521bb5c4 tempest-VolumesListAdminTestJSON-1238835600 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8bb258e6-c504-48f4-baf8-bc9b4f1dba34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:59:59 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-bfa9e602-2b67-4582-927f-e7a3521bb5c4 tempest-VolumesListAdminTestJSON-1238835600 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8bb258e6-c504-48f4-baf8-bc9b4f1dba34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 13:59:59 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-bfa9e602-2b67-4582-927f-e7a3521bb5c4 tempest-VolumesListAdminTestJSON-1238835600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5ac01c9-c4d2-4bc4-8350-ee7436c414a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 13:59:59 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-bfa9e602-2b67-4582-927f-e7a3521bb5c4 tempest-VolumesListAdminTestJSON-1238835600 None] Volume 95cbda78-1320-4c46-825f-11cbcdd47aba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-95cbda78-1320-4c46-825f-11cbcdd47aba', 'volume_size': 1} Jul 13 13:59:59 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-bfa9e602-2b67-4582-927f-e7a3521bb5c4 tempest-VolumesListAdminTestJSON-1238835600 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:59:59 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-bfa9e602-2b67-4582-927f-e7a3521bb5c4 tempest-VolumesListAdminTestJSON-1238835600 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:59:59 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-bfa9e602-2b67-4582-927f-e7a3521bb5c4 tempest-VolumesListAdminTestJSON-1238835600 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T11:59:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1445637547',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95cbda78-1320-4c46-825f-11cbcdd47aba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e0126cb4ff8453f9711962f728542b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T12:00:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T12:00:00Z,use_quota=True,user_id='bc915d69f03d4fc7940f8c899a69a98a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1147de8b-623b-426c-a13d-7fc824a80f67),volume_type_id=1147de8b-623b-426c-a13d-7fc824a80f67)}" {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 13 13:59:59 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-bfa9e602-2b67-4582-927f-e7a3521bb5c4 tempest-VolumesListAdminTestJSON-1238835600 None] Creating volume 95cbda78-1320-4c46-825f-11cbcdd47aba {{(pid=87098) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 13 13:59:59 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-bfa9e602-2b67-4582-927f-e7a3521bb5c4 tempest-VolumesListAdminTestJSON-1238835600 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 13:59:59 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-bfa9e602-2b67-4582-927f-e7a3521bb5c4 tempest-VolumesListAdminTestJSON-1238835600 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 13:59:59 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-bfa9e602-2b67-4582-927f-e7a3521bb5c4 tempest-VolumesListAdminTestJSON-1238835600 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 13:59:59 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-bfa9e602-2b67-4582-927f-e7a3521bb5c4 tempest-VolumesListAdminTestJSON-1238835600 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 13:59:59 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-bfa9e602-2b67-4582-927f-e7a3521bb5c4 tempest-VolumesListAdminTestJSON-1238835600 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 13:59:59 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-bfa9e602-2b67-4582-927f-e7a3521bb5c4 tempest-VolumesListAdminTestJSON-1238835600 None] Selected osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 13:59:59 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-bfa9e602-2b67-4582-927f-e7a3521bb5c4 tempest-VolumesListAdminTestJSON-1238835600 None] casted to osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 Jul 13 13:59:59 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-bfa9e602-2b67-4582-927f-e7a3521bb5c4 tempest-VolumesListAdminTestJSON-1238835600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-95cbda78-1320-4c46-825f-11cbcdd47aba 1073741824 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 13:59:59 devstack sudo[99650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-95cbda78-1320-4c46-825f-11cbcdd47aba 1073741824 Jul 13 13:59:59 devstack sudo[99650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:00:00 devstack sudo[99650]: pam_unix(sudo:session): session closed for user root Jul 13 14:00:00 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-bfa9e602-2b67-4582-927f-e7a3521bb5c4 tempest-VolumesListAdminTestJSON-1238835600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-95cbda78-1320-4c46-825f-11cbcdd47aba 1073741824" returned: 0 in 0.604s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:00:00 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [req-3983f700-83eb-45e8-83b4-72f196c32992 req-df903888-6871-4544-acb1-6225b21fe049 tempest-TestServerVolumeAttachScenarioOldVersion-1142723494 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 14:00:00 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-bfa9e602-2b67-4582-927f-e7a3521bb5c4 tempest-VolumesListAdminTestJSON-1238835600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-95cbda78-1320-4c46-825f-11cbcdd47aba {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:00:00 devstack sudo[99665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-95cbda78-1320-4c46-825f-11cbcdd47aba Jul 13 14:00:00 devstack sudo[99665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:00:00 devstack sudo[99665]: pam_unix(sudo:session): session closed for user root Jul 13 14:00:00 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-bfa9e602-2b67-4582-927f-e7a3521bb5c4 tempest-VolumesListAdminTestJSON-1238835600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-95cbda78-1320-4c46-825f-11cbcdd47aba" returned: 0 in 0.259s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:00:00 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-bfa9e602-2b67-4582-927f-e7a3521bb5c4 tempest-VolumesListAdminTestJSON-1238835600 None] <== create_volume: return (927ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'} {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 13 14:00:00 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-bfa9e602-2b67-4582-927f-e7a3521bb5c4 tempest-VolumesListAdminTestJSON-1238835600 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.930s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 14:00:00 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [req-3983f700-83eb-45e8-83b4-72f196c32992 req-df903888-6871-4544-acb1-6225b21fe049 tempest-TestServerVolumeAttachScenarioOldVersion-1142723494 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.269s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 14:00:00 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-bfa9e602-2b67-4582-927f-e7a3521bb5c4 tempest-VolumesListAdminTestJSON-1238835600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5ac01c9-c4d2-4bc4-8350-ee7436c414a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-95cbda78-1320-4c46-825f-11cbcdd47aba', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:00:00 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-bfa9e602-2b67-4582-927f-e7a3521bb5c4 tempest-VolumesListAdminTestJSON-1238835600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8ed7483-8817-4459-9981-bfd7b661380f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:00:00 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebe52803-e142-4101-a42f-ba888365e56e]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 14:00:00 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [req-3983f700-83eb-45e8-83b4-72f196c32992 req-df903888-6871-4544-acb1-6225b21fe049 tempest-TestServerVolumeAttachScenarioOldVersion-1142723494 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-d04873d9-e2e1-4aad-8f67-75af419fb118 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:00:00 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-bfa9e602-2b67-4582-927f-e7a3521bb5c4 tempest-VolumesListAdminTestJSON-1238835600 None] Volume volume-95cbda78-1320-4c46-825f-11cbcdd47aba (95cbda78-1320-4c46-825f-11cbcdd47aba): created successfully Jul 13 14:00:00 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-bfa9e602-2b67-4582-927f-e7a3521bb5c4 tempest-VolumesListAdminTestJSON-1238835600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8ed7483-8817-4459-9981-bfd7b661380f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:00:00 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-bfa9e602-2b67-4582-927f-e7a3521bb5c4 tempest-VolumesListAdminTestJSON-1238835600 None] Flow 'volume_create_manager' (f217d046-a277-4cca-a2de-8159f8614005) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 14:00:00 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-bfa9e602-2b67-4582-927f-e7a3521bb5c4 tempest-VolumesListAdminTestJSON-1238835600 None] Created volume successfully. Jul 13 14:00:00 devstack sudo[99668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-d04873d9-e2e1-4aad-8f67-75af419fb118 Jul 13 14:00:00 devstack sudo[99668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:00:01 devstack sudo[99668]: pam_unix(sudo:session): session closed for user root Jul 13 14:00:01 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [req-3983f700-83eb-45e8-83b4-72f196c32992 req-df903888-6871-4544-acb1-6225b21fe049 tempest-TestServerVolumeAttachScenarioOldVersion-1142723494 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-d04873d9-e2e1-4aad-8f67-75af419fb118" returned: 0 in 0.360s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:00:01 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [req-3983f700-83eb-45e8-83b4-72f196c32992 req-df903888-6871-4544-acb1-6225b21fe049 tempest-TestServerVolumeAttachScenarioOldVersion-1142723494 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.388s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 14:00:01 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [req-3983f700-83eb-45e8-83b4-72f196c32992 req-df903888-6871-4544-acb1-6225b21fe049 tempest-TestServerVolumeAttachScenarioOldVersion-1142723494 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654', 'name': 'volume-d04873d9-e2e1-4aad-8f67-75af419fb118', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '860feaf0-0472-4d6f-8365-f19d69966ff4', 'enforce_multipath': True} {{(pid=87098) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 13 14:00:01 devstack cinder-volume[87098]: INFO cinder.volume.manager [req-3983f700-83eb-45e8-83b4-72f196c32992 req-df903888-6871-4544-acb1-6225b21fe049 tempest-TestServerVolumeAttachScenarioOldVersion-1142723494 None] attachment_update completed successfully. Jul 13 14:00:02 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-60b404c3-7b1c-4f1a-9a33-e111405e0fe2 tempest-VolumesListAdminTestJSON-1238835600 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 14:00:02 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-60b404c3-7b1c-4f1a-9a33-e111405e0fe2 tempest-VolumesListAdminTestJSON-1238835600 None] Flow 'volume_create_manager' (e28c0349-daea-488c-8265-720240cada1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 14:00:02 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-60b404c3-7b1c-4f1a-9a33-e111405e0fe2 tempest-VolumesListAdminTestJSON-1238835600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (207cde69-33ef-4eac-8966-bcdc00d28a89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:00:02 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-60b404c3-7b1c-4f1a-9a33-e111405e0fe2 tempest-VolumesListAdminTestJSON-1238835600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (207cde69-33ef-4eac-8966-bcdc00d28a89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T12:00:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1479577529',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72637687-bd59-4d17-a88d-9de1150b24fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e0126cb4ff8453f9711962f728542b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T12:00:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T12:00:02Z,use_quota=True,user_id='bc915d69f03d4fc7940f8c899a69a98a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1147de8b-623b-426c-a13d-7fc824a80f67),volume_type_id=1147de8b-623b-426c-a13d-7fc824a80f67)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:00:02 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-60b404c3-7b1c-4f1a-9a33-e111405e0fe2 tempest-VolumesListAdminTestJSON-1238835600 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f769b6fe-51b8-479b-ac28-efa2f487d4fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:00:02 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-60b404c3-7b1c-4f1a-9a33-e111405e0fe2 tempest-VolumesListAdminTestJSON-1238835600 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f769b6fe-51b8-479b-ac28-efa2f487d4fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:00:02 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-60b404c3-7b1c-4f1a-9a33-e111405e0fe2 tempest-VolumesListAdminTestJSON-1238835600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a72523f-01a7-4052-8201-ae3f2849bc76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:00:02 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-60b404c3-7b1c-4f1a-9a33-e111405e0fe2 tempest-VolumesListAdminTestJSON-1238835600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a72523f-01a7-4052-8201-ae3f2849bc76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '72637687-bd59-4d17-a88d-9de1150b24fb', 'volume_name': 'volume-72637687-bd59-4d17-a88d-9de1150b24fb', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:00:02 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-60b404c3-7b1c-4f1a-9a33-e111405e0fe2 tempest-VolumesListAdminTestJSON-1238835600 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d61278f1-94a7-41aa-97a2-ec45d5144fca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:00:02 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-60b404c3-7b1c-4f1a-9a33-e111405e0fe2 tempest-VolumesListAdminTestJSON-1238835600 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d61278f1-94a7-41aa-97a2-ec45d5144fca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:00:02 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-60b404c3-7b1c-4f1a-9a33-e111405e0fe2 tempest-VolumesListAdminTestJSON-1238835600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74b50caa-90b9-4fb5-a23c-c23f97d58c87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:00:02 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-60b404c3-7b1c-4f1a-9a33-e111405e0fe2 tempest-VolumesListAdminTestJSON-1238835600 None] Volume 72637687-bd59-4d17-a88d-9de1150b24fb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-72637687-bd59-4d17-a88d-9de1150b24fb', 'volume_size': 1} Jul 13 14:00:02 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-60b404c3-7b1c-4f1a-9a33-e111405e0fe2 tempest-VolumesListAdminTestJSON-1238835600 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 14:00:02 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-60b404c3-7b1c-4f1a-9a33-e111405e0fe2 tempest-VolumesListAdminTestJSON-1238835600 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 14:00:02 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-60b404c3-7b1c-4f1a-9a33-e111405e0fe2 tempest-VolumesListAdminTestJSON-1238835600 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T12:00:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1479577529',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72637687-bd59-4d17-a88d-9de1150b24fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e0126cb4ff8453f9711962f728542b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T12:00:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T12:00:02Z,use_quota=True,user_id='bc915d69f03d4fc7940f8c899a69a98a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1147de8b-623b-426c-a13d-7fc824a80f67),volume_type_id=1147de8b-623b-426c-a13d-7fc824a80f67)}" {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 13 14:00:02 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-60b404c3-7b1c-4f1a-9a33-e111405e0fe2 tempest-VolumesListAdminTestJSON-1238835600 None] Creating volume 72637687-bd59-4d17-a88d-9de1150b24fb {{(pid=87098) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 13 14:00:02 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-60b404c3-7b1c-4f1a-9a33-e111405e0fe2 tempest-VolumesListAdminTestJSON-1238835600 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 14:00:02 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-60b404c3-7b1c-4f1a-9a33-e111405e0fe2 tempest-VolumesListAdminTestJSON-1238835600 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 14:00:02 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-60b404c3-7b1c-4f1a-9a33-e111405e0fe2 tempest-VolumesListAdminTestJSON-1238835600 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 14:00:02 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-60b404c3-7b1c-4f1a-9a33-e111405e0fe2 tempest-VolumesListAdminTestJSON-1238835600 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 14:00:02 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-60b404c3-7b1c-4f1a-9a33-e111405e0fe2 tempest-VolumesListAdminTestJSON-1238835600 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 14:00:02 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-60b404c3-7b1c-4f1a-9a33-e111405e0fe2 tempest-VolumesListAdminTestJSON-1238835600 None] Selected osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 14:00:02 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-60b404c3-7b1c-4f1a-9a33-e111405e0fe2 tempest-VolumesListAdminTestJSON-1238835600 None] casted to osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 Jul 13 14:00:02 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-60b404c3-7b1c-4f1a-9a33-e111405e0fe2 tempest-VolumesListAdminTestJSON-1238835600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-72637687-bd59-4d17-a88d-9de1150b24fb 1073741824 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:00:02 devstack sudo[100057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-72637687-bd59-4d17-a88d-9de1150b24fb 1073741824 Jul 13 14:00:02 devstack sudo[100057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:00:03 devstack sudo[100057]: pam_unix(sudo:session): session closed for user root Jul 13 14:00:03 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-60b404c3-7b1c-4f1a-9a33-e111405e0fe2 tempest-VolumesListAdminTestJSON-1238835600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-72637687-bd59-4d17-a88d-9de1150b24fb 1073741824" returned: 0 in 0.556s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:00:03 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-60b404c3-7b1c-4f1a-9a33-e111405e0fe2 tempest-VolumesListAdminTestJSON-1238835600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-72637687-bd59-4d17-a88d-9de1150b24fb {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:00:03 devstack sudo[100063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-72637687-bd59-4d17-a88d-9de1150b24fb Jul 13 14:00:03 devstack sudo[100063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:00:03 devstack sudo[100063]: pam_unix(sudo:session): session closed for user root Jul 13 14:00:03 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-60b404c3-7b1c-4f1a-9a33-e111405e0fe2 tempest-VolumesListAdminTestJSON-1238835600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-72637687-bd59-4d17-a88d-9de1150b24fb" returned: 0 in 0.299s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:00:03 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-60b404c3-7b1c-4f1a-9a33-e111405e0fe2 tempest-VolumesListAdminTestJSON-1238835600 None] <== create_volume: return (904ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'} {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 13 14:00:03 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-60b404c3-7b1c-4f1a-9a33-e111405e0fe2 tempest-VolumesListAdminTestJSON-1238835600 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.906s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 14:00:03 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-60b404c3-7b1c-4f1a-9a33-e111405e0fe2 tempest-VolumesListAdminTestJSON-1238835600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74b50caa-90b9-4fb5-a23c-c23f97d58c87) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-72637687-bd59-4d17-a88d-9de1150b24fb', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:00:03 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-60b404c3-7b1c-4f1a-9a33-e111405e0fe2 tempest-VolumesListAdminTestJSON-1238835600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66762ce5-a1b0-4ead-9c89-d03b40979bef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:00:03 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-60b404c3-7b1c-4f1a-9a33-e111405e0fe2 tempest-VolumesListAdminTestJSON-1238835600 None] Volume volume-72637687-bd59-4d17-a88d-9de1150b24fb (72637687-bd59-4d17-a88d-9de1150b24fb): created successfully Jul 13 14:00:03 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-60b404c3-7b1c-4f1a-9a33-e111405e0fe2 tempest-VolumesListAdminTestJSON-1238835600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66762ce5-a1b0-4ead-9c89-d03b40979bef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:00:03 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-60b404c3-7b1c-4f1a-9a33-e111405e0fe2 tempest-VolumesListAdminTestJSON-1238835600 None] Flow 'volume_create_manager' (e28c0349-daea-488c-8265-720240cada1c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 14:00:03 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-60b404c3-7b1c-4f1a-9a33-e111405e0fe2 tempest-VolumesListAdminTestJSON-1238835600 None] Created volume successfully. Jul 13 14:00:04 devstack cinder-volume[87098]: INFO cinder.volume.manager [req-56ae425d-85f0-45e4-a8eb-d01ea6b3f96a req-9e078e8a-ddd9-4f9c-ac6d-bf7df9bbfea4 tempest-TestServerVolumeAttachScenarioOldVersion-1142723494 None] Terminate volume connection completed successfully. Jul 13 14:00:04 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [req-56ae425d-85f0-45e4-a8eb-d01ea6b3f96a req-9e078e8a-ddd9-4f9c-ac6d-bf7df9bbfea4 tempest-TestServerVolumeAttachScenarioOldVersion-1142723494 None] Deleting attachment 860feaf0-0472-4d6f-8365-f19d69966ff4. {{(pid=87098) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 13 14:00:05 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-c891e086-406f-4b59-b517-9bbd37d04f4d tempest-VolumesListAdminTestJSON-1238835600 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 14:00:05 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-c891e086-406f-4b59-b517-9bbd37d04f4d tempest-VolumesListAdminTestJSON-1238835600 None] Flow 'volume_create_manager' (45a3b9f7-86d6-4615-8505-c234e7b014b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 14:00:05 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-c891e086-406f-4b59-b517-9bbd37d04f4d tempest-VolumesListAdminTestJSON-1238835600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0387e039-76e0-4c89-b1fb-fc532dd5fe9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:00:05 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-f3999256-2d36-47e8-9fd3-07bacbfd20b8 tempest-TestServerVolumeAttachScenarioOldVersion-1142723494 None] Acquiring lock "cinder-d04873d9-e2e1-4aad-8f67-75af419fb118-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 14:00:05 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-c891e086-406f-4b59-b517-9bbd37d04f4d tempest-VolumesListAdminTestJSON-1238835600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0387e039-76e0-4c89-b1fb-fc532dd5fe9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T12:00:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-249968404',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6371116-d3c2-4e7b-9988-e475659f7210,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e0126cb4ff8453f9711962f728542b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T12:00:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T12:00:05Z,use_quota=True,user_id='bc915d69f03d4fc7940f8c899a69a98a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1147de8b-623b-426c-a13d-7fc824a80f67),volume_type_id=1147de8b-623b-426c-a13d-7fc824a80f67)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:00:05 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-c891e086-406f-4b59-b517-9bbd37d04f4d tempest-VolumesListAdminTestJSON-1238835600 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb4e50d3-da2c-43f2-9cdc-9cf548909f26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:00:05 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-c891e086-406f-4b59-b517-9bbd37d04f4d tempest-VolumesListAdminTestJSON-1238835600 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb4e50d3-da2c-43f2-9cdc-9cf548909f26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:00:05 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-c891e086-406f-4b59-b517-9bbd37d04f4d tempest-VolumesListAdminTestJSON-1238835600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ffd69325-123b-4d3c-b694-22241c166b2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:00:05 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-c891e086-406f-4b59-b517-9bbd37d04f4d tempest-VolumesListAdminTestJSON-1238835600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ffd69325-123b-4d3c-b694-22241c166b2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a6371116-d3c2-4e7b-9988-e475659f7210', 'volume_name': 'volume-a6371116-d3c2-4e7b-9988-e475659f7210', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:00:05 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-c891e086-406f-4b59-b517-9bbd37d04f4d tempest-VolumesListAdminTestJSON-1238835600 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55ab6e9a-7f26-428d-b85e-a17c94c3f15c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:00:05 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-c891e086-406f-4b59-b517-9bbd37d04f4d tempest-VolumesListAdminTestJSON-1238835600 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55ab6e9a-7f26-428d-b85e-a17c94c3f15c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:00:05 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-c891e086-406f-4b59-b517-9bbd37d04f4d tempest-VolumesListAdminTestJSON-1238835600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6779d506-f4fa-4ec9-beb8-f4b4ed88abb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:00:05 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-c891e086-406f-4b59-b517-9bbd37d04f4d tempest-VolumesListAdminTestJSON-1238835600 None] Volume a6371116-d3c2-4e7b-9988-e475659f7210: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a6371116-d3c2-4e7b-9988-e475659f7210', 'volume_size': 1} Jul 13 14:00:05 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-c891e086-406f-4b59-b517-9bbd37d04f4d tempest-VolumesListAdminTestJSON-1238835600 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 14:00:05 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-c891e086-406f-4b59-b517-9bbd37d04f4d tempest-VolumesListAdminTestJSON-1238835600 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 14:00:05 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-c891e086-406f-4b59-b517-9bbd37d04f4d tempest-VolumesListAdminTestJSON-1238835600 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T12:00:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-249968404',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6371116-d3c2-4e7b-9988-e475659f7210,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e0126cb4ff8453f9711962f728542b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T12:00:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T12:00:05Z,use_quota=True,user_id='bc915d69f03d4fc7940f8c899a69a98a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1147de8b-623b-426c-a13d-7fc824a80f67),volume_type_id=1147de8b-623b-426c-a13d-7fc824a80f67)}" {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 13 14:00:05 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-c891e086-406f-4b59-b517-9bbd37d04f4d tempest-VolumesListAdminTestJSON-1238835600 None] Creating volume a6371116-d3c2-4e7b-9988-e475659f7210 {{(pid=87098) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 13 14:00:05 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-c891e086-406f-4b59-b517-9bbd37d04f4d tempest-VolumesListAdminTestJSON-1238835600 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 14:00:05 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-c891e086-406f-4b59-b517-9bbd37d04f4d tempest-VolumesListAdminTestJSON-1238835600 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 14:00:05 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-c891e086-406f-4b59-b517-9bbd37d04f4d tempest-VolumesListAdminTestJSON-1238835600 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 14:00:05 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-c891e086-406f-4b59-b517-9bbd37d04f4d tempest-VolumesListAdminTestJSON-1238835600 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 14:00:05 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-c891e086-406f-4b59-b517-9bbd37d04f4d tempest-VolumesListAdminTestJSON-1238835600 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 14:00:05 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-c891e086-406f-4b59-b517-9bbd37d04f4d tempest-VolumesListAdminTestJSON-1238835600 None] Selected osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 14:00:05 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-c891e086-406f-4b59-b517-9bbd37d04f4d tempest-VolumesListAdminTestJSON-1238835600 None] casted to osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 Jul 13 14:00:05 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-c891e086-406f-4b59-b517-9bbd37d04f4d tempest-VolumesListAdminTestJSON-1238835600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-a6371116-d3c2-4e7b-9988-e475659f7210 1073741824 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:00:05 devstack sudo[100092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-a6371116-d3c2-4e7b-9988-e475659f7210 1073741824 Jul 13 14:00:05 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-f3999256-2d36-47e8-9fd3-07bacbfd20b8 tempest-TestServerVolumeAttachScenarioOldVersion-1142723494 None] Lock "cinder-d04873d9-e2e1-4aad-8f67-75af419fb118-delete_volume" acquired by "delete_volume" :: waited 0.100s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 14:00:05 devstack sudo[100092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:00:05 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-f3999256-2d36-47e8-9fd3-07bacbfd20b8 tempest-TestServerVolumeAttachScenarioOldVersion-1142723494 None] Acquiring lock "cinder-quobyte-d04873d9-e2e1-4aad-8f67-75af419fb118" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 14:00:05 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-f3999256-2d36-47e8-9fd3-07bacbfd20b8 tempest-TestServerVolumeAttachScenarioOldVersion-1142723494 None] Lock "cinder-quobyte-d04873d9-e2e1-4aad-8f67-75af419fb118" acquired by "delete_volume" :: waited 0.019s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 14:00:05 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[409766f1-fd29-4c66-9214-b965dae15e92]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 14:00:05 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-f3999256-2d36-47e8-9fd3-07bacbfd20b8 tempest-TestServerVolumeAttachScenarioOldVersion-1142723494 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-d04873d9-e2e1-4aad-8f67-75af419fb118 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:00:05 devstack sudo[100094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-d04873d9-e2e1-4aad-8f67-75af419fb118 Jul 13 14:00:05 devstack sudo[100094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:00:05 devstack sudo[100092]: pam_unix(sudo:session): session closed for user root Jul 13 14:00:05 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-c891e086-406f-4b59-b517-9bbd37d04f4d tempest-VolumesListAdminTestJSON-1238835600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-a6371116-d3c2-4e7b-9988-e475659f7210 1073741824" returned: 0 in 0.531s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:00:05 devstack sudo[100094]: pam_unix(sudo:session): session closed for user root Jul 13 14:00:05 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-f3999256-2d36-47e8-9fd3-07bacbfd20b8 tempest-TestServerVolumeAttachScenarioOldVersion-1142723494 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-d04873d9-e2e1-4aad-8f67-75af419fb118" returned: 0 in 0.423s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:00:05 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-f3999256-2d36-47e8-9fd3-07bacbfd20b8 tempest-TestServerVolumeAttachScenarioOldVersion-1142723494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-d04873d9-e2e1-4aad-8f67-75af419fb118 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:00:05 devstack sudo[100103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-d04873d9-e2e1-4aad-8f67-75af419fb118 Jul 13 14:00:05 devstack sudo[100103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:00:05 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-c891e086-406f-4b59-b517-9bbd37d04f4d tempest-VolumesListAdminTestJSON-1238835600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-a6371116-d3c2-4e7b-9988-e475659f7210 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:00:05 devstack sudo[100105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-a6371116-d3c2-4e7b-9988-e475659f7210 Jul 13 14:00:05 devstack sudo[100105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:00:06 devstack sudo[100103]: pam_unix(sudo:session): session closed for user root Jul 13 14:00:06 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-f3999256-2d36-47e8-9fd3-07bacbfd20b8 tempest-TestServerVolumeAttachScenarioOldVersion-1142723494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-d04873d9-e2e1-4aad-8f67-75af419fb118" returned: 0 in 0.334s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:00:06 devstack sudo[100105]: pam_unix(sudo:session): session closed for user root Jul 13 14:00:06 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-c891e086-406f-4b59-b517-9bbd37d04f4d tempest-VolumesListAdminTestJSON-1238835600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-a6371116-d3c2-4e7b-9988-e475659f7210" returned: 0 in 0.278s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:00:06 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-c891e086-406f-4b59-b517-9bbd37d04f4d tempest-VolumesListAdminTestJSON-1238835600 None] <== create_volume: return (905ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'} {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 13 14:00:06 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-c891e086-406f-4b59-b517-9bbd37d04f4d tempest-VolumesListAdminTestJSON-1238835600 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.907s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 14:00:06 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-f3999256-2d36-47e8-9fd3-07bacbfd20b8 tempest-TestServerVolumeAttachScenarioOldVersion-1142723494 None] Lock "cinder-quobyte-d04873d9-e2e1-4aad-8f67-75af419fb118" released by "delete_volume" :: held 0.811s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 14:00:06 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-c891e086-406f-4b59-b517-9bbd37d04f4d tempest-VolumesListAdminTestJSON-1238835600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6779d506-f4fa-4ec9-beb8-f4b4ed88abb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a6371116-d3c2-4e7b-9988-e475659f7210', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:00:06 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-c891e086-406f-4b59-b517-9bbd37d04f4d tempest-VolumesListAdminTestJSON-1238835600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (749fe14f-4e38-4507-b6db-8906dcdac032) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:00:06 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-c891e086-406f-4b59-b517-9bbd37d04f4d tempest-VolumesListAdminTestJSON-1238835600 None] Volume volume-a6371116-d3c2-4e7b-9988-e475659f7210 (a6371116-d3c2-4e7b-9988-e475659f7210): created successfully Jul 13 14:00:06 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-c891e086-406f-4b59-b517-9bbd37d04f4d tempest-VolumesListAdminTestJSON-1238835600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (749fe14f-4e38-4507-b6db-8906dcdac032) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:00:06 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-c891e086-406f-4b59-b517-9bbd37d04f4d tempest-VolumesListAdminTestJSON-1238835600 None] Flow 'volume_create_manager' (45a3b9f7-86d6-4615-8505-c234e7b014b4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 14:00:06 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-c891e086-406f-4b59-b517-9bbd37d04f4d tempest-VolumesListAdminTestJSON-1238835600 None] Created volume successfully. Jul 13 14:00:06 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-f3999256-2d36-47e8-9fd3-07bacbfd20b8 tempest-TestServerVolumeAttachScenarioOldVersion-1142723494 None] Created reservations ['325def0b-da85-48fc-bf28-dcb573863f63', '9049ae1f-f640-4248-b8cf-7d2d2734b408', '619d7fc1-4667-47d9-8303-a3942b497506', '47033f64-eef3-4e44-8747-c689e36eb998'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 14:00:06 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-f3999256-2d36-47e8-9fd3-07bacbfd20b8 tempest-TestServerVolumeAttachScenarioOldVersion-1142723494 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 14:00:06 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-f3999256-2d36-47e8-9fd3-07bacbfd20b8 tempest-TestServerVolumeAttachScenarioOldVersion-1142723494 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 14:00:06 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-f3999256-2d36-47e8-9fd3-07bacbfd20b8 tempest-TestServerVolumeAttachScenarioOldVersion-1142723494 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 14:00:06 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-f3999256-2d36-47e8-9fd3-07bacbfd20b8 tempest-TestServerVolumeAttachScenarioOldVersion-1142723494 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 14:00:06 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-f3999256-2d36-47e8-9fd3-07bacbfd20b8 tempest-TestServerVolumeAttachScenarioOldVersion-1142723494 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 14:00:06 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-f3999256-2d36-47e8-9fd3-07bacbfd20b8 tempest-TestServerVolumeAttachScenarioOldVersion-1142723494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:00:06 devstack sudo[100109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 Jul 13 14:00:06 devstack sudo[100109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:00:06 devstack sudo[100109]: pam_unix(sudo:session): session closed for user root Jul 13 14:00:06 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-f3999256-2d36-47e8-9fd3-07bacbfd20b8 tempest-TestServerVolumeAttachScenarioOldVersion-1142723494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78" returned: 0 in 0.354s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:00:06 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-f3999256-2d36-47e8-9fd3-07bacbfd20b8 tempest-TestServerVolumeAttachScenarioOldVersion-1142723494 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 14:00:06 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-f3999256-2d36-47e8-9fd3-07bacbfd20b8 tempest-TestServerVolumeAttachScenarioOldVersion-1142723494 None] Deleted volume successfully. Jul 13 14:00:06 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-f3999256-2d36-47e8-9fd3-07bacbfd20b8 tempest-TestServerVolumeAttachScenarioOldVersion-1142723494 None] Lock "cinder-d04873d9-e2e1-4aad-8f67-75af419fb118-delete_volume" released by "delete_volume" :: held 1.489s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 14:00:07 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-74812297-f7cd-4489-9984-b03955882a66 tempest-VolumesListAdminTestJSON-1918296046 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 14:00:08 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-74812297-f7cd-4489-9984-b03955882a66 tempest-VolumesListAdminTestJSON-1918296046 None] Flow 'volume_create_manager' (ad073e25-eaec-435a-ba6f-2d77f1506e5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 14:00:08 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-74812297-f7cd-4489-9984-b03955882a66 tempest-VolumesListAdminTestJSON-1918296046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (927e8aa7-bc3a-4bc9-99a7-c2223ea31d7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:00:08 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-74812297-f7cd-4489-9984-b03955882a66 tempest-VolumesListAdminTestJSON-1918296046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (927e8aa7-bc3a-4bc9-99a7-c2223ea31d7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T12:00:08Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e67126b1-9acd-4f51-ba77-2effe00e43bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3557df952cc5470abfd29a27ede6ff08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T12:00:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T12:00:08Z,use_quota=True,user_id='5d41f2bd33d14c2587aa09f4f616ddb6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1147de8b-623b-426c-a13d-7fc824a80f67),volume_type_id=1147de8b-623b-426c-a13d-7fc824a80f67)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:00:08 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-74812297-f7cd-4489-9984-b03955882a66 tempest-VolumesListAdminTestJSON-1918296046 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac38f11b-03ad-4c7f-9269-ac001539375e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:00:08 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-74812297-f7cd-4489-9984-b03955882a66 tempest-VolumesListAdminTestJSON-1918296046 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac38f11b-03ad-4c7f-9269-ac001539375e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:00:08 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-74812297-f7cd-4489-9984-b03955882a66 tempest-VolumesListAdminTestJSON-1918296046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e7f09e0-3a04-4875-b116-26df333b1672) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:00:08 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-74812297-f7cd-4489-9984-b03955882a66 tempest-VolumesListAdminTestJSON-1918296046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e7f09e0-3a04-4875-b116-26df333b1672) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e67126b1-9acd-4f51-ba77-2effe00e43bd', 'volume_name': 'volume-e67126b1-9acd-4f51-ba77-2effe00e43bd', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:00:08 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-74812297-f7cd-4489-9984-b03955882a66 tempest-VolumesListAdminTestJSON-1918296046 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88a45fe0-34d5-4154-a4a7-9ba54f8a6778) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:00:08 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-74812297-f7cd-4489-9984-b03955882a66 tempest-VolumesListAdminTestJSON-1918296046 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88a45fe0-34d5-4154-a4a7-9ba54f8a6778) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:00:08 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-74812297-f7cd-4489-9984-b03955882a66 tempest-VolumesListAdminTestJSON-1918296046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16e0f92c-6471-46e5-9343-82db2d31c769) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:00:08 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-74812297-f7cd-4489-9984-b03955882a66 tempest-VolumesListAdminTestJSON-1918296046 None] Volume e67126b1-9acd-4f51-ba77-2effe00e43bd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e67126b1-9acd-4f51-ba77-2effe00e43bd', 'volume_size': 1} Jul 13 14:00:08 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-74812297-f7cd-4489-9984-b03955882a66 tempest-VolumesListAdminTestJSON-1918296046 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 14:00:08 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-74812297-f7cd-4489-9984-b03955882a66 tempest-VolumesListAdminTestJSON-1918296046 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 14:00:08 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-74812297-f7cd-4489-9984-b03955882a66 tempest-VolumesListAdminTestJSON-1918296046 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T12:00:08Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e67126b1-9acd-4f51-ba77-2effe00e43bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3557df952cc5470abfd29a27ede6ff08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T12:00:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T12:00:08Z,use_quota=True,user_id='5d41f2bd33d14c2587aa09f4f616ddb6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1147de8b-623b-426c-a13d-7fc824a80f67),volume_type_id=1147de8b-623b-426c-a13d-7fc824a80f67)}" {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 13 14:00:08 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-74812297-f7cd-4489-9984-b03955882a66 tempest-VolumesListAdminTestJSON-1918296046 None] Creating volume e67126b1-9acd-4f51-ba77-2effe00e43bd {{(pid=87098) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 13 14:00:08 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-74812297-f7cd-4489-9984-b03955882a66 tempest-VolumesListAdminTestJSON-1918296046 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 14:00:08 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-74812297-f7cd-4489-9984-b03955882a66 tempest-VolumesListAdminTestJSON-1918296046 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 14:00:08 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-74812297-f7cd-4489-9984-b03955882a66 tempest-VolumesListAdminTestJSON-1918296046 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 14:00:08 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-74812297-f7cd-4489-9984-b03955882a66 tempest-VolumesListAdminTestJSON-1918296046 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 14:00:08 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-74812297-f7cd-4489-9984-b03955882a66 tempest-VolumesListAdminTestJSON-1918296046 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 14:00:08 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-74812297-f7cd-4489-9984-b03955882a66 tempest-VolumesListAdminTestJSON-1918296046 None] Selected osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 14:00:08 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-74812297-f7cd-4489-9984-b03955882a66 tempest-VolumesListAdminTestJSON-1918296046 None] casted to osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 Jul 13 14:00:08 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-74812297-f7cd-4489-9984-b03955882a66 tempest-VolumesListAdminTestJSON-1918296046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-e67126b1-9acd-4f51-ba77-2effe00e43bd 1073741824 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:00:08 devstack sudo[100134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-e67126b1-9acd-4f51-ba77-2effe00e43bd 1073741824 Jul 13 14:00:08 devstack sudo[100134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:00:08 devstack sudo[100134]: pam_unix(sudo:session): session closed for user root Jul 13 14:00:08 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-74812297-f7cd-4489-9984-b03955882a66 tempest-VolumesListAdminTestJSON-1918296046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-e67126b1-9acd-4f51-ba77-2effe00e43bd 1073741824" returned: 0 in 0.572s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:00:08 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-74812297-f7cd-4489-9984-b03955882a66 tempest-VolumesListAdminTestJSON-1918296046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-e67126b1-9acd-4f51-ba77-2effe00e43bd {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:00:08 devstack sudo[100141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-e67126b1-9acd-4f51-ba77-2effe00e43bd Jul 13 14:00:08 devstack sudo[100141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:00:09 devstack sudo[100141]: pam_unix(sudo:session): session closed for user root Jul 13 14:00:09 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-74812297-f7cd-4489-9984-b03955882a66 tempest-VolumesListAdminTestJSON-1918296046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-e67126b1-9acd-4f51-ba77-2effe00e43bd" returned: 0 in 0.278s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:00:09 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-74812297-f7cd-4489-9984-b03955882a66 tempest-VolumesListAdminTestJSON-1918296046 None] <== create_volume: return (969ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'} {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 13 14:00:09 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-74812297-f7cd-4489-9984-b03955882a66 tempest-VolumesListAdminTestJSON-1918296046 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.972s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 14:00:09 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-74812297-f7cd-4489-9984-b03955882a66 tempest-VolumesListAdminTestJSON-1918296046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16e0f92c-6471-46e5-9343-82db2d31c769) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e67126b1-9acd-4f51-ba77-2effe00e43bd', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:00:09 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-74812297-f7cd-4489-9984-b03955882a66 tempest-VolumesListAdminTestJSON-1918296046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1168a7d9-f6c5-434e-8e03-091eda5fd5a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:00:09 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-74812297-f7cd-4489-9984-b03955882a66 tempest-VolumesListAdminTestJSON-1918296046 None] Volume volume-e67126b1-9acd-4f51-ba77-2effe00e43bd (e67126b1-9acd-4f51-ba77-2effe00e43bd): created successfully Jul 13 14:00:09 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-74812297-f7cd-4489-9984-b03955882a66 tempest-VolumesListAdminTestJSON-1918296046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1168a7d9-f6c5-434e-8e03-091eda5fd5a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:00:09 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-74812297-f7cd-4489-9984-b03955882a66 tempest-VolumesListAdminTestJSON-1918296046 None] Flow 'volume_create_manager' (ad073e25-eaec-435a-ba6f-2d77f1506e5b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 14:00:09 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-74812297-f7cd-4489-9984-b03955882a66 tempest-VolumesListAdminTestJSON-1918296046 None] Created volume successfully. Jul 13 14:00:10 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-4ecdb994-0e65-483c-b6c9-94951cee34e3 tempest-VolumesListAdminTestJSON-1918296046 None] Acquiring lock "cinder-e67126b1-9acd-4f51-ba77-2effe00e43bd-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 14:00:10 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-4ecdb994-0e65-483c-b6c9-94951cee34e3 tempest-VolumesListAdminTestJSON-1918296046 None] Lock "cinder-e67126b1-9acd-4f51-ba77-2effe00e43bd-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 14:00:10 devstack cinder-volume[87098]: DEBUG dbcounter [-] [87098] Writing DB stats cinder:SELECT=146,cinder:INSERT=44,cinder:UPDATE=182,cinder:DELETE=15 {{(pid=87098) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 13 14:00:10 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-4ecdb994-0e65-483c-b6c9-94951cee34e3 tempest-VolumesListAdminTestJSON-1918296046 None] Acquiring lock "cinder-quobyte-e67126b1-9acd-4f51-ba77-2effe00e43bd" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 14:00:10 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-4ecdb994-0e65-483c-b6c9-94951cee34e3 tempest-VolumesListAdminTestJSON-1918296046 None] Lock "cinder-quobyte-e67126b1-9acd-4f51-ba77-2effe00e43bd" acquired by "delete_volume" :: waited 0.027s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 14:00:10 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[348dd8fe-e078-4b9f-bfdd-c292d30d6bb8]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 14:00:10 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-4ecdb994-0e65-483c-b6c9-94951cee34e3 tempest-VolumesListAdminTestJSON-1918296046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-e67126b1-9acd-4f51-ba77-2effe00e43bd {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:00:10 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-ff077ad0-b0a3-4e4a-9ff9-ef20b4fd8728 tempest-VolumesListAdminTestJSON-1238835600 None] Acquiring lock "cinder-a6371116-d3c2-4e7b-9988-e475659f7210-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 14:00:10 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-ff077ad0-b0a3-4e4a-9ff9-ef20b4fd8728 tempest-VolumesListAdminTestJSON-1238835600 None] Lock "cinder-a6371116-d3c2-4e7b-9988-e475659f7210-delete_volume" acquired by "delete_volume" :: waited 0.065s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 14:00:10 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-ff077ad0-b0a3-4e4a-9ff9-ef20b4fd8728 tempest-VolumesListAdminTestJSON-1238835600 None] Acquiring lock "cinder-quobyte-a6371116-d3c2-4e7b-9988-e475659f7210" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 14:00:10 devstack sudo[100182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-e67126b1-9acd-4f51-ba77-2effe00e43bd Jul 13 14:00:10 devstack sudo[100182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:00:10 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-ff077ad0-b0a3-4e4a-9ff9-ef20b4fd8728 tempest-VolumesListAdminTestJSON-1238835600 None] Lock "cinder-quobyte-a6371116-d3c2-4e7b-9988-e475659f7210" acquired by "delete_volume" :: waited 0.015s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 14:00:10 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d1bd5ea-ef54-405f-9e18-38f5b40f8812]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 14:00:10 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-ff077ad0-b0a3-4e4a-9ff9-ef20b4fd8728 tempest-VolumesListAdminTestJSON-1238835600 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-a6371116-d3c2-4e7b-9988-e475659f7210 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:00:10 devstack sudo[100184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-a6371116-d3c2-4e7b-9988-e475659f7210 Jul 13 14:00:10 devstack sudo[100184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:00:10 devstack sudo[100182]: pam_unix(sudo:session): session closed for user root Jul 13 14:00:10 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-4ecdb994-0e65-483c-b6c9-94951cee34e3 tempest-VolumesListAdminTestJSON-1918296046 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-e67126b1-9acd-4f51-ba77-2effe00e43bd" returned: 0 in 0.586s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:00:10 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-4ecdb994-0e65-483c-b6c9-94951cee34e3 tempest-VolumesListAdminTestJSON-1918296046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-e67126b1-9acd-4f51-ba77-2effe00e43bd {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:00:10 devstack sudo[100189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-e67126b1-9acd-4f51-ba77-2effe00e43bd Jul 13 14:00:10 devstack sudo[100189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:00:11 devstack sudo[100184]: pam_unix(sudo:session): session closed for user root Jul 13 14:00:11 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-ff077ad0-b0a3-4e4a-9ff9-ef20b4fd8728 tempest-VolumesListAdminTestJSON-1238835600 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-a6371116-d3c2-4e7b-9988-e475659f7210" returned: 0 in 0.499s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:00:11 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-ff077ad0-b0a3-4e4a-9ff9-ef20b4fd8728 tempest-VolumesListAdminTestJSON-1238835600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-a6371116-d3c2-4e7b-9988-e475659f7210 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:00:11 devstack sudo[100194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-a6371116-d3c2-4e7b-9988-e475659f7210 Jul 13 14:00:11 devstack sudo[100194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:00:11 devstack sudo[100189]: pam_unix(sudo:session): session closed for user root Jul 13 14:00:11 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-4ecdb994-0e65-483c-b6c9-94951cee34e3 tempest-VolumesListAdminTestJSON-1918296046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-e67126b1-9acd-4f51-ba77-2effe00e43bd" returned: 0 in 0.320s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:00:11 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-4ecdb994-0e65-483c-b6c9-94951cee34e3 tempest-VolumesListAdminTestJSON-1918296046 None] Lock "cinder-quobyte-e67126b1-9acd-4f51-ba77-2effe00e43bd" released by "delete_volume" :: held 0.968s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 14:00:11 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-4ecdb994-0e65-483c-b6c9-94951cee34e3 tempest-VolumesListAdminTestJSON-1918296046 None] Created reservations ['acb530bc-4176-45f0-993d-911bc8dada64', '0ed248d6-6154-4e18-bf7e-00555bb84e0b', 'f3899828-301f-4cc5-81df-78bf00391605', '6b03662f-89a3-4fd5-8d8e-a76b69d5cd85'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 14:00:11 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-4ecdb994-0e65-483c-b6c9-94951cee34e3 tempest-VolumesListAdminTestJSON-1918296046 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 14:00:11 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-4ecdb994-0e65-483c-b6c9-94951cee34e3 tempest-VolumesListAdminTestJSON-1918296046 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 14:00:11 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-4ecdb994-0e65-483c-b6c9-94951cee34e3 tempest-VolumesListAdminTestJSON-1918296046 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 14:00:11 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-4ecdb994-0e65-483c-b6c9-94951cee34e3 tempest-VolumesListAdminTestJSON-1918296046 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 14:00:11 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-4ecdb994-0e65-483c-b6c9-94951cee34e3 tempest-VolumesListAdminTestJSON-1918296046 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 14:00:11 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-4ecdb994-0e65-483c-b6c9-94951cee34e3 tempest-VolumesListAdminTestJSON-1918296046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:00:11 devstack sudo[100194]: pam_unix(sudo:session): session closed for user root Jul 13 14:00:11 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-ff077ad0-b0a3-4e4a-9ff9-ef20b4fd8728 tempest-VolumesListAdminTestJSON-1238835600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-a6371116-d3c2-4e7b-9988-e475659f7210" returned: 0 in 0.346s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:00:11 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-ff077ad0-b0a3-4e4a-9ff9-ef20b4fd8728 tempest-VolumesListAdminTestJSON-1238835600 None] Lock "cinder-quobyte-a6371116-d3c2-4e7b-9988-e475659f7210" released by "delete_volume" :: held 0.926s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 14:00:11 devstack sudo[100198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 Jul 13 14:00:11 devstack sudo[100198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:00:11 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-ff077ad0-b0a3-4e4a-9ff9-ef20b4fd8728 tempest-VolumesListAdminTestJSON-1238835600 None] Created reservations ['61956b15-b3b5-44ff-9e1a-2951582fbf2c', 'f9d5dbe8-295c-4263-961f-54cccb18a018', 'fd1f68db-2b36-4fda-8653-43589dd1ddef', '26746398-837c-46e0-8de7-d846700928f8'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 14:00:11 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-ff077ad0-b0a3-4e4a-9ff9-ef20b4fd8728 tempest-VolumesListAdminTestJSON-1238835600 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 14:00:11 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-ff077ad0-b0a3-4e4a-9ff9-ef20b4fd8728 tempest-VolumesListAdminTestJSON-1238835600 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 14:00:11 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-ff077ad0-b0a3-4e4a-9ff9-ef20b4fd8728 tempest-VolumesListAdminTestJSON-1238835600 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 14:00:11 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-ff077ad0-b0a3-4e4a-9ff9-ef20b4fd8728 tempest-VolumesListAdminTestJSON-1238835600 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 14:00:11 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-ff077ad0-b0a3-4e4a-9ff9-ef20b4fd8728 tempest-VolumesListAdminTestJSON-1238835600 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 14:00:11 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-ff077ad0-b0a3-4e4a-9ff9-ef20b4fd8728 tempest-VolumesListAdminTestJSON-1238835600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:00:11 devstack sudo[100200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 Jul 13 14:00:11 devstack sudo[100200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:00:11 devstack sudo[100198]: pam_unix(sudo:session): session closed for user root Jul 13 14:00:11 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-4ecdb994-0e65-483c-b6c9-94951cee34e3 tempest-VolumesListAdminTestJSON-1918296046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78" returned: 0 in 0.435s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:00:11 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-4ecdb994-0e65-483c-b6c9-94951cee34e3 tempest-VolumesListAdminTestJSON-1918296046 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 14:00:11 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-99852fe3-dde5-4ee5-8886-af4761cfea1e tempest-VolumesListAdminTestJSON-1238835600 None] Acquiring lock "cinder-72637687-bd59-4d17-a88d-9de1150b24fb-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 14:00:11 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-4ecdb994-0e65-483c-b6c9-94951cee34e3 tempest-VolumesListAdminTestJSON-1918296046 None] Deleted volume successfully. Jul 13 14:00:11 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-99852fe3-dde5-4ee5-8886-af4761cfea1e tempest-VolumesListAdminTestJSON-1238835600 None] Lock "cinder-72637687-bd59-4d17-a88d-9de1150b24fb-delete_volume" acquired by "delete_volume" :: waited 0.067s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 14:00:11 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-4ecdb994-0e65-483c-b6c9-94951cee34e3 tempest-VolumesListAdminTestJSON-1918296046 None] Lock "cinder-e67126b1-9acd-4f51-ba77-2effe00e43bd-delete_volume" released by "delete_volume" :: held 1.755s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 14:00:12 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-99852fe3-dde5-4ee5-8886-af4761cfea1e tempest-VolumesListAdminTestJSON-1238835600 None] Acquiring lock "cinder-quobyte-72637687-bd59-4d17-a88d-9de1150b24fb" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 14:00:12 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-99852fe3-dde5-4ee5-8886-af4761cfea1e tempest-VolumesListAdminTestJSON-1238835600 None] Lock "cinder-quobyte-72637687-bd59-4d17-a88d-9de1150b24fb" acquired by "delete_volume" :: waited 0.024s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 14:00:12 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[8aa48ea6-cc62-4c70-9e46-0d26b54cc578]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 14:00:12 devstack sudo[100200]: pam_unix(sudo:session): session closed for user root Jul 13 14:00:12 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-99852fe3-dde5-4ee5-8886-af4761cfea1e tempest-VolumesListAdminTestJSON-1238835600 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-72637687-bd59-4d17-a88d-9de1150b24fb {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:00:12 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-ff077ad0-b0a3-4e4a-9ff9-ef20b4fd8728 tempest-VolumesListAdminTestJSON-1238835600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78" returned: 0 in 0.490s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:00:12 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-ff077ad0-b0a3-4e4a-9ff9-ef20b4fd8728 tempest-VolumesListAdminTestJSON-1238835600 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 14:00:12 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-ff077ad0-b0a3-4e4a-9ff9-ef20b4fd8728 tempest-VolumesListAdminTestJSON-1238835600 None] Deleted volume successfully. Jul 13 14:00:12 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-ff077ad0-b0a3-4e4a-9ff9-ef20b4fd8728 tempest-VolumesListAdminTestJSON-1238835600 None] Lock "cinder-a6371116-d3c2-4e7b-9988-e475659f7210-delete_volume" released by "delete_volume" :: held 1.668s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 14:00:12 devstack sudo[100204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-72637687-bd59-4d17-a88d-9de1150b24fb Jul 13 14:00:12 devstack sudo[100204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:00:12 devstack sudo[100204]: pam_unix(sudo:session): session closed for user root Jul 13 14:00:12 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-99852fe3-dde5-4ee5-8886-af4761cfea1e tempest-VolumesListAdminTestJSON-1238835600 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-72637687-bd59-4d17-a88d-9de1150b24fb" returned: 0 in 0.448s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:00:12 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-99852fe3-dde5-4ee5-8886-af4761cfea1e tempest-VolumesListAdminTestJSON-1238835600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-72637687-bd59-4d17-a88d-9de1150b24fb {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:00:12 devstack sudo[100209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-72637687-bd59-4d17-a88d-9de1150b24fb Jul 13 14:00:12 devstack sudo[100209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:00:12 devstack sudo[100209]: pam_unix(sudo:session): session closed for user root Jul 13 14:00:12 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-99852fe3-dde5-4ee5-8886-af4761cfea1e tempest-VolumesListAdminTestJSON-1238835600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-72637687-bd59-4d17-a88d-9de1150b24fb" returned: 0 in 0.308s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:00:12 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-99852fe3-dde5-4ee5-8886-af4761cfea1e tempest-VolumesListAdminTestJSON-1238835600 None] Lock "cinder-quobyte-72637687-bd59-4d17-a88d-9de1150b24fb" released by "delete_volume" :: held 0.823s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 14:00:12 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-99852fe3-dde5-4ee5-8886-af4761cfea1e tempest-VolumesListAdminTestJSON-1238835600 None] Created reservations ['873aa751-3b7b-4c4c-b39e-0e0f471d279c', '47a75d6a-a2a3-4c80-9144-7b2ab7723ffb', '08f38e26-97e1-4d45-8074-15381667cbba', 'e2483786-8b7a-400a-b679-84fde3dabf15'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 14:00:13 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-99852fe3-dde5-4ee5-8886-af4761cfea1e tempest-VolumesListAdminTestJSON-1238835600 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 14:00:13 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-99852fe3-dde5-4ee5-8886-af4761cfea1e tempest-VolumesListAdminTestJSON-1238835600 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 14:00:13 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-99852fe3-dde5-4ee5-8886-af4761cfea1e tempest-VolumesListAdminTestJSON-1238835600 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 14:00:13 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-99852fe3-dde5-4ee5-8886-af4761cfea1e tempest-VolumesListAdminTestJSON-1238835600 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 14:00:13 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-99852fe3-dde5-4ee5-8886-af4761cfea1e tempest-VolumesListAdminTestJSON-1238835600 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 14:00:13 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-99852fe3-dde5-4ee5-8886-af4761cfea1e tempest-VolumesListAdminTestJSON-1238835600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:00:13 devstack sudo[100212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 Jul 13 14:00:13 devstack sudo[100212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:00:13 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-aa1d12bd-d09e-4ad2-9da1-d0139bf25196 tempest-VolumesListAdminTestJSON-1238835600 None] Acquiring lock "cinder-95cbda78-1320-4c46-825f-11cbcdd47aba-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 14:00:13 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-aa1d12bd-d09e-4ad2-9da1-d0139bf25196 tempest-VolumesListAdminTestJSON-1238835600 None] Lock "cinder-95cbda78-1320-4c46-825f-11cbcdd47aba-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 14:00:13 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-aa1d12bd-d09e-4ad2-9da1-d0139bf25196 tempest-VolumesListAdminTestJSON-1238835600 None] Acquiring lock "cinder-quobyte-95cbda78-1320-4c46-825f-11cbcdd47aba" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 14:00:13 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-aa1d12bd-d09e-4ad2-9da1-d0139bf25196 tempest-VolumesListAdminTestJSON-1238835600 None] Lock "cinder-quobyte-95cbda78-1320-4c46-825f-11cbcdd47aba" acquired by "delete_volume" :: waited 0.021s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 14:00:13 devstack sudo[100212]: pam_unix(sudo:session): session closed for user root Jul 13 14:00:13 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-99852fe3-dde5-4ee5-8886-af4761cfea1e tempest-VolumesListAdminTestJSON-1238835600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78" returned: 0 in 0.323s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:00:13 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-99852fe3-dde5-4ee5-8886-af4761cfea1e tempest-VolumesListAdminTestJSON-1238835600 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 14:00:13 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-99852fe3-dde5-4ee5-8886-af4761cfea1e tempest-VolumesListAdminTestJSON-1238835600 None] Deleted volume successfully. Jul 13 14:00:13 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[09110bea-c823-40b3-beba-d35e53576b92]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 14:00:13 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-aa1d12bd-d09e-4ad2-9da1-d0139bf25196 tempest-VolumesListAdminTestJSON-1238835600 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-95cbda78-1320-4c46-825f-11cbcdd47aba {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:00:13 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-99852fe3-dde5-4ee5-8886-af4761cfea1e tempest-VolumesListAdminTestJSON-1238835600 None] Lock "cinder-72637687-bd59-4d17-a88d-9de1150b24fb-delete_volume" released by "delete_volume" :: held 1.489s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 14:00:13 devstack sudo[100215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-95cbda78-1320-4c46-825f-11cbcdd47aba Jul 13 14:00:13 devstack sudo[100215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:00:13 devstack sudo[100215]: pam_unix(sudo:session): session closed for user root Jul 13 14:00:13 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-aa1d12bd-d09e-4ad2-9da1-d0139bf25196 tempest-VolumesListAdminTestJSON-1238835600 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-95cbda78-1320-4c46-825f-11cbcdd47aba" returned: 0 in 0.416s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:00:13 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-aa1d12bd-d09e-4ad2-9da1-d0139bf25196 tempest-VolumesListAdminTestJSON-1238835600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-95cbda78-1320-4c46-825f-11cbcdd47aba {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:00:13 devstack sudo[100221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-95cbda78-1320-4c46-825f-11cbcdd47aba Jul 13 14:00:13 devstack sudo[100221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:00:14 devstack sudo[100221]: pam_unix(sudo:session): session closed for user root Jul 13 14:00:14 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-aa1d12bd-d09e-4ad2-9da1-d0139bf25196 tempest-VolumesListAdminTestJSON-1238835600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-95cbda78-1320-4c46-825f-11cbcdd47aba" returned: 0 in 0.352s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:00:14 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-aa1d12bd-d09e-4ad2-9da1-d0139bf25196 tempest-VolumesListAdminTestJSON-1238835600 None] Lock "cinder-quobyte-95cbda78-1320-4c46-825f-11cbcdd47aba" released by "delete_volume" :: held 0.829s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 14:00:14 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-aa1d12bd-d09e-4ad2-9da1-d0139bf25196 tempest-VolumesListAdminTestJSON-1238835600 None] Created reservations ['505a7379-8bff-472c-bdfa-da46618ba7e2', '90397668-346b-4a7b-bf7a-4fa9af6b155e', '27ed1d0b-0643-4a2a-ac21-4c314c7560e0', '1f36892e-e45a-4f6d-91e7-c4eeae2ce58e'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 14:00:14 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-aa1d12bd-d09e-4ad2-9da1-d0139bf25196 tempest-VolumesListAdminTestJSON-1238835600 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 14:00:14 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-aa1d12bd-d09e-4ad2-9da1-d0139bf25196 tempest-VolumesListAdminTestJSON-1238835600 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 14:00:14 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-aa1d12bd-d09e-4ad2-9da1-d0139bf25196 tempest-VolumesListAdminTestJSON-1238835600 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 14:00:14 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-aa1d12bd-d09e-4ad2-9da1-d0139bf25196 tempest-VolumesListAdminTestJSON-1238835600 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 14:00:14 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-aa1d12bd-d09e-4ad2-9da1-d0139bf25196 tempest-VolumesListAdminTestJSON-1238835600 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 14:00:14 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-aa1d12bd-d09e-4ad2-9da1-d0139bf25196 tempest-VolumesListAdminTestJSON-1238835600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:00:14 devstack sudo[100224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 Jul 13 14:00:14 devstack sudo[100224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:00:14 devstack sudo[100224]: pam_unix(sudo:session): session closed for user root Jul 13 14:00:14 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-aa1d12bd-d09e-4ad2-9da1-d0139bf25196 tempest-VolumesListAdminTestJSON-1238835600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78" returned: 0 in 0.319s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:00:14 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-aa1d12bd-d09e-4ad2-9da1-d0139bf25196 tempest-VolumesListAdminTestJSON-1238835600 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 14:00:14 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-aa1d12bd-d09e-4ad2-9da1-d0139bf25196 tempest-VolumesListAdminTestJSON-1238835600 None] Deleted volume successfully. Jul 13 14:00:14 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-aa1d12bd-d09e-4ad2-9da1-d0139bf25196 tempest-VolumesListAdminTestJSON-1238835600 None] Lock "cinder-95cbda78-1320-4c46-825f-11cbcdd47aba-delete_volume" released by "delete_volume" :: held 1.402s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 14:00:22 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-0311d15f-748a-44d1-9371-240a9fdc2073 tempest-TestServerVolumeAttachmentScenario-1406476146 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 14:00:22 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-0311d15f-748a-44d1-9371-240a9fdc2073 tempest-TestServerVolumeAttachmentScenario-1406476146 None] Flow 'volume_create_manager' (a39f35fb-f9d2-4b60-930a-af6ff8d92ce2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 14:00:22 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-0311d15f-748a-44d1-9371-240a9fdc2073 tempest-TestServerVolumeAttachmentScenario-1406476146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c81bdfb0-db25-44f2-be16-f464e40c3198) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:00:22 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-0311d15f-748a-44d1-9371-240a9fdc2073 tempest-TestServerVolumeAttachmentScenario-1406476146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c81bdfb0-db25-44f2-be16-f464e40c3198) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T12:00:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1993822465',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5bdcac5e-f4f1-46d3-8f6e-b62987578e78,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8409a8b090a2486ab7a32ce05ad649fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T12:00:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T12:00:22Z,use_quota=True,user_id='3a02ba36f0954b06853ffbd2790a92a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1147de8b-623b-426c-a13d-7fc824a80f67),volume_type_id=1147de8b-623b-426c-a13d-7fc824a80f67)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:00:22 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-0311d15f-748a-44d1-9371-240a9fdc2073 tempest-TestServerVolumeAttachmentScenario-1406476146 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46f8ded8-a4c9-4a51-b182-8161a4e85415) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:00:22 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-0311d15f-748a-44d1-9371-240a9fdc2073 tempest-TestServerVolumeAttachmentScenario-1406476146 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46f8ded8-a4c9-4a51-b182-8161a4e85415) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:00:22 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-0311d15f-748a-44d1-9371-240a9fdc2073 tempest-TestServerVolumeAttachmentScenario-1406476146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (166ee99f-ea4e-486d-aece-b006a73013b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:00:22 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-0311d15f-748a-44d1-9371-240a9fdc2073 tempest-TestServerVolumeAttachmentScenario-1406476146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (166ee99f-ea4e-486d-aece-b006a73013b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5bdcac5e-f4f1-46d3-8f6e-b62987578e78', 'volume_name': 'volume-5bdcac5e-f4f1-46d3-8f6e-b62987578e78', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:00:22 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-0311d15f-748a-44d1-9371-240a9fdc2073 tempest-TestServerVolumeAttachmentScenario-1406476146 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d9c7f6f-eef4-4e3a-8647-d5a71f7c2d3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:00:22 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-0311d15f-748a-44d1-9371-240a9fdc2073 tempest-TestServerVolumeAttachmentScenario-1406476146 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d9c7f6f-eef4-4e3a-8647-d5a71f7c2d3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:00:22 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-0311d15f-748a-44d1-9371-240a9fdc2073 tempest-TestServerVolumeAttachmentScenario-1406476146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (436f8a52-ab5f-4a92-8617-92f937a665be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:00:22 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-0311d15f-748a-44d1-9371-240a9fdc2073 tempest-TestServerVolumeAttachmentScenario-1406476146 None] Volume 5bdcac5e-f4f1-46d3-8f6e-b62987578e78: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5bdcac5e-f4f1-46d3-8f6e-b62987578e78', 'volume_size': 1} Jul 13 14:00:22 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-0311d15f-748a-44d1-9371-240a9fdc2073 tempest-TestServerVolumeAttachmentScenario-1406476146 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 14:00:22 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-0311d15f-748a-44d1-9371-240a9fdc2073 tempest-TestServerVolumeAttachmentScenario-1406476146 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 14:00:22 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-0311d15f-748a-44d1-9371-240a9fdc2073 tempest-TestServerVolumeAttachmentScenario-1406476146 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T12:00:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1993822465',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5bdcac5e-f4f1-46d3-8f6e-b62987578e78,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8409a8b090a2486ab7a32ce05ad649fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T12:00:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T12:00:22Z,use_quota=True,user_id='3a02ba36f0954b06853ffbd2790a92a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1147de8b-623b-426c-a13d-7fc824a80f67),volume_type_id=1147de8b-623b-426c-a13d-7fc824a80f67)}" {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 13 14:00:22 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-0311d15f-748a-44d1-9371-240a9fdc2073 tempest-TestServerVolumeAttachmentScenario-1406476146 None] Creating volume 5bdcac5e-f4f1-46d3-8f6e-b62987578e78 {{(pid=87098) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 13 14:00:22 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-0311d15f-748a-44d1-9371-240a9fdc2073 tempest-TestServerVolumeAttachmentScenario-1406476146 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 14:00:22 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-0311d15f-748a-44d1-9371-240a9fdc2073 tempest-TestServerVolumeAttachmentScenario-1406476146 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 14:00:22 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-0311d15f-748a-44d1-9371-240a9fdc2073 tempest-TestServerVolumeAttachmentScenario-1406476146 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 14:00:22 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-0311d15f-748a-44d1-9371-240a9fdc2073 tempest-TestServerVolumeAttachmentScenario-1406476146 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 14:00:22 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-0311d15f-748a-44d1-9371-240a9fdc2073 tempest-TestServerVolumeAttachmentScenario-1406476146 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 14:00:22 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-0311d15f-748a-44d1-9371-240a9fdc2073 tempest-TestServerVolumeAttachmentScenario-1406476146 None] Selected osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 14:00:22 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-0311d15f-748a-44d1-9371-240a9fdc2073 tempest-TestServerVolumeAttachmentScenario-1406476146 None] casted to osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 Jul 13 14:00:22 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-0311d15f-748a-44d1-9371-240a9fdc2073 tempest-TestServerVolumeAttachmentScenario-1406476146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-5bdcac5e-f4f1-46d3-8f6e-b62987578e78 1073741824 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:00:22 devstack sudo[100238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-5bdcac5e-f4f1-46d3-8f6e-b62987578e78 1073741824 Jul 13 14:00:22 devstack sudo[100238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:00:22 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-84f3ea10-6f8f-4876-be8a-7dc9ca08a91d tempest-TestServerVolumeAttachmentScenario-1406476146 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 14:00:22 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-84f3ea10-6f8f-4876-be8a-7dc9ca08a91d tempest-TestServerVolumeAttachmentScenario-1406476146 None] Flow 'volume_create_manager' (ec428cd0-48aa-4b95-bfc8-6fc6f06bfeed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 14:00:22 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-84f3ea10-6f8f-4876-be8a-7dc9ca08a91d tempest-TestServerVolumeAttachmentScenario-1406476146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b61bb69e-1ec7-4fba-9b77-3e8a5f1b9a60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:00:22 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-84f3ea10-6f8f-4876-be8a-7dc9ca08a91d tempest-TestServerVolumeAttachmentScenario-1406476146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b61bb69e-1ec7-4fba-9b77-3e8a5f1b9a60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T12:00:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1247347019',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d245956-b5de-448e-95be-85ea935d3ee3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8409a8b090a2486ab7a32ce05ad649fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T12:00:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T12:00:22Z,use_quota=True,user_id='3a02ba36f0954b06853ffbd2790a92a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1147de8b-623b-426c-a13d-7fc824a80f67),volume_type_id=1147de8b-623b-426c-a13d-7fc824a80f67)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:00:22 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-84f3ea10-6f8f-4876-be8a-7dc9ca08a91d tempest-TestServerVolumeAttachmentScenario-1406476146 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5340f8e-3471-46d9-9635-b604fb4fb601) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:00:22 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-84f3ea10-6f8f-4876-be8a-7dc9ca08a91d tempest-TestServerVolumeAttachmentScenario-1406476146 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5340f8e-3471-46d9-9635-b604fb4fb601) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:00:22 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-84f3ea10-6f8f-4876-be8a-7dc9ca08a91d tempest-TestServerVolumeAttachmentScenario-1406476146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f358af60-f533-4296-a603-56427f297338) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:00:22 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-84f3ea10-6f8f-4876-be8a-7dc9ca08a91d tempest-TestServerVolumeAttachmentScenario-1406476146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f358af60-f533-4296-a603-56427f297338) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3d245956-b5de-448e-95be-85ea935d3ee3', 'volume_name': 'volume-3d245956-b5de-448e-95be-85ea935d3ee3', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:00:22 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-84f3ea10-6f8f-4876-be8a-7dc9ca08a91d tempest-TestServerVolumeAttachmentScenario-1406476146 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86a3b398-6ec4-4e55-a4c9-f0df11ba6b05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:00:22 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-84f3ea10-6f8f-4876-be8a-7dc9ca08a91d tempest-TestServerVolumeAttachmentScenario-1406476146 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86a3b398-6ec4-4e55-a4c9-f0df11ba6b05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:00:22 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-84f3ea10-6f8f-4876-be8a-7dc9ca08a91d tempest-TestServerVolumeAttachmentScenario-1406476146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f02f8ceb-057d-48b8-ad8f-df31890936f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:00:22 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-84f3ea10-6f8f-4876-be8a-7dc9ca08a91d tempest-TestServerVolumeAttachmentScenario-1406476146 None] Volume 3d245956-b5de-448e-95be-85ea935d3ee3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3d245956-b5de-448e-95be-85ea935d3ee3', 'volume_size': 1} Jul 13 14:00:22 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-84f3ea10-6f8f-4876-be8a-7dc9ca08a91d tempest-TestServerVolumeAttachmentScenario-1406476146 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 14:00:22 devstack sudo[100238]: pam_unix(sudo:session): session closed for user root Jul 13 14:00:22 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-0311d15f-748a-44d1-9371-240a9fdc2073 tempest-TestServerVolumeAttachmentScenario-1406476146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-5bdcac5e-f4f1-46d3-8f6e-b62987578e78 1073741824" returned: 0 in 0.754s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:00:22 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-0311d15f-748a-44d1-9371-240a9fdc2073 tempest-TestServerVolumeAttachmentScenario-1406476146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-5bdcac5e-f4f1-46d3-8f6e-b62987578e78 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:00:23 devstack sudo[100244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-5bdcac5e-f4f1-46d3-8f6e-b62987578e78 Jul 13 14:00:23 devstack sudo[100244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:00:23 devstack sudo[100244]: pam_unix(sudo:session): session closed for user root Jul 13 14:00:23 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-0311d15f-748a-44d1-9371-240a9fdc2073 tempest-TestServerVolumeAttachmentScenario-1406476146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-5bdcac5e-f4f1-46d3-8f6e-b62987578e78" returned: 0 in 0.374s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:00:23 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-0311d15f-748a-44d1-9371-240a9fdc2073 tempest-TestServerVolumeAttachmentScenario-1406476146 None] <== create_volume: return (1211ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'} {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 13 14:00:23 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-0311d15f-748a-44d1-9371-240a9fdc2073 tempest-TestServerVolumeAttachmentScenario-1406476146 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.213s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 14:00:23 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-84f3ea10-6f8f-4876-be8a-7dc9ca08a91d tempest-TestServerVolumeAttachmentScenario-1406476146 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.789s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 14:00:23 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-84f3ea10-6f8f-4876-be8a-7dc9ca08a91d tempest-TestServerVolumeAttachmentScenario-1406476146 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T12:00:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1247347019',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d245956-b5de-448e-95be-85ea935d3ee3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8409a8b090a2486ab7a32ce05ad649fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T12:00:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T12:00:22Z,use_quota=True,user_id='3a02ba36f0954b06853ffbd2790a92a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1147de8b-623b-426c-a13d-7fc824a80f67),volume_type_id=1147de8b-623b-426c-a13d-7fc824a80f67)}" {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 13 14:00:23 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-84f3ea10-6f8f-4876-be8a-7dc9ca08a91d tempest-TestServerVolumeAttachmentScenario-1406476146 None] Creating volume 3d245956-b5de-448e-95be-85ea935d3ee3 {{(pid=87098) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 13 14:00:23 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-84f3ea10-6f8f-4876-be8a-7dc9ca08a91d tempest-TestServerVolumeAttachmentScenario-1406476146 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 14:00:23 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-84f3ea10-6f8f-4876-be8a-7dc9ca08a91d tempest-TestServerVolumeAttachmentScenario-1406476146 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 14:00:23 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-84f3ea10-6f8f-4876-be8a-7dc9ca08a91d tempest-TestServerVolumeAttachmentScenario-1406476146 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 14:00:23 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-84f3ea10-6f8f-4876-be8a-7dc9ca08a91d tempest-TestServerVolumeAttachmentScenario-1406476146 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 14:00:23 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-84f3ea10-6f8f-4876-be8a-7dc9ca08a91d tempest-TestServerVolumeAttachmentScenario-1406476146 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 14:00:23 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-84f3ea10-6f8f-4876-be8a-7dc9ca08a91d tempest-TestServerVolumeAttachmentScenario-1406476146 None] Selected osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 14:00:23 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-84f3ea10-6f8f-4876-be8a-7dc9ca08a91d tempest-TestServerVolumeAttachmentScenario-1406476146 None] casted to osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 Jul 13 14:00:23 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-84f3ea10-6f8f-4876-be8a-7dc9ca08a91d tempest-TestServerVolumeAttachmentScenario-1406476146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-3d245956-b5de-448e-95be-85ea935d3ee3 1073741824 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:00:23 devstack sudo[100248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-3d245956-b5de-448e-95be-85ea935d3ee3 1073741824 Jul 13 14:00:23 devstack sudo[100248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:00:23 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-0311d15f-748a-44d1-9371-240a9fdc2073 tempest-TestServerVolumeAttachmentScenario-1406476146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (436f8a52-ab5f-4a92-8617-92f937a665be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5bdcac5e-f4f1-46d3-8f6e-b62987578e78', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:00:23 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-0311d15f-748a-44d1-9371-240a9fdc2073 tempest-TestServerVolumeAttachmentScenario-1406476146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60ccc0ea-4fc9-40b7-9da5-ea43c8760921) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:00:23 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-0311d15f-748a-44d1-9371-240a9fdc2073 tempest-TestServerVolumeAttachmentScenario-1406476146 None] Volume volume-5bdcac5e-f4f1-46d3-8f6e-b62987578e78 (5bdcac5e-f4f1-46d3-8f6e-b62987578e78): created successfully Jul 13 14:00:23 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-0311d15f-748a-44d1-9371-240a9fdc2073 tempest-TestServerVolumeAttachmentScenario-1406476146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60ccc0ea-4fc9-40b7-9da5-ea43c8760921) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:00:23 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-0311d15f-748a-44d1-9371-240a9fdc2073 tempest-TestServerVolumeAttachmentScenario-1406476146 None] Flow 'volume_create_manager' (a39f35fb-f9d2-4b60-930a-af6ff8d92ce2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 14:00:23 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-0311d15f-748a-44d1-9371-240a9fdc2073 tempest-TestServerVolumeAttachmentScenario-1406476146 None] Created volume successfully. Jul 13 14:00:23 devstack sudo[100248]: pam_unix(sudo:session): session closed for user root Jul 13 14:00:23 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-84f3ea10-6f8f-4876-be8a-7dc9ca08a91d tempest-TestServerVolumeAttachmentScenario-1406476146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-3d245956-b5de-448e-95be-85ea935d3ee3 1073741824" returned: 0 in 0.609s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:00:24 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-84f3ea10-6f8f-4876-be8a-7dc9ca08a91d tempest-TestServerVolumeAttachmentScenario-1406476146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-3d245956-b5de-448e-95be-85ea935d3ee3 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:00:24 devstack sudo[100254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-3d245956-b5de-448e-95be-85ea935d3ee3 Jul 13 14:00:24 devstack sudo[100254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:00:24 devstack sudo[100254]: pam_unix(sudo:session): session closed for user root Jul 13 14:00:24 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-84f3ea10-6f8f-4876-be8a-7dc9ca08a91d tempest-TestServerVolumeAttachmentScenario-1406476146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-3d245956-b5de-448e-95be-85ea935d3ee3" returned: 0 in 0.338s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:00:24 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-84f3ea10-6f8f-4876-be8a-7dc9ca08a91d tempest-TestServerVolumeAttachmentScenario-1406476146 None] <== create_volume: return (1021ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'} {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 13 14:00:24 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-84f3ea10-6f8f-4876-be8a-7dc9ca08a91d tempest-TestServerVolumeAttachmentScenario-1406476146 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.024s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 14:00:24 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-84f3ea10-6f8f-4876-be8a-7dc9ca08a91d tempest-TestServerVolumeAttachmentScenario-1406476146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f02f8ceb-057d-48b8-ad8f-df31890936f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3d245956-b5de-448e-95be-85ea935d3ee3', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:00:24 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-84f3ea10-6f8f-4876-be8a-7dc9ca08a91d tempest-TestServerVolumeAttachmentScenario-1406476146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5105e53-fe62-4c99-9c52-9f049c39b8dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:00:24 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-84f3ea10-6f8f-4876-be8a-7dc9ca08a91d tempest-TestServerVolumeAttachmentScenario-1406476146 None] Volume volume-3d245956-b5de-448e-95be-85ea935d3ee3 (3d245956-b5de-448e-95be-85ea935d3ee3): created successfully Jul 13 14:00:24 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-84f3ea10-6f8f-4876-be8a-7dc9ca08a91d tempest-TestServerVolumeAttachmentScenario-1406476146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5105e53-fe62-4c99-9c52-9f049c39b8dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:00:24 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-84f3ea10-6f8f-4876-be8a-7dc9ca08a91d tempest-TestServerVolumeAttachmentScenario-1406476146 None] Flow 'volume_create_manager' (ec428cd0-48aa-4b95-bfc8-6fc6f06bfeed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 14:00:24 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-84f3ea10-6f8f-4876-be8a-7dc9ca08a91d tempest-TestServerVolumeAttachmentScenario-1406476146 None] Created volume successfully. Jul 13 14:00:24 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-e56fe56b-9567-440d-977e-21732330f381 tempest-VolumesImageMetadata-1985184076 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 14:00:24 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-e56fe56b-9567-440d-977e-21732330f381 tempest-VolumesImageMetadata-1985184076 None] Flow 'volume_create_manager' (66558b4f-e13e-4413-bebb-c295546995e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 14:00:24 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-e56fe56b-9567-440d-977e-21732330f381 tempest-VolumesImageMetadata-1985184076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77f340d4-cc48-47e9-a4ea-dbb226facf96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:00:24 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-e56fe56b-9567-440d-977e-21732330f381 tempest-VolumesImageMetadata-1985184076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77f340d4-cc48-47e9-a4ea-dbb226facf96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T12:00:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1369824228',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db51aaf8-ce1e-4f54-b0da-84993bacc9aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a06abe81c14d4001a89add31c82742c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T12:00:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T12:00:25Z,use_quota=True,user_id='f02ffc70e07743799b011a96771fe688',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1147de8b-623b-426c-a13d-7fc824a80f67),volume_type_id=1147de8b-623b-426c-a13d-7fc824a80f67)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:00:24 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-e56fe56b-9567-440d-977e-21732330f381 tempest-VolumesImageMetadata-1985184076 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2cd782a5-e902-4adb-bd36-8a3cf6c0ba0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:00:24 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-e56fe56b-9567-440d-977e-21732330f381 tempest-VolumesImageMetadata-1985184076 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2cd782a5-e902-4adb-bd36-8a3cf6c0ba0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:00:24 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-e56fe56b-9567-440d-977e-21732330f381 tempest-VolumesImageMetadata-1985184076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59f6b580-f77f-4564-8a42-cba9a0d5700c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:00:24 devstack cinder-volume[87098]: DEBUG cinder.image.glance [None req-e56fe56b-9567-440d-977e-21732330f381 tempest-VolumesImageMetadata-1985184076 None] Creating Keystone auth plugin from conf {{(pid=87098) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 13 14:00:25 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-e56fe56b-9567-440d-977e-21732330f381 tempest-VolumesImageMetadata-1985184076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59f6b580-f77f-4564-8a42-cba9a0d5700c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'db51aaf8-ce1e-4f54-b0da-84993bacc9aa', 'volume_name': 'volume-db51aaf8-ce1e-4f54-b0da-84993bacc9aa', 'volume_size': 1, 'image_id': 'def20bd7-001f-4245-a717-37b9a4cc8574', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/def20bd7-001f-4245-a717-37b9a4cc8574', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '2181cd3fc958400682584829a80e727e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'def20bd7-001f-4245-a717-37b9a4cc8574', 'created_at': datetime.datetime(2026, 7, 13, 11, 42, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 13, 11, 42, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/def20bd7-001f-4245-a717-37b9a4cc8574/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:00:25 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-e56fe56b-9567-440d-977e-21732330f381 tempest-VolumesImageMetadata-1985184076 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81e7e366-cc1d-4b9b-8fb9-08cf5115135c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:00:25 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-e56fe56b-9567-440d-977e-21732330f381 tempest-VolumesImageMetadata-1985184076 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81e7e366-cc1d-4b9b-8fb9-08cf5115135c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:00:25 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-e56fe56b-9567-440d-977e-21732330f381 tempest-VolumesImageMetadata-1985184076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (844be659-616c-4c8c-867d-4e2114d4872e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:00:25 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-e56fe56b-9567-440d-977e-21732330f381 tempest-VolumesImageMetadata-1985184076 None] Volume db51aaf8-ce1e-4f54-b0da-84993bacc9aa: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-db51aaf8-ce1e-4f54-b0da-84993bacc9aa', 'volume_size': 1, 'image_id': 'def20bd7-001f-4245-a717-37b9a4cc8574', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/def20bd7-001f-4245-a717-37b9a4cc8574', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '2181cd3fc958400682584829a80e727e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'def20bd7-001f-4245-a717-37b9a4cc8574', 'created_at': datetime.datetime(2026, 7, 13, 11, 42, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 13, 11, 42, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/def20bd7-001f-4245-a717-37b9a4cc8574/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 13 14:00:25 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-e56fe56b-9567-440d-977e-21732330f381 tempest-VolumesImageMetadata-1985184076 None] Trying to clone db51aaf8-ce1e-4f54-b0da-84993bacc9aa from image def20bd7-001f-4245-a717-37b9a4cc8574 at location (None, [{'url': 'file:///opt/stack/data/glance/images/def20bd7-001f-4245-a717-37b9a4cc8574', 'metadata': {}}]). {{(pid=87098) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 13 14:00:25 devstack cinder-volume[87098]: DEBUG cinder.image.image_utils [None req-e56fe56b-9567-440d-977e-21732330f381 tempest-VolumesImageMetadata-1985184076 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_def20bd7-001f-4245-a717-37b9a4cc8574_ug946lb7devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87098) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 13 14:00:25 devstack cinder-volume[87098]: INFO cinder.image.image_utils [None req-e56fe56b-9567-440d-977e-21732330f381 tempest-VolumesImageMetadata-1985184076 None] Image download 20.69 MB at 20.69 MB/s Jul 13 14:00:25 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b021790-2354-43cc-b1b8-e55e0f011f35]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 14:00:25 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-e56fe56b-9567-440d-977e-21732330f381 tempest-VolumesImageMetadata-1985184076 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_def20bd7-001f-4245-a717-37b9a4cc8574_ug946lb7devstack@QuobyteHD {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:00:25 devstack sudo[100258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_def20bd7-001f-4245-a717-37b9a4cc8574_ug946lb7devstack@QuobyteHD Jul 13 14:00:25 devstack sudo[100258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:00:26 devstack sudo[100258]: pam_unix(sudo:session): session closed for user root Jul 13 14:00:26 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-e56fe56b-9567-440d-977e-21732330f381 tempest-VolumesImageMetadata-1985184076 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_def20bd7-001f-4245-a717-37b9a4cc8574_ug946lb7devstack@QuobyteHD" returned: 0 in 0.397s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:00:26 devstack cinder-volume[87098]: DEBUG cinder.image.image_utils [None req-e56fe56b-9567-440d-977e-21732330f381 tempest-VolumesImageMetadata-1985184076 None] Temporary image def20bd7-001f-4245-a717-37b9a4cc8574 is fetched for user f02ffc70e07743799b011a96771fe688. {{(pid=87098) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 13 14:00:26 devstack cinder-volume[87098]: DEBUG dbcounter [-] [87098] Writing DB stats cinder:SELECT=117,cinder:INSERT=41,cinder:UPDATE=175,cinder:DELETE=16 {{(pid=87098) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 13 14:00:26 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[461e0607-5a14-4292-a823-527c70c3d874]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 14:00:26 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-e56fe56b-9567-440d-977e-21732330f381 tempest-VolumesImageMetadata-1985184076 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_def20bd7-001f-4245-a717-37b9a4cc8574_ug946lb7devstack@QuobyteHD {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:00:26 devstack sudo[100266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_def20bd7-001f-4245-a717-37b9a4cc8574_ug946lb7devstack@QuobyteHD Jul 13 14:00:26 devstack sudo[100266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:00:26 devstack sudo[100266]: pam_unix(sudo:session): session closed for user root Jul 13 14:00:26 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-e56fe56b-9567-440d-977e-21732330f381 tempest-VolumesImageMetadata-1985184076 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_def20bd7-001f-4245-a717-37b9a4cc8574_ug946lb7devstack@QuobyteHD" returned: 0 in 0.411s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:00:26 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-e56fe56b-9567-440d-977e-21732330f381 tempest-VolumesImageMetadata-1985184076 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 14:00:26 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-e56fe56b-9567-440d-977e-21732330f381 tempest-VolumesImageMetadata-1985184076 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 14:00:26 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-e56fe56b-9567-440d-977e-21732330f381 tempest-VolumesImageMetadata-1985184076 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T12:00:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1369824228',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db51aaf8-ce1e-4f54-b0da-84993bacc9aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a06abe81c14d4001a89add31c82742c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T12:00:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T12:00:25Z,use_quota=True,user_id='f02ffc70e07743799b011a96771fe688',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1147de8b-623b-426c-a13d-7fc824a80f67),volume_type_id=1147de8b-623b-426c-a13d-7fc824a80f67)}" {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 13 14:00:26 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-e56fe56b-9567-440d-977e-21732330f381 tempest-VolumesImageMetadata-1985184076 None] Creating volume db51aaf8-ce1e-4f54-b0da-84993bacc9aa {{(pid=87098) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 13 14:00:26 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-e56fe56b-9567-440d-977e-21732330f381 tempest-VolumesImageMetadata-1985184076 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 14:00:26 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-e56fe56b-9567-440d-977e-21732330f381 tempest-VolumesImageMetadata-1985184076 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 14:00:26 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-e56fe56b-9567-440d-977e-21732330f381 tempest-VolumesImageMetadata-1985184076 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 14:00:26 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-e56fe56b-9567-440d-977e-21732330f381 tempest-VolumesImageMetadata-1985184076 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 14:00:26 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-e56fe56b-9567-440d-977e-21732330f381 tempest-VolumesImageMetadata-1985184076 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 14:00:26 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-e56fe56b-9567-440d-977e-21732330f381 tempest-VolumesImageMetadata-1985184076 None] Selected osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 14:00:26 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-e56fe56b-9567-440d-977e-21732330f381 tempest-VolumesImageMetadata-1985184076 None] casted to osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 Jul 13 14:00:26 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-e56fe56b-9567-440d-977e-21732330f381 tempest-VolumesImageMetadata-1985184076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-db51aaf8-ce1e-4f54-b0da-84993bacc9aa 1073741824 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:00:26 devstack sudo[100272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-db51aaf8-ce1e-4f54-b0da-84993bacc9aa 1073741824 Jul 13 14:00:26 devstack sudo[100272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:00:27 devstack sudo[100272]: pam_unix(sudo:session): session closed for user root Jul 13 14:00:27 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-e56fe56b-9567-440d-977e-21732330f381 tempest-VolumesImageMetadata-1985184076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-db51aaf8-ce1e-4f54-b0da-84993bacc9aa 1073741824" returned: 0 in 0.563s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:00:27 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-e56fe56b-9567-440d-977e-21732330f381 tempest-VolumesImageMetadata-1985184076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-db51aaf8-ce1e-4f54-b0da-84993bacc9aa {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:00:27 devstack sudo[100278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-db51aaf8-ce1e-4f54-b0da-84993bacc9aa Jul 13 14:00:27 devstack sudo[100278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:00:27 devstack sudo[100278]: pam_unix(sudo:session): session closed for user root Jul 13 14:00:27 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-e56fe56b-9567-440d-977e-21732330f381 tempest-VolumesImageMetadata-1985184076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-db51aaf8-ce1e-4f54-b0da-84993bacc9aa" returned: 0 in 0.328s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:00:27 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-e56fe56b-9567-440d-977e-21732330f381 tempest-VolumesImageMetadata-1985184076 None] <== create_volume: return (944ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'} {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 13 14:00:27 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-e56fe56b-9567-440d-977e-21732330f381 tempest-VolumesImageMetadata-1985184076 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.950s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 14:00:27 devstack cinder-volume[87098]: DEBUG cinder.volume.volume_utils [None req-e56fe56b-9567-440d-977e-21732330f381 tempest-VolumesImageMetadata-1985184076 None] Attempting download of def20bd7-001f-4245-a717-37b9a4cc8574 ((None, [{'url': 'file:///opt/stack/data/glance/images/def20bd7-001f-4245-a717-37b9a4cc8574', 'metadata': {}}])) to volume db51aaf8-ce1e-4f54-b0da-84993bacc9aa. {{(pid=87098) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 13 14:00:27 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[f03db066-7d9f-4160-95a0-86a482f14adb]: (4, 'raw') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 14:00:27 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-e56fe56b-9567-440d-977e-21732330f381 tempest-VolumesImageMetadata-1985184076 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_def20bd7-001f-4245-a717-37b9a4cc8574_pc5d7e9h {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:00:27 devstack sudo[100284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_def20bd7-001f-4245-a717-37b9a4cc8574_pc5d7e9h Jul 13 14:00:27 devstack sudo[100284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:00:28 devstack sudo[100284]: pam_unix(sudo:session): session closed for user root Jul 13 14:00:28 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-e56fe56b-9567-440d-977e-21732330f381 tempest-VolumesImageMetadata-1985184076 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_def20bd7-001f-4245-a717-37b9a4cc8574_pc5d7e9h" returned: 0 in 0.399s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:00:28 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-e56fe56b-9567-440d-977e-21732330f381 tempest-VolumesImageMetadata-1985184076 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_def20bd7-001f-4245-a717-37b9a4cc8574_pc5d7e9h {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:00:28 devstack sudo[100299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_def20bd7-001f-4245-a717-37b9a4cc8574_pc5d7e9h Jul 13 14:00:28 devstack sudo[100299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:00:28 devstack sudo[100299]: pam_unix(sudo:session): session closed for user root Jul 13 14:00:28 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-e56fe56b-9567-440d-977e-21732330f381 tempest-VolumesImageMetadata-1985184076 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_def20bd7-001f-4245-a717-37b9a4cc8574_pc5d7e9h" returned: 1 in 0.512s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:00:28 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-e56fe56b-9567-440d-977e-21732330f381 tempest-VolumesImageMetadata-1985184076 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_def20bd7-001f-4245-a717-37b9a4cc8574_pc5d7e9h' failed. Not Retrying. {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 13 14:00:28 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[711d5e3a-4e9e-43da-bc60-cb4a2e9c648e]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 14:00:28 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-e56fe56b-9567-440d-977e-21732330f381 tempest-VolumesImageMetadata-1985184076 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_def20bd7-001f-4245-a717-37b9a4cc8574_ug946lb7devstack@QuobyteHD {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:00:28 devstack sudo[100307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_def20bd7-001f-4245-a717-37b9a4cc8574_ug946lb7devstack@QuobyteHD Jul 13 14:00:28 devstack sudo[100307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:00:29 devstack cinder-volume[87098]: DEBUG oslo_service.periodic_task [None req-727a1692-ea28-4a77-b327-0d94e8f01efb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87098) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 13 14:00:29 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-727a1692-ea28-4a77-b327-0d94e8f01efb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 14:00:29 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-727a1692-ea28-4a77-b327-0d94e8f01efb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 14:00:29 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-727a1692-ea28-4a77-b327-0d94e8f01efb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 14:00:29 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-727a1692-ea28-4a77-b327-0d94e8f01efb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 14:00:29 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-727a1692-ea28-4a77-b327-0d94e8f01efb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 14:00:29 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-727a1692-ea28-4a77-b327-0d94e8f01efb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:00:29 devstack sudo[100309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 Jul 13 14:00:29 devstack sudo[100309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:00:29 devstack sudo[100307]: pam_unix(sudo:session): session closed for user root Jul 13 14:00:29 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-e56fe56b-9567-440d-977e-21732330f381 tempest-VolumesImageMetadata-1985184076 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_def20bd7-001f-4245-a717-37b9a4cc8574_ug946lb7devstack@QuobyteHD" returned: 0 in 0.385s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:00:29 devstack cinder-volume[87098]: DEBUG cinder.image.image_utils [None req-e56fe56b-9567-440d-977e-21732330f381 tempest-VolumesImageMetadata-1985184076 None] def20bd7-001f-4245-a717-37b9a4cc8574 was qcow2, converting to raw {{(pid=87098) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 13 14:00:29 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-e56fe56b-9567-440d-977e-21732330f381 tempest-VolumesImageMetadata-1985184076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_def20bd7-001f-4245-a717-37b9a4cc8574_ug946lb7devstack@QuobyteHD /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-db51aaf8-ce1e-4f54-b0da-84993bacc9aa {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:00:29 devstack sudo[100314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_def20bd7-001f-4245-a717-37b9a4cc8574_ug946lb7devstack@QuobyteHD /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-db51aaf8-ce1e-4f54-b0da-84993bacc9aa Jul 13 14:00:29 devstack sudo[100314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:00:29 devstack sudo[100309]: pam_unix(sudo:session): session closed for user root Jul 13 14:00:29 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-727a1692-ea28-4a77-b327-0d94e8f01efb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78" returned: 0 in 0.325s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:00:29 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-727a1692-ea28-4a77-b327-0d94e8f01efb None None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 14:00:29 devstack cinder-volume[87098]: DEBUG oslo_service.periodic_task [None req-727a1692-ea28-4a77-b327-0d94e8f01efb None None] Running periodic task VolumeManager._thread_info {{(pid=87098) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 13 14:00:29 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-727a1692-ea28-4a77-b327-0d94e8f01efb None None] thread count: 28 {{(pid=87098) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 13 14:00:29 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-727a1692-ea28-4a77-b327-0d94e8f01efb None None] thread info: [<_MainThread(MainThread, started 127988054597760)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87098) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 13 14:00:31 devstack sudo[100314]: pam_unix(sudo:session): session closed for user root Jul 13 14:00:31 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-e56fe56b-9567-440d-977e-21732330f381 tempest-VolumesImageMetadata-1985184076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_def20bd7-001f-4245-a717-37b9a4cc8574_ug946lb7devstack@QuobyteHD /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-db51aaf8-ce1e-4f54-b0da-84993bacc9aa" returned: 0 in 2.210s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:00:31 devstack cinder-volume[87098]: DEBUG cinder.image.image_utils [None req-e56fe56b-9567-440d-977e-21732330f381 tempest-VolumesImageMetadata-1985184076 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_def20bd7-001f-4245-a717-37b9a4cc8574_ug946lb7devstack@QuobyteHD, size 112.00 MB, duration 2.21 sec, destination /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-db51aaf8-ce1e-4f54-b0da-84993bacc9aa {{(pid=87098) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 13 14:00:31 devstack cinder-volume[87098]: INFO cinder.image.image_utils [None req-e56fe56b-9567-440d-977e-21732330f381 tempest-VolumesImageMetadata-1985184076 None] Converted 112.00 MB image at 50.65 MB/s Jul 13 14:00:31 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-e56fe56b-9567-440d-977e-21732330f381 tempest-VolumesImageMetadata-1985184076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-db51aaf8-ce1e-4f54-b0da-84993bacc9aa 1G {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:00:31 devstack sudo[100378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-db51aaf8-ce1e-4f54-b0da-84993bacc9aa 1G Jul 13 14:00:31 devstack sudo[100378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:00:31 devstack sudo[100378]: pam_unix(sudo:session): session closed for user root Jul 13 14:00:31 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-e56fe56b-9567-440d-977e-21732330f381 tempest-VolumesImageMetadata-1985184076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-db51aaf8-ce1e-4f54-b0da-84993bacc9aa 1G" returned: 0 in 0.569s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:00:32 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[1daa7c18-a478-44b5-a8ae-0d0c02455cff]: (4, 'raw') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 14:00:32 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-e56fe56b-9567-440d-977e-21732330f381 tempest-VolumesImageMetadata-1985184076 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-db51aaf8-ce1e-4f54-b0da-84993bacc9aa {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:00:32 devstack sudo[100395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-db51aaf8-ce1e-4f54-b0da-84993bacc9aa Jul 13 14:00:32 devstack sudo[100395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:00:32 devstack sudo[100395]: pam_unix(sudo:session): session closed for user root Jul 13 14:00:32 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-e56fe56b-9567-440d-977e-21732330f381 tempest-VolumesImageMetadata-1985184076 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-db51aaf8-ce1e-4f54-b0da-84993bacc9aa" returned: 0 in 0.456s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:00:32 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-e56fe56b-9567-440d-977e-21732330f381 tempest-VolumesImageMetadata-1985184076 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-db51aaf8-ce1e-4f54-b0da-84993bacc9aa {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:00:32 devstack sudo[100402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-db51aaf8-ce1e-4f54-b0da-84993bacc9aa Jul 13 14:00:32 devstack sudo[100402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:00:32 devstack sudo[100402]: pam_unix(sudo:session): session closed for user root Jul 13 14:00:32 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-e56fe56b-9567-440d-977e-21732330f381 tempest-VolumesImageMetadata-1985184076 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-db51aaf8-ce1e-4f54-b0da-84993bacc9aa" returned: 1 in 0.521s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:00:32 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-e56fe56b-9567-440d-977e-21732330f381 tempest-VolumesImageMetadata-1985184076 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-db51aaf8-ce1e-4f54-b0da-84993bacc9aa' failed. Not Retrying. {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 13 14:00:32 devstack cinder-volume[87098]: DEBUG cinder.volume.volume_utils [None req-e56fe56b-9567-440d-977e-21732330f381 tempest-VolumesImageMetadata-1985184076 None] Downloaded image def20bd7-001f-4245-a717-37b9a4cc8574 ((None, [{'url': 'file:///opt/stack/data/glance/images/def20bd7-001f-4245-a717-37b9a4cc8574', 'metadata': {}}])) to volume db51aaf8-ce1e-4f54-b0da-84993bacc9aa successfully. {{(pid=87098) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 13 14:00:33 devstack cinder-volume[87098]: DEBUG cinder.image.image_utils [None req-e56fe56b-9567-440d-977e-21732330f381 tempest-VolumesImageMetadata-1985184076 None] Temporary image def20bd7-001f-4245-a717-37b9a4cc8574 for user f02ffc70e07743799b011a96771fe688 is deleted. {{(pid=87098) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 13 14:00:33 devstack cinder-volume[87098]: DEBUG cinder.volume.volume_utils [None req-e56fe56b-9567-440d-977e-21732330f381 tempest-VolumesImageMetadata-1985184076 None] Marking volume db51aaf8-ce1e-4f54-b0da-84993bacc9aa as bootable. {{(pid=87098) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 13 14:00:33 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-e56fe56b-9567-440d-977e-21732330f381 tempest-VolumesImageMetadata-1985184076 None] Copying metadata from image def20bd7-001f-4245-a717-37b9a4cc8574 to db51aaf8-ce1e-4f54-b0da-84993bacc9aa. {{(pid=87098) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 13 14:00:33 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-e56fe56b-9567-440d-977e-21732330f381 tempest-VolumesImageMetadata-1985184076 None] Creating volume glance metadata for volume db51aaf8-ce1e-4f54-b0da-84993bacc9aa backed by image def20bd7-001f-4245-a717-37b9a4cc8574 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'def20bd7-001f-4245-a717-37b9a4cc8574', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87098) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 13 14:00:33 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-e56fe56b-9567-440d-977e-21732330f381 tempest-VolumesImageMetadata-1985184076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (844be659-616c-4c8c-867d-4e2114d4872e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-db51aaf8-ce1e-4f54-b0da-84993bacc9aa', 'volume_size': 1, 'image_id': 'def20bd7-001f-4245-a717-37b9a4cc8574', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/def20bd7-001f-4245-a717-37b9a4cc8574', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '2181cd3fc958400682584829a80e727e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'def20bd7-001f-4245-a717-37b9a4cc8574', 'created_at': datetime.datetime(2026, 7, 13, 11, 42, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 13, 11, 42, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/def20bd7-001f-4245-a717-37b9a4cc8574/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:00:33 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-e56fe56b-9567-440d-977e-21732330f381 tempest-VolumesImageMetadata-1985184076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9703ded5-0508-457d-8481-5955dee9eecd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:00:33 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-e56fe56b-9567-440d-977e-21732330f381 tempest-VolumesImageMetadata-1985184076 None] Volume volume-db51aaf8-ce1e-4f54-b0da-84993bacc9aa (db51aaf8-ce1e-4f54-b0da-84993bacc9aa): created successfully Jul 13 14:00:33 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-e56fe56b-9567-440d-977e-21732330f381 tempest-VolumesImageMetadata-1985184076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9703ded5-0508-457d-8481-5955dee9eecd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:00:33 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-e56fe56b-9567-440d-977e-21732330f381 tempest-VolumesImageMetadata-1985184076 None] Flow 'volume_create_manager' (66558b4f-e13e-4413-bebb-c295546995e9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 14:00:33 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-e56fe56b-9567-440d-977e-21732330f381 tempest-VolumesImageMetadata-1985184076 None] Created volume successfully. Jul 13 14:00:33 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-2618de52-aa43-4314-aa72-cd481fd2dbbc tempest-VolumesImageMetadata-1985184076 None] Acquiring lock "cinder-db51aaf8-ce1e-4f54-b0da-84993bacc9aa-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 14:00:33 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-2618de52-aa43-4314-aa72-cd481fd2dbbc tempest-VolumesImageMetadata-1985184076 None] Lock "cinder-db51aaf8-ce1e-4f54-b0da-84993bacc9aa-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 14:00:34 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-2618de52-aa43-4314-aa72-cd481fd2dbbc tempest-VolumesImageMetadata-1985184076 None] Acquiring lock "cinder-quobyte-db51aaf8-ce1e-4f54-b0da-84993bacc9aa" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 14:00:34 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-2618de52-aa43-4314-aa72-cd481fd2dbbc tempest-VolumesImageMetadata-1985184076 None] Lock "cinder-quobyte-db51aaf8-ce1e-4f54-b0da-84993bacc9aa" acquired by "delete_volume" :: waited 0.027s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 14:00:34 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[c559381b-6dbc-40a6-918d-56d426f3bd54]: (4, 'raw') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 14:00:34 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-2618de52-aa43-4314-aa72-cd481fd2dbbc tempest-VolumesImageMetadata-1985184076 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-db51aaf8-ce1e-4f54-b0da-84993bacc9aa {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:00:34 devstack sudo[100407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-db51aaf8-ce1e-4f54-b0da-84993bacc9aa Jul 13 14:00:34 devstack sudo[100407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:00:34 devstack sudo[100407]: pam_unix(sudo:session): session closed for user root Jul 13 14:00:34 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-2618de52-aa43-4314-aa72-cd481fd2dbbc tempest-VolumesImageMetadata-1985184076 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-db51aaf8-ce1e-4f54-b0da-84993bacc9aa" returned: 0 in 0.499s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:00:34 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-2618de52-aa43-4314-aa72-cd481fd2dbbc tempest-VolumesImageMetadata-1985184076 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-db51aaf8-ce1e-4f54-b0da-84993bacc9aa {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:00:34 devstack sudo[100411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-db51aaf8-ce1e-4f54-b0da-84993bacc9aa Jul 13 14:00:34 devstack sudo[100411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:00:35 devstack sudo[100411]: pam_unix(sudo:session): session closed for user root Jul 13 14:00:35 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-2618de52-aa43-4314-aa72-cd481fd2dbbc tempest-VolumesImageMetadata-1985184076 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-db51aaf8-ce1e-4f54-b0da-84993bacc9aa" returned: 1 in 0.606s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:00:35 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-2618de52-aa43-4314-aa72-cd481fd2dbbc tempest-VolumesImageMetadata-1985184076 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-db51aaf8-ce1e-4f54-b0da-84993bacc9aa' failed. Not Retrying. {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 13 14:00:35 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-2618de52-aa43-4314-aa72-cd481fd2dbbc tempest-VolumesImageMetadata-1985184076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-db51aaf8-ce1e-4f54-b0da-84993bacc9aa {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:00:35 devstack sudo[100417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-db51aaf8-ce1e-4f54-b0da-84993bacc9aa Jul 13 14:00:35 devstack sudo[100417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:00:35 devstack sudo[100417]: pam_unix(sudo:session): session closed for user root Jul 13 14:00:35 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-2618de52-aa43-4314-aa72-cd481fd2dbbc tempest-VolumesImageMetadata-1985184076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-db51aaf8-ce1e-4f54-b0da-84993bacc9aa" returned: 0 in 0.285s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:00:35 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-2618de52-aa43-4314-aa72-cd481fd2dbbc tempest-VolumesImageMetadata-1985184076 None] Lock "cinder-quobyte-db51aaf8-ce1e-4f54-b0da-84993bacc9aa" released by "delete_volume" :: held 1.470s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 14:00:35 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-2618de52-aa43-4314-aa72-cd481fd2dbbc tempest-VolumesImageMetadata-1985184076 None] Created reservations ['c0c0e642-4b92-47df-8c62-7f76795c7ab1', '31e7a5e9-e8b7-4b04-907d-d3461e9f8a53', 'def3ff35-ff1b-47d9-8615-69ae344566ee', '848b9970-26f8-42e9-aa42-bc50b8885ac5'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 14:00:35 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-2618de52-aa43-4314-aa72-cd481fd2dbbc tempest-VolumesImageMetadata-1985184076 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 14:00:35 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-2618de52-aa43-4314-aa72-cd481fd2dbbc tempest-VolumesImageMetadata-1985184076 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 14:00:35 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-2618de52-aa43-4314-aa72-cd481fd2dbbc tempest-VolumesImageMetadata-1985184076 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 14:00:35 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-2618de52-aa43-4314-aa72-cd481fd2dbbc tempest-VolumesImageMetadata-1985184076 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 14:00:35 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-2618de52-aa43-4314-aa72-cd481fd2dbbc tempest-VolumesImageMetadata-1985184076 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 14:00:35 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-2618de52-aa43-4314-aa72-cd481fd2dbbc tempest-VolumesImageMetadata-1985184076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:00:35 devstack sudo[100421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 Jul 13 14:00:35 devstack sudo[100421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:00:36 devstack sudo[100421]: pam_unix(sudo:session): session closed for user root Jul 13 14:00:36 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-2618de52-aa43-4314-aa72-cd481fd2dbbc tempest-VolumesImageMetadata-1985184076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78" returned: 0 in 0.310s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:00:36 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-2618de52-aa43-4314-aa72-cd481fd2dbbc tempest-VolumesImageMetadata-1985184076 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 14:00:36 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-2618de52-aa43-4314-aa72-cd481fd2dbbc tempest-VolumesImageMetadata-1985184076 None] Deleted volume successfully. Jul 13 14:00:36 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-2618de52-aa43-4314-aa72-cd481fd2dbbc tempest-VolumesImageMetadata-1985184076 None] Lock "cinder-db51aaf8-ce1e-4f54-b0da-84993bacc9aa-delete_volume" released by "delete_volume" :: held 2.117s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 14:00:43 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-44f26805-3427-4959-a32a-d70a86dd15c9 tempest-VolumesTransfersTest-1620443482 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 14:00:43 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-44f26805-3427-4959-a32a-d70a86dd15c9 tempest-VolumesTransfersTest-1620443482 None] Flow 'volume_create_manager' (bce4ed9c-ac5a-486d-bfe3-0ccb477002e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 14:00:43 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-44f26805-3427-4959-a32a-d70a86dd15c9 tempest-VolumesTransfersTest-1620443482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4a87dfa-7f07-46ce-bfcc-8886da408e06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:00:43 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-44f26805-3427-4959-a32a-d70a86dd15c9 tempest-VolumesTransfersTest-1620443482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4a87dfa-7f07-46ce-bfcc-8886da408e06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T12:00:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-648228937',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b1c7c8d-2a6d-4384-82b7-f0d3a8196dc3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51f7823e5ea54eedb0d4b62990ab1e4f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T12:00:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T12:00:43Z,use_quota=True,user_id='0273450b925f4840b9f024c5c031a1da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1147de8b-623b-426c-a13d-7fc824a80f67),volume_type_id=1147de8b-623b-426c-a13d-7fc824a80f67)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:00:43 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-44f26805-3427-4959-a32a-d70a86dd15c9 tempest-VolumesTransfersTest-1620443482 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39429158-11ea-437d-85e7-f1f0cdf85706) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:00:43 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-44f26805-3427-4959-a32a-d70a86dd15c9 tempest-VolumesTransfersTest-1620443482 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39429158-11ea-437d-85e7-f1f0cdf85706) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:00:43 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-44f26805-3427-4959-a32a-d70a86dd15c9 tempest-VolumesTransfersTest-1620443482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ace0ef5-391d-40b9-a54f-d97445d53cce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:00:43 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-44f26805-3427-4959-a32a-d70a86dd15c9 tempest-VolumesTransfersTest-1620443482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ace0ef5-391d-40b9-a54f-d97445d53cce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5b1c7c8d-2a6d-4384-82b7-f0d3a8196dc3', 'volume_name': 'volume-5b1c7c8d-2a6d-4384-82b7-f0d3a8196dc3', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:00:43 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-44f26805-3427-4959-a32a-d70a86dd15c9 tempest-VolumesTransfersTest-1620443482 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (605af362-3c77-4322-9f64-ad9212d51792) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:00:43 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-44f26805-3427-4959-a32a-d70a86dd15c9 tempest-VolumesTransfersTest-1620443482 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (605af362-3c77-4322-9f64-ad9212d51792) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:00:43 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-44f26805-3427-4959-a32a-d70a86dd15c9 tempest-VolumesTransfersTest-1620443482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cff76449-79b8-481c-bf69-23206be9a2f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:00:43 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-44f26805-3427-4959-a32a-d70a86dd15c9 tempest-VolumesTransfersTest-1620443482 None] Volume 5b1c7c8d-2a6d-4384-82b7-f0d3a8196dc3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5b1c7c8d-2a6d-4384-82b7-f0d3a8196dc3', 'volume_size': 1} Jul 13 14:00:43 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-44f26805-3427-4959-a32a-d70a86dd15c9 tempest-VolumesTransfersTest-1620443482 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 14:00:43 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-44f26805-3427-4959-a32a-d70a86dd15c9 tempest-VolumesTransfersTest-1620443482 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 14:00:43 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-44f26805-3427-4959-a32a-d70a86dd15c9 tempest-VolumesTransfersTest-1620443482 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T12:00:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-648228937',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b1c7c8d-2a6d-4384-82b7-f0d3a8196dc3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51f7823e5ea54eedb0d4b62990ab1e4f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T12:00:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T12:00:43Z,use_quota=True,user_id='0273450b925f4840b9f024c5c031a1da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1147de8b-623b-426c-a13d-7fc824a80f67),volume_type_id=1147de8b-623b-426c-a13d-7fc824a80f67)}" {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 13 14:00:43 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-44f26805-3427-4959-a32a-d70a86dd15c9 tempest-VolumesTransfersTest-1620443482 None] Creating volume 5b1c7c8d-2a6d-4384-82b7-f0d3a8196dc3 {{(pid=87098) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 13 14:00:43 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-44f26805-3427-4959-a32a-d70a86dd15c9 tempest-VolumesTransfersTest-1620443482 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 14:00:43 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-44f26805-3427-4959-a32a-d70a86dd15c9 tempest-VolumesTransfersTest-1620443482 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 14:00:43 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-44f26805-3427-4959-a32a-d70a86dd15c9 tempest-VolumesTransfersTest-1620443482 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 14:00:43 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-44f26805-3427-4959-a32a-d70a86dd15c9 tempest-VolumesTransfersTest-1620443482 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 14:00:43 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-44f26805-3427-4959-a32a-d70a86dd15c9 tempest-VolumesTransfersTest-1620443482 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 14:00:43 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-44f26805-3427-4959-a32a-d70a86dd15c9 tempest-VolumesTransfersTest-1620443482 None] Selected osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 14:00:43 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-44f26805-3427-4959-a32a-d70a86dd15c9 tempest-VolumesTransfersTest-1620443482 None] casted to osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 Jul 13 14:00:43 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-44f26805-3427-4959-a32a-d70a86dd15c9 tempest-VolumesTransfersTest-1620443482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-5b1c7c8d-2a6d-4384-82b7-f0d3a8196dc3 1073741824 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:00:43 devstack sudo[100425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-5b1c7c8d-2a6d-4384-82b7-f0d3a8196dc3 1073741824 Jul 13 14:00:43 devstack sudo[100425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:00:43 devstack sudo[100425]: pam_unix(sudo:session): session closed for user root Jul 13 14:00:43 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-44f26805-3427-4959-a32a-d70a86dd15c9 tempest-VolumesTransfersTest-1620443482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-5b1c7c8d-2a6d-4384-82b7-f0d3a8196dc3 1073741824" returned: 0 in 0.524s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:00:43 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-44f26805-3427-4959-a32a-d70a86dd15c9 tempest-VolumesTransfersTest-1620443482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-5b1c7c8d-2a6d-4384-82b7-f0d3a8196dc3 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:00:43 devstack sudo[100432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-5b1c7c8d-2a6d-4384-82b7-f0d3a8196dc3 Jul 13 14:00:43 devstack sudo[100432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:00:44 devstack sudo[100432]: pam_unix(sudo:session): session closed for user root Jul 13 14:00:44 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-44f26805-3427-4959-a32a-d70a86dd15c9 tempest-VolumesTransfersTest-1620443482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-5b1c7c8d-2a6d-4384-82b7-f0d3a8196dc3" returned: 0 in 0.289s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:00:44 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-44f26805-3427-4959-a32a-d70a86dd15c9 tempest-VolumesTransfersTest-1620443482 None] <== create_volume: return (875ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'} {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 13 14:00:44 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-44f26805-3427-4959-a32a-d70a86dd15c9 tempest-VolumesTransfersTest-1620443482 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.878s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 14:00:44 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-44f26805-3427-4959-a32a-d70a86dd15c9 tempest-VolumesTransfersTest-1620443482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cff76449-79b8-481c-bf69-23206be9a2f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5b1c7c8d-2a6d-4384-82b7-f0d3a8196dc3', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:00:44 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-44f26805-3427-4959-a32a-d70a86dd15c9 tempest-VolumesTransfersTest-1620443482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38be3087-fec8-43bd-b0a0-fb06c3c984c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:00:44 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-44f26805-3427-4959-a32a-d70a86dd15c9 tempest-VolumesTransfersTest-1620443482 None] Volume volume-5b1c7c8d-2a6d-4384-82b7-f0d3a8196dc3 (5b1c7c8d-2a6d-4384-82b7-f0d3a8196dc3): created successfully Jul 13 14:00:44 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-44f26805-3427-4959-a32a-d70a86dd15c9 tempest-VolumesTransfersTest-1620443482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38be3087-fec8-43bd-b0a0-fb06c3c984c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:00:44 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-44f26805-3427-4959-a32a-d70a86dd15c9 tempest-VolumesTransfersTest-1620443482 None] Flow 'volume_create_manager' (bce4ed9c-ac5a-486d-bfe3-0ccb477002e7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 14:00:44 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-44f26805-3427-4959-a32a-d70a86dd15c9 tempest-VolumesTransfersTest-1620443482 None] Created volume successfully. Jul 13 14:00:45 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-c68db6cf-0239-4d6c-a014-489e43a79cc5 tempest-VolumesTransfersTest-7234712 None] Transfer volume completed successfully. Jul 13 14:00:46 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-99e57dd5-8167-4efe-8b2a-c7dc97b61942 tempest-VolumesTransfersTest-460036408 None] Acquiring lock "cinder-5b1c7c8d-2a6d-4384-82b7-f0d3a8196dc3-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 14:00:46 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-99e57dd5-8167-4efe-8b2a-c7dc97b61942 tempest-VolumesTransfersTest-460036408 None] Lock "cinder-5b1c7c8d-2a6d-4384-82b7-f0d3a8196dc3-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 14:00:46 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-99e57dd5-8167-4efe-8b2a-c7dc97b61942 tempest-VolumesTransfersTest-460036408 None] Acquiring lock "cinder-quobyte-5b1c7c8d-2a6d-4384-82b7-f0d3a8196dc3" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 14:00:46 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-99e57dd5-8167-4efe-8b2a-c7dc97b61942 tempest-VolumesTransfersTest-460036408 None] Lock "cinder-quobyte-5b1c7c8d-2a6d-4384-82b7-f0d3a8196dc3" acquired by "delete_volume" :: waited 0.016s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 14:00:46 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[0682adb7-e6e9-43b2-bef2-5b96cc85e179]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 14:00:46 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-99e57dd5-8167-4efe-8b2a-c7dc97b61942 tempest-VolumesTransfersTest-460036408 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-5b1c7c8d-2a6d-4384-82b7-f0d3a8196dc3 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:00:46 devstack sudo[100449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-5b1c7c8d-2a6d-4384-82b7-f0d3a8196dc3 Jul 13 14:00:46 devstack sudo[100449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:00:46 devstack sudo[100449]: pam_unix(sudo:session): session closed for user root Jul 13 14:00:46 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-99e57dd5-8167-4efe-8b2a-c7dc97b61942 tempest-VolumesTransfersTest-460036408 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-5b1c7c8d-2a6d-4384-82b7-f0d3a8196dc3" returned: 0 in 0.473s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:00:46 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-99e57dd5-8167-4efe-8b2a-c7dc97b61942 tempest-VolumesTransfersTest-460036408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-5b1c7c8d-2a6d-4384-82b7-f0d3a8196dc3 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:00:47 devstack sudo[100456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-5b1c7c8d-2a6d-4384-82b7-f0d3a8196dc3 Jul 13 14:00:47 devstack sudo[100456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:00:47 devstack sudo[100456]: pam_unix(sudo:session): session closed for user root Jul 13 14:00:47 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-99e57dd5-8167-4efe-8b2a-c7dc97b61942 tempest-VolumesTransfersTest-460036408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-5b1c7c8d-2a6d-4384-82b7-f0d3a8196dc3" returned: 0 in 0.305s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:00:47 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-99e57dd5-8167-4efe-8b2a-c7dc97b61942 tempest-VolumesTransfersTest-460036408 None] Lock "cinder-quobyte-5b1c7c8d-2a6d-4384-82b7-f0d3a8196dc3" released by "delete_volume" :: held 0.835s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 14:00:47 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-99e57dd5-8167-4efe-8b2a-c7dc97b61942 tempest-VolumesTransfersTest-460036408 None] Created reservations ['12376b2b-bc39-4a34-821c-2c65b3cc300d', '491910db-52fe-419d-afbb-a958d95b7f84', '19cfa225-b804-4f42-b664-67a5f9302905', '80469c56-81e0-4794-acb4-a292b4171d6f'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 14:00:47 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-99e57dd5-8167-4efe-8b2a-c7dc97b61942 tempest-VolumesTransfersTest-460036408 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 14:00:47 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-99e57dd5-8167-4efe-8b2a-c7dc97b61942 tempest-VolumesTransfersTest-460036408 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 14:00:47 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-99e57dd5-8167-4efe-8b2a-c7dc97b61942 tempest-VolumesTransfersTest-460036408 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 14:00:47 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-99e57dd5-8167-4efe-8b2a-c7dc97b61942 tempest-VolumesTransfersTest-460036408 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 14:00:47 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-99e57dd5-8167-4efe-8b2a-c7dc97b61942 tempest-VolumesTransfersTest-460036408 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 14:00:47 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-99e57dd5-8167-4efe-8b2a-c7dc97b61942 tempest-VolumesTransfersTest-460036408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:00:47 devstack sudo[100467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 Jul 13 14:00:47 devstack sudo[100467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:00:47 devstack sudo[100467]: pam_unix(sudo:session): session closed for user root Jul 13 14:00:47 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-99e57dd5-8167-4efe-8b2a-c7dc97b61942 tempest-VolumesTransfersTest-460036408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78" returned: 0 in 0.440s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:00:47 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-99e57dd5-8167-4efe-8b2a-c7dc97b61942 tempest-VolumesTransfersTest-460036408 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 14:00:47 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-99e57dd5-8167-4efe-8b2a-c7dc97b61942 tempest-VolumesTransfersTest-460036408 None] Deleted volume successfully. Jul 13 14:00:47 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-99e57dd5-8167-4efe-8b2a-c7dc97b61942 tempest-VolumesTransfersTest-460036408 None] Lock "cinder-5b1c7c8d-2a6d-4384-82b7-f0d3a8196dc3-delete_volume" released by "delete_volume" :: held 1.527s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 14:00:48 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-bd08932f-45ce-4d66-95e5-e7fdf04addfe tempest-VolumesTransfersTest-1620443482 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 14:00:48 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-bd08932f-45ce-4d66-95e5-e7fdf04addfe tempest-VolumesTransfersTest-1620443482 None] Flow 'volume_create_manager' (cddde654-3fc9-4365-a2c0-aed5efff5a7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 14:00:48 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-bd08932f-45ce-4d66-95e5-e7fdf04addfe tempest-VolumesTransfersTest-1620443482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40027362-074d-4809-bcfb-1b372fe25cdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:00:48 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-bd08932f-45ce-4d66-95e5-e7fdf04addfe tempest-VolumesTransfersTest-1620443482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40027362-074d-4809-bcfb-1b372fe25cdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T12:00:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-245777357',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2cf7495-d1fe-497e-ae9c-77a1d6c822ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51f7823e5ea54eedb0d4b62990ab1e4f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T12:00:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T12:00:48Z,use_quota=True,user_id='0273450b925f4840b9f024c5c031a1da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1147de8b-623b-426c-a13d-7fc824a80f67),volume_type_id=1147de8b-623b-426c-a13d-7fc824a80f67)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:00:48 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-bd08932f-45ce-4d66-95e5-e7fdf04addfe tempest-VolumesTransfersTest-1620443482 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c966f184-29ad-438a-ad0d-47a54f295284) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:00:48 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-bd08932f-45ce-4d66-95e5-e7fdf04addfe tempest-VolumesTransfersTest-1620443482 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c966f184-29ad-438a-ad0d-47a54f295284) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:00:48 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-bd08932f-45ce-4d66-95e5-e7fdf04addfe tempest-VolumesTransfersTest-1620443482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c4e4327-6fef-4621-963b-a73ca8a23da1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:00:48 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-bd08932f-45ce-4d66-95e5-e7fdf04addfe tempest-VolumesTransfersTest-1620443482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c4e4327-6fef-4621-963b-a73ca8a23da1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e2cf7495-d1fe-497e-ae9c-77a1d6c822ae', 'volume_name': 'volume-e2cf7495-d1fe-497e-ae9c-77a1d6c822ae', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:00:48 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-bd08932f-45ce-4d66-95e5-e7fdf04addfe tempest-VolumesTransfersTest-1620443482 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0fef2148-6f00-4f4d-9c17-26cb01a858e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:00:48 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-bd08932f-45ce-4d66-95e5-e7fdf04addfe tempest-VolumesTransfersTest-1620443482 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0fef2148-6f00-4f4d-9c17-26cb01a858e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:00:48 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-bd08932f-45ce-4d66-95e5-e7fdf04addfe tempest-VolumesTransfersTest-1620443482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9d60172-32e3-4d04-8f7c-5f6e78f2d959) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:00:48 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-bd08932f-45ce-4d66-95e5-e7fdf04addfe tempest-VolumesTransfersTest-1620443482 None] Volume e2cf7495-d1fe-497e-ae9c-77a1d6c822ae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e2cf7495-d1fe-497e-ae9c-77a1d6c822ae', 'volume_size': 1} Jul 13 14:00:48 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-bd08932f-45ce-4d66-95e5-e7fdf04addfe tempest-VolumesTransfersTest-1620443482 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 14:00:48 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-bd08932f-45ce-4d66-95e5-e7fdf04addfe tempest-VolumesTransfersTest-1620443482 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 14:00:48 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-bd08932f-45ce-4d66-95e5-e7fdf04addfe tempest-VolumesTransfersTest-1620443482 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T12:00:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-245777357',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2cf7495-d1fe-497e-ae9c-77a1d6c822ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51f7823e5ea54eedb0d4b62990ab1e4f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T12:00:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T12:00:48Z,use_quota=True,user_id='0273450b925f4840b9f024c5c031a1da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1147de8b-623b-426c-a13d-7fc824a80f67),volume_type_id=1147de8b-623b-426c-a13d-7fc824a80f67)}" {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 13 14:00:48 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-bd08932f-45ce-4d66-95e5-e7fdf04addfe tempest-VolumesTransfersTest-1620443482 None] Creating volume e2cf7495-d1fe-497e-ae9c-77a1d6c822ae {{(pid=87098) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 13 14:00:48 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-bd08932f-45ce-4d66-95e5-e7fdf04addfe tempest-VolumesTransfersTest-1620443482 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 14:00:48 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-bd08932f-45ce-4d66-95e5-e7fdf04addfe tempest-VolumesTransfersTest-1620443482 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 14:00:48 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-bd08932f-45ce-4d66-95e5-e7fdf04addfe tempest-VolumesTransfersTest-1620443482 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 14:00:48 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-bd08932f-45ce-4d66-95e5-e7fdf04addfe tempest-VolumesTransfersTest-1620443482 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 14:00:48 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-bd08932f-45ce-4d66-95e5-e7fdf04addfe tempest-VolumesTransfersTest-1620443482 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 14:00:48 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-bd08932f-45ce-4d66-95e5-e7fdf04addfe tempest-VolumesTransfersTest-1620443482 None] Selected osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 14:00:48 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-bd08932f-45ce-4d66-95e5-e7fdf04addfe tempest-VolumesTransfersTest-1620443482 None] casted to osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 Jul 13 14:00:48 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-bd08932f-45ce-4d66-95e5-e7fdf04addfe tempest-VolumesTransfersTest-1620443482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-e2cf7495-d1fe-497e-ae9c-77a1d6c822ae 1073741824 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:00:48 devstack sudo[100470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-e2cf7495-d1fe-497e-ae9c-77a1d6c822ae 1073741824 Jul 13 14:00:48 devstack sudo[100470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:00:48 devstack sudo[100470]: pam_unix(sudo:session): session closed for user root Jul 13 14:00:48 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-bd08932f-45ce-4d66-95e5-e7fdf04addfe tempest-VolumesTransfersTest-1620443482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-e2cf7495-d1fe-497e-ae9c-77a1d6c822ae 1073741824" returned: 0 in 0.512s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:00:48 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-bd08932f-45ce-4d66-95e5-e7fdf04addfe tempest-VolumesTransfersTest-1620443482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-e2cf7495-d1fe-497e-ae9c-77a1d6c822ae {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:00:49 devstack sudo[100476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-e2cf7495-d1fe-497e-ae9c-77a1d6c822ae Jul 13 14:00:49 devstack sudo[100476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:00:49 devstack sudo[100476]: pam_unix(sudo:session): session closed for user root Jul 13 14:00:49 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-bd08932f-45ce-4d66-95e5-e7fdf04addfe tempest-VolumesTransfersTest-1620443482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-e2cf7495-d1fe-497e-ae9c-77a1d6c822ae" returned: 0 in 0.271s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:00:49 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-bd08932f-45ce-4d66-95e5-e7fdf04addfe tempest-VolumesTransfersTest-1620443482 None] <== create_volume: return (838ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'} {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 13 14:00:49 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-bd08932f-45ce-4d66-95e5-e7fdf04addfe tempest-VolumesTransfersTest-1620443482 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.842s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 14:00:49 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-bd08932f-45ce-4d66-95e5-e7fdf04addfe tempest-VolumesTransfersTest-1620443482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9d60172-32e3-4d04-8f7c-5f6e78f2d959) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e2cf7495-d1fe-497e-ae9c-77a1d6c822ae', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:00:49 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-bd08932f-45ce-4d66-95e5-e7fdf04addfe tempest-VolumesTransfersTest-1620443482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e0f4b8f-b083-4172-9997-45a8c9c6f2c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:00:49 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-bd08932f-45ce-4d66-95e5-e7fdf04addfe tempest-VolumesTransfersTest-1620443482 None] Volume volume-e2cf7495-d1fe-497e-ae9c-77a1d6c822ae (e2cf7495-d1fe-497e-ae9c-77a1d6c822ae): created successfully Jul 13 14:00:49 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-bd08932f-45ce-4d66-95e5-e7fdf04addfe tempest-VolumesTransfersTest-1620443482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e0f4b8f-b083-4172-9997-45a8c9c6f2c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:00:49 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-bd08932f-45ce-4d66-95e5-e7fdf04addfe tempest-VolumesTransfersTest-1620443482 None] Flow 'volume_create_manager' (cddde654-3fc9-4365-a2c0-aed5efff5a7b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 14:00:49 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-bd08932f-45ce-4d66-95e5-e7fdf04addfe tempest-VolumesTransfersTest-1620443482 None] Created volume successfully. Jul 13 14:00:50 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-55e5949d-9e50-4efc-9293-0e1a2787cfe2 tempest-VolumesTransfersTest-460036408 None] Acquiring lock "cinder-e2cf7495-d1fe-497e-ae9c-77a1d6c822ae-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 14:00:50 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-55e5949d-9e50-4efc-9293-0e1a2787cfe2 tempest-VolumesTransfersTest-460036408 None] Lock "cinder-e2cf7495-d1fe-497e-ae9c-77a1d6c822ae-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 14:00:50 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-55e5949d-9e50-4efc-9293-0e1a2787cfe2 tempest-VolumesTransfersTest-460036408 None] Acquiring lock "cinder-quobyte-e2cf7495-d1fe-497e-ae9c-77a1d6c822ae" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 14:00:50 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-55e5949d-9e50-4efc-9293-0e1a2787cfe2 tempest-VolumesTransfersTest-460036408 None] Lock "cinder-quobyte-e2cf7495-d1fe-497e-ae9c-77a1d6c822ae" acquired by "delete_volume" :: waited 0.016s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 14:00:50 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[279a8836-04f1-48b9-a086-8c8b1d23c192]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 14:00:50 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-55e5949d-9e50-4efc-9293-0e1a2787cfe2 tempest-VolumesTransfersTest-460036408 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-e2cf7495-d1fe-497e-ae9c-77a1d6c822ae {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:00:50 devstack sudo[100479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-e2cf7495-d1fe-497e-ae9c-77a1d6c822ae Jul 13 14:00:50 devstack sudo[100479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:00:51 devstack sudo[100479]: pam_unix(sudo:session): session closed for user root Jul 13 14:00:51 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-55e5949d-9e50-4efc-9293-0e1a2787cfe2 tempest-VolumesTransfersTest-460036408 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-e2cf7495-d1fe-497e-ae9c-77a1d6c822ae" returned: 0 in 0.366s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:00:51 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-55e5949d-9e50-4efc-9293-0e1a2787cfe2 tempest-VolumesTransfersTest-460036408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-e2cf7495-d1fe-497e-ae9c-77a1d6c822ae {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:00:51 devstack sudo[100484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-e2cf7495-d1fe-497e-ae9c-77a1d6c822ae Jul 13 14:00:51 devstack sudo[100484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:00:51 devstack sudo[100484]: pam_unix(sudo:session): session closed for user root Jul 13 14:00:51 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-55e5949d-9e50-4efc-9293-0e1a2787cfe2 tempest-VolumesTransfersTest-460036408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-e2cf7495-d1fe-497e-ae9c-77a1d6c822ae" returned: 0 in 0.252s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:00:51 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-55e5949d-9e50-4efc-9293-0e1a2787cfe2 tempest-VolumesTransfersTest-460036408 None] Lock "cinder-quobyte-e2cf7495-d1fe-497e-ae9c-77a1d6c822ae" released by "delete_volume" :: held 0.663s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 14:00:51 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-55e5949d-9e50-4efc-9293-0e1a2787cfe2 tempest-VolumesTransfersTest-460036408 None] Created reservations ['d8619d63-e2ff-4e6b-9dcd-21e36f106852', 'f24fe9d1-c1b5-4ccb-9af5-84c55d6f6da5', '6525c122-37fb-428d-8daa-afb4487db0d1', 'cd8089e5-7a83-4504-9d2b-0df333e6c5e9'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 14:00:51 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-55e5949d-9e50-4efc-9293-0e1a2787cfe2 tempest-VolumesTransfersTest-460036408 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 14:00:51 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-55e5949d-9e50-4efc-9293-0e1a2787cfe2 tempest-VolumesTransfersTest-460036408 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 14:00:51 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-55e5949d-9e50-4efc-9293-0e1a2787cfe2 tempest-VolumesTransfersTest-460036408 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 14:00:51 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-55e5949d-9e50-4efc-9293-0e1a2787cfe2 tempest-VolumesTransfersTest-460036408 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 14:00:51 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-55e5949d-9e50-4efc-9293-0e1a2787cfe2 tempest-VolumesTransfersTest-460036408 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 14:00:51 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-55e5949d-9e50-4efc-9293-0e1a2787cfe2 tempest-VolumesTransfersTest-460036408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:00:51 devstack sudo[100487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 Jul 13 14:00:51 devstack sudo[100487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:00:51 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-55e5949d-9e50-4efc-9293-0e1a2787cfe2 tempest-VolumesTransfersTest-460036408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78" returned: 0 in 0.274s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:00:51 devstack sudo[100487]: pam_unix(sudo:session): session closed for user root Jul 13 14:00:51 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-55e5949d-9e50-4efc-9293-0e1a2787cfe2 tempest-VolumesTransfersTest-460036408 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 14:00:51 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-55e5949d-9e50-4efc-9293-0e1a2787cfe2 tempest-VolumesTransfersTest-460036408 None] Deleted volume successfully. Jul 13 14:00:51 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-55e5949d-9e50-4efc-9293-0e1a2787cfe2 tempest-VolumesTransfersTest-460036408 None] Lock "cinder-e2cf7495-d1fe-497e-ae9c-77a1d6c822ae-delete_volume" released by "delete_volume" :: held 1.201s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 14:00:54 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac0b5c2f-2f60-4a45-aa77-87d5de28795a tempest-TestShelveInstance-1277930598 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 14:00:54 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-ac0b5c2f-2f60-4a45-aa77-87d5de28795a tempest-TestShelveInstance-1277930598 None] Flow 'volume_create_manager' (e63c686c-afdf-4283-a228-a462607cba14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 14:00:54 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-ac0b5c2f-2f60-4a45-aa77-87d5de28795a tempest-TestShelveInstance-1277930598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4912447-30de-4a44-8205-ec1036aa95d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:00:55 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-ac0b5c2f-2f60-4a45-aa77-87d5de28795a tempest-TestShelveInstance-1277930598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4912447-30de-4a44-8205-ec1036aa95d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T12:00:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-2071350577',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=849033af-fc3f-4a27-aa35-51356ad1ede2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='215caa84874d49f9b3166aa84d00d9b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T12:00:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T12:00:55Z,use_quota=True,user_id='eac42b993ca94f6e9e73c63056745dfa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1147de8b-623b-426c-a13d-7fc824a80f67),volume_type_id=1147de8b-623b-426c-a13d-7fc824a80f67)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:00:55 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-ac0b5c2f-2f60-4a45-aa77-87d5de28795a tempest-TestShelveInstance-1277930598 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4126ba7f-7fb9-4b93-a295-54a944024479) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:00:55 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-ac0b5c2f-2f60-4a45-aa77-87d5de28795a tempest-TestShelveInstance-1277930598 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4126ba7f-7fb9-4b93-a295-54a944024479) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:00:55 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-ac0b5c2f-2f60-4a45-aa77-87d5de28795a tempest-TestShelveInstance-1277930598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (837b20be-078d-47e7-962b-74b366c15329) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:00:55 devstack cinder-volume[87098]: DEBUG cinder.image.glance [None req-ac0b5c2f-2f60-4a45-aa77-87d5de28795a tempest-TestShelveInstance-1277930598 None] Creating Keystone auth plugin from conf {{(pid=87098) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 13 14:00:55 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-ac0b5c2f-2f60-4a45-aa77-87d5de28795a tempest-TestShelveInstance-1277930598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (837b20be-078d-47e7-962b-74b366c15329) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '849033af-fc3f-4a27-aa35-51356ad1ede2', 'volume_name': 'volume-849033af-fc3f-4a27-aa35-51356ad1ede2', 'volume_size': 1, 'image_id': 'def20bd7-001f-4245-a717-37b9a4cc8574', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/def20bd7-001f-4245-a717-37b9a4cc8574', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '2181cd3fc958400682584829a80e727e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'def20bd7-001f-4245-a717-37b9a4cc8574', 'created_at': datetime.datetime(2026, 7, 13, 11, 42, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 13, 11, 42, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/def20bd7-001f-4245-a717-37b9a4cc8574/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:00:55 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-ac0b5c2f-2f60-4a45-aa77-87d5de28795a tempest-TestShelveInstance-1277930598 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11b25c98-3d08-45ad-9c63-e07a58e6d22b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:00:55 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-ac0b5c2f-2f60-4a45-aa77-87d5de28795a tempest-TestShelveInstance-1277930598 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11b25c98-3d08-45ad-9c63-e07a58e6d22b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:00:55 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-ac0b5c2f-2f60-4a45-aa77-87d5de28795a tempest-TestShelveInstance-1277930598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3dae1985-6181-430c-9eb8-e0f72adf02de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:00:55 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-ac0b5c2f-2f60-4a45-aa77-87d5de28795a tempest-TestShelveInstance-1277930598 None] Volume 849033af-fc3f-4a27-aa35-51356ad1ede2: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-849033af-fc3f-4a27-aa35-51356ad1ede2', 'volume_size': 1, 'image_id': 'def20bd7-001f-4245-a717-37b9a4cc8574', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/def20bd7-001f-4245-a717-37b9a4cc8574', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '2181cd3fc958400682584829a80e727e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'def20bd7-001f-4245-a717-37b9a4cc8574', 'created_at': datetime.datetime(2026, 7, 13, 11, 42, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 13, 11, 42, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/def20bd7-001f-4245-a717-37b9a4cc8574/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 13 14:00:55 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac0b5c2f-2f60-4a45-aa77-87d5de28795a tempest-TestShelveInstance-1277930598 None] Trying to clone 849033af-fc3f-4a27-aa35-51356ad1ede2 from image def20bd7-001f-4245-a717-37b9a4cc8574 at location (None, [{'url': 'file:///opt/stack/data/glance/images/def20bd7-001f-4245-a717-37b9a4cc8574', 'metadata': {}}]). {{(pid=87098) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 13 14:00:55 devstack cinder-volume[87098]: DEBUG cinder.image.image_utils [None req-ac0b5c2f-2f60-4a45-aa77-87d5de28795a tempest-TestShelveInstance-1277930598 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_def20bd7-001f-4245-a717-37b9a4cc8574_8m19m38bdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87098) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 13 14:00:55 devstack cinder-volume[87098]: INFO cinder.image.image_utils [None req-ac0b5c2f-2f60-4a45-aa77-87d5de28795a tempest-TestShelveInstance-1277930598 None] Image download 20.69 MB at 20.69 MB/s Jul 13 14:00:56 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[12ad3516-e655-4230-a075-854be3fa2585]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 14:00:56 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-ac0b5c2f-2f60-4a45-aa77-87d5de28795a tempest-TestShelveInstance-1277930598 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_def20bd7-001f-4245-a717-37b9a4cc8574_8m19m38bdevstack@QuobyteHD {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:00:56 devstack sudo[100496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_def20bd7-001f-4245-a717-37b9a4cc8574_8m19m38bdevstack@QuobyteHD Jul 13 14:00:56 devstack sudo[100496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:00:56 devstack sudo[100496]: pam_unix(sudo:session): session closed for user root Jul 13 14:00:56 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-ac0b5c2f-2f60-4a45-aa77-87d5de28795a tempest-TestShelveInstance-1277930598 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_def20bd7-001f-4245-a717-37b9a4cc8574_8m19m38bdevstack@QuobyteHD" returned: 0 in 0.387s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:00:56 devstack cinder-volume[87098]: DEBUG cinder.image.image_utils [None req-ac0b5c2f-2f60-4a45-aa77-87d5de28795a tempest-TestShelveInstance-1277930598 None] Temporary image def20bd7-001f-4245-a717-37b9a4cc8574 is fetched for user eac42b993ca94f6e9e73c63056745dfa. {{(pid=87098) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 13 14:00:56 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [req-8a7024bd-6b5a-42df-bdca-a983a679aa2c req-6e41bf09-54d9-459b-bfd1-dfee467af42a tempest-TestServerVolumeAttachmentScenario-1406476146 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 14:00:56 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [req-8a7024bd-6b5a-42df-bdca-a983a679aa2c req-6e41bf09-54d9-459b-bfd1-dfee467af42a tempest-TestServerVolumeAttachmentScenario-1406476146 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 14:00:56 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7243548-7412-4a7c-9fbd-ce2a9715af4b]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 14:00:56 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [req-8a7024bd-6b5a-42df-bdca-a983a679aa2c req-6e41bf09-54d9-459b-bfd1-dfee467af42a tempest-TestServerVolumeAttachmentScenario-1406476146 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-5bdcac5e-f4f1-46d3-8f6e-b62987578e78 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:00:56 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c3d884f-6c03-4032-a96c-2fe7d8a117b1]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 14:00:56 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-ac0b5c2f-2f60-4a45-aa77-87d5de28795a tempest-TestShelveInstance-1277930598 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_def20bd7-001f-4245-a717-37b9a4cc8574_8m19m38bdevstack@QuobyteHD {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:00:56 devstack sudo[100509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-5bdcac5e-f4f1-46d3-8f6e-b62987578e78 Jul 13 14:00:56 devstack sudo[100509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:00:56 devstack sudo[100510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_def20bd7-001f-4245-a717-37b9a4cc8574_8m19m38bdevstack@QuobyteHD Jul 13 14:00:56 devstack sudo[100510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:00:56 devstack sudo[100510]: pam_unix(sudo:session): session closed for user root Jul 13 14:00:56 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-ac0b5c2f-2f60-4a45-aa77-87d5de28795a tempest-TestShelveInstance-1277930598 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_def20bd7-001f-4245-a717-37b9a4cc8574_8m19m38bdevstack@QuobyteHD" returned: 0 in 0.357s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:00:56 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-ac0b5c2f-2f60-4a45-aa77-87d5de28795a tempest-TestShelveInstance-1277930598 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 14:00:56 devstack sudo[100509]: pam_unix(sudo:session): session closed for user root Jul 13 14:00:56 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [req-8a7024bd-6b5a-42df-bdca-a983a679aa2c req-6e41bf09-54d9-459b-bfd1-dfee467af42a tempest-TestServerVolumeAttachmentScenario-1406476146 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-5bdcac5e-f4f1-46d3-8f6e-b62987578e78" returned: 0 in 0.419s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:00:56 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [req-8a7024bd-6b5a-42df-bdca-a983a679aa2c req-6e41bf09-54d9-459b-bfd1-dfee467af42a tempest-TestServerVolumeAttachmentScenario-1406476146 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.444s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 14:00:56 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-ac0b5c2f-2f60-4a45-aa77-87d5de28795a tempest-TestShelveInstance-1277930598 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.023s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 14:00:56 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-ac0b5c2f-2f60-4a45-aa77-87d5de28795a tempest-TestShelveInstance-1277930598 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T12:00:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-2071350577',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=849033af-fc3f-4a27-aa35-51356ad1ede2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='215caa84874d49f9b3166aa84d00d9b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T12:00:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T12:00:55Z,use_quota=True,user_id='eac42b993ca94f6e9e73c63056745dfa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1147de8b-623b-426c-a13d-7fc824a80f67),volume_type_id=1147de8b-623b-426c-a13d-7fc824a80f67)}" {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 13 14:00:56 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-ac0b5c2f-2f60-4a45-aa77-87d5de28795a tempest-TestShelveInstance-1277930598 None] Creating volume 849033af-fc3f-4a27-aa35-51356ad1ede2 {{(pid=87098) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 13 14:00:56 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-ac0b5c2f-2f60-4a45-aa77-87d5de28795a tempest-TestShelveInstance-1277930598 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 14:00:56 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-ac0b5c2f-2f60-4a45-aa77-87d5de28795a tempest-TestShelveInstance-1277930598 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 14:00:56 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-ac0b5c2f-2f60-4a45-aa77-87d5de28795a tempest-TestShelveInstance-1277930598 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 14:00:56 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-ac0b5c2f-2f60-4a45-aa77-87d5de28795a tempest-TestShelveInstance-1277930598 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 14:00:56 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-ac0b5c2f-2f60-4a45-aa77-87d5de28795a tempest-TestShelveInstance-1277930598 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 14:00:56 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-ac0b5c2f-2f60-4a45-aa77-87d5de28795a tempest-TestShelveInstance-1277930598 None] Selected osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 14:00:56 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-ac0b5c2f-2f60-4a45-aa77-87d5de28795a tempest-TestShelveInstance-1277930598 None] casted to osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 Jul 13 14:00:56 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-ac0b5c2f-2f60-4a45-aa77-87d5de28795a tempest-TestShelveInstance-1277930598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-849033af-fc3f-4a27-aa35-51356ad1ede2 1073741824 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:00:56 devstack sudo[100520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-849033af-fc3f-4a27-aa35-51356ad1ede2 1073741824 Jul 13 14:00:56 devstack sudo[100520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:00:56 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [req-8a7024bd-6b5a-42df-bdca-a983a679aa2c req-6e41bf09-54d9-459b-bfd1-dfee467af42a tempest-TestServerVolumeAttachmentScenario-1406476146 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654', 'name': 'volume-5bdcac5e-f4f1-46d3-8f6e-b62987578e78', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9e5d5061-3241-4d49-9179-7b2efc28db4c', 'enforce_multipath': True} {{(pid=87098) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 13 14:00:57 devstack cinder-volume[87098]: INFO cinder.volume.manager [req-8a7024bd-6b5a-42df-bdca-a983a679aa2c req-6e41bf09-54d9-459b-bfd1-dfee467af42a tempest-TestServerVolumeAttachmentScenario-1406476146 None] attachment_update completed successfully. Jul 13 14:00:57 devstack sudo[100520]: pam_unix(sudo:session): session closed for user root Jul 13 14:00:57 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-ac0b5c2f-2f60-4a45-aa77-87d5de28795a tempest-TestShelveInstance-1277930598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-849033af-fc3f-4a27-aa35-51356ad1ede2 1073741824" returned: 0 in 0.537s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:00:57 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-ac0b5c2f-2f60-4a45-aa77-87d5de28795a tempest-TestShelveInstance-1277930598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-849033af-fc3f-4a27-aa35-51356ad1ede2 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:00:57 devstack sudo[100908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-849033af-fc3f-4a27-aa35-51356ad1ede2 Jul 13 14:00:57 devstack sudo[100908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:00:57 devstack sudo[100908]: pam_unix(sudo:session): session closed for user root Jul 13 14:00:57 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-ac0b5c2f-2f60-4a45-aa77-87d5de28795a tempest-TestShelveInstance-1277930598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-849033af-fc3f-4a27-aa35-51356ad1ede2" returned: 0 in 0.313s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:00:57 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-ac0b5c2f-2f60-4a45-aa77-87d5de28795a tempest-TestShelveInstance-1277930598 None] <== create_volume: return (896ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'} {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 13 14:00:57 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-ac0b5c2f-2f60-4a45-aa77-87d5de28795a tempest-TestShelveInstance-1277930598 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.899s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 14:00:57 devstack cinder-volume[87098]: DEBUG cinder.volume.volume_utils [None req-ac0b5c2f-2f60-4a45-aa77-87d5de28795a tempest-TestShelveInstance-1277930598 None] Attempting download of def20bd7-001f-4245-a717-37b9a4cc8574 ((None, [{'url': 'file:///opt/stack/data/glance/images/def20bd7-001f-4245-a717-37b9a4cc8574', 'metadata': {}}])) to volume 849033af-fc3f-4a27-aa35-51356ad1ede2. {{(pid=87098) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 13 14:00:57 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[96c50655-cb4b-460b-bff0-576aba8f3a57]: (4, 'raw') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 14:00:57 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-ac0b5c2f-2f60-4a45-aa77-87d5de28795a tempest-TestShelveInstance-1277930598 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_def20bd7-001f-4245-a717-37b9a4cc8574_6ys2i4tf {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:00:58 devstack sudo[100911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_def20bd7-001f-4245-a717-37b9a4cc8574_6ys2i4tf Jul 13 14:00:58 devstack sudo[100911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:00:58 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-c2000adb-066d-41fc-bf6c-7590902c0e98 tempest-VolumesNegativeTest-1089248346 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 14:00:58 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-c2000adb-066d-41fc-bf6c-7590902c0e98 tempest-VolumesNegativeTest-1089248346 None] Flow 'volume_create_manager' (9db79aae-092d-4df3-973f-240568bea1b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 14:00:58 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-c2000adb-066d-41fc-bf6c-7590902c0e98 tempest-VolumesNegativeTest-1089248346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56aa127e-7507-450e-bea3-c10d956d11db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:00:58 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-c2000adb-066d-41fc-bf6c-7590902c0e98 tempest-VolumesNegativeTest-1089248346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56aa127e-7507-450e-bea3-c10d956d11db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T12:00:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1401756959',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9670eeea-1036-4d38-aeae-c2808114f2d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f73c06323f848a188bebfe2d8ee2918',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T12:00:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T12:00:58Z,use_quota=True,user_id='29f7b5f1d5584abda61162cc94da11fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1147de8b-623b-426c-a13d-7fc824a80f67),volume_type_id=1147de8b-623b-426c-a13d-7fc824a80f67)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:00:58 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-c2000adb-066d-41fc-bf6c-7590902c0e98 tempest-VolumesNegativeTest-1089248346 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f255af8-9fe1-4eef-b283-c8f6f5ae9b91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:00:58 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-c2000adb-066d-41fc-bf6c-7590902c0e98 tempest-VolumesNegativeTest-1089248346 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f255af8-9fe1-4eef-b283-c8f6f5ae9b91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:00:58 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-c2000adb-066d-41fc-bf6c-7590902c0e98 tempest-VolumesNegativeTest-1089248346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da61dde7-6d33-4cd5-8613-2de69eac509b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:00:58 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-c2000adb-066d-41fc-bf6c-7590902c0e98 tempest-VolumesNegativeTest-1089248346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da61dde7-6d33-4cd5-8613-2de69eac509b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9670eeea-1036-4d38-aeae-c2808114f2d1', 'volume_name': 'volume-9670eeea-1036-4d38-aeae-c2808114f2d1', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:00:58 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-c2000adb-066d-41fc-bf6c-7590902c0e98 tempest-VolumesNegativeTest-1089248346 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f7b433d-1224-4c06-b576-3d9da1da918e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:00:58 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-c2000adb-066d-41fc-bf6c-7590902c0e98 tempest-VolumesNegativeTest-1089248346 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f7b433d-1224-4c06-b576-3d9da1da918e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:00:58 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-c2000adb-066d-41fc-bf6c-7590902c0e98 tempest-VolumesNegativeTest-1089248346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cca860bd-52e4-4947-b6f3-0dc469fab49e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:00:58 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-c2000adb-066d-41fc-bf6c-7590902c0e98 tempest-VolumesNegativeTest-1089248346 None] Volume 9670eeea-1036-4d38-aeae-c2808114f2d1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9670eeea-1036-4d38-aeae-c2808114f2d1', 'volume_size': 1} Jul 13 14:00:58 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-c2000adb-066d-41fc-bf6c-7590902c0e98 tempest-VolumesNegativeTest-1089248346 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 14:00:58 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-c2000adb-066d-41fc-bf6c-7590902c0e98 tempest-VolumesNegativeTest-1089248346 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 14:00:58 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-c2000adb-066d-41fc-bf6c-7590902c0e98 tempest-VolumesNegativeTest-1089248346 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T12:00:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1401756959',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9670eeea-1036-4d38-aeae-c2808114f2d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f73c06323f848a188bebfe2d8ee2918',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T12:00:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T12:00:58Z,use_quota=True,user_id='29f7b5f1d5584abda61162cc94da11fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1147de8b-623b-426c-a13d-7fc824a80f67),volume_type_id=1147de8b-623b-426c-a13d-7fc824a80f67)}" {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 13 14:00:58 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-c2000adb-066d-41fc-bf6c-7590902c0e98 tempest-VolumesNegativeTest-1089248346 None] Creating volume 9670eeea-1036-4d38-aeae-c2808114f2d1 {{(pid=87098) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 13 14:00:58 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-c2000adb-066d-41fc-bf6c-7590902c0e98 tempest-VolumesNegativeTest-1089248346 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 14:00:58 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-c2000adb-066d-41fc-bf6c-7590902c0e98 tempest-VolumesNegativeTest-1089248346 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 14:00:58 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-c2000adb-066d-41fc-bf6c-7590902c0e98 tempest-VolumesNegativeTest-1089248346 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 14:00:58 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-c2000adb-066d-41fc-bf6c-7590902c0e98 tempest-VolumesNegativeTest-1089248346 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 14:00:58 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-c2000adb-066d-41fc-bf6c-7590902c0e98 tempest-VolumesNegativeTest-1089248346 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 14:00:58 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-c2000adb-066d-41fc-bf6c-7590902c0e98 tempest-VolumesNegativeTest-1089248346 None] Selected osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 14:00:58 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-c2000adb-066d-41fc-bf6c-7590902c0e98 tempest-VolumesNegativeTest-1089248346 None] casted to osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 Jul 13 14:00:58 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-c2000adb-066d-41fc-bf6c-7590902c0e98 tempest-VolumesNegativeTest-1089248346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-9670eeea-1036-4d38-aeae-c2808114f2d1 1073741824 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:00:58 devstack sudo[100913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-9670eeea-1036-4d38-aeae-c2808114f2d1 1073741824 Jul 13 14:00:58 devstack sudo[100913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:00:58 devstack sudo[100911]: pam_unix(sudo:session): session closed for user root Jul 13 14:00:58 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-ac0b5c2f-2f60-4a45-aa77-87d5de28795a tempest-TestShelveInstance-1277930598 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_def20bd7-001f-4245-a717-37b9a4cc8574_6ys2i4tf" returned: 0 in 0.351s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:00:58 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-ac0b5c2f-2f60-4a45-aa77-87d5de28795a tempest-TestShelveInstance-1277930598 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_def20bd7-001f-4245-a717-37b9a4cc8574_6ys2i4tf {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:00:58 devstack sudo[100917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_def20bd7-001f-4245-a717-37b9a4cc8574_6ys2i4tf Jul 13 14:00:58 devstack sudo[100917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:00:58 devstack sudo[100917]: pam_unix(sudo:session): session closed for user root Jul 13 14:00:58 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-ac0b5c2f-2f60-4a45-aa77-87d5de28795a tempest-TestShelveInstance-1277930598 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_def20bd7-001f-4245-a717-37b9a4cc8574_6ys2i4tf" returned: 1 in 0.355s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:00:58 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-ac0b5c2f-2f60-4a45-aa77-87d5de28795a tempest-TestShelveInstance-1277930598 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_def20bd7-001f-4245-a717-37b9a4cc8574_6ys2i4tf' failed. Not Retrying. {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 13 14:00:58 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fddc833-b557-4d56-8fde-d40579aea643]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 14:00:58 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-ac0b5c2f-2f60-4a45-aa77-87d5de28795a tempest-TestShelveInstance-1277930598 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_def20bd7-001f-4245-a717-37b9a4cc8574_8m19m38bdevstack@QuobyteHD {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:00:58 devstack sudo[100913]: pam_unix(sudo:session): session closed for user root Jul 13 14:00:58 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-c2000adb-066d-41fc-bf6c-7590902c0e98 tempest-VolumesNegativeTest-1089248346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-9670eeea-1036-4d38-aeae-c2808114f2d1 1073741824" returned: 0 in 0.467s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:00:58 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-c2000adb-066d-41fc-bf6c-7590902c0e98 tempest-VolumesNegativeTest-1089248346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-9670eeea-1036-4d38-aeae-c2808114f2d1 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:00:58 devstack sudo[100926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-9670eeea-1036-4d38-aeae-c2808114f2d1 Jul 13 14:00:58 devstack sudo[100926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:00:58 devstack sudo[100925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_def20bd7-001f-4245-a717-37b9a4cc8574_8m19m38bdevstack@QuobyteHD Jul 13 14:00:58 devstack sudo[100925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:00:58 devstack sudo[100926]: pam_unix(sudo:session): session closed for user root Jul 13 14:00:58 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-c2000adb-066d-41fc-bf6c-7590902c0e98 tempest-VolumesNegativeTest-1089248346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-9670eeea-1036-4d38-aeae-c2808114f2d1" returned: 0 in 0.273s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:00:58 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-c2000adb-066d-41fc-bf6c-7590902c0e98 tempest-VolumesNegativeTest-1089248346 None] <== create_volume: return (787ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'} {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 13 14:00:58 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-c2000adb-066d-41fc-bf6c-7590902c0e98 tempest-VolumesNegativeTest-1089248346 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.790s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 14:00:58 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-c2000adb-066d-41fc-bf6c-7590902c0e98 tempest-VolumesNegativeTest-1089248346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cca860bd-52e4-4947-b6f3-0dc469fab49e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9670eeea-1036-4d38-aeae-c2808114f2d1', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:00:58 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-c2000adb-066d-41fc-bf6c-7590902c0e98 tempest-VolumesNegativeTest-1089248346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72b6e0db-781b-45ee-83e3-ec4d304fb622) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:00:59 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-c2000adb-066d-41fc-bf6c-7590902c0e98 tempest-VolumesNegativeTest-1089248346 None] Volume volume-9670eeea-1036-4d38-aeae-c2808114f2d1 (9670eeea-1036-4d38-aeae-c2808114f2d1): created successfully Jul 13 14:00:59 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-c2000adb-066d-41fc-bf6c-7590902c0e98 tempest-VolumesNegativeTest-1089248346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72b6e0db-781b-45ee-83e3-ec4d304fb622) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:00:59 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-c2000adb-066d-41fc-bf6c-7590902c0e98 tempest-VolumesNegativeTest-1089248346 None] Flow 'volume_create_manager' (9db79aae-092d-4df3-973f-240568bea1b3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 14:00:59 devstack sudo[100925]: pam_unix(sudo:session): session closed for user root Jul 13 14:00:59 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-ac0b5c2f-2f60-4a45-aa77-87d5de28795a tempest-TestShelveInstance-1277930598 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_def20bd7-001f-4245-a717-37b9a4cc8574_8m19m38bdevstack@QuobyteHD" returned: 0 in 0.383s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:00:59 devstack cinder-volume[87098]: DEBUG cinder.image.image_utils [None req-ac0b5c2f-2f60-4a45-aa77-87d5de28795a tempest-TestShelveInstance-1277930598 None] def20bd7-001f-4245-a717-37b9a4cc8574 was qcow2, converting to raw {{(pid=87098) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 13 14:00:59 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-ac0b5c2f-2f60-4a45-aa77-87d5de28795a tempest-TestShelveInstance-1277930598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_def20bd7-001f-4245-a717-37b9a4cc8574_8m19m38bdevstack@QuobyteHD /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-849033af-fc3f-4a27-aa35-51356ad1ede2 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:00:59 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-c2000adb-066d-41fc-bf6c-7590902c0e98 tempest-VolumesNegativeTest-1089248346 None] Created volume successfully. Jul 13 14:00:59 devstack sudo[100933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_def20bd7-001f-4245-a717-37b9a4cc8574_8m19m38bdevstack@QuobyteHD /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-849033af-fc3f-4a27-aa35-51356ad1ede2 Jul 13 14:00:59 devstack sudo[100933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:01:00 devstack sudo[100933]: pam_unix(sudo:session): session closed for user root Jul 13 14:01:00 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-ac0b5c2f-2f60-4a45-aa77-87d5de28795a tempest-TestShelveInstance-1277930598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_def20bd7-001f-4245-a717-37b9a4cc8574_8m19m38bdevstack@QuobyteHD /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-849033af-fc3f-4a27-aa35-51356ad1ede2" returned: 0 in 1.950s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:01:00 devstack cinder-volume[87098]: DEBUG cinder.image.image_utils [None req-ac0b5c2f-2f60-4a45-aa77-87d5de28795a tempest-TestShelveInstance-1277930598 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_def20bd7-001f-4245-a717-37b9a4cc8574_8m19m38bdevstack@QuobyteHD, size 112.00 MB, duration 1.95 sec, destination /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-849033af-fc3f-4a27-aa35-51356ad1ede2 {{(pid=87098) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 13 14:01:00 devstack cinder-volume[87098]: INFO cinder.image.image_utils [None req-ac0b5c2f-2f60-4a45-aa77-87d5de28795a tempest-TestShelveInstance-1277930598 None] Converted 112.00 MB image at 57.36 MB/s Jul 13 14:01:00 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-ac0b5c2f-2f60-4a45-aa77-87d5de28795a tempest-TestShelveInstance-1277930598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-849033af-fc3f-4a27-aa35-51356ad1ede2 1G {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:01:01 devstack sudo[100948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-849033af-fc3f-4a27-aa35-51356ad1ede2 1G Jul 13 14:01:01 devstack sudo[100948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:01:01 devstack sudo[100948]: pam_unix(sudo:session): session closed for user root Jul 13 14:01:01 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-ac0b5c2f-2f60-4a45-aa77-87d5de28795a tempest-TestShelveInstance-1277930598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-849033af-fc3f-4a27-aa35-51356ad1ede2 1G" returned: 0 in 0.422s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:01:01 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fc2a5ed-7972-448c-b1d4-228a5224ca34]: (4, 'raw') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 14:01:01 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-ac0b5c2f-2f60-4a45-aa77-87d5de28795a tempest-TestShelveInstance-1277930598 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-849033af-fc3f-4a27-aa35-51356ad1ede2 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:01:01 devstack sudo[100954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-849033af-fc3f-4a27-aa35-51356ad1ede2 Jul 13 14:01:01 devstack sudo[100954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:01:01 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [req-b0a106b7-37e8-4fe2-94b0-615c7eb7e994 req-6afebbd2-fe79-4998-a01b-192b14bdf7ca tempest-TestServerVolumeAttachmentScenario-1406476146 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 14:01:01 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [req-b0a106b7-37e8-4fe2-94b0-615c7eb7e994 req-6afebbd2-fe79-4998-a01b-192b14bdf7ca tempest-TestServerVolumeAttachmentScenario-1406476146 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 14:01:01 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bb05d95-8c7f-4b19-917b-2a265a76ee65]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 14:01:01 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [req-b0a106b7-37e8-4fe2-94b0-615c7eb7e994 req-6afebbd2-fe79-4998-a01b-192b14bdf7ca tempest-TestServerVolumeAttachmentScenario-1406476146 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-3d245956-b5de-448e-95be-85ea935d3ee3 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:01:01 devstack sudo[100954]: pam_unix(sudo:session): session closed for user root Jul 13 14:01:01 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-ac0b5c2f-2f60-4a45-aa77-87d5de28795a tempest-TestShelveInstance-1277930598 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-849033af-fc3f-4a27-aa35-51356ad1ede2" returned: 0 in 0.488s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:01:01 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-ac0b5c2f-2f60-4a45-aa77-87d5de28795a tempest-TestShelveInstance-1277930598 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-849033af-fc3f-4a27-aa35-51356ad1ede2 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:01:01 devstack sudo[100975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-3d245956-b5de-448e-95be-85ea935d3ee3 Jul 13 14:01:01 devstack sudo[100975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:01:02 devstack sudo[100977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-849033af-fc3f-4a27-aa35-51356ad1ede2 Jul 13 14:01:02 devstack sudo[100977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:01:02 devstack sudo[100975]: pam_unix(sudo:session): session closed for user root Jul 13 14:01:02 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [req-b0a106b7-37e8-4fe2-94b0-615c7eb7e994 req-6afebbd2-fe79-4998-a01b-192b14bdf7ca tempest-TestServerVolumeAttachmentScenario-1406476146 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-3d245956-b5de-448e-95be-85ea935d3ee3" returned: 0 in 0.515s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:01:02 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [req-b0a106b7-37e8-4fe2-94b0-615c7eb7e994 req-6afebbd2-fe79-4998-a01b-192b14bdf7ca tempest-TestServerVolumeAttachmentScenario-1406476146 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.538s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 14:01:02 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [req-b0a106b7-37e8-4fe2-94b0-615c7eb7e994 req-6afebbd2-fe79-4998-a01b-192b14bdf7ca tempest-TestServerVolumeAttachmentScenario-1406476146 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654', 'name': 'volume-3d245956-b5de-448e-95be-85ea935d3ee3', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c680fa16-49fe-4322-a799-e9fda7c44c5a', 'enforce_multipath': True} {{(pid=87098) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 13 14:01:02 devstack sudo[100977]: pam_unix(sudo:session): session closed for user root Jul 13 14:01:02 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-ac0b5c2f-2f60-4a45-aa77-87d5de28795a tempest-TestShelveInstance-1277930598 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-849033af-fc3f-4a27-aa35-51356ad1ede2" returned: 1 in 0.468s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:01:02 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-ac0b5c2f-2f60-4a45-aa77-87d5de28795a tempest-TestShelveInstance-1277930598 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-849033af-fc3f-4a27-aa35-51356ad1ede2' failed. Not Retrying. {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 13 14:01:02 devstack cinder-volume[87098]: DEBUG cinder.volume.volume_utils [None req-ac0b5c2f-2f60-4a45-aa77-87d5de28795a tempest-TestShelveInstance-1277930598 None] Downloaded image def20bd7-001f-4245-a717-37b9a4cc8574 ((None, [{'url': 'file:///opt/stack/data/glance/images/def20bd7-001f-4245-a717-37b9a4cc8574', 'metadata': {}}])) to volume 849033af-fc3f-4a27-aa35-51356ad1ede2 successfully. {{(pid=87098) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 13 14:01:02 devstack cinder-volume[87098]: DEBUG cinder.image.image_utils [None req-ac0b5c2f-2f60-4a45-aa77-87d5de28795a tempest-TestShelveInstance-1277930598 None] Temporary image def20bd7-001f-4245-a717-37b9a4cc8574 for user eac42b993ca94f6e9e73c63056745dfa is deleted. {{(pid=87098) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 13 14:01:02 devstack cinder-volume[87098]: DEBUG cinder.volume.volume_utils [None req-ac0b5c2f-2f60-4a45-aa77-87d5de28795a tempest-TestShelveInstance-1277930598 None] Marking volume 849033af-fc3f-4a27-aa35-51356ad1ede2 as bootable. {{(pid=87098) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 13 14:01:02 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac0b5c2f-2f60-4a45-aa77-87d5de28795a tempest-TestShelveInstance-1277930598 None] Copying metadata from image def20bd7-001f-4245-a717-37b9a4cc8574 to 849033af-fc3f-4a27-aa35-51356ad1ede2. {{(pid=87098) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 13 14:01:02 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac0b5c2f-2f60-4a45-aa77-87d5de28795a tempest-TestShelveInstance-1277930598 None] Creating volume glance metadata for volume 849033af-fc3f-4a27-aa35-51356ad1ede2 backed by image def20bd7-001f-4245-a717-37b9a4cc8574 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'def20bd7-001f-4245-a717-37b9a4cc8574', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87098) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 13 14:01:02 devstack cinder-volume[87098]: INFO cinder.volume.manager [req-b0a106b7-37e8-4fe2-94b0-615c7eb7e994 req-6afebbd2-fe79-4998-a01b-192b14bdf7ca tempest-TestServerVolumeAttachmentScenario-1406476146 None] attachment_update completed successfully. Jul 13 14:01:02 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-ac0b5c2f-2f60-4a45-aa77-87d5de28795a tempest-TestShelveInstance-1277930598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3dae1985-6181-430c-9eb8-e0f72adf02de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-849033af-fc3f-4a27-aa35-51356ad1ede2', 'volume_size': 1, 'image_id': 'def20bd7-001f-4245-a717-37b9a4cc8574', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/def20bd7-001f-4245-a717-37b9a4cc8574', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '2181cd3fc958400682584829a80e727e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'def20bd7-001f-4245-a717-37b9a4cc8574', 'created_at': datetime.datetime(2026, 7, 13, 11, 42, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 13, 11, 42, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/def20bd7-001f-4245-a717-37b9a4cc8574/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:01:02 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-ac0b5c2f-2f60-4a45-aa77-87d5de28795a tempest-TestShelveInstance-1277930598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc14de95-a3b0-4c4e-9e1c-ade8cd24f6d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:01:02 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-ac0b5c2f-2f60-4a45-aa77-87d5de28795a tempest-TestShelveInstance-1277930598 None] Volume volume-849033af-fc3f-4a27-aa35-51356ad1ede2 (849033af-fc3f-4a27-aa35-51356ad1ede2): created successfully Jul 13 14:01:02 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-ac0b5c2f-2f60-4a45-aa77-87d5de28795a tempest-TestShelveInstance-1277930598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc14de95-a3b0-4c4e-9e1c-ade8cd24f6d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:01:02 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-ac0b5c2f-2f60-4a45-aa77-87d5de28795a tempest-TestShelveInstance-1277930598 None] Flow 'volume_create_manager' (e63c686c-afdf-4283-a228-a462607cba14) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 14:01:02 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-ac0b5c2f-2f60-4a45-aa77-87d5de28795a tempest-TestShelveInstance-1277930598 None] Created volume successfully. Jul 13 14:01:04 devstack cinder-volume[87098]: INFO cinder.volume.manager [req-4174b839-2987-4d47-8e5c-d901032c9e40 req-69293f6d-0e72-4e9e-b31e-cb1dd22460ba tempest-TestServerVolumeAttachmentScenario-1406476146 None] Terminate volume connection completed successfully. Jul 13 14:01:04 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [req-4174b839-2987-4d47-8e5c-d901032c9e40 req-69293f6d-0e72-4e9e-b31e-cb1dd22460ba tempest-TestServerVolumeAttachmentScenario-1406476146 None] Deleting attachment c680fa16-49fe-4322-a799-e9fda7c44c5a. {{(pid=87098) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 13 14:01:06 devstack cinder-volume[87098]: INFO cinder.volume.manager [req-606505b9-867b-4bc2-b68b-17c1ee6ff20e req-afd56b08-435a-4717-a403-f236f1317835 tempest-TestServerVolumeAttachmentScenario-1406476146 None] Terminate volume connection completed successfully. Jul 13 14:01:06 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [req-606505b9-867b-4bc2-b68b-17c1ee6ff20e req-afd56b08-435a-4717-a403-f236f1317835 tempest-TestServerVolumeAttachmentScenario-1406476146 None] Deleting attachment 9e5d5061-3241-4d49-9179-7b2efc28db4c. {{(pid=87098) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 13 14:01:07 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [req-587e8276-d60a-4d21-9bd2-3ca0b14442db req-f8a8bcf6-755d-4e4d-99d1-0a5a9c735ac7 tempest-TestShelveInstance-1277930598 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 14:01:07 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [req-587e8276-d60a-4d21-9bd2-3ca0b14442db req-f8a8bcf6-755d-4e4d-99d1-0a5a9c735ac7 tempest-TestShelveInstance-1277930598 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 14:01:07 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5da01d8-419f-4604-b55a-a13f46c8e735]: (4, 'raw') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 14:01:07 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [req-587e8276-d60a-4d21-9bd2-3ca0b14442db req-f8a8bcf6-755d-4e4d-99d1-0a5a9c735ac7 tempest-TestShelveInstance-1277930598 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-849033af-fc3f-4a27-aa35-51356ad1ede2 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:01:07 devstack sudo[101105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-849033af-fc3f-4a27-aa35-51356ad1ede2 Jul 13 14:01:07 devstack sudo[101105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:01:08 devstack sudo[101105]: pam_unix(sudo:session): session closed for user root Jul 13 14:01:08 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [req-587e8276-d60a-4d21-9bd2-3ca0b14442db req-f8a8bcf6-755d-4e4d-99d1-0a5a9c735ac7 tempest-TestShelveInstance-1277930598 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-849033af-fc3f-4a27-aa35-51356ad1ede2" returned: 0 in 0.638s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:01:08 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [req-587e8276-d60a-4d21-9bd2-3ca0b14442db req-f8a8bcf6-755d-4e4d-99d1-0a5a9c735ac7 tempest-TestShelveInstance-1277930598 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-849033af-fc3f-4a27-aa35-51356ad1ede2 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:01:08 devstack sudo[101117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-849033af-fc3f-4a27-aa35-51356ad1ede2 Jul 13 14:01:08 devstack sudo[101117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:01:08 devstack sudo[101117]: pam_unix(sudo:session): session closed for user root Jul 13 14:01:08 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [req-587e8276-d60a-4d21-9bd2-3ca0b14442db req-f8a8bcf6-755d-4e4d-99d1-0a5a9c735ac7 tempest-TestShelveInstance-1277930598 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-849033af-fc3f-4a27-aa35-51356ad1ede2" returned: 1 in 0.790s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:01:08 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [req-587e8276-d60a-4d21-9bd2-3ca0b14442db req-f8a8bcf6-755d-4e4d-99d1-0a5a9c735ac7 tempest-TestShelveInstance-1277930598 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-849033af-fc3f-4a27-aa35-51356ad1ede2' failed. Not Retrying. {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 13 14:01:08 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [req-587e8276-d60a-4d21-9bd2-3ca0b14442db req-f8a8bcf6-755d-4e4d-99d1-0a5a9c735ac7 tempest-TestShelveInstance-1277930598 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.504s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 14:01:08 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [req-587e8276-d60a-4d21-9bd2-3ca0b14442db req-f8a8bcf6-755d-4e4d-99d1-0a5a9c735ac7 tempest-TestShelveInstance-1277930598 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654', 'name': 'volume-849033af-fc3f-4a27-aa35-51356ad1ede2', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b4104b8c-cdef-4d2a-ac4a-929f999fa25f', 'enforce_multipath': True} {{(pid=87098) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 13 14:01:09 devstack cinder-volume[87098]: INFO cinder.volume.manager [req-587e8276-d60a-4d21-9bd2-3ca0b14442db req-f8a8bcf6-755d-4e4d-99d1-0a5a9c735ac7 tempest-TestShelveInstance-1277930598 None] attachment_update completed successfully. Jul 13 14:01:14 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-86e48066-8a3e-4fbc-b960-406ca94c4a9e tempest-TestServerVolumeAttachmentScenario-1406476146 None] Acquiring lock "cinder-3d245956-b5de-448e-95be-85ea935d3ee3-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 14:01:14 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-86e48066-8a3e-4fbc-b960-406ca94c4a9e tempest-TestServerVolumeAttachmentScenario-1406476146 None] Lock "cinder-3d245956-b5de-448e-95be-85ea935d3ee3-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 14:01:14 devstack cinder-volume[87098]: DEBUG dbcounter [-] [87098] Writing DB stats cinder:UPDATE=92,cinder:SELECT=82,cinder:INSERT=33,cinder:DELETE=7 {{(pid=87098) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 13 14:01:14 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-86e48066-8a3e-4fbc-b960-406ca94c4a9e tempest-TestServerVolumeAttachmentScenario-1406476146 None] Acquiring lock "cinder-quobyte-3d245956-b5de-448e-95be-85ea935d3ee3" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 14:01:14 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-86e48066-8a3e-4fbc-b960-406ca94c4a9e tempest-TestServerVolumeAttachmentScenario-1406476146 None] Lock "cinder-quobyte-3d245956-b5de-448e-95be-85ea935d3ee3" acquired by "delete_volume" :: waited 0.020s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 14:01:14 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[045079ba-e9f7-4144-b8d0-2119a6a7e196]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 14:01:14 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-86e48066-8a3e-4fbc-b960-406ca94c4a9e tempest-TestServerVolumeAttachmentScenario-1406476146 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-3d245956-b5de-448e-95be-85ea935d3ee3 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:01:14 devstack sudo[101634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-3d245956-b5de-448e-95be-85ea935d3ee3 Jul 13 14:01:14 devstack sudo[101634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:01:14 devstack sudo[101634]: pam_unix(sudo:session): session closed for user root Jul 13 14:01:14 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-86e48066-8a3e-4fbc-b960-406ca94c4a9e tempest-TestServerVolumeAttachmentScenario-1406476146 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-3d245956-b5de-448e-95be-85ea935d3ee3" returned: 0 in 0.510s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:01:14 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-86e48066-8a3e-4fbc-b960-406ca94c4a9e tempest-TestServerVolumeAttachmentScenario-1406476146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-3d245956-b5de-448e-95be-85ea935d3ee3 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:01:14 devstack sudo[101639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-3d245956-b5de-448e-95be-85ea935d3ee3 Jul 13 14:01:14 devstack sudo[101639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:01:15 devstack sudo[101639]: pam_unix(sudo:session): session closed for user root Jul 13 14:01:15 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-86e48066-8a3e-4fbc-b960-406ca94c4a9e tempest-TestServerVolumeAttachmentScenario-1406476146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-3d245956-b5de-448e-95be-85ea935d3ee3" returned: 0 in 0.303s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:01:15 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-86e48066-8a3e-4fbc-b960-406ca94c4a9e tempest-TestServerVolumeAttachmentScenario-1406476146 None] Lock "cinder-quobyte-3d245956-b5de-448e-95be-85ea935d3ee3" released by "delete_volume" :: held 0.893s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 14:01:15 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-86e48066-8a3e-4fbc-b960-406ca94c4a9e tempest-TestServerVolumeAttachmentScenario-1406476146 None] Created reservations ['0507c53e-f75b-4f0e-8cff-ba6e6c7e0cde', 'ad4b1401-a012-441b-803b-66f63f302ec2', '3682f22d-1269-461c-9e20-8fa775c04d72', '20123501-cefe-45b9-8d6f-bd0093652124'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 14:01:15 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-86e48066-8a3e-4fbc-b960-406ca94c4a9e tempest-TestServerVolumeAttachmentScenario-1406476146 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 14:01:15 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-86e48066-8a3e-4fbc-b960-406ca94c4a9e tempest-TestServerVolumeAttachmentScenario-1406476146 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 14:01:15 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-86e48066-8a3e-4fbc-b960-406ca94c4a9e tempest-TestServerVolumeAttachmentScenario-1406476146 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 14:01:15 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-86e48066-8a3e-4fbc-b960-406ca94c4a9e tempest-TestServerVolumeAttachmentScenario-1406476146 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 14:01:15 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-86e48066-8a3e-4fbc-b960-406ca94c4a9e tempest-TestServerVolumeAttachmentScenario-1406476146 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 14:01:15 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-86e48066-8a3e-4fbc-b960-406ca94c4a9e tempest-TestServerVolumeAttachmentScenario-1406476146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:01:15 devstack sudo[101643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 Jul 13 14:01:15 devstack sudo[101643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:01:15 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-64fb57a5-50ee-4f54-9964-c550af368cc3 tempest-TestServerVolumeAttachmentScenario-1406476146 None] Acquiring lock "cinder-5bdcac5e-f4f1-46d3-8f6e-b62987578e78-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 14:01:15 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-64fb57a5-50ee-4f54-9964-c550af368cc3 tempest-TestServerVolumeAttachmentScenario-1406476146 None] Lock "cinder-5bdcac5e-f4f1-46d3-8f6e-b62987578e78-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 14:01:15 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-64fb57a5-50ee-4f54-9964-c550af368cc3 tempest-TestServerVolumeAttachmentScenario-1406476146 None] Acquiring lock "cinder-quobyte-5bdcac5e-f4f1-46d3-8f6e-b62987578e78" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 14:01:15 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-64fb57a5-50ee-4f54-9964-c550af368cc3 tempest-TestServerVolumeAttachmentScenario-1406476146 None] Lock "cinder-quobyte-5bdcac5e-f4f1-46d3-8f6e-b62987578e78" acquired by "delete_volume" :: waited 0.023s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 14:01:15 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[d06fcea8-9b35-4d9e-b53c-0bc87fc6f322]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 14:01:15 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-64fb57a5-50ee-4f54-9964-c550af368cc3 tempest-TestServerVolumeAttachmentScenario-1406476146 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-5bdcac5e-f4f1-46d3-8f6e-b62987578e78 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:01:15 devstack sudo[101646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-5bdcac5e-f4f1-46d3-8f6e-b62987578e78 Jul 13 14:01:15 devstack sudo[101646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:01:16 devstack sudo[101643]: pam_unix(sudo:session): session closed for user root Jul 13 14:01:16 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-86e48066-8a3e-4fbc-b960-406ca94c4a9e tempest-TestServerVolumeAttachmentScenario-1406476146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78" returned: 0 in 0.657s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:01:16 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-86e48066-8a3e-4fbc-b960-406ca94c4a9e tempest-TestServerVolumeAttachmentScenario-1406476146 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 14:01:16 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-86e48066-8a3e-4fbc-b960-406ca94c4a9e tempest-TestServerVolumeAttachmentScenario-1406476146 None] Deleted volume successfully. Jul 13 14:01:16 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-86e48066-8a3e-4fbc-b960-406ca94c4a9e tempest-TestServerVolumeAttachmentScenario-1406476146 None] Lock "cinder-3d245956-b5de-448e-95be-85ea935d3ee3-delete_volume" released by "delete_volume" :: held 1.896s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 14:01:16 devstack sudo[101646]: pam_unix(sudo:session): session closed for user root Jul 13 14:01:16 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-64fb57a5-50ee-4f54-9964-c550af368cc3 tempest-TestServerVolumeAttachmentScenario-1406476146 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-5bdcac5e-f4f1-46d3-8f6e-b62987578e78" returned: 0 in 0.511s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:01:16 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-64fb57a5-50ee-4f54-9964-c550af368cc3 tempest-TestServerVolumeAttachmentScenario-1406476146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-5bdcac5e-f4f1-46d3-8f6e-b62987578e78 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:01:16 devstack sudo[101652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-5bdcac5e-f4f1-46d3-8f6e-b62987578e78 Jul 13 14:01:16 devstack sudo[101652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:01:16 devstack sudo[101652]: pam_unix(sudo:session): session closed for user root Jul 13 14:01:16 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-64fb57a5-50ee-4f54-9964-c550af368cc3 tempest-TestServerVolumeAttachmentScenario-1406476146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-5bdcac5e-f4f1-46d3-8f6e-b62987578e78" returned: 0 in 0.395s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:01:16 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-64fb57a5-50ee-4f54-9964-c550af368cc3 tempest-TestServerVolumeAttachmentScenario-1406476146 None] Lock "cinder-quobyte-5bdcac5e-f4f1-46d3-8f6e-b62987578e78" released by "delete_volume" :: held 0.976s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 14:01:16 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-64fb57a5-50ee-4f54-9964-c550af368cc3 tempest-TestServerVolumeAttachmentScenario-1406476146 None] Created reservations ['fcbe9313-a170-421a-ac15-1ad9cca8d986', 'd8ed2c86-ecc1-4b94-810b-541712baaf62', '5c61193b-96b1-466d-9999-a9655fb95d05', '795fb6a2-dbac-41e5-989a-08a7c0baa436'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 14:01:16 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-64fb57a5-50ee-4f54-9964-c550af368cc3 tempest-TestServerVolumeAttachmentScenario-1406476146 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 14:01:16 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-64fb57a5-50ee-4f54-9964-c550af368cc3 tempest-TestServerVolumeAttachmentScenario-1406476146 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 14:01:16 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-64fb57a5-50ee-4f54-9964-c550af368cc3 tempest-TestServerVolumeAttachmentScenario-1406476146 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 14:01:16 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-64fb57a5-50ee-4f54-9964-c550af368cc3 tempest-TestServerVolumeAttachmentScenario-1406476146 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 14:01:16 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-64fb57a5-50ee-4f54-9964-c550af368cc3 tempest-TestServerVolumeAttachmentScenario-1406476146 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 14:01:16 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-64fb57a5-50ee-4f54-9964-c550af368cc3 tempest-TestServerVolumeAttachmentScenario-1406476146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:01:17 devstack sudo[101657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 Jul 13 14:01:17 devstack sudo[101657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:01:17 devstack sudo[101657]: pam_unix(sudo:session): session closed for user root Jul 13 14:01:17 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-64fb57a5-50ee-4f54-9964-c550af368cc3 tempest-TestServerVolumeAttachmentScenario-1406476146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78" returned: 0 in 0.303s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:01:17 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-64fb57a5-50ee-4f54-9964-c550af368cc3 tempest-TestServerVolumeAttachmentScenario-1406476146 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 14:01:17 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-64fb57a5-50ee-4f54-9964-c550af368cc3 tempest-TestServerVolumeAttachmentScenario-1406476146 None] Deleted volume successfully. Jul 13 14:01:17 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-64fb57a5-50ee-4f54-9964-c550af368cc3 tempest-TestServerVolumeAttachmentScenario-1406476146 None] Lock "cinder-5bdcac5e-f4f1-46d3-8f6e-b62987578e78-delete_volume" released by "delete_volume" :: held 1.733s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 14:01:21 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-cc7c6bb1-7c78-499b-bcb2-19b89091e7d2 tempest-VolumesNegativeTest-1089248346 None] Acquiring lock "cinder-9670eeea-1036-4d38-aeae-c2808114f2d1-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 14:01:21 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-cc7c6bb1-7c78-499b-bcb2-19b89091e7d2 tempest-VolumesNegativeTest-1089248346 None] Lock "cinder-9670eeea-1036-4d38-aeae-c2808114f2d1-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 14:01:21 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-cc7c6bb1-7c78-499b-bcb2-19b89091e7d2 tempest-VolumesNegativeTest-1089248346 None] Acquiring lock "cinder-quobyte-9670eeea-1036-4d38-aeae-c2808114f2d1" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 14:01:21 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-cc7c6bb1-7c78-499b-bcb2-19b89091e7d2 tempest-VolumesNegativeTest-1089248346 None] Lock "cinder-quobyte-9670eeea-1036-4d38-aeae-c2808114f2d1" acquired by "delete_volume" :: waited 0.025s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 14:01:21 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c603870-d733-4aee-b053-7514edd8417f]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 14:01:21 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-cc7c6bb1-7c78-499b-bcb2-19b89091e7d2 tempest-VolumesNegativeTest-1089248346 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-9670eeea-1036-4d38-aeae-c2808114f2d1 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:01:21 devstack sudo[101671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-9670eeea-1036-4d38-aeae-c2808114f2d1 Jul 13 14:01:21 devstack sudo[101671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:01:22 devstack sudo[101671]: pam_unix(sudo:session): session closed for user root Jul 13 14:01:22 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-cc7c6bb1-7c78-499b-bcb2-19b89091e7d2 tempest-VolumesNegativeTest-1089248346 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-9670eeea-1036-4d38-aeae-c2808114f2d1" returned: 0 in 0.570s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:01:22 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-cc7c6bb1-7c78-499b-bcb2-19b89091e7d2 tempest-VolumesNegativeTest-1089248346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-9670eeea-1036-4d38-aeae-c2808114f2d1 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:01:22 devstack sudo[101676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-9670eeea-1036-4d38-aeae-c2808114f2d1 Jul 13 14:01:22 devstack sudo[101676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:01:22 devstack sudo[101676]: pam_unix(sudo:session): session closed for user root Jul 13 14:01:22 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-cc7c6bb1-7c78-499b-bcb2-19b89091e7d2 tempest-VolumesNegativeTest-1089248346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-9670eeea-1036-4d38-aeae-c2808114f2d1" returned: 0 in 0.312s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:01:22 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-cc7c6bb1-7c78-499b-bcb2-19b89091e7d2 tempest-VolumesNegativeTest-1089248346 None] Lock "cinder-quobyte-9670eeea-1036-4d38-aeae-c2808114f2d1" released by "delete_volume" :: held 0.932s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 14:01:22 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-cc7c6bb1-7c78-499b-bcb2-19b89091e7d2 tempest-VolumesNegativeTest-1089248346 None] Created reservations ['1e062789-fba8-44ee-a56a-c6311a59cd2f', 'ea33b753-5cdb-440d-a923-f51f5e66d644', 'c790ec72-1243-429d-b160-d8f6a0406ef7', 'ade323ed-f3e1-4385-ba5d-685069440e0f'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 14:01:22 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-cc7c6bb1-7c78-499b-bcb2-19b89091e7d2 tempest-VolumesNegativeTest-1089248346 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 14:01:22 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-cc7c6bb1-7c78-499b-bcb2-19b89091e7d2 tempest-VolumesNegativeTest-1089248346 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 14:01:22 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-cc7c6bb1-7c78-499b-bcb2-19b89091e7d2 tempest-VolumesNegativeTest-1089248346 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 14:01:22 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-cc7c6bb1-7c78-499b-bcb2-19b89091e7d2 tempest-VolumesNegativeTest-1089248346 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 14:01:22 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-cc7c6bb1-7c78-499b-bcb2-19b89091e7d2 tempest-VolumesNegativeTest-1089248346 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 14:01:22 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-cc7c6bb1-7c78-499b-bcb2-19b89091e7d2 tempest-VolumesNegativeTest-1089248346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:01:22 devstack sudo[101679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 Jul 13 14:01:22 devstack sudo[101679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:01:23 devstack sudo[101679]: pam_unix(sudo:session): session closed for user root Jul 13 14:01:23 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-cc7c6bb1-7c78-499b-bcb2-19b89091e7d2 tempest-VolumesNegativeTest-1089248346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78" returned: 0 in 0.500s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:01:23 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-cc7c6bb1-7c78-499b-bcb2-19b89091e7d2 tempest-VolumesNegativeTest-1089248346 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 14:01:23 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-cc7c6bb1-7c78-499b-bcb2-19b89091e7d2 tempest-VolumesNegativeTest-1089248346 None] Deleted volume successfully. Jul 13 14:01:23 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-cc7c6bb1-7c78-499b-bcb2-19b89091e7d2 tempest-VolumesNegativeTest-1089248346 None] Lock "cinder-9670eeea-1036-4d38-aeae-c2808114f2d1-delete_volume" released by "delete_volume" :: held 1.734s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 14:01:29 devstack cinder-volume[87098]: DEBUG oslo_service.periodic_task [None req-727a1692-ea28-4a77-b327-0d94e8f01efb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87098) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 13 14:01:29 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-727a1692-ea28-4a77-b327-0d94e8f01efb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 14:01:29 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-727a1692-ea28-4a77-b327-0d94e8f01efb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 14:01:29 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-727a1692-ea28-4a77-b327-0d94e8f01efb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 14:01:29 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-727a1692-ea28-4a77-b327-0d94e8f01efb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 14:01:29 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-727a1692-ea28-4a77-b327-0d94e8f01efb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 14:01:29 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-727a1692-ea28-4a77-b327-0d94e8f01efb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:01:29 devstack sudo[101686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 Jul 13 14:01:29 devstack sudo[101686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:01:29 devstack sudo[101686]: pam_unix(sudo:session): session closed for user root Jul 13 14:01:29 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-727a1692-ea28-4a77-b327-0d94e8f01efb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78" returned: 0 in 0.342s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:01:29 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-727a1692-ea28-4a77-b327-0d94e8f01efb None None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 14:01:29 devstack cinder-volume[87098]: DEBUG oslo_service.periodic_task [None req-727a1692-ea28-4a77-b327-0d94e8f01efb None None] Running periodic task VolumeManager._thread_info {{(pid=87098) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 13 14:01:29 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-727a1692-ea28-4a77-b327-0d94e8f01efb None None] thread count: 28 {{(pid=87098) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 13 14:01:29 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-727a1692-ea28-4a77-b327-0d94e8f01efb None None] thread info: [<_MainThread(MainThread, started 127988054597760)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87098) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 13 14:01:32 devstack cinder-volume[87098]: DEBUG dbcounter [-] [87098] Writing DB stats cinder:SELECT=72,cinder:UPDATE=69,cinder:INSERT=27,cinder:DELETE=4 {{(pid=87098) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 13 14:01:33 devstack cinder-volume[87098]: DEBUG dbcounter [-] [87098] Writing DB stats cinder:SELECT=15,cinder:INSERT=5,cinder:UPDATE=20,cinder:DELETE=2 {{(pid=87098) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 13 14:01:48 devstack cinder-volume[87098]: INFO cinder.volume.manager [req-d38f7c3e-4179-46a0-adcc-004238f46965 req-6fc96ab0-8912-4230-a6b8-7d9f4df96e92 tempest-TestShelveInstance-1277930598 None] Terminate volume connection completed successfully. Jul 13 14:01:48 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [req-d38f7c3e-4179-46a0-adcc-004238f46965 req-6fc96ab0-8912-4230-a6b8-7d9f4df96e92 tempest-TestShelveInstance-1277930598 None] Deleting attachment b4104b8c-cdef-4d2a-ac4a-929f999fa25f. {{(pid=87098) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 13 14:01:50 devstack cinder-volume[87098]: DEBUG dbcounter [-] [87098] Writing DB stats cinder:SELECT=1 {{(pid=87098) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 13 14:01:51 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [req-fc162cc8-3795-4275-9eb6-5b83f304e769 req-6474a4e8-daac-4651-9037-22f801eeea07 tempest-TestShelveInstance-1277930598 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 14:01:51 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [req-fc162cc8-3795-4275-9eb6-5b83f304e769 req-6474a4e8-daac-4651-9037-22f801eeea07 tempest-TestShelveInstance-1277930598 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 14:01:51 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[392be11c-928a-4604-afea-86cf88e03daf]: (4, 'raw') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 14:01:51 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [req-fc162cc8-3795-4275-9eb6-5b83f304e769 req-6474a4e8-daac-4651-9037-22f801eeea07 tempest-TestShelveInstance-1277930598 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-849033af-fc3f-4a27-aa35-51356ad1ede2 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:01:51 devstack sudo[101831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-849033af-fc3f-4a27-aa35-51356ad1ede2 Jul 13 14:01:51 devstack sudo[101831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:01:52 devstack sudo[101831]: pam_unix(sudo:session): session closed for user root Jul 13 14:01:52 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [req-fc162cc8-3795-4275-9eb6-5b83f304e769 req-6474a4e8-daac-4651-9037-22f801eeea07 tempest-TestShelveInstance-1277930598 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-849033af-fc3f-4a27-aa35-51356ad1ede2" returned: 0 in 0.423s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:01:52 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [req-fc162cc8-3795-4275-9eb6-5b83f304e769 req-6474a4e8-daac-4651-9037-22f801eeea07 tempest-TestShelveInstance-1277930598 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-849033af-fc3f-4a27-aa35-51356ad1ede2 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:01:52 devstack sudo[101835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-849033af-fc3f-4a27-aa35-51356ad1ede2 Jul 13 14:01:52 devstack sudo[101835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:01:52 devstack sudo[101835]: pam_unix(sudo:session): session closed for user root Jul 13 14:01:52 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [req-fc162cc8-3795-4275-9eb6-5b83f304e769 req-6474a4e8-daac-4651-9037-22f801eeea07 tempest-TestShelveInstance-1277930598 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-849033af-fc3f-4a27-aa35-51356ad1ede2" returned: 1 in 0.445s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:01:52 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [req-fc162cc8-3795-4275-9eb6-5b83f304e769 req-6474a4e8-daac-4651-9037-22f801eeea07 tempest-TestShelveInstance-1277930598 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-849033af-fc3f-4a27-aa35-51356ad1ede2' failed. Not Retrying. {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 13 14:01:52 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [req-fc162cc8-3795-4275-9eb6-5b83f304e769 req-6474a4e8-daac-4651-9037-22f801eeea07 tempest-TestShelveInstance-1277930598 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.920s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 14:01:52 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [req-fc162cc8-3795-4275-9eb6-5b83f304e769 req-6474a4e8-daac-4651-9037-22f801eeea07 tempest-TestShelveInstance-1277930598 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654', 'name': 'volume-849033af-fc3f-4a27-aa35-51356ad1ede2', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3fbd5fba-5770-4a8a-a5e8-e555bf701fea', 'enforce_multipath': True} {{(pid=87098) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 13 14:01:52 devstack cinder-volume[87098]: INFO cinder.volume.manager [req-fc162cc8-3795-4275-9eb6-5b83f304e769 req-6474a4e8-daac-4651-9037-22f801eeea07 tempest-TestShelveInstance-1277930598 None] attachment_update completed successfully. Jul 13 14:02:02 devstack cinder-volume[87098]: DEBUG dbcounter [-] [87098] Writing DB stats cinder:SELECT=5,cinder:UPDATE=2 {{(pid=87098) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 13 14:02:02 devstack cinder-volume[87098]: DEBUG dbcounter [-] [87098] Writing DB stats cinder:UPDATE=2,cinder:SELECT=8 {{(pid=87098) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 13 14:02:04 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-62dffa07-11f1-4942-8de8-8c14cb981eff tempest-TestStampPattern-1316181496 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 14:02:04 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-62dffa07-11f1-4942-8de8-8c14cb981eff tempest-TestStampPattern-1316181496 None] Flow 'volume_create_manager' (a0aaed3d-f89a-4174-b4a4-cfcbfa26abbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 14:02:04 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-62dffa07-11f1-4942-8de8-8c14cb981eff tempest-TestStampPattern-1316181496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0365330e-82de-4c80-9e02-b9557f29253c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:02:04 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-62dffa07-11f1-4942-8de8-8c14cb981eff tempest-TestStampPattern-1316181496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0365330e-82de-4c80-9e02-b9557f29253c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T12:02:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-436200308',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55554bd4-18e8-4e7e-a946-d481530b3100,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db43e6824efd407ea5ad5d4b761ff6cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T12:02:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T12:02:05Z,use_quota=True,user_id='fb2d3d01859444e49f04a19f3bb842bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1147de8b-623b-426c-a13d-7fc824a80f67),volume_type_id=1147de8b-623b-426c-a13d-7fc824a80f67)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:02:04 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-62dffa07-11f1-4942-8de8-8c14cb981eff tempest-TestStampPattern-1316181496 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e03b077c-414f-426c-b16c-3a7a9696d4cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:02:04 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-62dffa07-11f1-4942-8de8-8c14cb981eff tempest-TestStampPattern-1316181496 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e03b077c-414f-426c-b16c-3a7a9696d4cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:02:04 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-62dffa07-11f1-4942-8de8-8c14cb981eff tempest-TestStampPattern-1316181496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (313daa92-4529-4b02-8bc8-e6d5e14762fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:02:04 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-62dffa07-11f1-4942-8de8-8c14cb981eff tempest-TestStampPattern-1316181496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (313daa92-4529-4b02-8bc8-e6d5e14762fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '55554bd4-18e8-4e7e-a946-d481530b3100', 'volume_name': 'volume-55554bd4-18e8-4e7e-a946-d481530b3100', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:02:04 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-62dffa07-11f1-4942-8de8-8c14cb981eff tempest-TestStampPattern-1316181496 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c95b64d-a537-4ab0-93bd-849c294c412d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:02:04 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-62dffa07-11f1-4942-8de8-8c14cb981eff tempest-TestStampPattern-1316181496 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c95b64d-a537-4ab0-93bd-849c294c412d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:02:04 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-62dffa07-11f1-4942-8de8-8c14cb981eff tempest-TestStampPattern-1316181496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5a2ddfc-d642-4f8b-af95-49e86ddc79fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:02:04 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-62dffa07-11f1-4942-8de8-8c14cb981eff tempest-TestStampPattern-1316181496 None] Volume 55554bd4-18e8-4e7e-a946-d481530b3100: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-55554bd4-18e8-4e7e-a946-d481530b3100', 'volume_size': 1} Jul 13 14:02:04 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-62dffa07-11f1-4942-8de8-8c14cb981eff tempest-TestStampPattern-1316181496 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 14:02:05 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-62dffa07-11f1-4942-8de8-8c14cb981eff tempest-TestStampPattern-1316181496 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 14:02:05 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-62dffa07-11f1-4942-8de8-8c14cb981eff tempest-TestStampPattern-1316181496 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T12:02:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-436200308',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55554bd4-18e8-4e7e-a946-d481530b3100,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db43e6824efd407ea5ad5d4b761ff6cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T12:02:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T12:02:05Z,use_quota=True,user_id='fb2d3d01859444e49f04a19f3bb842bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1147de8b-623b-426c-a13d-7fc824a80f67),volume_type_id=1147de8b-623b-426c-a13d-7fc824a80f67)}" {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 13 14:02:05 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-62dffa07-11f1-4942-8de8-8c14cb981eff tempest-TestStampPattern-1316181496 None] Creating volume 55554bd4-18e8-4e7e-a946-d481530b3100 {{(pid=87098) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 13 14:02:05 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-62dffa07-11f1-4942-8de8-8c14cb981eff tempest-TestStampPattern-1316181496 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 14:02:05 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-62dffa07-11f1-4942-8de8-8c14cb981eff tempest-TestStampPattern-1316181496 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 14:02:05 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-62dffa07-11f1-4942-8de8-8c14cb981eff tempest-TestStampPattern-1316181496 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 14:02:05 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-62dffa07-11f1-4942-8de8-8c14cb981eff tempest-TestStampPattern-1316181496 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 14:02:05 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-62dffa07-11f1-4942-8de8-8c14cb981eff tempest-TestStampPattern-1316181496 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 14:02:05 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-62dffa07-11f1-4942-8de8-8c14cb981eff tempest-TestStampPattern-1316181496 None] Selected osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 14:02:05 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-62dffa07-11f1-4942-8de8-8c14cb981eff tempest-TestStampPattern-1316181496 None] casted to osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 Jul 13 14:02:05 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-62dffa07-11f1-4942-8de8-8c14cb981eff tempest-TestStampPattern-1316181496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-55554bd4-18e8-4e7e-a946-d481530b3100 1073741824 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:02:05 devstack sudo[102389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-55554bd4-18e8-4e7e-a946-d481530b3100 1073741824 Jul 13 14:02:05 devstack sudo[102389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:02:05 devstack sudo[102389]: pam_unix(sudo:session): session closed for user root Jul 13 14:02:05 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-62dffa07-11f1-4942-8de8-8c14cb981eff tempest-TestStampPattern-1316181496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-55554bd4-18e8-4e7e-a946-d481530b3100 1073741824" returned: 0 in 0.811s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:02:05 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-62dffa07-11f1-4942-8de8-8c14cb981eff tempest-TestStampPattern-1316181496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-55554bd4-18e8-4e7e-a946-d481530b3100 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:02:05 devstack sudo[102395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-55554bd4-18e8-4e7e-a946-d481530b3100 Jul 13 14:02:05 devstack sudo[102395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:02:06 devstack sudo[102395]: pam_unix(sudo:session): session closed for user root Jul 13 14:02:06 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-62dffa07-11f1-4942-8de8-8c14cb981eff tempest-TestStampPattern-1316181496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-55554bd4-18e8-4e7e-a946-d481530b3100" returned: 0 in 0.539s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:02:06 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-62dffa07-11f1-4942-8de8-8c14cb981eff tempest-TestStampPattern-1316181496 None] <== create_volume: return (1441ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'} {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 13 14:02:06 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-62dffa07-11f1-4942-8de8-8c14cb981eff tempest-TestStampPattern-1316181496 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.444s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 14:02:06 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-62dffa07-11f1-4942-8de8-8c14cb981eff tempest-TestStampPattern-1316181496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5a2ddfc-d642-4f8b-af95-49e86ddc79fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-55554bd4-18e8-4e7e-a946-d481530b3100', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:02:06 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-62dffa07-11f1-4942-8de8-8c14cb981eff tempest-TestStampPattern-1316181496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89c76ca8-e7b2-4989-8fea-2afc3eb4a7f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:02:06 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-62dffa07-11f1-4942-8de8-8c14cb981eff tempest-TestStampPattern-1316181496 None] Volume volume-55554bd4-18e8-4e7e-a946-d481530b3100 (55554bd4-18e8-4e7e-a946-d481530b3100): created successfully Jul 13 14:02:06 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-62dffa07-11f1-4942-8de8-8c14cb981eff tempest-TestStampPattern-1316181496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89c76ca8-e7b2-4989-8fea-2afc3eb4a7f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:02:06 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-62dffa07-11f1-4942-8de8-8c14cb981eff tempest-TestStampPattern-1316181496 None] Flow 'volume_create_manager' (a0aaed3d-f89a-4174-b4a4-cfcbfa26abbe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 14:02:06 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-62dffa07-11f1-4942-8de8-8c14cb981eff tempest-TestStampPattern-1316181496 None] Created volume successfully. Jul 13 14:02:07 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-e0d40687-fbbf-47f3-a161-62a734c03e98 tempest-TestMinimumBasicScenario-720126083 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 14:02:07 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-e0d40687-fbbf-47f3-a161-62a734c03e98 tempest-TestMinimumBasicScenario-720126083 None] Flow 'volume_create_manager' (9320f711-710c-4507-a9d7-f8cac00dfa73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 14:02:07 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-e0d40687-fbbf-47f3-a161-62a734c03e98 tempest-TestMinimumBasicScenario-720126083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (160ea0b6-22a2-4dda-a160-4caba36b66ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:02:07 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-e0d40687-fbbf-47f3-a161-62a734c03e98 tempest-TestMinimumBasicScenario-720126083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (160ea0b6-22a2-4dda-a160-4caba36b66ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T12:02:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1202175232',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6fce93a-7e5c-4553-8c53-3e4e68085e0c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0a9febcb589436ab8acde2b70edc094',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T12:02:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T12:02:07Z,use_quota=True,user_id='365c3148408e4f05b67b23d417f1447e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1147de8b-623b-426c-a13d-7fc824a80f67),volume_type_id=1147de8b-623b-426c-a13d-7fc824a80f67)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:02:07 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-e0d40687-fbbf-47f3-a161-62a734c03e98 tempest-TestMinimumBasicScenario-720126083 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4021a49-866f-413c-88fb-e6c4fcd18cbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:02:07 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-e0d40687-fbbf-47f3-a161-62a734c03e98 tempest-TestMinimumBasicScenario-720126083 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4021a49-866f-413c-88fb-e6c4fcd18cbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:02:07 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-e0d40687-fbbf-47f3-a161-62a734c03e98 tempest-TestMinimumBasicScenario-720126083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9681173-44e4-40a9-99e7-16421f7031c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:02:07 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-e0d40687-fbbf-47f3-a161-62a734c03e98 tempest-TestMinimumBasicScenario-720126083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9681173-44e4-40a9-99e7-16421f7031c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b6fce93a-7e5c-4553-8c53-3e4e68085e0c', 'volume_name': 'volume-b6fce93a-7e5c-4553-8c53-3e4e68085e0c', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:02:07 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-e0d40687-fbbf-47f3-a161-62a734c03e98 tempest-TestMinimumBasicScenario-720126083 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2829147d-0905-4f37-b4b8-482577730127) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:02:07 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-e0d40687-fbbf-47f3-a161-62a734c03e98 tempest-TestMinimumBasicScenario-720126083 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2829147d-0905-4f37-b4b8-482577730127) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:02:07 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-e0d40687-fbbf-47f3-a161-62a734c03e98 tempest-TestMinimumBasicScenario-720126083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc9b047a-afef-4cf4-ad7a-ecd212c02202) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:02:07 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-e0d40687-fbbf-47f3-a161-62a734c03e98 tempest-TestMinimumBasicScenario-720126083 None] Volume b6fce93a-7e5c-4553-8c53-3e4e68085e0c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b6fce93a-7e5c-4553-8c53-3e4e68085e0c', 'volume_size': 1} Jul 13 14:02:07 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-e0d40687-fbbf-47f3-a161-62a734c03e98 tempest-TestMinimumBasicScenario-720126083 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 14:02:07 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-e0d40687-fbbf-47f3-a161-62a734c03e98 tempest-TestMinimumBasicScenario-720126083 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 14:02:07 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-e0d40687-fbbf-47f3-a161-62a734c03e98 tempest-TestMinimumBasicScenario-720126083 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T12:02:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1202175232',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6fce93a-7e5c-4553-8c53-3e4e68085e0c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0a9febcb589436ab8acde2b70edc094',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T12:02:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T12:02:07Z,use_quota=True,user_id='365c3148408e4f05b67b23d417f1447e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1147de8b-623b-426c-a13d-7fc824a80f67),volume_type_id=1147de8b-623b-426c-a13d-7fc824a80f67)}" {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 13 14:02:07 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-e0d40687-fbbf-47f3-a161-62a734c03e98 tempest-TestMinimumBasicScenario-720126083 None] Creating volume b6fce93a-7e5c-4553-8c53-3e4e68085e0c {{(pid=87098) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 13 14:02:07 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-e0d40687-fbbf-47f3-a161-62a734c03e98 tempest-TestMinimumBasicScenario-720126083 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 14:02:07 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-e0d40687-fbbf-47f3-a161-62a734c03e98 tempest-TestMinimumBasicScenario-720126083 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 14:02:07 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-e0d40687-fbbf-47f3-a161-62a734c03e98 tempest-TestMinimumBasicScenario-720126083 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 14:02:07 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-e0d40687-fbbf-47f3-a161-62a734c03e98 tempest-TestMinimumBasicScenario-720126083 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 14:02:07 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-e0d40687-fbbf-47f3-a161-62a734c03e98 tempest-TestMinimumBasicScenario-720126083 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 14:02:07 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-e0d40687-fbbf-47f3-a161-62a734c03e98 tempest-TestMinimumBasicScenario-720126083 None] Selected osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 14:02:07 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-e0d40687-fbbf-47f3-a161-62a734c03e98 tempest-TestMinimumBasicScenario-720126083 None] casted to osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 Jul 13 14:02:07 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-e0d40687-fbbf-47f3-a161-62a734c03e98 tempest-TestMinimumBasicScenario-720126083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-b6fce93a-7e5c-4553-8c53-3e4e68085e0c 1073741824 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:02:07 devstack sudo[102402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-b6fce93a-7e5c-4553-8c53-3e4e68085e0c 1073741824 Jul 13 14:02:07 devstack sudo[102402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:02:08 devstack sudo[102402]: pam_unix(sudo:session): session closed for user root Jul 13 14:02:08 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-e0d40687-fbbf-47f3-a161-62a734c03e98 tempest-TestMinimumBasicScenario-720126083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-b6fce93a-7e5c-4553-8c53-3e4e68085e0c 1073741824" returned: 0 in 0.649s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:02:08 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-e0d40687-fbbf-47f3-a161-62a734c03e98 tempest-TestMinimumBasicScenario-720126083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-b6fce93a-7e5c-4553-8c53-3e4e68085e0c {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:02:08 devstack sudo[102408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-b6fce93a-7e5c-4553-8c53-3e4e68085e0c Jul 13 14:02:08 devstack sudo[102408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:02:08 devstack sudo[102408]: pam_unix(sudo:session): session closed for user root Jul 13 14:02:08 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-e0d40687-fbbf-47f3-a161-62a734c03e98 tempest-TestMinimumBasicScenario-720126083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-b6fce93a-7e5c-4553-8c53-3e4e68085e0c" returned: 0 in 0.374s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:02:08 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-e0d40687-fbbf-47f3-a161-62a734c03e98 tempest-TestMinimumBasicScenario-720126083 None] <== create_volume: return (1096ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'} {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 13 14:02:08 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-e0d40687-fbbf-47f3-a161-62a734c03e98 tempest-TestMinimumBasicScenario-720126083 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.101s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 14:02:08 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-e0d40687-fbbf-47f3-a161-62a734c03e98 tempest-TestMinimumBasicScenario-720126083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc9b047a-afef-4cf4-ad7a-ecd212c02202) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b6fce93a-7e5c-4553-8c53-3e4e68085e0c', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:02:08 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-e0d40687-fbbf-47f3-a161-62a734c03e98 tempest-TestMinimumBasicScenario-720126083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01db2416-a73e-49f0-b43c-7e561f14bcc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:02:08 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-e0d40687-fbbf-47f3-a161-62a734c03e98 tempest-TestMinimumBasicScenario-720126083 None] Volume volume-b6fce93a-7e5c-4553-8c53-3e4e68085e0c (b6fce93a-7e5c-4553-8c53-3e4e68085e0c): created successfully Jul 13 14:02:08 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-e0d40687-fbbf-47f3-a161-62a734c03e98 tempest-TestMinimumBasicScenario-720126083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01db2416-a73e-49f0-b43c-7e561f14bcc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:02:08 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-e0d40687-fbbf-47f3-a161-62a734c03e98 tempest-TestMinimumBasicScenario-720126083 None] Flow 'volume_create_manager' (9320f711-710c-4507-a9d7-f8cac00dfa73) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 14:02:08 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-e0d40687-fbbf-47f3-a161-62a734c03e98 tempest-TestMinimumBasicScenario-720126083 None] Created volume successfully. Jul 13 14:02:11 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [req-c513a371-7db2-4b90-beb6-059beea16097 req-251013ed-a8f5-422b-adc9-d4a46542efd0 tempest-TestMinimumBasicScenario-720126083 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 14:02:11 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [req-c513a371-7db2-4b90-beb6-059beea16097 req-251013ed-a8f5-422b-adc9-d4a46542efd0 tempest-TestMinimumBasicScenario-720126083 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 14:02:11 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[e99524c6-a467-4f85-a4f2-db734a3567ea]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 14:02:11 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [req-c513a371-7db2-4b90-beb6-059beea16097 req-251013ed-a8f5-422b-adc9-d4a46542efd0 tempest-TestMinimumBasicScenario-720126083 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-b6fce93a-7e5c-4553-8c53-3e4e68085e0c {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:02:11 devstack sudo[102475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-b6fce93a-7e5c-4553-8c53-3e4e68085e0c Jul 13 14:02:11 devstack sudo[102475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:02:11 devstack sudo[102475]: pam_unix(sudo:session): session closed for user root Jul 13 14:02:11 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [req-c513a371-7db2-4b90-beb6-059beea16097 req-251013ed-a8f5-422b-adc9-d4a46542efd0 tempest-TestMinimumBasicScenario-720126083 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-b6fce93a-7e5c-4553-8c53-3e4e68085e0c" returned: 0 in 0.608s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:02:11 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [req-c513a371-7db2-4b90-beb6-059beea16097 req-251013ed-a8f5-422b-adc9-d4a46542efd0 tempest-TestMinimumBasicScenario-720126083 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.641s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 14:02:11 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [req-c513a371-7db2-4b90-beb6-059beea16097 req-251013ed-a8f5-422b-adc9-d4a46542efd0 tempest-TestMinimumBasicScenario-720126083 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654', 'name': 'volume-b6fce93a-7e5c-4553-8c53-3e4e68085e0c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'afdab17f-1b80-4fdb-8a60-dd6ed4e9da39', 'enforce_multipath': True} {{(pid=87098) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 13 14:02:12 devstack cinder-volume[87098]: INFO cinder.volume.manager [req-c513a371-7db2-4b90-beb6-059beea16097 req-251013ed-a8f5-422b-adc9-d4a46542efd0 tempest-TestMinimumBasicScenario-720126083 None] attachment_update completed successfully. Jul 13 14:02:21 devstack cinder-volume[87098]: DEBUG dbcounter [-] [87098] Writing DB stats cinder:UPDATE=11,cinder:SELECT=5,cinder:INSERT=1 {{(pid=87098) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 13 14:02:22 devstack cinder-volume[87098]: DEBUG dbcounter [-] [87098] Writing DB stats cinder:SELECT=14,cinder:INSERT=1,cinder:UPDATE=4,cinder:DELETE=2 {{(pid=87098) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 13 14:02:29 devstack cinder-volume[87098]: DEBUG oslo_service.periodic_task [None req-727a1692-ea28-4a77-b327-0d94e8f01efb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87098) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 13 14:02:29 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-727a1692-ea28-4a77-b327-0d94e8f01efb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 14:02:29 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-727a1692-ea28-4a77-b327-0d94e8f01efb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 14:02:29 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-727a1692-ea28-4a77-b327-0d94e8f01efb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 14:02:29 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-727a1692-ea28-4a77-b327-0d94e8f01efb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 14:02:29 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-727a1692-ea28-4a77-b327-0d94e8f01efb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 14:02:29 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-727a1692-ea28-4a77-b327-0d94e8f01efb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:02:29 devstack sudo[102626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 Jul 13 14:02:29 devstack sudo[102626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:02:29 devstack sudo[102626]: pam_unix(sudo:session): session closed for user root Jul 13 14:02:29 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-727a1692-ea28-4a77-b327-0d94e8f01efb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78" returned: 0 in 0.266s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:02:29 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-727a1692-ea28-4a77-b327-0d94e8f01efb None None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 14:02:29 devstack cinder-volume[87098]: DEBUG oslo_service.periodic_task [None req-727a1692-ea28-4a77-b327-0d94e8f01efb None None] Running periodic task VolumeManager._thread_info {{(pid=87098) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 13 14:02:29 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-727a1692-ea28-4a77-b327-0d94e8f01efb None None] thread count: 28 {{(pid=87098) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 13 14:02:29 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-727a1692-ea28-4a77-b327-0d94e8f01efb None None] thread info: [<_MainThread(MainThread, started 127988054597760)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87098) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 13 14:02:42 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [req-01c13384-18e5-4849-bea3-f279709e7eda req-336f4786-4ff7-441f-854f-d468c5dea055 tempest-TestStampPattern-1316181496 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 14:02:42 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [req-01c13384-18e5-4849-bea3-f279709e7eda req-336f4786-4ff7-441f-854f-d468c5dea055 tempest-TestStampPattern-1316181496 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 14:02:42 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[a24f2ad4-e2bb-4cc5-b497-a1554cada026]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 14:02:42 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [req-01c13384-18e5-4849-bea3-f279709e7eda req-336f4786-4ff7-441f-854f-d468c5dea055 tempest-TestStampPattern-1316181496 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-55554bd4-18e8-4e7e-a946-d481530b3100 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:02:42 devstack sudo[102716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-55554bd4-18e8-4e7e-a946-d481530b3100 Jul 13 14:02:42 devstack sudo[102716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:02:42 devstack sudo[102716]: pam_unix(sudo:session): session closed for user root Jul 13 14:02:43 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [req-01c13384-18e5-4849-bea3-f279709e7eda req-336f4786-4ff7-441f-854f-d468c5dea055 tempest-TestStampPattern-1316181496 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-55554bd4-18e8-4e7e-a946-d481530b3100" returned: 0 in 0.486s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:02:43 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [req-01c13384-18e5-4849-bea3-f279709e7eda req-336f4786-4ff7-441f-854f-d468c5dea055 tempest-TestStampPattern-1316181496 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.510s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 14:02:43 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [req-01c13384-18e5-4849-bea3-f279709e7eda req-336f4786-4ff7-441f-854f-d468c5dea055 tempest-TestStampPattern-1316181496 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654', 'name': 'volume-55554bd4-18e8-4e7e-a946-d481530b3100', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '57459948-8dce-4689-8f0c-23defae77cd7', 'enforce_multipath': True} {{(pid=87098) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 13 14:02:43 devstack cinder-volume[87098]: INFO cinder.volume.manager [req-01c13384-18e5-4849-bea3-f279709e7eda req-336f4786-4ff7-441f-854f-d468c5dea055 tempest-TestStampPattern-1316181496 None] attachment_update completed successfully. Jul 13 14:02:43 devstack cinder-volume[87098]: INFO cinder.volume.manager [req-61c14eb7-887e-47e3-abdf-2e86cb1892ac req-20a621c9-77af-4a61-bd43-4178c9241c31 tempest-TestShelveInstance-1277930598 None] Terminate volume connection completed successfully. Jul 13 14:02:43 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [req-61c14eb7-887e-47e3-abdf-2e86cb1892ac req-20a621c9-77af-4a61-bd43-4178c9241c31 tempest-TestShelveInstance-1277930598 None] Deleting attachment 3fbd5fba-5770-4a8a-a5e8-e555bf701fea. {{(pid=87098) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 13 14:02:43 devstack cinder-volume[87098]: DEBUG cinder.coordination [req-61c14eb7-887e-47e3-abdf-2e86cb1892ac req-f65b029f-72ee-4914-a06f-89170c46779a tempest-TestShelveInstance-1277930598 None] Acquiring lock "cinder-849033af-fc3f-4a27-aa35-51356ad1ede2-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 14:02:43 devstack cinder-volume[87098]: DEBUG cinder.coordination [req-61c14eb7-887e-47e3-abdf-2e86cb1892ac req-f65b029f-72ee-4914-a06f-89170c46779a tempest-TestShelveInstance-1277930598 None] Lock "cinder-849033af-fc3f-4a27-aa35-51356ad1ede2-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 14:02:43 devstack cinder-volume[87098]: DEBUG cinder.coordination [req-61c14eb7-887e-47e3-abdf-2e86cb1892ac req-f65b029f-72ee-4914-a06f-89170c46779a tempest-TestShelveInstance-1277930598 None] Acquiring lock "cinder-quobyte-849033af-fc3f-4a27-aa35-51356ad1ede2" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 14:02:44 devstack cinder-volume[87098]: DEBUG cinder.coordination [req-61c14eb7-887e-47e3-abdf-2e86cb1892ac req-f65b029f-72ee-4914-a06f-89170c46779a tempest-TestShelveInstance-1277930598 None] Lock "cinder-quobyte-849033af-fc3f-4a27-aa35-51356ad1ede2" acquired by "delete_volume" :: waited 0.030s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 14:02:44 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[30599709-5b8c-49f5-ac21-86c1ca3918c1]: (4, 'raw') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 14:02:44 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [req-61c14eb7-887e-47e3-abdf-2e86cb1892ac req-f65b029f-72ee-4914-a06f-89170c46779a tempest-TestShelveInstance-1277930598 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-849033af-fc3f-4a27-aa35-51356ad1ede2 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:02:44 devstack sudo[102726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-849033af-fc3f-4a27-aa35-51356ad1ede2 Jul 13 14:02:44 devstack sudo[102726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:02:44 devstack sudo[102726]: pam_unix(sudo:session): session closed for user root Jul 13 14:02:44 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [req-61c14eb7-887e-47e3-abdf-2e86cb1892ac req-f65b029f-72ee-4914-a06f-89170c46779a tempest-TestShelveInstance-1277930598 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-849033af-fc3f-4a27-aa35-51356ad1ede2" returned: 0 in 0.501s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:02:44 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [req-61c14eb7-887e-47e3-abdf-2e86cb1892ac req-f65b029f-72ee-4914-a06f-89170c46779a tempest-TestShelveInstance-1277930598 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-849033af-fc3f-4a27-aa35-51356ad1ede2 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:02:44 devstack sudo[102739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-849033af-fc3f-4a27-aa35-51356ad1ede2 Jul 13 14:02:44 devstack sudo[102739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:02:44 devstack sudo[102739]: pam_unix(sudo:session): session closed for user root Jul 13 14:02:44 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [req-61c14eb7-887e-47e3-abdf-2e86cb1892ac req-f65b029f-72ee-4914-a06f-89170c46779a tempest-TestShelveInstance-1277930598 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-849033af-fc3f-4a27-aa35-51356ad1ede2" returned: 1 in 0.405s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:02:44 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [req-61c14eb7-887e-47e3-abdf-2e86cb1892ac req-f65b029f-72ee-4914-a06f-89170c46779a tempest-TestShelveInstance-1277930598 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-849033af-fc3f-4a27-aa35-51356ad1ede2' failed. Not Retrying. {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 13 14:02:44 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [req-61c14eb7-887e-47e3-abdf-2e86cb1892ac req-f65b029f-72ee-4914-a06f-89170c46779a tempest-TestShelveInstance-1277930598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-849033af-fc3f-4a27-aa35-51356ad1ede2 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:02:45 devstack sudo[102745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-849033af-fc3f-4a27-aa35-51356ad1ede2 Jul 13 14:02:45 devstack sudo[102745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:02:45 devstack sudo[102745]: pam_unix(sudo:session): session closed for user root Jul 13 14:02:45 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [req-61c14eb7-887e-47e3-abdf-2e86cb1892ac req-f65b029f-72ee-4914-a06f-89170c46779a tempest-TestShelveInstance-1277930598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-849033af-fc3f-4a27-aa35-51356ad1ede2" returned: 0 in 0.296s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:02:45 devstack cinder-volume[87098]: DEBUG cinder.coordination [req-61c14eb7-887e-47e3-abdf-2e86cb1892ac req-f65b029f-72ee-4914-a06f-89170c46779a tempest-TestShelveInstance-1277930598 None] Lock "cinder-quobyte-849033af-fc3f-4a27-aa35-51356ad1ede2" released by "delete_volume" :: held 1.300s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 14:02:45 devstack cinder-volume[87098]: DEBUG cinder.quota [req-61c14eb7-887e-47e3-abdf-2e86cb1892ac req-f65b029f-72ee-4914-a06f-89170c46779a tempest-TestShelveInstance-1277930598 None] Created reservations ['64a7fe26-f2d6-44b0-95b4-1d480cebbf3a', 'b0577673-b31e-4ea3-b18c-73807dde7e3d', 'd9bf9012-3e75-402d-b54a-4d1843a555ad', '6c6f44b3-e396-431d-ae6c-44fde71352d2'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 14:02:45 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [req-61c14eb7-887e-47e3-abdf-2e86cb1892ac req-f65b029f-72ee-4914-a06f-89170c46779a tempest-TestShelveInstance-1277930598 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 14:02:45 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [req-61c14eb7-887e-47e3-abdf-2e86cb1892ac req-f65b029f-72ee-4914-a06f-89170c46779a tempest-TestShelveInstance-1277930598 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 14:02:45 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [req-61c14eb7-887e-47e3-abdf-2e86cb1892ac req-f65b029f-72ee-4914-a06f-89170c46779a tempest-TestShelveInstance-1277930598 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 14:02:45 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [req-61c14eb7-887e-47e3-abdf-2e86cb1892ac req-f65b029f-72ee-4914-a06f-89170c46779a tempest-TestShelveInstance-1277930598 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 14:02:45 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [req-61c14eb7-887e-47e3-abdf-2e86cb1892ac req-f65b029f-72ee-4914-a06f-89170c46779a tempest-TestShelveInstance-1277930598 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 14:02:45 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [req-61c14eb7-887e-47e3-abdf-2e86cb1892ac req-f65b029f-72ee-4914-a06f-89170c46779a tempest-TestShelveInstance-1277930598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:02:45 devstack sudo[102748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 Jul 13 14:02:45 devstack sudo[102748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:02:45 devstack sudo[102748]: pam_unix(sudo:session): session closed for user root Jul 13 14:02:45 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [req-61c14eb7-887e-47e3-abdf-2e86cb1892ac req-f65b029f-72ee-4914-a06f-89170c46779a tempest-TestShelveInstance-1277930598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78" returned: 0 in 0.294s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:02:45 devstack cinder-volume[87098]: DEBUG cinder.manager [req-61c14eb7-887e-47e3-abdf-2e86cb1892ac req-f65b029f-72ee-4914-a06f-89170c46779a tempest-TestShelveInstance-1277930598 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 14:02:45 devstack cinder-volume[87098]: INFO cinder.volume.manager [req-61c14eb7-887e-47e3-abdf-2e86cb1892ac req-f65b029f-72ee-4914-a06f-89170c46779a tempest-TestShelveInstance-1277930598 None] Deleted volume successfully. Jul 13 14:02:45 devstack cinder-volume[87098]: DEBUG cinder.coordination [req-61c14eb7-887e-47e3-abdf-2e86cb1892ac req-f65b029f-72ee-4914-a06f-89170c46779a tempest-TestShelveInstance-1277930598 None] Lock "cinder-849033af-fc3f-4a27-aa35-51356ad1ede2-delete_volume" released by "delete_volume" :: held 1.879s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 14:02:48 devstack cinder-volume[87098]: INFO cinder.volume.manager [req-3768f14f-c321-48f7-b426-0ae6f2b18eb8 req-ed638f6c-cc4a-4efc-8d91-640f50cf9be4 tempest-TestStampPattern-1316181496 None] Terminate volume connection completed successfully. Jul 13 14:02:48 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [req-3768f14f-c321-48f7-b426-0ae6f2b18eb8 req-ed638f6c-cc4a-4efc-8d91-640f50cf9be4 tempest-TestStampPattern-1316181496 None] Deleting attachment 57459948-8dce-4689-8f0c-23defae77cd7. {{(pid=87098) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 13 14:02:48 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-78180121-ba28-45f4-a4a9-2ad0a3f4ca5e tempest-TestStampPattern-1316181496 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 14:02:48 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-78180121-ba28-45f4-a4a9-2ad0a3f4ca5e tempest-TestStampPattern-1316181496 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 14:02:48 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-78180121-ba28-45f4-a4a9-2ad0a3f4ca5e tempest-TestStampPattern-1316181496 None] Creating offline snapshot 6125f572-4fef-487f-8525-ab2a63b79f3d of volume 55554bd4-18e8-4e7e-a946-d481530b3100 {{(pid=87098) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 13 14:02:48 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7e9bf90-066b-4143-9555-68e904ef81f6]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 14:02:48 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-78180121-ba28-45f4-a4a9-2ad0a3f4ca5e tempest-TestStampPattern-1316181496 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-55554bd4-18e8-4e7e-a946-d481530b3100 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:02:49 devstack sudo[102782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-55554bd4-18e8-4e7e-a946-d481530b3100 Jul 13 14:02:49 devstack sudo[102782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:02:49 devstack sudo[102782]: pam_unix(sudo:session): session closed for user root Jul 13 14:02:49 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-78180121-ba28-45f4-a4a9-2ad0a3f4ca5e tempest-TestStampPattern-1316181496 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-55554bd4-18e8-4e7e-a946-d481530b3100" returned: 0 in 0.555s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:02:49 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-78180121-ba28-45f4-a4a9-2ad0a3f4ca5e tempest-TestStampPattern-1316181496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-55554bd4-18e8-4e7e-a946-d481530b3100,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-55554bd4-18e8-4e7e-a946-d481530b3100.6125f572-4fef-487f-8525-ab2a63b79f3d 1G {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:02:49 devstack sudo[102787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-55554bd4-18e8-4e7e-a946-d481530b3100,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-55554bd4-18e8-4e7e-a946-d481530b3100.6125f572-4fef-487f-8525-ab2a63b79f3d 1G Jul 13 14:02:49 devstack sudo[102787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:02:50 devstack sudo[102787]: pam_unix(sudo:session): session closed for user root Jul 13 14:02:50 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-78180121-ba28-45f4-a4a9-2ad0a3f4ca5e tempest-TestStampPattern-1316181496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-55554bd4-18e8-4e7e-a946-d481530b3100,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-55554bd4-18e8-4e7e-a946-d481530b3100.6125f572-4fef-487f-8525-ab2a63b79f3d 1G" returned: 0 in 0.592s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:02:50 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-78180121-ba28-45f4-a4a9-2ad0a3f4ca5e tempest-TestStampPattern-1316181496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-55554bd4-18e8-4e7e-a946-d481530b3100 -F qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-55554bd4-18e8-4e7e-a946-d481530b3100.6125f572-4fef-487f-8525-ab2a63b79f3d {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:02:50 devstack sudo[102794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-55554bd4-18e8-4e7e-a946-d481530b3100 -F qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-55554bd4-18e8-4e7e-a946-d481530b3100.6125f572-4fef-487f-8525-ab2a63b79f3d Jul 13 14:02:50 devstack sudo[102794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:02:50 devstack sudo[102794]: pam_unix(sudo:session): session closed for user root Jul 13 14:02:50 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-78180121-ba28-45f4-a4a9-2ad0a3f4ca5e tempest-TestStampPattern-1316181496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-55554bd4-18e8-4e7e-a946-d481530b3100 -F qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-55554bd4-18e8-4e7e-a946-d481530b3100.6125f572-4fef-487f-8525-ab2a63b79f3d" returned: 0 in 0.334s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:02:50 devstack cinder-volume[87098]: WARNING cinder.volume.drivers.remotefs [None req-78180121-ba28-45f4-a4a9-2ad0a3f4ca5e tempest-TestStampPattern-1316181496 None] /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-55554bd4-18e8-4e7e-a946-d481530b3100.6125f572-4fef-487f-8525-ab2a63b79f3d is being set with open permissions: ugo+rw Jul 13 14:02:50 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-78180121-ba28-45f4-a4a9-2ad0a3f4ca5e tempest-TestStampPattern-1316181496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-55554bd4-18e8-4e7e-a946-d481530b3100.6125f572-4fef-487f-8525-ab2a63b79f3d {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:02:50 devstack sudo[102799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-55554bd4-18e8-4e7e-a946-d481530b3100.6125f572-4fef-487f-8525-ab2a63b79f3d Jul 13 14:02:50 devstack sudo[102799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:02:50 devstack sudo[102799]: pam_unix(sudo:session): session closed for user root Jul 13 14:02:50 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-78180121-ba28-45f4-a4a9-2ad0a3f4ca5e tempest-TestStampPattern-1316181496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-55554bd4-18e8-4e7e-a946-d481530b3100.6125f572-4fef-487f-8525-ab2a63b79f3d" returned: 0 in 0.375s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:02:50 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-78180121-ba28-45f4-a4a9-2ad0a3f4ca5e tempest-TestStampPattern-1316181496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-55554bd4-18e8-4e7e-a946-d481530b3100.info {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:02:50 devstack sudo[102803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-55554bd4-18e8-4e7e-a946-d481530b3100.info Jul 13 14:02:50 devstack sudo[102803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:02:51 devstack sudo[102803]: pam_unix(sudo:session): session closed for user root Jul 13 14:02:51 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-78180121-ba28-45f4-a4a9-2ad0a3f4ca5e tempest-TestStampPattern-1316181496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-55554bd4-18e8-4e7e-a946-d481530b3100.info" returned: 0 in 0.323s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:02:51 devstack cinder-volume[87098]: WARNING cinder.volume.drivers.remotefs [None req-78180121-ba28-45f4-a4a9-2ad0a3f4ca5e tempest-TestStampPattern-1316181496 None] /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-55554bd4-18e8-4e7e-a946-d481530b3100.info is being set with open permissions: ugo+rw Jul 13 14:02:51 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-78180121-ba28-45f4-a4a9-2ad0a3f4ca5e tempest-TestStampPattern-1316181496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-55554bd4-18e8-4e7e-a946-d481530b3100.info {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:02:51 devstack sudo[102807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-55554bd4-18e8-4e7e-a946-d481530b3100.info Jul 13 14:02:51 devstack sudo[102807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:02:51 devstack sudo[102807]: pam_unix(sudo:session): session closed for user root Jul 13 14:02:51 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-78180121-ba28-45f4-a4a9-2ad0a3f4ca5e tempest-TestStampPattern-1316181496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-55554bd4-18e8-4e7e-a946-d481530b3100.info" returned: 0 in 0.246s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:02:51 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-78180121-ba28-45f4-a4a9-2ad0a3f4ca5e tempest-TestStampPattern-1316181496 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.573s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 14:02:51 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-78180121-ba28-45f4-a4a9-2ad0a3f4ca5e tempest-TestStampPattern-1316181496 None] Create snapshot completed successfully Jul 13 14:02:58 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-d73ec0b7-71f1-4ae5-9de4-7184ded9be72 tempest-CinderUnicodeTest-302130129 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 14:02:58 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-d73ec0b7-71f1-4ae5-9de4-7184ded9be72 tempest-CinderUnicodeTest-302130129 None] Flow 'volume_create_manager' (77738879-785f-4383-bb92-930eae68139e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 14:02:58 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-d73ec0b7-71f1-4ae5-9de4-7184ded9be72 tempest-CinderUnicodeTest-302130129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (152c4993-c6d8-4204-9a43-3f8133559c26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:02:58 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-d73ec0b7-71f1-4ae5-9de4-7184ded9be72 tempest-CinderUnicodeTest-302130129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (152c4993-c6d8-4204-9a43-3f8133559c26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T12:02:58Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=980e35f1-edc8-4d8b-ab6c-ad95665fbeca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='abbb0f7967af427d8e153ea9ad03090b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T12:02:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T12:02:58Z,use_quota=True,user_id='8dbc057b236a4f499e0419f37d90dac9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1147de8b-623b-426c-a13d-7fc824a80f67),volume_type_id=1147de8b-623b-426c-a13d-7fc824a80f67)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:02:58 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-d73ec0b7-71f1-4ae5-9de4-7184ded9be72 tempest-CinderUnicodeTest-302130129 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4417e50-1d77-41db-abcb-e755ea53a1e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:02:58 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-d73ec0b7-71f1-4ae5-9de4-7184ded9be72 tempest-CinderUnicodeTest-302130129 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4417e50-1d77-41db-abcb-e755ea53a1e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:02:58 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-d73ec0b7-71f1-4ae5-9de4-7184ded9be72 tempest-CinderUnicodeTest-302130129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2121d4f1-88c7-460c-adde-ed6fedbbcda7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:02:58 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-d73ec0b7-71f1-4ae5-9de4-7184ded9be72 tempest-CinderUnicodeTest-302130129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2121d4f1-88c7-460c-adde-ed6fedbbcda7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '980e35f1-edc8-4d8b-ab6c-ad95665fbeca', 'volume_name': 'volume-980e35f1-edc8-4d8b-ab6c-ad95665fbeca', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:02:58 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-d73ec0b7-71f1-4ae5-9de4-7184ded9be72 tempest-CinderUnicodeTest-302130129 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cfa48dba-34b1-43d2-98e5-0e95025b8911) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:02:58 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-d73ec0b7-71f1-4ae5-9de4-7184ded9be72 tempest-CinderUnicodeTest-302130129 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cfa48dba-34b1-43d2-98e5-0e95025b8911) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:02:58 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-d73ec0b7-71f1-4ae5-9de4-7184ded9be72 tempest-CinderUnicodeTest-302130129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e0f7268-0f0c-497c-aa48-ecef7bb256f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:02:58 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-d73ec0b7-71f1-4ae5-9de4-7184ded9be72 tempest-CinderUnicodeTest-302130129 None] Volume 980e35f1-edc8-4d8b-ab6c-ad95665fbeca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-980e35f1-edc8-4d8b-ab6c-ad95665fbeca', 'volume_size': 1} Jul 13 14:02:58 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-d73ec0b7-71f1-4ae5-9de4-7184ded9be72 tempest-CinderUnicodeTest-302130129 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 14:02:58 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-d73ec0b7-71f1-4ae5-9de4-7184ded9be72 tempest-CinderUnicodeTest-302130129 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 14:02:58 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-d73ec0b7-71f1-4ae5-9de4-7184ded9be72 tempest-CinderUnicodeTest-302130129 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T12:02:58Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=980e35f1-edc8-4d8b-ab6c-ad95665fbeca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='abbb0f7967af427d8e153ea9ad03090b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T12:02:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T12:02:58Z,use_quota=True,user_id='8dbc057b236a4f499e0419f37d90dac9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1147de8b-623b-426c-a13d-7fc824a80f67),volume_type_id=1147de8b-623b-426c-a13d-7fc824a80f67)}" {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 13 14:02:58 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-d73ec0b7-71f1-4ae5-9de4-7184ded9be72 tempest-CinderUnicodeTest-302130129 None] Creating volume 980e35f1-edc8-4d8b-ab6c-ad95665fbeca {{(pid=87098) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 13 14:02:58 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-d73ec0b7-71f1-4ae5-9de4-7184ded9be72 tempest-CinderUnicodeTest-302130129 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 14:02:58 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-d73ec0b7-71f1-4ae5-9de4-7184ded9be72 tempest-CinderUnicodeTest-302130129 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 14:02:58 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-d73ec0b7-71f1-4ae5-9de4-7184ded9be72 tempest-CinderUnicodeTest-302130129 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 14:02:58 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-d73ec0b7-71f1-4ae5-9de4-7184ded9be72 tempest-CinderUnicodeTest-302130129 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 14:02:58 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-d73ec0b7-71f1-4ae5-9de4-7184ded9be72 tempest-CinderUnicodeTest-302130129 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 14:02:58 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-d73ec0b7-71f1-4ae5-9de4-7184ded9be72 tempest-CinderUnicodeTest-302130129 None] Selected osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 14:02:58 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-d73ec0b7-71f1-4ae5-9de4-7184ded9be72 tempest-CinderUnicodeTest-302130129 None] casted to osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 Jul 13 14:02:58 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-d73ec0b7-71f1-4ae5-9de4-7184ded9be72 tempest-CinderUnicodeTest-302130129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-980e35f1-edc8-4d8b-ab6c-ad95665fbeca 1073741824 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:02:58 devstack sudo[102842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-980e35f1-edc8-4d8b-ab6c-ad95665fbeca 1073741824 Jul 13 14:02:58 devstack sudo[102842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:02:59 devstack sudo[102842]: pam_unix(sudo:session): session closed for user root Jul 13 14:02:59 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-d73ec0b7-71f1-4ae5-9de4-7184ded9be72 tempest-CinderUnicodeTest-302130129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-980e35f1-edc8-4d8b-ab6c-ad95665fbeca 1073741824" returned: 0 in 0.664s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:02:59 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-b49c2b77-7b8f-4ae2-bb80-f1458c02a760 tempest-TestStampPattern-1316181496 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 14:02:59 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-b49c2b77-7b8f-4ae2-bb80-f1458c02a760 tempest-TestStampPattern-1316181496 None] Flow 'volume_create_manager' (85177320-6c32-4e80-8983-349725ee1926) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 14:02:59 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-b49c2b77-7b8f-4ae2-bb80-f1458c02a760 tempest-TestStampPattern-1316181496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40d8ebf1-600a-4b56-85c6-a7e4a28a57ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:02:59 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-d73ec0b7-71f1-4ae5-9de4-7184ded9be72 tempest-CinderUnicodeTest-302130129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-980e35f1-edc8-4d8b-ab6c-ad95665fbeca {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:02:59 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-b49c2b77-7b8f-4ae2-bb80-f1458c02a760 tempest-TestStampPattern-1316181496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40d8ebf1-600a-4b56-85c6-a7e4a28a57ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T12:02:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-987003092',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eedbbce3-433b-4d33-ad8c-5a1d88c976c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db43e6824efd407ea5ad5d4b761ff6cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T12:02:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=6125f572-4fef-487f-8525-ab2a63b79f3d,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T12:02:59Z,use_quota=True,user_id='fb2d3d01859444e49f04a19f3bb842bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1147de8b-623b-426c-a13d-7fc824a80f67),volume_type_id=1147de8b-623b-426c-a13d-7fc824a80f67)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:02:59 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-b49c2b77-7b8f-4ae2-bb80-f1458c02a760 tempest-TestStampPattern-1316181496 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (108f096f-9bb0-4599-9c46-5574557e77e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:02:59 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-b49c2b77-7b8f-4ae2-bb80-f1458c02a760 tempest-TestStampPattern-1316181496 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (108f096f-9bb0-4599-9c46-5574557e77e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:02:59 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-b49c2b77-7b8f-4ae2-bb80-f1458c02a760 tempest-TestStampPattern-1316181496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e62cb41e-3afa-48c9-ac58-a58bcb026bf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:02:59 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-b49c2b77-7b8f-4ae2-bb80-f1458c02a760 tempest-TestStampPattern-1316181496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e62cb41e-3afa-48c9-ac58-a58bcb026bf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'eedbbce3-433b-4d33-ad8c-5a1d88c976c0', 'volume_name': 'volume-eedbbce3-433b-4d33-ad8c-5a1d88c976c0', 'volume_size': 1, 'snapshot_id': '6125f572-4fef-487f-8525-ab2a63b79f3d'}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:02:59 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-b49c2b77-7b8f-4ae2-bb80-f1458c02a760 tempest-TestStampPattern-1316181496 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cbbab61e-e8d3-4214-b01e-6c58903a1ae7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:02:59 devstack sudo[102848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-980e35f1-edc8-4d8b-ab6c-ad95665fbeca Jul 13 14:02:59 devstack sudo[102848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:02:59 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-b49c2b77-7b8f-4ae2-bb80-f1458c02a760 tempest-TestStampPattern-1316181496 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cbbab61e-e8d3-4214-b01e-6c58903a1ae7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:02:59 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-b49c2b77-7b8f-4ae2-bb80-f1458c02a760 tempest-TestStampPattern-1316181496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01e1897d-7657-4a55-884f-faaba70c5c60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:02:59 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-b49c2b77-7b8f-4ae2-bb80-f1458c02a760 tempest-TestStampPattern-1316181496 None] Volume eedbbce3-433b-4d33-ad8c-5a1d88c976c0: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-eedbbce3-433b-4d33-ad8c-5a1d88c976c0', 'volume_size': 1, 'snapshot_id': '6125f572-4fef-487f-8525-ab2a63b79f3d'} Jul 13 14:02:59 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-b49c2b77-7b8f-4ae2-bb80-f1458c02a760 tempest-TestStampPattern-1316181496 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 14:02:59 devstack sudo[102848]: pam_unix(sudo:session): session closed for user root Jul 13 14:02:59 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-d73ec0b7-71f1-4ae5-9de4-7184ded9be72 tempest-CinderUnicodeTest-302130129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-980e35f1-edc8-4d8b-ab6c-ad95665fbeca" returned: 0 in 0.325s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:02:59 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-d73ec0b7-71f1-4ae5-9de4-7184ded9be72 tempest-CinderUnicodeTest-302130129 None] <== create_volume: return (1081ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'} {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 13 14:02:59 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-d73ec0b7-71f1-4ae5-9de4-7184ded9be72 tempest-CinderUnicodeTest-302130129 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.084s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 14:02:59 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-b49c2b77-7b8f-4ae2-bb80-f1458c02a760 tempest-TestStampPattern-1316181496 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.230s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 14:02:59 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-b49c2b77-7b8f-4ae2-bb80-f1458c02a760 tempest-TestStampPattern-1316181496 None] Acquiring lock "cinder-quobyte-6125f572-4fef-487f-8525-ab2a63b79f3d-eedbbce3-433b-4d33-ad8c-5a1d88c976c0" by "_create_volume_from_snapshot" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 14:02:59 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-d73ec0b7-71f1-4ae5-9de4-7184ded9be72 tempest-CinderUnicodeTest-302130129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e0f7268-0f0c-497c-aa48-ecef7bb256f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-980e35f1-edc8-4d8b-ab6c-ad95665fbeca', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:02:59 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-d73ec0b7-71f1-4ae5-9de4-7184ded9be72 tempest-CinderUnicodeTest-302130129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97f07482-73ae-4dbe-becd-b00a8ca389f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:02:59 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-b49c2b77-7b8f-4ae2-bb80-f1458c02a760 tempest-TestStampPattern-1316181496 None] Lock "cinder-quobyte-6125f572-4fef-487f-8525-ab2a63b79f3d-eedbbce3-433b-4d33-ad8c-5a1d88c976c0" acquired by "_create_volume_from_snapshot" :: waited 0.034s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 14:02:59 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-b49c2b77-7b8f-4ae2-bb80-f1458c02a760 tempest-TestStampPattern-1316181496 None] Creating volume eedbbce3-433b-4d33-ad8c-5a1d88c976c0 from snapshot 6125f572-4fef-487f-8525-ab2a63b79f3d {{(pid=87098) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 13 14:02:59 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-b49c2b77-7b8f-4ae2-bb80-f1458c02a760 tempest-TestStampPattern-1316181496 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 14:02:59 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-b49c2b77-7b8f-4ae2-bb80-f1458c02a760 tempest-TestStampPattern-1316181496 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 14:02:59 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-b49c2b77-7b8f-4ae2-bb80-f1458c02a760 tempest-TestStampPattern-1316181496 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 14:02:59 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-b49c2b77-7b8f-4ae2-bb80-f1458c02a760 tempest-TestStampPattern-1316181496 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 14:02:59 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-b49c2b77-7b8f-4ae2-bb80-f1458c02a760 tempest-TestStampPattern-1316181496 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 14:02:59 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-b49c2b77-7b8f-4ae2-bb80-f1458c02a760 tempest-TestStampPattern-1316181496 None] Selected osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 14:02:59 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-b49c2b77-7b8f-4ae2-bb80-f1458c02a760 tempest-TestStampPattern-1316181496 None] Acquiring lock "cinder-quobyte-eedbbce3-433b-4d33-ad8c-5a1d88c976c0" by "_copy_volume_from_snapshot" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 14:02:59 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-d73ec0b7-71f1-4ae5-9de4-7184ded9be72 tempest-CinderUnicodeTest-302130129 None] Volume volume-980e35f1-edc8-4d8b-ab6c-ad95665fbeca (980e35f1-edc8-4d8b-ab6c-ad95665fbeca): created successfully Jul 13 14:02:59 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-d73ec0b7-71f1-4ae5-9de4-7184ded9be72 tempest-CinderUnicodeTest-302130129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97f07482-73ae-4dbe-becd-b00a8ca389f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:02:59 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-d73ec0b7-71f1-4ae5-9de4-7184ded9be72 tempest-CinderUnicodeTest-302130129 None] Flow 'volume_create_manager' (77738879-785f-4383-bb92-930eae68139e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 14:02:59 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-d73ec0b7-71f1-4ae5-9de4-7184ded9be72 tempest-CinderUnicodeTest-302130129 None] Created volume successfully. Jul 13 14:02:59 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-b49c2b77-7b8f-4ae2-bb80-f1458c02a760 tempest-TestStampPattern-1316181496 None] Lock "cinder-quobyte-eedbbce3-433b-4d33-ad8c-5a1d88c976c0" acquired by "_copy_volume_from_snapshot" :: waited 0.060s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 14:02:59 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-b49c2b77-7b8f-4ae2-bb80-f1458c02a760 tempest-TestStampPattern-1316181496 None] snapshot: 6125f572-4fef-487f-8525-ab2a63b79f3d, volume: eedbbce3-433b-4d33-ad8c-5a1d88c976c0, {{(pid=87098) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 13 14:02:59 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-b49c2b77-7b8f-4ae2-bb80-f1458c02a760 tempest-TestStampPattern-1316181496 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 14:02:59 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-b49c2b77-7b8f-4ae2-bb80-f1458c02a760 tempest-TestStampPattern-1316181496 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 14:02:59 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-b49c2b77-7b8f-4ae2-bb80-f1458c02a760 tempest-TestStampPattern-1316181496 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 14:02:59 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-b49c2b77-7b8f-4ae2-bb80-f1458c02a760 tempest-TestStampPattern-1316181496 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 14:02:59 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-b49c2b77-7b8f-4ae2-bb80-f1458c02a760 tempest-TestStampPattern-1316181496 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 14:02:59 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[0eeb5388-e325-4fb4-8202-9d1c1868251c]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 14:02:59 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-b49c2b77-7b8f-4ae2-bb80-f1458c02a760 tempest-TestStampPattern-1316181496 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-55554bd4-18e8-4e7e-a946-d481530b3100.6125f572-4fef-487f-8525-ab2a63b79f3d {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:02:59 devstack sudo[102851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-55554bd4-18e8-4e7e-a946-d481530b3100.6125f572-4fef-487f-8525-ab2a63b79f3d Jul 13 14:02:59 devstack sudo[102851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:03:00 devstack sudo[102851]: pam_unix(sudo:session): session closed for user root Jul 13 14:03:00 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-b49c2b77-7b8f-4ae2-bb80-f1458c02a760 tempest-TestStampPattern-1316181496 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-55554bd4-18e8-4e7e-a946-d481530b3100.6125f572-4fef-487f-8525-ab2a63b79f3d" returned: 0 in 0.418s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:03:00 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-b49c2b77-7b8f-4ae2-bb80-f1458c02a760 tempest-TestStampPattern-1316181496 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-55554bd4-18e8-4e7e-a946-d481530b3100(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87098) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 13 14:03:00 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-b49c2b77-7b8f-4ae2-bb80-f1458c02a760 tempest-TestStampPattern-1316181496 None] will copy from snapshot at /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-55554bd4-18e8-4e7e-a946-d481530b3100 {{(pid=87098) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 13 14:03:00 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-b49c2b77-7b8f-4ae2-bb80-f1458c02a760 tempest-TestStampPattern-1316181496 None] Creating direct copy from snapshot {{(pid=87098) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 13 14:03:00 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[f25cbeeb-db6d-4c68-9f27-67a58b21291f]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 14:03:00 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-b49c2b77-7b8f-4ae2-bb80-f1458c02a760 tempest-TestStampPattern-1316181496 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-55554bd4-18e8-4e7e-a946-d481530b3100 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:03:00 devstack sudo[102859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-55554bd4-18e8-4e7e-a946-d481530b3100 Jul 13 14:03:00 devstack sudo[102859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:03:00 devstack sudo[102859]: pam_unix(sudo:session): session closed for user root Jul 13 14:03:00 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-b49c2b77-7b8f-4ae2-bb80-f1458c02a760 tempest-TestStampPattern-1316181496 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-55554bd4-18e8-4e7e-a946-d481530b3100" returned: 0 in 0.392s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:03:00 devstack cinder-volume[87098]: DEBUG cinder.utils [None req-b49c2b77-7b8f-4ae2-bb80-f1458c02a760 tempest-TestStampPattern-1316181496 None] Path /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-eedbbce3-433b-4d33-ad8c-5a1d88c976c0 not found in is_blk_device check {{(pid=87098) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 13 14:03:00 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-b49c2b77-7b8f-4ae2-bb80-f1458c02a760 tempest-TestStampPattern-1316181496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-55554bd4-18e8-4e7e-a946-d481530b3100 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-eedbbce3-433b-4d33-ad8c-5a1d88c976c0 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:03:00 devstack sudo[102864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-55554bd4-18e8-4e7e-a946-d481530b3100 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-eedbbce3-433b-4d33-ad8c-5a1d88c976c0 Jul 13 14:03:00 devstack sudo[102864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:03:01 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-f7fffe38-a24f-4726-ae35-2003269b6896 tempest-CinderUnicodeTest-302130129 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 14:03:01 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-f7fffe38-a24f-4726-ae35-2003269b6896 tempest-CinderUnicodeTest-302130129 None] Flow 'volume_create_manager' (79cf0b4a-2d1e-4abf-b604-2540c6dabe8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 14:03:01 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-f7fffe38-a24f-4726-ae35-2003269b6896 tempest-CinderUnicodeTest-302130129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3fc68b41-4326-4cff-978c-6b5b7f867712) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:03:01 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-f7fffe38-a24f-4726-ae35-2003269b6896 tempest-CinderUnicodeTest-302130129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3fc68b41-4326-4cff-978c-6b5b7f867712) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T12:03:01Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-127453134',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=474c51e6-ee73-4dc4-8909-94bcaa02d532,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='abbb0f7967af427d8e153ea9ad03090b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T12:03:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T12:03:01Z,use_quota=True,user_id='8dbc057b236a4f499e0419f37d90dac9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1147de8b-623b-426c-a13d-7fc824a80f67),volume_type_id=1147de8b-623b-426c-a13d-7fc824a80f67)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:03:01 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-f7fffe38-a24f-4726-ae35-2003269b6896 tempest-CinderUnicodeTest-302130129 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d428d87-7d5e-45b4-9ba3-a33cc766f4db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:03:01 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-f7fffe38-a24f-4726-ae35-2003269b6896 tempest-CinderUnicodeTest-302130129 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d428d87-7d5e-45b4-9ba3-a33cc766f4db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:03:01 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-f7fffe38-a24f-4726-ae35-2003269b6896 tempest-CinderUnicodeTest-302130129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de33d1eb-b555-4996-b53d-3b115e4b365d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:03:01 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-f7fffe38-a24f-4726-ae35-2003269b6896 tempest-CinderUnicodeTest-302130129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de33d1eb-b555-4996-b53d-3b115e4b365d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '474c51e6-ee73-4dc4-8909-94bcaa02d532', 'volume_name': 'volume-474c51e6-ee73-4dc4-8909-94bcaa02d532', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:03:01 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-f7fffe38-a24f-4726-ae35-2003269b6896 tempest-CinderUnicodeTest-302130129 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (242347dc-f8e7-4b90-a304-49af9a979bde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:03:01 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-f7fffe38-a24f-4726-ae35-2003269b6896 tempest-CinderUnicodeTest-302130129 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (242347dc-f8e7-4b90-a304-49af9a979bde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:03:01 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-f7fffe38-a24f-4726-ae35-2003269b6896 tempest-CinderUnicodeTest-302130129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (feff7ed8-9e25-4a9e-995e-42f8f2bf99bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:03:01 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-f7fffe38-a24f-4726-ae35-2003269b6896 tempest-CinderUnicodeTest-302130129 None] Volume 474c51e6-ee73-4dc4-8909-94bcaa02d532: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-474c51e6-ee73-4dc4-8909-94bcaa02d532', 'volume_size': 1} Jul 13 14:03:01 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-f7fffe38-a24f-4726-ae35-2003269b6896 tempest-CinderUnicodeTest-302130129 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 14:03:07 devstack sudo[102864]: pam_unix(sudo:session): session closed for user root Jul 13 14:03:07 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-b49c2b77-7b8f-4ae2-bb80-f1458c02a760 tempest-TestStampPattern-1316181496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-55554bd4-18e8-4e7e-a946-d481530b3100 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-eedbbce3-433b-4d33-ad8c-5a1d88c976c0" returned: 0 in 6.575s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:03:07 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[dce2f935-532a-46c8-a405-0aab436eeef5]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 14:03:07 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-b49c2b77-7b8f-4ae2-bb80-f1458c02a760 tempest-TestStampPattern-1316181496 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-55554bd4-18e8-4e7e-a946-d481530b3100 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:03:07 devstack sudo[102896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-55554bd4-18e8-4e7e-a946-d481530b3100 Jul 13 14:03:07 devstack sudo[102896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:03:07 devstack sudo[102896]: pam_unix(sudo:session): session closed for user root Jul 13 14:03:07 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-b49c2b77-7b8f-4ae2-bb80-f1458c02a760 tempest-TestStampPattern-1316181496 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-55554bd4-18e8-4e7e-a946-d481530b3100" returned: 0 in 0.891s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:03:07 devstack cinder-volume[87098]: DEBUG cinder.image.image_utils [None req-b49c2b77-7b8f-4ae2-bb80-f1458c02a760 tempest-TestStampPattern-1316181496 None] Image conversion details: src /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-55554bd4-18e8-4e7e-a946-d481530b3100, size 1024.00 MB, duration 6.58 sec, destination /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-eedbbce3-433b-4d33-ad8c-5a1d88c976c0 {{(pid=87098) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 13 14:03:07 devstack cinder-volume[87098]: INFO cinder.image.image_utils [None req-b49c2b77-7b8f-4ae2-bb80-f1458c02a760 tempest-TestStampPattern-1316181496 None] Converted 1024.00 MB image at 155.71 MB/s Jul 13 14:03:07 devstack cinder-volume[87098]: WARNING cinder.volume.drivers.remotefs [None req-b49c2b77-7b8f-4ae2-bb80-f1458c02a760 tempest-TestStampPattern-1316181496 None] /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-eedbbce3-433b-4d33-ad8c-5a1d88c976c0 is being set with open permissions: ugo+rw Jul 13 14:03:07 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-b49c2b77-7b8f-4ae2-bb80-f1458c02a760 tempest-TestStampPattern-1316181496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-eedbbce3-433b-4d33-ad8c-5a1d88c976c0 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:03:08 devstack sudo[102917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-eedbbce3-433b-4d33-ad8c-5a1d88c976c0 Jul 13 14:03:08 devstack sudo[102917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:03:08 devstack sudo[102917]: pam_unix(sudo:session): session closed for user root Jul 13 14:03:08 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-b49c2b77-7b8f-4ae2-bb80-f1458c02a760 tempest-TestStampPattern-1316181496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-eedbbce3-433b-4d33-ad8c-5a1d88c976c0" returned: 0 in 0.321s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:03:08 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-b49c2b77-7b8f-4ae2-bb80-f1458c02a760 tempest-TestStampPattern-1316181496 None] Lock "cinder-quobyte-eedbbce3-433b-4d33-ad8c-5a1d88c976c0" released by "_copy_volume_from_snapshot" :: held 8.742s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 14:03:08 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-b49c2b77-7b8f-4ae2-bb80-f1458c02a760 tempest-TestStampPattern-1316181496 None] Lock "cinder-quobyte-6125f572-4fef-487f-8525-ab2a63b79f3d-eedbbce3-433b-4d33-ad8c-5a1d88c976c0" released by "_create_volume_from_snapshot" :: held 8.824s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 14:03:08 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-b49c2b77-7b8f-4ae2-bb80-f1458c02a760 tempest-TestStampPattern-1316181496 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.862s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 14:03:08 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-f7fffe38-a24f-4726-ae35-2003269b6896 tempest-CinderUnicodeTest-302130129 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.085s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 14:03:08 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-f7fffe38-a24f-4726-ae35-2003269b6896 tempest-CinderUnicodeTest-302130129 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T12:03:01Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-127453134',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=474c51e6-ee73-4dc4-8909-94bcaa02d532,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='abbb0f7967af427d8e153ea9ad03090b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T12:03:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T12:03:01Z,use_quota=True,user_id='8dbc057b236a4f499e0419f37d90dac9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1147de8b-623b-426c-a13d-7fc824a80f67),volume_type_id=1147de8b-623b-426c-a13d-7fc824a80f67)}" {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 13 14:03:08 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-f7fffe38-a24f-4726-ae35-2003269b6896 tempest-CinderUnicodeTest-302130129 None] Creating volume 474c51e6-ee73-4dc4-8909-94bcaa02d532 {{(pid=87098) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 13 14:03:08 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-f7fffe38-a24f-4726-ae35-2003269b6896 tempest-CinderUnicodeTest-302130129 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 14:03:08 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-f7fffe38-a24f-4726-ae35-2003269b6896 tempest-CinderUnicodeTest-302130129 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 14:03:08 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-f7fffe38-a24f-4726-ae35-2003269b6896 tempest-CinderUnicodeTest-302130129 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 14:03:08 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-f7fffe38-a24f-4726-ae35-2003269b6896 tempest-CinderUnicodeTest-302130129 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 14:03:08 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-f7fffe38-a24f-4726-ae35-2003269b6896 tempest-CinderUnicodeTest-302130129 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 14:03:08 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-f7fffe38-a24f-4726-ae35-2003269b6896 tempest-CinderUnicodeTest-302130129 None] Selected osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 14:03:08 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-f7fffe38-a24f-4726-ae35-2003269b6896 tempest-CinderUnicodeTest-302130129 None] casted to osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 Jul 13 14:03:08 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-f7fffe38-a24f-4726-ae35-2003269b6896 tempest-CinderUnicodeTest-302130129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-474c51e6-ee73-4dc4-8909-94bcaa02d532 1073741824 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:03:08 devstack sudo[102926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-474c51e6-ee73-4dc4-8909-94bcaa02d532 1073741824 Jul 13 14:03:08 devstack sudo[102926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:03:08 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-b49c2b77-7b8f-4ae2-bb80-f1458c02a760 tempest-TestStampPattern-1316181496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01e1897d-7657-4a55-884f-faaba70c5c60) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eedbbce3-433b-4d33-ad8c-5a1d88c976c0', 'volume_size': 1, 'snapshot_id': '6125f572-4fef-487f-8525-ab2a63b79f3d'}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:03:08 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-b49c2b77-7b8f-4ae2-bb80-f1458c02a760 tempest-TestStampPattern-1316181496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8962fac0-c8c0-4a9a-a351-a02d986a7f62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:03:08 devstack cinder-volume[87098]: INFO cinder.volume.manager [req-9ef7d2b8-de27-4f4c-8f92-5e3c522fbcc8 req-8afcb90c-6e4a-4c7e-a8fe-f7238e831efe tempest-TestMinimumBasicScenario-720126083 None] Terminate volume connection completed successfully. Jul 13 14:03:08 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [req-9ef7d2b8-de27-4f4c-8f92-5e3c522fbcc8 req-8afcb90c-6e4a-4c7e-a8fe-f7238e831efe tempest-TestMinimumBasicScenario-720126083 None] Deleting attachment afdab17f-1b80-4fdb-8a60-dd6ed4e9da39. {{(pid=87098) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 13 14:03:08 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-b49c2b77-7b8f-4ae2-bb80-f1458c02a760 tempest-TestStampPattern-1316181496 None] Volume volume-eedbbce3-433b-4d33-ad8c-5a1d88c976c0 (eedbbce3-433b-4d33-ad8c-5a1d88c976c0): created successfully Jul 13 14:03:08 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-b49c2b77-7b8f-4ae2-bb80-f1458c02a760 tempest-TestStampPattern-1316181496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8962fac0-c8c0-4a9a-a351-a02d986a7f62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:03:08 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-b49c2b77-7b8f-4ae2-bb80-f1458c02a760 tempest-TestStampPattern-1316181496 None] Flow 'volume_create_manager' (85177320-6c32-4e80-8983-349725ee1926) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 14:03:08 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-b49c2b77-7b8f-4ae2-bb80-f1458c02a760 tempest-TestStampPattern-1316181496 None] Created volume successfully. Jul 13 14:03:09 devstack sudo[102926]: pam_unix(sudo:session): session closed for user root Jul 13 14:03:09 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-f7fffe38-a24f-4726-ae35-2003269b6896 tempest-CinderUnicodeTest-302130129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-474c51e6-ee73-4dc4-8909-94bcaa02d532 1073741824" returned: 0 in 0.979s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:03:09 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-f7fffe38-a24f-4726-ae35-2003269b6896 tempest-CinderUnicodeTest-302130129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-474c51e6-ee73-4dc4-8909-94bcaa02d532 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:03:09 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-c96e7284-491d-464c-a8c3-2bfd25a8c603 tempest-TestMinimumBasicScenario-720126083 None] Acquiring lock "cinder-b6fce93a-7e5c-4553-8c53-3e4e68085e0c-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 14:03:09 devstack sudo[102966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-474c51e6-ee73-4dc4-8909-94bcaa02d532 Jul 13 14:03:09 devstack sudo[102966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:03:09 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-c96e7284-491d-464c-a8c3-2bfd25a8c603 tempest-TestMinimumBasicScenario-720126083 None] Lock "cinder-b6fce93a-7e5c-4553-8c53-3e4e68085e0c-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 14:03:09 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-c96e7284-491d-464c-a8c3-2bfd25a8c603 tempest-TestMinimumBasicScenario-720126083 None] Acquiring lock "cinder-quobyte-b6fce93a-7e5c-4553-8c53-3e4e68085e0c" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 14:03:09 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-c96e7284-491d-464c-a8c3-2bfd25a8c603 tempest-TestMinimumBasicScenario-720126083 None] Lock "cinder-quobyte-b6fce93a-7e5c-4553-8c53-3e4e68085e0c" acquired by "delete_volume" :: waited 0.026s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 14:03:09 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[252507ba-e296-4664-b6ce-d846772a9131]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 14:03:09 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-c96e7284-491d-464c-a8c3-2bfd25a8c603 tempest-TestMinimumBasicScenario-720126083 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-b6fce93a-7e5c-4553-8c53-3e4e68085e0c {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:03:09 devstack sudo[102966]: pam_unix(sudo:session): session closed for user root Jul 13 14:03:09 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-f7fffe38-a24f-4726-ae35-2003269b6896 tempest-CinderUnicodeTest-302130129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-474c51e6-ee73-4dc4-8909-94bcaa02d532" returned: 0 in 0.335s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:03:09 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-f7fffe38-a24f-4726-ae35-2003269b6896 tempest-CinderUnicodeTest-302130129 None] <== create_volume: return (1373ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'} {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 13 14:03:09 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-f7fffe38-a24f-4726-ae35-2003269b6896 tempest-CinderUnicodeTest-302130129 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.381s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 14:03:09 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-f7fffe38-a24f-4726-ae35-2003269b6896 tempest-CinderUnicodeTest-302130129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (feff7ed8-9e25-4a9e-995e-42f8f2bf99bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-474c51e6-ee73-4dc4-8909-94bcaa02d532', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:03:09 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-f7fffe38-a24f-4726-ae35-2003269b6896 tempest-CinderUnicodeTest-302130129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71430762-4537-42ec-a580-6957c4788c45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:03:09 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-f7fffe38-a24f-4726-ae35-2003269b6896 tempest-CinderUnicodeTest-302130129 None] Volume volume-474c51e6-ee73-4dc4-8909-94bcaa02d532 (474c51e6-ee73-4dc4-8909-94bcaa02d532): created successfully Jul 13 14:03:09 devstack sudo[102973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-b6fce93a-7e5c-4553-8c53-3e4e68085e0c Jul 13 14:03:09 devstack sudo[102973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:03:09 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-f7fffe38-a24f-4726-ae35-2003269b6896 tempest-CinderUnicodeTest-302130129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71430762-4537-42ec-a580-6957c4788c45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:03:09 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-f7fffe38-a24f-4726-ae35-2003269b6896 tempest-CinderUnicodeTest-302130129 None] Flow 'volume_create_manager' (79cf0b4a-2d1e-4abf-b604-2540c6dabe8b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 14:03:09 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-f7fffe38-a24f-4726-ae35-2003269b6896 tempest-CinderUnicodeTest-302130129 None] Created volume successfully. Jul 13 14:03:10 devstack sudo[102973]: pam_unix(sudo:session): session closed for user root Jul 13 14:03:10 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-c96e7284-491d-464c-a8c3-2bfd25a8c603 tempest-TestMinimumBasicScenario-720126083 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-b6fce93a-7e5c-4553-8c53-3e4e68085e0c" returned: 0 in 0.507s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:03:10 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-c96e7284-491d-464c-a8c3-2bfd25a8c603 tempest-TestMinimumBasicScenario-720126083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-b6fce93a-7e5c-4553-8c53-3e4e68085e0c {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:03:10 devstack sudo[102980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-b6fce93a-7e5c-4553-8c53-3e4e68085e0c Jul 13 14:03:10 devstack sudo[102980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:03:10 devstack sudo[102980]: pam_unix(sudo:session): session closed for user root Jul 13 14:03:10 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-c96e7284-491d-464c-a8c3-2bfd25a8c603 tempest-TestMinimumBasicScenario-720126083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-b6fce93a-7e5c-4553-8c53-3e4e68085e0c" returned: 0 in 0.306s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:03:10 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-c96e7284-491d-464c-a8c3-2bfd25a8c603 tempest-TestMinimumBasicScenario-720126083 None] Lock "cinder-quobyte-b6fce93a-7e5c-4553-8c53-3e4e68085e0c" released by "delete_volume" :: held 0.889s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 14:03:10 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-c96e7284-491d-464c-a8c3-2bfd25a8c603 tempest-TestMinimumBasicScenario-720126083 None] Created reservations ['4ef04e9b-7d84-4c78-92fe-bfe736ae7027', 'ef727471-f9c4-43f3-af3b-34bdba9d7943', '8eb12f11-4214-4ec8-82bb-eb830a6d2cc3', '8b490241-02c5-4337-b087-5bc86d5cdc57'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 14:03:10 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-c96e7284-491d-464c-a8c3-2bfd25a8c603 tempest-TestMinimumBasicScenario-720126083 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 14:03:10 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-c96e7284-491d-464c-a8c3-2bfd25a8c603 tempest-TestMinimumBasicScenario-720126083 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 14:03:10 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-c96e7284-491d-464c-a8c3-2bfd25a8c603 tempest-TestMinimumBasicScenario-720126083 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 14:03:10 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-c96e7284-491d-464c-a8c3-2bfd25a8c603 tempest-TestMinimumBasicScenario-720126083 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 14:03:10 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-c96e7284-491d-464c-a8c3-2bfd25a8c603 tempest-TestMinimumBasicScenario-720126083 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 14:03:10 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-c96e7284-491d-464c-a8c3-2bfd25a8c603 tempest-TestMinimumBasicScenario-720126083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:03:10 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-727e07d2-b307-4e73-8e6a-b83ec9dfb825 tempest-CinderUnicodeTest-302130129 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 14:03:10 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-727e07d2-b307-4e73-8e6a-b83ec9dfb825 tempest-CinderUnicodeTest-302130129 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 14:03:10 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-727e07d2-b307-4e73-8e6a-b83ec9dfb825 tempest-CinderUnicodeTest-302130129 None] Creating offline snapshot 3f511ccc-5c89-440b-8718-29366e3b6339 of volume 474c51e6-ee73-4dc4-8909-94bcaa02d532 {{(pid=87098) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 13 14:03:10 devstack sudo[102985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 Jul 13 14:03:10 devstack sudo[102985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:03:10 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cec80bf-9fe8-4e57-8cbb-0a0a846ed020]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 14:03:10 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-727e07d2-b307-4e73-8e6a-b83ec9dfb825 tempest-CinderUnicodeTest-302130129 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-474c51e6-ee73-4dc4-8909-94bcaa02d532 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:03:11 devstack sudo[102987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-474c51e6-ee73-4dc4-8909-94bcaa02d532 Jul 13 14:03:11 devstack sudo[102987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:03:11 devstack sudo[102985]: pam_unix(sudo:session): session closed for user root Jul 13 14:03:11 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-c96e7284-491d-464c-a8c3-2bfd25a8c603 tempest-TestMinimumBasicScenario-720126083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78" returned: 0 in 0.370s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:03:11 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-c96e7284-491d-464c-a8c3-2bfd25a8c603 tempest-TestMinimumBasicScenario-720126083 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 14:03:11 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-c96e7284-491d-464c-a8c3-2bfd25a8c603 tempest-TestMinimumBasicScenario-720126083 None] Deleted volume successfully. Jul 13 14:03:11 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-c96e7284-491d-464c-a8c3-2bfd25a8c603 tempest-TestMinimumBasicScenario-720126083 None] Lock "cinder-b6fce93a-7e5c-4553-8c53-3e4e68085e0c-delete_volume" released by "delete_volume" :: held 1.704s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 14:03:11 devstack sudo[102987]: pam_unix(sudo:session): session closed for user root Jul 13 14:03:11 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-727e07d2-b307-4e73-8e6a-b83ec9dfb825 tempest-CinderUnicodeTest-302130129 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-474c51e6-ee73-4dc4-8909-94bcaa02d532" returned: 0 in 0.427s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:03:11 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-727e07d2-b307-4e73-8e6a-b83ec9dfb825 tempest-CinderUnicodeTest-302130129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-474c51e6-ee73-4dc4-8909-94bcaa02d532,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-474c51e6-ee73-4dc4-8909-94bcaa02d532.3f511ccc-5c89-440b-8718-29366e3b6339 1G {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:03:11 devstack sudo[102994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-474c51e6-ee73-4dc4-8909-94bcaa02d532,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-474c51e6-ee73-4dc4-8909-94bcaa02d532.3f511ccc-5c89-440b-8718-29366e3b6339 1G Jul 13 14:03:11 devstack sudo[102994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:03:11 devstack sudo[102994]: pam_unix(sudo:session): session closed for user root Jul 13 14:03:11 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-727e07d2-b307-4e73-8e6a-b83ec9dfb825 tempest-CinderUnicodeTest-302130129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-474c51e6-ee73-4dc4-8909-94bcaa02d532,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-474c51e6-ee73-4dc4-8909-94bcaa02d532.3f511ccc-5c89-440b-8718-29366e3b6339 1G" returned: 0 in 0.453s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:03:11 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-727e07d2-b307-4e73-8e6a-b83ec9dfb825 tempest-CinderUnicodeTest-302130129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-474c51e6-ee73-4dc4-8909-94bcaa02d532 -F qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-474c51e6-ee73-4dc4-8909-94bcaa02d532.3f511ccc-5c89-440b-8718-29366e3b6339 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:03:11 devstack sudo[103034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-474c51e6-ee73-4dc4-8909-94bcaa02d532 -F qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-474c51e6-ee73-4dc4-8909-94bcaa02d532.3f511ccc-5c89-440b-8718-29366e3b6339 Jul 13 14:03:11 devstack sudo[103034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:03:12 devstack sudo[103034]: pam_unix(sudo:session): session closed for user root Jul 13 14:03:12 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-727e07d2-b307-4e73-8e6a-b83ec9dfb825 tempest-CinderUnicodeTest-302130129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-474c51e6-ee73-4dc4-8909-94bcaa02d532 -F qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-474c51e6-ee73-4dc4-8909-94bcaa02d532.3f511ccc-5c89-440b-8718-29366e3b6339" returned: 0 in 0.485s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:03:12 devstack cinder-volume[87098]: WARNING cinder.volume.drivers.remotefs [None req-727e07d2-b307-4e73-8e6a-b83ec9dfb825 tempest-CinderUnicodeTest-302130129 None] /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-474c51e6-ee73-4dc4-8909-94bcaa02d532.3f511ccc-5c89-440b-8718-29366e3b6339 is being set with open permissions: ugo+rw Jul 13 14:03:12 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-727e07d2-b307-4e73-8e6a-b83ec9dfb825 tempest-CinderUnicodeTest-302130129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-474c51e6-ee73-4dc4-8909-94bcaa02d532.3f511ccc-5c89-440b-8718-29366e3b6339 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:03:12 devstack sudo[103039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-474c51e6-ee73-4dc4-8909-94bcaa02d532.3f511ccc-5c89-440b-8718-29366e3b6339 Jul 13 14:03:12 devstack sudo[103039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:03:12 devstack sudo[103039]: pam_unix(sudo:session): session closed for user root Jul 13 14:03:12 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-727e07d2-b307-4e73-8e6a-b83ec9dfb825 tempest-CinderUnicodeTest-302130129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-474c51e6-ee73-4dc4-8909-94bcaa02d532.3f511ccc-5c89-440b-8718-29366e3b6339" returned: 0 in 0.566s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:03:12 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-727e07d2-b307-4e73-8e6a-b83ec9dfb825 tempest-CinderUnicodeTest-302130129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-474c51e6-ee73-4dc4-8909-94bcaa02d532.info {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:03:12 devstack sudo[103058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-474c51e6-ee73-4dc4-8909-94bcaa02d532.info Jul 13 14:03:12 devstack sudo[103058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:03:13 devstack sudo[103058]: pam_unix(sudo:session): session closed for user root Jul 13 14:03:13 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-727e07d2-b307-4e73-8e6a-b83ec9dfb825 tempest-CinderUnicodeTest-302130129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-474c51e6-ee73-4dc4-8909-94bcaa02d532.info" returned: 0 in 0.379s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:03:13 devstack cinder-volume[87098]: WARNING cinder.volume.drivers.remotefs [None req-727e07d2-b307-4e73-8e6a-b83ec9dfb825 tempest-CinderUnicodeTest-302130129 None] /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-474c51e6-ee73-4dc4-8909-94bcaa02d532.info is being set with open permissions: ugo+rw Jul 13 14:03:13 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-727e07d2-b307-4e73-8e6a-b83ec9dfb825 tempest-CinderUnicodeTest-302130129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-474c51e6-ee73-4dc4-8909-94bcaa02d532.info {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:03:13 devstack sudo[103066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-474c51e6-ee73-4dc4-8909-94bcaa02d532.info Jul 13 14:03:13 devstack sudo[103066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:03:13 devstack sudo[103066]: pam_unix(sudo:session): session closed for user root Jul 13 14:03:13 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-727e07d2-b307-4e73-8e6a-b83ec9dfb825 tempest-CinderUnicodeTest-302130129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-474c51e6-ee73-4dc4-8909-94bcaa02d532.info" returned: 0 in 0.437s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:03:13 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-727e07d2-b307-4e73-8e6a-b83ec9dfb825 tempest-CinderUnicodeTest-302130129 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.963s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 14:03:13 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-727e07d2-b307-4e73-8e6a-b83ec9dfb825 tempest-CinderUnicodeTest-302130129 None] Create snapshot completed successfully Jul 13 14:03:14 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-42c4f761-3047-4ce1-90f9-185307e08db8 tempest-CinderUnicodeTest-302130129 None] Acquiring lock "cinder-3f511ccc-5c89-440b-8718-29366e3b6339-delete_snapshot" by "delete_snapshot" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 14:03:14 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-42c4f761-3047-4ce1-90f9-185307e08db8 tempest-CinderUnicodeTest-302130129 None] Lock "cinder-3f511ccc-5c89-440b-8718-29366e3b6339-delete_snapshot" acquired by "delete_snapshot" :: waited 0.041s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 14:03:14 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-42c4f761-3047-4ce1-90f9-185307e08db8 tempest-CinderUnicodeTest-302130129 None] Acquiring lock "cinder-quobyte-474c51e6-ee73-4dc4-8909-94bcaa02d532" by "delete_snapshot" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 14:03:14 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-42c4f761-3047-4ce1-90f9-185307e08db8 tempest-CinderUnicodeTest-302130129 None] Lock "cinder-quobyte-474c51e6-ee73-4dc4-8909-94bcaa02d532" acquired by "delete_snapshot" :: waited 0.041s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 14:03:14 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-42c4f761-3047-4ce1-90f9-185307e08db8 tempest-CinderUnicodeTest-302130129 None] Acquiring lock "cinder-quobyte-3f511ccc-5c89-440b-8718-29366e3b6339" by "_delete_snapshot" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 14:03:14 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-42c4f761-3047-4ce1-90f9-185307e08db8 tempest-CinderUnicodeTest-302130129 None] Lock "cinder-quobyte-3f511ccc-5c89-440b-8718-29366e3b6339" acquired by "_delete_snapshot" :: waited 0.036s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 14:03:14 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-42c4f761-3047-4ce1-90f9-185307e08db8 tempest-CinderUnicodeTest-302130129 None] Deleting offline snapshot 3f511ccc-5c89-440b-8718-29366e3b6339 of volume 474c51e6-ee73-4dc4-8909-94bcaa02d532 {{(pid=87098) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 13 14:03:14 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-42c4f761-3047-4ce1-90f9-185307e08db8 tempest-CinderUnicodeTest-302130129 None] snapshot_file for this snap is: volume-474c51e6-ee73-4dc4-8909-94bcaa02d532.3f511ccc-5c89-440b-8718-29366e3b6339 {{(pid=87098) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 13 14:03:14 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb108994-5f9b-4e24-9cad-2cfcc1acf407]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 14:03:14 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-42c4f761-3047-4ce1-90f9-185307e08db8 tempest-CinderUnicodeTest-302130129 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-474c51e6-ee73-4dc4-8909-94bcaa02d532.3f511ccc-5c89-440b-8718-29366e3b6339 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:03:14 devstack sudo[103071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-474c51e6-ee73-4dc4-8909-94bcaa02d532.3f511ccc-5c89-440b-8718-29366e3b6339 Jul 13 14:03:14 devstack sudo[103071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:03:14 devstack sudo[103071]: pam_unix(sudo:session): session closed for user root Jul 13 14:03:14 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-42c4f761-3047-4ce1-90f9-185307e08db8 tempest-CinderUnicodeTest-302130129 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-474c51e6-ee73-4dc4-8909-94bcaa02d532.3f511ccc-5c89-440b-8718-29366e3b6339" returned: 0 in 0.462s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:03:14 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-42c4f761-3047-4ce1-90f9-185307e08db8 tempest-CinderUnicodeTest-302130129 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-474c51e6-ee73-4dc4-8909-94bcaa02d532(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87098) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 13 14:03:14 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[8024b983-aebd-41fb-a318-0118936ec9bd]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 14:03:14 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-42c4f761-3047-4ce1-90f9-185307e08db8 tempest-CinderUnicodeTest-302130129 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-474c51e6-ee73-4dc4-8909-94bcaa02d532 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:03:15 devstack sudo[103078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-474c51e6-ee73-4dc4-8909-94bcaa02d532 Jul 13 14:03:15 devstack sudo[103078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:03:15 devstack sudo[103078]: pam_unix(sudo:session): session closed for user root Jul 13 14:03:15 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-42c4f761-3047-4ce1-90f9-185307e08db8 tempest-CinderUnicodeTest-302130129 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-474c51e6-ee73-4dc4-8909-94bcaa02d532" returned: 0 in 0.539s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:03:15 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-42c4f761-3047-4ce1-90f9-185307e08db8 tempest-CinderUnicodeTest-302130129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-474c51e6-ee73-4dc4-8909-94bcaa02d532.3f511ccc-5c89-440b-8718-29366e3b6339 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:03:15 devstack sudo[103085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-474c51e6-ee73-4dc4-8909-94bcaa02d532.3f511ccc-5c89-440b-8718-29366e3b6339 Jul 13 14:03:15 devstack sudo[103085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:03:15 devstack sudo[103085]: pam_unix(sudo:session): session closed for user root Jul 13 14:03:15 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-42c4f761-3047-4ce1-90f9-185307e08db8 tempest-CinderUnicodeTest-302130129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-474c51e6-ee73-4dc4-8909-94bcaa02d532.3f511ccc-5c89-440b-8718-29366e3b6339" returned: 0 in 0.492s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:03:15 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-42c4f761-3047-4ce1-90f9-185307e08db8 tempest-CinderUnicodeTest-302130129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-474c51e6-ee73-4dc4-8909-94bcaa02d532.3f511ccc-5c89-440b-8718-29366e3b6339 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:03:15 devstack sudo[103091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-474c51e6-ee73-4dc4-8909-94bcaa02d532.3f511ccc-5c89-440b-8718-29366e3b6339 Jul 13 14:03:15 devstack sudo[103091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:03:16 devstack sudo[103091]: pam_unix(sudo:session): session closed for user root Jul 13 14:03:16 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-42c4f761-3047-4ce1-90f9-185307e08db8 tempest-CinderUnicodeTest-302130129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-474c51e6-ee73-4dc4-8909-94bcaa02d532.3f511ccc-5c89-440b-8718-29366e3b6339" returned: 0 in 0.314s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:03:16 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-42c4f761-3047-4ce1-90f9-185307e08db8 tempest-CinderUnicodeTest-302130129 None] Lock "cinder-quobyte-3f511ccc-5c89-440b-8718-29366e3b6339" released by "_delete_snapshot" :: held 1.989s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 14:03:16 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-42c4f761-3047-4ce1-90f9-185307e08db8 tempest-CinderUnicodeTest-302130129 None] Lock "cinder-quobyte-474c51e6-ee73-4dc4-8909-94bcaa02d532" released by "delete_snapshot" :: held 2.040s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 14:03:16 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-42c4f761-3047-4ce1-90f9-185307e08db8 tempest-CinderUnicodeTest-302130129 None] Created reservations ['2796dcd4-aa07-4529-acdf-9d59b1691573', '535aee80-18fc-4061-9285-2e0f3314884f', '63cb8d8f-de40-44da-9870-abda59cef760', '54b7fe69-38da-4f1c-a5ed-3f07fbf59f6e'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 14:03:16 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-42c4f761-3047-4ce1-90f9-185307e08db8 tempest-CinderUnicodeTest-302130129 None] Delete snapshot completed successfully. Jul 13 14:03:16 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-42c4f761-3047-4ce1-90f9-185307e08db8 tempest-CinderUnicodeTest-302130129 None] Lock "cinder-3f511ccc-5c89-440b-8718-29366e3b6339-delete_snapshot" released by "delete_snapshot" :: held 2.250s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 14:03:17 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-93ec4846-1a53-4de7-b9ed-e42cd010299e tempest-CinderUnicodeTest-302130129 None] Acquiring lock "cinder-474c51e6-ee73-4dc4-8909-94bcaa02d532-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 14:03:17 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-93ec4846-1a53-4de7-b9ed-e42cd010299e tempest-CinderUnicodeTest-302130129 None] Lock "cinder-474c51e6-ee73-4dc4-8909-94bcaa02d532-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 14:03:17 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-93ec4846-1a53-4de7-b9ed-e42cd010299e tempest-CinderUnicodeTest-302130129 None] Acquiring lock "cinder-quobyte-474c51e6-ee73-4dc4-8909-94bcaa02d532" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 14:03:17 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-93ec4846-1a53-4de7-b9ed-e42cd010299e tempest-CinderUnicodeTest-302130129 None] Lock "cinder-quobyte-474c51e6-ee73-4dc4-8909-94bcaa02d532" acquired by "delete_volume" :: waited 0.017s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 14:03:17 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a256fe1-bf7c-41cc-9efa-a7ac236dc8a6]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 14:03:17 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-93ec4846-1a53-4de7-b9ed-e42cd010299e tempest-CinderUnicodeTest-302130129 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-474c51e6-ee73-4dc4-8909-94bcaa02d532 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:03:17 devstack sudo[103097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-474c51e6-ee73-4dc4-8909-94bcaa02d532 Jul 13 14:03:17 devstack sudo[103097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:03:17 devstack sudo[103097]: pam_unix(sudo:session): session closed for user root Jul 13 14:03:17 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-93ec4846-1a53-4de7-b9ed-e42cd010299e tempest-CinderUnicodeTest-302130129 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-474c51e6-ee73-4dc4-8909-94bcaa02d532" returned: 0 in 0.375s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:03:17 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-93ec4846-1a53-4de7-b9ed-e42cd010299e tempest-CinderUnicodeTest-302130129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-474c51e6-ee73-4dc4-8909-94bcaa02d532 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:03:17 devstack sudo[103102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-474c51e6-ee73-4dc4-8909-94bcaa02d532 Jul 13 14:03:17 devstack sudo[103102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:03:18 devstack sudo[103102]: pam_unix(sudo:session): session closed for user root Jul 13 14:03:18 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-93ec4846-1a53-4de7-b9ed-e42cd010299e tempest-CinderUnicodeTest-302130129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-474c51e6-ee73-4dc4-8909-94bcaa02d532" returned: 0 in 0.308s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:03:18 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-93ec4846-1a53-4de7-b9ed-e42cd010299e tempest-CinderUnicodeTest-302130129 None] Lock "cinder-quobyte-474c51e6-ee73-4dc4-8909-94bcaa02d532" released by "delete_volume" :: held 0.751s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 14:03:18 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-93ec4846-1a53-4de7-b9ed-e42cd010299e tempest-CinderUnicodeTest-302130129 None] Created reservations ['12193cad-6b39-45cb-b5b8-e0e78b003df6', 'dfa7f15f-5655-43fb-a617-85e6d57d243b', 'bf809d0c-70f7-47dd-a9c5-b593c888470b', 'ea56f33f-d683-45cd-9a7b-ed7d0027809f'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 14:03:18 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-93ec4846-1a53-4de7-b9ed-e42cd010299e tempest-CinderUnicodeTest-302130129 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 14:03:18 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-93ec4846-1a53-4de7-b9ed-e42cd010299e tempest-CinderUnicodeTest-302130129 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 14:03:18 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-93ec4846-1a53-4de7-b9ed-e42cd010299e tempest-CinderUnicodeTest-302130129 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 14:03:18 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-93ec4846-1a53-4de7-b9ed-e42cd010299e tempest-CinderUnicodeTest-302130129 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 14:03:18 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-93ec4846-1a53-4de7-b9ed-e42cd010299e tempest-CinderUnicodeTest-302130129 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 14:03:18 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-93ec4846-1a53-4de7-b9ed-e42cd010299e tempest-CinderUnicodeTest-302130129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:03:18 devstack sudo[103107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 Jul 13 14:03:18 devstack sudo[103107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:03:18 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-443ef288-d8ff-499c-9356-c593a8c10492 tempest-CinderUnicodeTest-302130129 None] Acquiring lock "cinder-980e35f1-edc8-4d8b-ab6c-ad95665fbeca-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 14:03:18 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-443ef288-d8ff-499c-9356-c593a8c10492 tempest-CinderUnicodeTest-302130129 None] Lock "cinder-980e35f1-edc8-4d8b-ab6c-ad95665fbeca-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 14:03:18 devstack sudo[103107]: pam_unix(sudo:session): session closed for user root Jul 13 14:03:18 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-93ec4846-1a53-4de7-b9ed-e42cd010299e tempest-CinderUnicodeTest-302130129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78" returned: 0 in 0.323s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:03:18 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-93ec4846-1a53-4de7-b9ed-e42cd010299e tempest-CinderUnicodeTest-302130129 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 14:03:18 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-93ec4846-1a53-4de7-b9ed-e42cd010299e tempest-CinderUnicodeTest-302130129 None] Deleted volume successfully. Jul 13 14:03:18 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-93ec4846-1a53-4de7-b9ed-e42cd010299e tempest-CinderUnicodeTest-302130129 None] Lock "cinder-474c51e6-ee73-4dc4-8909-94bcaa02d532-delete_volume" released by "delete_volume" :: held 1.347s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 14:03:18 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-443ef288-d8ff-499c-9356-c593a8c10492 tempest-CinderUnicodeTest-302130129 None] Acquiring lock "cinder-quobyte-980e35f1-edc8-4d8b-ab6c-ad95665fbeca" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 14:03:18 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-443ef288-d8ff-499c-9356-c593a8c10492 tempest-CinderUnicodeTest-302130129 None] Lock "cinder-quobyte-980e35f1-edc8-4d8b-ab6c-ad95665fbeca" acquired by "delete_volume" :: waited 0.021s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 14:03:18 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[53069a7d-10de-45f7-83c9-92a80d33e5fd]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 14:03:18 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-443ef288-d8ff-499c-9356-c593a8c10492 tempest-CinderUnicodeTest-302130129 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-980e35f1-edc8-4d8b-ab6c-ad95665fbeca {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:03:19 devstack sudo[103110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-980e35f1-edc8-4d8b-ab6c-ad95665fbeca Jul 13 14:03:19 devstack sudo[103110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:03:19 devstack sudo[103110]: pam_unix(sudo:session): session closed for user root Jul 13 14:03:19 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-443ef288-d8ff-499c-9356-c593a8c10492 tempest-CinderUnicodeTest-302130129 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-980e35f1-edc8-4d8b-ab6c-ad95665fbeca" returned: 0 in 0.598s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:03:19 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-443ef288-d8ff-499c-9356-c593a8c10492 tempest-CinderUnicodeTest-302130129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-980e35f1-edc8-4d8b-ab6c-ad95665fbeca {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:03:19 devstack sudo[103121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-980e35f1-edc8-4d8b-ab6c-ad95665fbeca Jul 13 14:03:19 devstack sudo[103121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:03:19 devstack sudo[103121]: pam_unix(sudo:session): session closed for user root Jul 13 14:03:19 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-443ef288-d8ff-499c-9356-c593a8c10492 tempest-CinderUnicodeTest-302130129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-980e35f1-edc8-4d8b-ab6c-ad95665fbeca" returned: 0 in 0.273s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:03:19 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-443ef288-d8ff-499c-9356-c593a8c10492 tempest-CinderUnicodeTest-302130129 None] Lock "cinder-quobyte-980e35f1-edc8-4d8b-ab6c-ad95665fbeca" released by "delete_volume" :: held 0.917s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 14:03:19 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-443ef288-d8ff-499c-9356-c593a8c10492 tempest-CinderUnicodeTest-302130129 None] Created reservations ['55231e05-f13c-4e90-a822-b547b91e91eb', 'b1755ef2-3497-479d-b69e-b9a9d8efe3d8', '130a5e34-f84f-448a-b579-9b06fcf24a15', 'b3494316-3f35-40df-895e-2ac78b8c30cf'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 14:03:19 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-443ef288-d8ff-499c-9356-c593a8c10492 tempest-CinderUnicodeTest-302130129 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 14:03:19 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-443ef288-d8ff-499c-9356-c593a8c10492 tempest-CinderUnicodeTest-302130129 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 14:03:19 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-443ef288-d8ff-499c-9356-c593a8c10492 tempest-CinderUnicodeTest-302130129 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 14:03:19 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-443ef288-d8ff-499c-9356-c593a8c10492 tempest-CinderUnicodeTest-302130129 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 14:03:19 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-443ef288-d8ff-499c-9356-c593a8c10492 tempest-CinderUnicodeTest-302130129 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 14:03:19 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-443ef288-d8ff-499c-9356-c593a8c10492 tempest-CinderUnicodeTest-302130129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:03:19 devstack sudo[103125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 Jul 13 14:03:19 devstack sudo[103125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:03:20 devstack sudo[103125]: pam_unix(sudo:session): session closed for user root Jul 13 14:03:20 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-443ef288-d8ff-499c-9356-c593a8c10492 tempest-CinderUnicodeTest-302130129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78" returned: 0 in 0.346s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:03:20 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-443ef288-d8ff-499c-9356-c593a8c10492 tempest-CinderUnicodeTest-302130129 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 14:03:20 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-443ef288-d8ff-499c-9356-c593a8c10492 tempest-CinderUnicodeTest-302130129 None] Deleted volume successfully. Jul 13 14:03:20 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-443ef288-d8ff-499c-9356-c593a8c10492 tempest-CinderUnicodeTest-302130129 None] Lock "cinder-980e35f1-edc8-4d8b-ab6c-ad95665fbeca-delete_volume" released by "delete_volume" :: held 1.595s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 14:03:27 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d31458f-2065-4e6f-827a-40702f42d2c9 tempest-VolumeDependencyTests-966777309 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 14:03:27 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-7d31458f-2065-4e6f-827a-40702f42d2c9 tempest-VolumeDependencyTests-966777309 None] Flow 'volume_create_manager' (790455c6-6a2a-4994-8dcb-3e42db82ca93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 14:03:27 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-7d31458f-2065-4e6f-827a-40702f42d2c9 tempest-VolumeDependencyTests-966777309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5bb8830-8622-4c01-86cc-e9fc1689a4b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:03:27 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-7d31458f-2065-4e6f-827a-40702f42d2c9 tempest-VolumeDependencyTests-966777309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5bb8830-8622-4c01-86cc-e9fc1689a4b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T12:03:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-558926210',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a022bca-3248-46f9-a63d-cad31a8db027,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ee818648f484682ba4ad7d08cac9318',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T12:03:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T12:03:28Z,use_quota=True,user_id='a5b52678f79c43abb451317f8aa4e9af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1147de8b-623b-426c-a13d-7fc824a80f67),volume_type_id=1147de8b-623b-426c-a13d-7fc824a80f67)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:03:27 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-7d31458f-2065-4e6f-827a-40702f42d2c9 tempest-VolumeDependencyTests-966777309 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ea6a1ea-35ba-4bc9-9975-30350c0cd4fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:03:27 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-7d31458f-2065-4e6f-827a-40702f42d2c9 tempest-VolumeDependencyTests-966777309 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ea6a1ea-35ba-4bc9-9975-30350c0cd4fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:03:27 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-7d31458f-2065-4e6f-827a-40702f42d2c9 tempest-VolumeDependencyTests-966777309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7478d9b0-f7c0-4a45-9fd5-e538c16febde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:03:27 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-7d31458f-2065-4e6f-827a-40702f42d2c9 tempest-VolumeDependencyTests-966777309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7478d9b0-f7c0-4a45-9fd5-e538c16febde) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3a022bca-3248-46f9-a63d-cad31a8db027', 'volume_name': 'volume-3a022bca-3248-46f9-a63d-cad31a8db027', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:03:27 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-7d31458f-2065-4e6f-827a-40702f42d2c9 tempest-VolumeDependencyTests-966777309 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91968622-2fc9-4f96-8e8d-9881bf415921) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:03:27 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-7d31458f-2065-4e6f-827a-40702f42d2c9 tempest-VolumeDependencyTests-966777309 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91968622-2fc9-4f96-8e8d-9881bf415921) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:03:27 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-7d31458f-2065-4e6f-827a-40702f42d2c9 tempest-VolumeDependencyTests-966777309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (652ca2f3-46a7-48cf-8bd4-53be6055a728) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:03:27 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-7d31458f-2065-4e6f-827a-40702f42d2c9 tempest-VolumeDependencyTests-966777309 None] Volume 3a022bca-3248-46f9-a63d-cad31a8db027: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3a022bca-3248-46f9-a63d-cad31a8db027', 'volume_size': 1} Jul 13 14:03:27 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-7d31458f-2065-4e6f-827a-40702f42d2c9 tempest-VolumeDependencyTests-966777309 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 14:03:27 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-7d31458f-2065-4e6f-827a-40702f42d2c9 tempest-VolumeDependencyTests-966777309 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 14:03:27 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-7d31458f-2065-4e6f-827a-40702f42d2c9 tempest-VolumeDependencyTests-966777309 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T12:03:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-558926210',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a022bca-3248-46f9-a63d-cad31a8db027,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ee818648f484682ba4ad7d08cac9318',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T12:03:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T12:03:28Z,use_quota=True,user_id='a5b52678f79c43abb451317f8aa4e9af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1147de8b-623b-426c-a13d-7fc824a80f67),volume_type_id=1147de8b-623b-426c-a13d-7fc824a80f67)}" {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 13 14:03:27 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-7d31458f-2065-4e6f-827a-40702f42d2c9 tempest-VolumeDependencyTests-966777309 None] Creating volume 3a022bca-3248-46f9-a63d-cad31a8db027 {{(pid=87098) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 13 14:03:27 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-7d31458f-2065-4e6f-827a-40702f42d2c9 tempest-VolumeDependencyTests-966777309 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 14:03:27 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-7d31458f-2065-4e6f-827a-40702f42d2c9 tempest-VolumeDependencyTests-966777309 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 14:03:27 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-7d31458f-2065-4e6f-827a-40702f42d2c9 tempest-VolumeDependencyTests-966777309 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 14:03:27 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-7d31458f-2065-4e6f-827a-40702f42d2c9 tempest-VolumeDependencyTests-966777309 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 14:03:27 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-7d31458f-2065-4e6f-827a-40702f42d2c9 tempest-VolumeDependencyTests-966777309 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 14:03:27 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-7d31458f-2065-4e6f-827a-40702f42d2c9 tempest-VolumeDependencyTests-966777309 None] Selected osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 14:03:27 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-7d31458f-2065-4e6f-827a-40702f42d2c9 tempest-VolumeDependencyTests-966777309 None] casted to osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 Jul 13 14:03:27 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-7d31458f-2065-4e6f-827a-40702f42d2c9 tempest-VolumeDependencyTests-966777309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-3a022bca-3248-46f9-a63d-cad31a8db027 1073741824 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:03:27 devstack sudo[103137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-3a022bca-3248-46f9-a63d-cad31a8db027 1073741824 Jul 13 14:03:27 devstack sudo[103137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:03:28 devstack sudo[103137]: pam_unix(sudo:session): session closed for user root Jul 13 14:03:28 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-7d31458f-2065-4e6f-827a-40702f42d2c9 tempest-VolumeDependencyTests-966777309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-3a022bca-3248-46f9-a63d-cad31a8db027 1073741824" returned: 0 in 0.437s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:03:28 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-7d31458f-2065-4e6f-827a-40702f42d2c9 tempest-VolumeDependencyTests-966777309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-3a022bca-3248-46f9-a63d-cad31a8db027 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:03:28 devstack sudo[103143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-3a022bca-3248-46f9-a63d-cad31a8db027 Jul 13 14:03:28 devstack sudo[103143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:03:28 devstack sudo[103143]: pam_unix(sudo:session): session closed for user root Jul 13 14:03:28 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-7d31458f-2065-4e6f-827a-40702f42d2c9 tempest-VolumeDependencyTests-966777309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-3a022bca-3248-46f9-a63d-cad31a8db027" returned: 0 in 0.254s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:03:28 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-7d31458f-2065-4e6f-827a-40702f42d2c9 tempest-VolumeDependencyTests-966777309 None] <== create_volume: return (779ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'} {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 13 14:03:28 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-7d31458f-2065-4e6f-827a-40702f42d2c9 tempest-VolumeDependencyTests-966777309 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.782s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 14:03:28 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-7d31458f-2065-4e6f-827a-40702f42d2c9 tempest-VolumeDependencyTests-966777309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (652ca2f3-46a7-48cf-8bd4-53be6055a728) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3a022bca-3248-46f9-a63d-cad31a8db027', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:03:28 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-7d31458f-2065-4e6f-827a-40702f42d2c9 tempest-VolumeDependencyTests-966777309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8beb7f8a-723a-42b1-b387-7fc05369b39f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:03:28 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-7d31458f-2065-4e6f-827a-40702f42d2c9 tempest-VolumeDependencyTests-966777309 None] Volume volume-3a022bca-3248-46f9-a63d-cad31a8db027 (3a022bca-3248-46f9-a63d-cad31a8db027): created successfully Jul 13 14:03:28 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-7d31458f-2065-4e6f-827a-40702f42d2c9 tempest-VolumeDependencyTests-966777309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8beb7f8a-723a-42b1-b387-7fc05369b39f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:03:28 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-7d31458f-2065-4e6f-827a-40702f42d2c9 tempest-VolumeDependencyTests-966777309 None] Flow 'volume_create_manager' (790455c6-6a2a-4994-8dcb-3e42db82ca93) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 14:03:28 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-7d31458f-2065-4e6f-827a-40702f42d2c9 tempest-VolumeDependencyTests-966777309 None] Created volume successfully. Jul 13 14:03:28 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-641ceff9-85a9-4508-92a2-7a700b481ad2 tempest-VolumeDependencyTests-966777309 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 14:03:28 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-641ceff9-85a9-4508-92a2-7a700b481ad2 tempest-VolumeDependencyTests-966777309 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 14:03:29 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-641ceff9-85a9-4508-92a2-7a700b481ad2 tempest-VolumeDependencyTests-966777309 None] Creating offline snapshot d2797bc1-23d3-4d12-940e-145da3fb3326 of volume 3a022bca-3248-46f9-a63d-cad31a8db027 {{(pid=87098) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 13 14:03:29 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d6c789e-e512-4740-bc88-c42988e7d2bd]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 14:03:29 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-641ceff9-85a9-4508-92a2-7a700b481ad2 tempest-VolumeDependencyTests-966777309 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-3a022bca-3248-46f9-a63d-cad31a8db027 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:03:29 devstack cinder-volume[87098]: DEBUG oslo_service.periodic_task [None req-727a1692-ea28-4a77-b327-0d94e8f01efb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87098) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 13 14:03:29 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-727a1692-ea28-4a77-b327-0d94e8f01efb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 14:03:29 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-727a1692-ea28-4a77-b327-0d94e8f01efb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 14:03:29 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-727a1692-ea28-4a77-b327-0d94e8f01efb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 14:03:29 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-727a1692-ea28-4a77-b327-0d94e8f01efb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 14:03:29 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-727a1692-ea28-4a77-b327-0d94e8f01efb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 14:03:29 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-727a1692-ea28-4a77-b327-0d94e8f01efb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:03:29 devstack sudo[103147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 Jul 13 14:03:29 devstack sudo[103147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:03:29 devstack sudo[103146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-3a022bca-3248-46f9-a63d-cad31a8db027 Jul 13 14:03:29 devstack sudo[103146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:03:29 devstack sudo[103147]: pam_unix(sudo:session): session closed for user root Jul 13 14:03:29 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-727a1692-ea28-4a77-b327-0d94e8f01efb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78" returned: 0 in 0.289s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:03:29 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-727a1692-ea28-4a77-b327-0d94e8f01efb None None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 14:03:29 devstack cinder-volume[87098]: DEBUG oslo_service.periodic_task [None req-727a1692-ea28-4a77-b327-0d94e8f01efb None None] Running periodic task VolumeManager._thread_info {{(pid=87098) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 13 14:03:29 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-727a1692-ea28-4a77-b327-0d94e8f01efb None None] thread count: 28 {{(pid=87098) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 13 14:03:29 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-727a1692-ea28-4a77-b327-0d94e8f01efb None None] thread info: [<_MainThread(MainThread, started 127988054597760)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87098) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 13 14:03:29 devstack sudo[103146]: pam_unix(sudo:session): session closed for user root Jul 13 14:03:29 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-641ceff9-85a9-4508-92a2-7a700b481ad2 tempest-VolumeDependencyTests-966777309 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-3a022bca-3248-46f9-a63d-cad31a8db027" returned: 0 in 0.412s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:03:29 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-641ceff9-85a9-4508-92a2-7a700b481ad2 tempest-VolumeDependencyTests-966777309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-3a022bca-3248-46f9-a63d-cad31a8db027,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-3a022bca-3248-46f9-a63d-cad31a8db027.d2797bc1-23d3-4d12-940e-145da3fb3326 1G {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:03:29 devstack sudo[103154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-3a022bca-3248-46f9-a63d-cad31a8db027,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-3a022bca-3248-46f9-a63d-cad31a8db027.d2797bc1-23d3-4d12-940e-145da3fb3326 1G Jul 13 14:03:29 devstack sudo[103154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:03:29 devstack sudo[103154]: pam_unix(sudo:session): session closed for user root Jul 13 14:03:29 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-641ceff9-85a9-4508-92a2-7a700b481ad2 tempest-VolumeDependencyTests-966777309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-3a022bca-3248-46f9-a63d-cad31a8db027,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-3a022bca-3248-46f9-a63d-cad31a8db027.d2797bc1-23d3-4d12-940e-145da3fb3326 1G" returned: 0 in 0.432s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:03:29 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-641ceff9-85a9-4508-92a2-7a700b481ad2 tempest-VolumeDependencyTests-966777309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3a022bca-3248-46f9-a63d-cad31a8db027 -F qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-3a022bca-3248-46f9-a63d-cad31a8db027.d2797bc1-23d3-4d12-940e-145da3fb3326 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:03:29 devstack sudo[103160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3a022bca-3248-46f9-a63d-cad31a8db027 -F qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-3a022bca-3248-46f9-a63d-cad31a8db027.d2797bc1-23d3-4d12-940e-145da3fb3326 Jul 13 14:03:29 devstack sudo[103160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:03:30 devstack sudo[103160]: pam_unix(sudo:session): session closed for user root Jul 13 14:03:30 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-641ceff9-85a9-4508-92a2-7a700b481ad2 tempest-VolumeDependencyTests-966777309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3a022bca-3248-46f9-a63d-cad31a8db027 -F qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-3a022bca-3248-46f9-a63d-cad31a8db027.d2797bc1-23d3-4d12-940e-145da3fb3326" returned: 0 in 0.329s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:03:30 devstack cinder-volume[87098]: WARNING cinder.volume.drivers.remotefs [None req-641ceff9-85a9-4508-92a2-7a700b481ad2 tempest-VolumeDependencyTests-966777309 None] /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-3a022bca-3248-46f9-a63d-cad31a8db027.d2797bc1-23d3-4d12-940e-145da3fb3326 is being set with open permissions: ugo+rw Jul 13 14:03:30 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-641ceff9-85a9-4508-92a2-7a700b481ad2 tempest-VolumeDependencyTests-966777309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-3a022bca-3248-46f9-a63d-cad31a8db027.d2797bc1-23d3-4d12-940e-145da3fb3326 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:03:30 devstack sudo[103165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-3a022bca-3248-46f9-a63d-cad31a8db027.d2797bc1-23d3-4d12-940e-145da3fb3326 Jul 13 14:03:30 devstack sudo[103165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:03:30 devstack sudo[103165]: pam_unix(sudo:session): session closed for user root Jul 13 14:03:30 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-641ceff9-85a9-4508-92a2-7a700b481ad2 tempest-VolumeDependencyTests-966777309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-3a022bca-3248-46f9-a63d-cad31a8db027.d2797bc1-23d3-4d12-940e-145da3fb3326" returned: 0 in 0.247s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:03:30 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-641ceff9-85a9-4508-92a2-7a700b481ad2 tempest-VolumeDependencyTests-966777309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-3a022bca-3248-46f9-a63d-cad31a8db027.info {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:03:30 devstack sudo[103168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-3a022bca-3248-46f9-a63d-cad31a8db027.info Jul 13 14:03:30 devstack sudo[103168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:03:30 devstack sudo[103168]: pam_unix(sudo:session): session closed for user root Jul 13 14:03:30 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-641ceff9-85a9-4508-92a2-7a700b481ad2 tempest-VolumeDependencyTests-966777309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-3a022bca-3248-46f9-a63d-cad31a8db027.info" returned: 0 in 0.255s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:03:30 devstack cinder-volume[87098]: WARNING cinder.volume.drivers.remotefs [None req-641ceff9-85a9-4508-92a2-7a700b481ad2 tempest-VolumeDependencyTests-966777309 None] /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-3a022bca-3248-46f9-a63d-cad31a8db027.info is being set with open permissions: ugo+rw Jul 13 14:03:30 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-641ceff9-85a9-4508-92a2-7a700b481ad2 tempest-VolumeDependencyTests-966777309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-3a022bca-3248-46f9-a63d-cad31a8db027.info {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:03:30 devstack sudo[103171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-3a022bca-3248-46f9-a63d-cad31a8db027.info Jul 13 14:03:30 devstack sudo[103171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:03:31 devstack sudo[103171]: pam_unix(sudo:session): session closed for user root Jul 13 14:03:31 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-641ceff9-85a9-4508-92a2-7a700b481ad2 tempest-VolumeDependencyTests-966777309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-3a022bca-3248-46f9-a63d-cad31a8db027.info" returned: 0 in 0.258s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:03:31 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-641ceff9-85a9-4508-92a2-7a700b481ad2 tempest-VolumeDependencyTests-966777309 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.026s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 14:03:31 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-641ceff9-85a9-4508-92a2-7a700b481ad2 tempest-VolumeDependencyTests-966777309 None] Create snapshot completed successfully Jul 13 14:03:32 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-f2787ab3-0b83-4687-99f6-0790a47b86a7 tempest-VolumeDependencyTests-966777309 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 14:03:32 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-f2787ab3-0b83-4687-99f6-0790a47b86a7 tempest-VolumeDependencyTests-966777309 None] Flow 'volume_create_manager' (6686cf13-f8d2-4ec2-9c17-1fa20e116549) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 14:03:32 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-f2787ab3-0b83-4687-99f6-0790a47b86a7 tempest-VolumeDependencyTests-966777309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9ad8d67-8f00-42bf-ae79-7211dcfa7c67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:03:32 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-f2787ab3-0b83-4687-99f6-0790a47b86a7 tempest-VolumeDependencyTests-966777309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9ad8d67-8f00-42bf-ae79-7211dcfa7c67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T12:03:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1717754749',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7237d372-b074-431a-8efd-5800776ee3dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ee818648f484682ba4ad7d08cac9318',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T12:03:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=d2797bc1-23d3-4d12-940e-145da3fb3326,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T12:03:33Z,use_quota=True,user_id='a5b52678f79c43abb451317f8aa4e9af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1147de8b-623b-426c-a13d-7fc824a80f67),volume_type_id=1147de8b-623b-426c-a13d-7fc824a80f67)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:03:32 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-f2787ab3-0b83-4687-99f6-0790a47b86a7 tempest-VolumeDependencyTests-966777309 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2ce8abf-7026-4aff-844b-6cccf0f7c0b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:03:32 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-f2787ab3-0b83-4687-99f6-0790a47b86a7 tempest-VolumeDependencyTests-966777309 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2ce8abf-7026-4aff-844b-6cccf0f7c0b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:03:32 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-f2787ab3-0b83-4687-99f6-0790a47b86a7 tempest-VolumeDependencyTests-966777309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b149d285-1237-47c8-af57-68d9c149c054) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:03:32 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-f2787ab3-0b83-4687-99f6-0790a47b86a7 tempest-VolumeDependencyTests-966777309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b149d285-1237-47c8-af57-68d9c149c054) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '7237d372-b074-431a-8efd-5800776ee3dd', 'volume_name': 'volume-7237d372-b074-431a-8efd-5800776ee3dd', 'volume_size': 1, 'snapshot_id': 'd2797bc1-23d3-4d12-940e-145da3fb3326'}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:03:32 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-f2787ab3-0b83-4687-99f6-0790a47b86a7 tempest-VolumeDependencyTests-966777309 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (302c5ecd-6350-44fd-91a5-1a0452e23665) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:03:32 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-f2787ab3-0b83-4687-99f6-0790a47b86a7 tempest-VolumeDependencyTests-966777309 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (302c5ecd-6350-44fd-91a5-1a0452e23665) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:03:32 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-f2787ab3-0b83-4687-99f6-0790a47b86a7 tempest-VolumeDependencyTests-966777309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b62ed2a-f4d0-469d-a0b9-47d958fea4aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:03:32 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-f2787ab3-0b83-4687-99f6-0790a47b86a7 tempest-VolumeDependencyTests-966777309 None] Volume 7237d372-b074-431a-8efd-5800776ee3dd: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-7237d372-b074-431a-8efd-5800776ee3dd', 'volume_size': 1, 'snapshot_id': 'd2797bc1-23d3-4d12-940e-145da3fb3326'} Jul 13 14:03:32 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-f2787ab3-0b83-4687-99f6-0790a47b86a7 tempest-VolumeDependencyTests-966777309 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 14:03:32 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-f2787ab3-0b83-4687-99f6-0790a47b86a7 tempest-VolumeDependencyTests-966777309 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 14:03:32 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-f2787ab3-0b83-4687-99f6-0790a47b86a7 tempest-VolumeDependencyTests-966777309 None] Acquiring lock "cinder-quobyte-d2797bc1-23d3-4d12-940e-145da3fb3326-7237d372-b074-431a-8efd-5800776ee3dd" by "_create_volume_from_snapshot" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 14:03:32 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-f2787ab3-0b83-4687-99f6-0790a47b86a7 tempest-VolumeDependencyTests-966777309 None] Lock "cinder-quobyte-d2797bc1-23d3-4d12-940e-145da3fb3326-7237d372-b074-431a-8efd-5800776ee3dd" acquired by "_create_volume_from_snapshot" :: waited 0.016s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 14:03:32 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-f2787ab3-0b83-4687-99f6-0790a47b86a7 tempest-VolumeDependencyTests-966777309 None] Creating volume 7237d372-b074-431a-8efd-5800776ee3dd from snapshot d2797bc1-23d3-4d12-940e-145da3fb3326 {{(pid=87098) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 13 14:03:32 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-f2787ab3-0b83-4687-99f6-0790a47b86a7 tempest-VolumeDependencyTests-966777309 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 14:03:32 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-f2787ab3-0b83-4687-99f6-0790a47b86a7 tempest-VolumeDependencyTests-966777309 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 14:03:32 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-f2787ab3-0b83-4687-99f6-0790a47b86a7 tempest-VolumeDependencyTests-966777309 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 14:03:32 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-f2787ab3-0b83-4687-99f6-0790a47b86a7 tempest-VolumeDependencyTests-966777309 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 14:03:32 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-f2787ab3-0b83-4687-99f6-0790a47b86a7 tempest-VolumeDependencyTests-966777309 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 14:03:32 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-f2787ab3-0b83-4687-99f6-0790a47b86a7 tempest-VolumeDependencyTests-966777309 None] Selected osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 14:03:32 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-f2787ab3-0b83-4687-99f6-0790a47b86a7 tempest-VolumeDependencyTests-966777309 None] Acquiring lock "cinder-quobyte-7237d372-b074-431a-8efd-5800776ee3dd" by "_copy_volume_from_snapshot" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 14:03:32 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-f2787ab3-0b83-4687-99f6-0790a47b86a7 tempest-VolumeDependencyTests-966777309 None] Lock "cinder-quobyte-7237d372-b074-431a-8efd-5800776ee3dd" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 14:03:32 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-f2787ab3-0b83-4687-99f6-0790a47b86a7 tempest-VolumeDependencyTests-966777309 None] snapshot: d2797bc1-23d3-4d12-940e-145da3fb3326, volume: 7237d372-b074-431a-8efd-5800776ee3dd, {{(pid=87098) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 13 14:03:32 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-f2787ab3-0b83-4687-99f6-0790a47b86a7 tempest-VolumeDependencyTests-966777309 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 14:03:32 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-f2787ab3-0b83-4687-99f6-0790a47b86a7 tempest-VolumeDependencyTests-966777309 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 14:03:32 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-f2787ab3-0b83-4687-99f6-0790a47b86a7 tempest-VolumeDependencyTests-966777309 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 14:03:32 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-f2787ab3-0b83-4687-99f6-0790a47b86a7 tempest-VolumeDependencyTests-966777309 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 14:03:32 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-f2787ab3-0b83-4687-99f6-0790a47b86a7 tempest-VolumeDependencyTests-966777309 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 14:03:32 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e006527-d7cb-41f3-a41e-b2d18fbc554a]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 14:03:32 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-f2787ab3-0b83-4687-99f6-0790a47b86a7 tempest-VolumeDependencyTests-966777309 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-3a022bca-3248-46f9-a63d-cad31a8db027.d2797bc1-23d3-4d12-940e-145da3fb3326 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:03:33 devstack sudo[103174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-3a022bca-3248-46f9-a63d-cad31a8db027.d2797bc1-23d3-4d12-940e-145da3fb3326 Jul 13 14:03:33 devstack sudo[103174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:03:33 devstack sudo[103174]: pam_unix(sudo:session): session closed for user root Jul 13 14:03:33 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-f2787ab3-0b83-4687-99f6-0790a47b86a7 tempest-VolumeDependencyTests-966777309 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-3a022bca-3248-46f9-a63d-cad31a8db027.d2797bc1-23d3-4d12-940e-145da3fb3326" returned: 0 in 0.403s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:03:33 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-f2787ab3-0b83-4687-99f6-0790a47b86a7 tempest-VolumeDependencyTests-966777309 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3a022bca-3248-46f9-a63d-cad31a8db027(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87098) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 13 14:03:33 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-f2787ab3-0b83-4687-99f6-0790a47b86a7 tempest-VolumeDependencyTests-966777309 None] will copy from snapshot at /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-3a022bca-3248-46f9-a63d-cad31a8db027 {{(pid=87098) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 13 14:03:33 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-f2787ab3-0b83-4687-99f6-0790a47b86a7 tempest-VolumeDependencyTests-966777309 None] Creating direct copy from snapshot {{(pid=87098) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 13 14:03:33 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[7176b919-e91b-44ee-b15d-c10d07d0c23d]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 14:03:33 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-f2787ab3-0b83-4687-99f6-0790a47b86a7 tempest-VolumeDependencyTests-966777309 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-3a022bca-3248-46f9-a63d-cad31a8db027 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:03:33 devstack sudo[103179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-3a022bca-3248-46f9-a63d-cad31a8db027 Jul 13 14:03:33 devstack sudo[103179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:03:33 devstack sudo[103179]: pam_unix(sudo:session): session closed for user root Jul 13 14:03:33 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-f2787ab3-0b83-4687-99f6-0790a47b86a7 tempest-VolumeDependencyTests-966777309 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-3a022bca-3248-46f9-a63d-cad31a8db027" returned: 0 in 0.386s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:03:33 devstack cinder-volume[87098]: DEBUG cinder.utils [None req-f2787ab3-0b83-4687-99f6-0790a47b86a7 tempest-VolumeDependencyTests-966777309 None] Path /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-7237d372-b074-431a-8efd-5800776ee3dd not found in is_blk_device check {{(pid=87098) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 13 14:03:33 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-f2787ab3-0b83-4687-99f6-0790a47b86a7 tempest-VolumeDependencyTests-966777309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-3a022bca-3248-46f9-a63d-cad31a8db027 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-7237d372-b074-431a-8efd-5800776ee3dd {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:03:33 devstack sudo[103184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-3a022bca-3248-46f9-a63d-cad31a8db027 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-7237d372-b074-431a-8efd-5800776ee3dd Jul 13 14:03:33 devstack sudo[103184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:03:39 devstack sudo[103184]: pam_unix(sudo:session): session closed for user root Jul 13 14:03:39 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-f2787ab3-0b83-4687-99f6-0790a47b86a7 tempest-VolumeDependencyTests-966777309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-3a022bca-3248-46f9-a63d-cad31a8db027 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-7237d372-b074-431a-8efd-5800776ee3dd" returned: 0 in 5.725s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:03:39 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b6dfb30-3bc0-489f-bfde-37bb3617f260]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 14:03:39 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-f2787ab3-0b83-4687-99f6-0790a47b86a7 tempest-VolumeDependencyTests-966777309 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-3a022bca-3248-46f9-a63d-cad31a8db027 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:03:39 devstack sudo[103210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-3a022bca-3248-46f9-a63d-cad31a8db027 Jul 13 14:03:39 devstack sudo[103210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:03:39 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [req-5a75505d-7113-451c-b5ef-8ea450a73d70 req-c470537b-b985-44fb-8711-bdeab6a8aa0f tempest-TestStampPattern-1316181496 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 14:03:40 devstack sudo[103210]: pam_unix(sudo:session): session closed for user root Jul 13 14:03:40 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-f2787ab3-0b83-4687-99f6-0790a47b86a7 tempest-VolumeDependencyTests-966777309 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-3a022bca-3248-46f9-a63d-cad31a8db027" returned: 0 in 0.579s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:03:40 devstack cinder-volume[87098]: DEBUG cinder.image.image_utils [None req-f2787ab3-0b83-4687-99f6-0790a47b86a7 tempest-VolumeDependencyTests-966777309 None] Image conversion details: src /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-3a022bca-3248-46f9-a63d-cad31a8db027, size 1024.00 MB, duration 5.73 sec, destination /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-7237d372-b074-431a-8efd-5800776ee3dd {{(pid=87098) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 13 14:03:40 devstack cinder-volume[87098]: INFO cinder.image.image_utils [None req-f2787ab3-0b83-4687-99f6-0790a47b86a7 tempest-VolumeDependencyTests-966777309 None] Converted 1024.00 MB image at 178.83 MB/s Jul 13 14:03:40 devstack cinder-volume[87098]: WARNING cinder.volume.drivers.remotefs [None req-f2787ab3-0b83-4687-99f6-0790a47b86a7 tempest-VolumeDependencyTests-966777309 None] /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-7237d372-b074-431a-8efd-5800776ee3dd is being set with open permissions: ugo+rw Jul 13 14:03:40 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-f2787ab3-0b83-4687-99f6-0790a47b86a7 tempest-VolumeDependencyTests-966777309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-7237d372-b074-431a-8efd-5800776ee3dd {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:03:40 devstack sudo[103218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-7237d372-b074-431a-8efd-5800776ee3dd Jul 13 14:03:40 devstack sudo[103218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:03:40 devstack sudo[103218]: pam_unix(sudo:session): session closed for user root Jul 13 14:03:40 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-f2787ab3-0b83-4687-99f6-0790a47b86a7 tempest-VolumeDependencyTests-966777309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-7237d372-b074-431a-8efd-5800776ee3dd" returned: 0 in 0.239s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:03:40 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-f2787ab3-0b83-4687-99f6-0790a47b86a7 tempest-VolumeDependencyTests-966777309 None] Lock "cinder-quobyte-7237d372-b074-431a-8efd-5800776ee3dd" released by "_copy_volume_from_snapshot" :: held 7.455s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 14:03:40 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-f2787ab3-0b83-4687-99f6-0790a47b86a7 tempest-VolumeDependencyTests-966777309 None] Lock "cinder-quobyte-d2797bc1-23d3-4d12-940e-145da3fb3326-7237d372-b074-431a-8efd-5800776ee3dd" released by "_create_volume_from_snapshot" :: held 7.487s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 14:03:40 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-f2787ab3-0b83-4687-99f6-0790a47b86a7 tempest-VolumeDependencyTests-966777309 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.505s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 14:03:40 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [req-5a75505d-7113-451c-b5ef-8ea450a73d70 req-c470537b-b985-44fb-8711-bdeab6a8aa0f tempest-TestStampPattern-1316181496 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.626s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 14:03:40 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe6db379-17b3-43e9-af61-8d878c802edd]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 14:03:40 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [req-5a75505d-7113-451c-b5ef-8ea450a73d70 req-c470537b-b985-44fb-8711-bdeab6a8aa0f tempest-TestStampPattern-1316181496 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-eedbbce3-433b-4d33-ad8c-5a1d88c976c0 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:03:40 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-f2787ab3-0b83-4687-99f6-0790a47b86a7 tempest-VolumeDependencyTests-966777309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b62ed2a-f4d0-469d-a0b9-47d958fea4aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7237d372-b074-431a-8efd-5800776ee3dd', 'volume_size': 1, 'snapshot_id': 'd2797bc1-23d3-4d12-940e-145da3fb3326'}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:03:40 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-f2787ab3-0b83-4687-99f6-0790a47b86a7 tempest-VolumeDependencyTests-966777309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2904cde8-6ef4-4242-843f-fae4c7168921) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:03:40 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-f2787ab3-0b83-4687-99f6-0790a47b86a7 tempest-VolumeDependencyTests-966777309 None] Volume volume-7237d372-b074-431a-8efd-5800776ee3dd (7237d372-b074-431a-8efd-5800776ee3dd): created successfully Jul 13 14:03:40 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-f2787ab3-0b83-4687-99f6-0790a47b86a7 tempest-VolumeDependencyTests-966777309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2904cde8-6ef4-4242-843f-fae4c7168921) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:03:40 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-f2787ab3-0b83-4687-99f6-0790a47b86a7 tempest-VolumeDependencyTests-966777309 None] Flow 'volume_create_manager' (6686cf13-f8d2-4ec2-9c17-1fa20e116549) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 14:03:40 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-f2787ab3-0b83-4687-99f6-0790a47b86a7 tempest-VolumeDependencyTests-966777309 None] Created volume successfully. Jul 13 14:03:40 devstack sudo[103221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-eedbbce3-433b-4d33-ad8c-5a1d88c976c0 Jul 13 14:03:40 devstack sudo[103221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:03:40 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-c8c268e4-01c9-45d1-b83d-7a7ff25a64d9 tempest-VolumeDependencyTests-966777309 None] Acquiring lock "cinder-d2797bc1-23d3-4d12-940e-145da3fb3326-delete_snapshot" by "delete_snapshot" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 14:03:40 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-c8c268e4-01c9-45d1-b83d-7a7ff25a64d9 tempest-VolumeDependencyTests-966777309 None] Lock "cinder-d2797bc1-23d3-4d12-940e-145da3fb3326-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 14:03:40 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-c8c268e4-01c9-45d1-b83d-7a7ff25a64d9 tempest-VolumeDependencyTests-966777309 None] Acquiring lock "cinder-quobyte-3a022bca-3248-46f9-a63d-cad31a8db027" by "delete_snapshot" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 14:03:40 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-c8c268e4-01c9-45d1-b83d-7a7ff25a64d9 tempest-VolumeDependencyTests-966777309 None] Lock "cinder-quobyte-3a022bca-3248-46f9-a63d-cad31a8db027" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 14:03:40 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-c8c268e4-01c9-45d1-b83d-7a7ff25a64d9 tempest-VolumeDependencyTests-966777309 None] Acquiring lock "cinder-quobyte-d2797bc1-23d3-4d12-940e-145da3fb3326" by "_delete_snapshot" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 14:03:40 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-c8c268e4-01c9-45d1-b83d-7a7ff25a64d9 tempest-VolumeDependencyTests-966777309 None] Lock "cinder-quobyte-d2797bc1-23d3-4d12-940e-145da3fb3326" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 14:03:40 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-c8c268e4-01c9-45d1-b83d-7a7ff25a64d9 tempest-VolumeDependencyTests-966777309 None] Deleting offline snapshot d2797bc1-23d3-4d12-940e-145da3fb3326 of volume 3a022bca-3248-46f9-a63d-cad31a8db027 {{(pid=87098) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 13 14:03:40 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-c8c268e4-01c9-45d1-b83d-7a7ff25a64d9 tempest-VolumeDependencyTests-966777309 None] snapshot_file for this snap is: volume-3a022bca-3248-46f9-a63d-cad31a8db027.d2797bc1-23d3-4d12-940e-145da3fb3326 {{(pid=87098) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 13 14:03:40 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[3605ff00-8fac-4360-9c03-34bb64b6c588]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 14:03:40 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-c8c268e4-01c9-45d1-b83d-7a7ff25a64d9 tempest-VolumeDependencyTests-966777309 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-3a022bca-3248-46f9-a63d-cad31a8db027.d2797bc1-23d3-4d12-940e-145da3fb3326 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:03:40 devstack sudo[103221]: pam_unix(sudo:session): session closed for user root Jul 13 14:03:40 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [req-5a75505d-7113-451c-b5ef-8ea450a73d70 req-c470537b-b985-44fb-8711-bdeab6a8aa0f tempest-TestStampPattern-1316181496 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-eedbbce3-433b-4d33-ad8c-5a1d88c976c0" returned: 0 in 0.461s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:03:40 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [req-5a75505d-7113-451c-b5ef-8ea450a73d70 req-c470537b-b985-44fb-8711-bdeab6a8aa0f tempest-TestStampPattern-1316181496 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.487s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 14:03:40 devstack sudo[103225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-3a022bca-3248-46f9-a63d-cad31a8db027.d2797bc1-23d3-4d12-940e-145da3fb3326 Jul 13 14:03:40 devstack sudo[103225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:03:40 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [req-5a75505d-7113-451c-b5ef-8ea450a73d70 req-c470537b-b985-44fb-8711-bdeab6a8aa0f tempest-TestStampPattern-1316181496 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654', 'name': 'volume-eedbbce3-433b-4d33-ad8c-5a1d88c976c0', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '85b1a0a0-b99b-4292-a8d2-46c7feb281f6', 'enforce_multipath': True} {{(pid=87098) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 13 14:03:41 devstack cinder-volume[87098]: INFO cinder.volume.manager [req-5a75505d-7113-451c-b5ef-8ea450a73d70 req-c470537b-b985-44fb-8711-bdeab6a8aa0f tempest-TestStampPattern-1316181496 None] attachment_update completed successfully. Jul 13 14:03:41 devstack sudo[103225]: pam_unix(sudo:session): session closed for user root Jul 13 14:03:41 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-c8c268e4-01c9-45d1-b83d-7a7ff25a64d9 tempest-VolumeDependencyTests-966777309 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-3a022bca-3248-46f9-a63d-cad31a8db027.d2797bc1-23d3-4d12-940e-145da3fb3326" returned: 0 in 0.593s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:03:41 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-c8c268e4-01c9-45d1-b83d-7a7ff25a64d9 tempest-VolumeDependencyTests-966777309 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3a022bca-3248-46f9-a63d-cad31a8db027(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87098) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 13 14:03:41 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8a30648-d1a6-40c7-b893-edc3766f97be]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 14:03:41 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-c8c268e4-01c9-45d1-b83d-7a7ff25a64d9 tempest-VolumeDependencyTests-966777309 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-3a022bca-3248-46f9-a63d-cad31a8db027 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:03:41 devstack sudo[103298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-3a022bca-3248-46f9-a63d-cad31a8db027 Jul 13 14:03:41 devstack sudo[103298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:03:41 devstack sudo[103298]: pam_unix(sudo:session): session closed for user root Jul 13 14:03:41 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-c8c268e4-01c9-45d1-b83d-7a7ff25a64d9 tempest-VolumeDependencyTests-966777309 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-3a022bca-3248-46f9-a63d-cad31a8db027" returned: 0 in 0.444s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:03:41 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-c8c268e4-01c9-45d1-b83d-7a7ff25a64d9 tempest-VolumeDependencyTests-966777309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-3a022bca-3248-46f9-a63d-cad31a8db027.d2797bc1-23d3-4d12-940e-145da3fb3326 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:03:41 devstack sudo[103619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-3a022bca-3248-46f9-a63d-cad31a8db027.d2797bc1-23d3-4d12-940e-145da3fb3326 Jul 13 14:03:41 devstack sudo[103619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:03:42 devstack sudo[103619]: pam_unix(sudo:session): session closed for user root Jul 13 14:03:42 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-c8c268e4-01c9-45d1-b83d-7a7ff25a64d9 tempest-VolumeDependencyTests-966777309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-3a022bca-3248-46f9-a63d-cad31a8db027.d2797bc1-23d3-4d12-940e-145da3fb3326" returned: 0 in 0.426s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:03:42 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-c8c268e4-01c9-45d1-b83d-7a7ff25a64d9 tempest-VolumeDependencyTests-966777309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-3a022bca-3248-46f9-a63d-cad31a8db027.d2797bc1-23d3-4d12-940e-145da3fb3326 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:03:42 devstack sudo[103625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-3a022bca-3248-46f9-a63d-cad31a8db027.d2797bc1-23d3-4d12-940e-145da3fb3326 Jul 13 14:03:42 devstack sudo[103625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:03:42 devstack sudo[103625]: pam_unix(sudo:session): session closed for user root Jul 13 14:03:42 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-c8c268e4-01c9-45d1-b83d-7a7ff25a64d9 tempest-VolumeDependencyTests-966777309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-3a022bca-3248-46f9-a63d-cad31a8db027.d2797bc1-23d3-4d12-940e-145da3fb3326" returned: 0 in 0.264s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:03:42 devstack cinder-volume[87098]: DEBUG dbcounter [-] [87098] Writing DB stats cinder:SELECT=60,cinder:UPDATE=56,cinder:INSERT=15,cinder:DELETE=8 {{(pid=87098) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 13 14:03:42 devstack cinder-volume[87098]: DEBUG dbcounter [-] [87098] Writing DB stats cinder:SELECT=65,cinder:UPDATE=61,cinder:INSERT=11,cinder:DELETE=4 {{(pid=87098) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 13 14:03:42 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-c8c268e4-01c9-45d1-b83d-7a7ff25a64d9 tempest-VolumeDependencyTests-966777309 None] Lock "cinder-quobyte-d2797bc1-23d3-4d12-940e-145da3fb3326" released by "_delete_snapshot" :: held 1.862s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 14:03:42 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-c8c268e4-01c9-45d1-b83d-7a7ff25a64d9 tempest-VolumeDependencyTests-966777309 None] Lock "cinder-quobyte-3a022bca-3248-46f9-a63d-cad31a8db027" released by "delete_snapshot" :: held 1.890s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 14:03:42 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-c8c268e4-01c9-45d1-b83d-7a7ff25a64d9 tempest-VolumeDependencyTests-966777309 None] Created reservations ['383df41b-499a-4baf-a860-008a2e73dd80', '0e163ee8-2328-4f9f-acdb-3d3b37e0a201', '241f1223-5edf-425e-bb29-b53a8c01fdea', 'e6f49e8b-e8ab-457e-9b24-3ba80db3bdb0'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 14:03:42 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-c8c268e4-01c9-45d1-b83d-7a7ff25a64d9 tempest-VolumeDependencyTests-966777309 None] Delete snapshot completed successfully. Jul 13 14:03:42 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-c8c268e4-01c9-45d1-b83d-7a7ff25a64d9 tempest-VolumeDependencyTests-966777309 None] Lock "cinder-d2797bc1-23d3-4d12-940e-145da3fb3326-delete_snapshot" released by "delete_snapshot" :: held 2.101s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 14:03:42 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-1e72243f-1ef1-4c76-b1e6-bbf14484f84d tempest-VolumeDependencyTests-966777309 None] Acquiring lock "cinder-3a022bca-3248-46f9-a63d-cad31a8db027-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 14:03:42 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-1e72243f-1ef1-4c76-b1e6-bbf14484f84d tempest-VolumeDependencyTests-966777309 None] Lock "cinder-3a022bca-3248-46f9-a63d-cad31a8db027-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 14:03:42 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-1e72243f-1ef1-4c76-b1e6-bbf14484f84d tempest-VolumeDependencyTests-966777309 None] Acquiring lock "cinder-quobyte-3a022bca-3248-46f9-a63d-cad31a8db027" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 14:03:42 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-1e72243f-1ef1-4c76-b1e6-bbf14484f84d tempest-VolumeDependencyTests-966777309 None] Lock "cinder-quobyte-3a022bca-3248-46f9-a63d-cad31a8db027" acquired by "delete_volume" :: waited 0.024s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 14:03:42 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a5cee10-cde3-49e6-9379-79f8b545f7e0]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 14:03:42 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-1e72243f-1ef1-4c76-b1e6-bbf14484f84d tempest-VolumeDependencyTests-966777309 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-3a022bca-3248-46f9-a63d-cad31a8db027 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:03:43 devstack sudo[103634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-3a022bca-3248-46f9-a63d-cad31a8db027 Jul 13 14:03:43 devstack sudo[103634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:03:43 devstack sudo[103634]: pam_unix(sudo:session): session closed for user root Jul 13 14:03:43 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-1e72243f-1ef1-4c76-b1e6-bbf14484f84d tempest-VolumeDependencyTests-966777309 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-3a022bca-3248-46f9-a63d-cad31a8db027" returned: 0 in 0.475s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:03:43 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-1e72243f-1ef1-4c76-b1e6-bbf14484f84d tempest-VolumeDependencyTests-966777309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-3a022bca-3248-46f9-a63d-cad31a8db027 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:03:43 devstack sudo[103649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-3a022bca-3248-46f9-a63d-cad31a8db027 Jul 13 14:03:43 devstack sudo[103649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:03:43 devstack sudo[103649]: pam_unix(sudo:session): session closed for user root Jul 13 14:03:43 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-1e72243f-1ef1-4c76-b1e6-bbf14484f84d tempest-VolumeDependencyTests-966777309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-3a022bca-3248-46f9-a63d-cad31a8db027" returned: 0 in 0.303s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:03:43 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-1e72243f-1ef1-4c76-b1e6-bbf14484f84d tempest-VolumeDependencyTests-966777309 None] Lock "cinder-quobyte-3a022bca-3248-46f9-a63d-cad31a8db027" released by "delete_volume" :: held 0.867s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 14:03:43 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-1e72243f-1ef1-4c76-b1e6-bbf14484f84d tempest-VolumeDependencyTests-966777309 None] Created reservations ['cef53df7-9859-4250-93d4-ec8f79dec9b4', 'd69c0f2b-9687-4b45-9804-d91af1e5d67d', '99b3f48e-ca63-4abb-9152-175ea4074311', '9fa17242-ea30-4723-92cc-80b7a206d654'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 14:03:43 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-1e72243f-1ef1-4c76-b1e6-bbf14484f84d tempest-VolumeDependencyTests-966777309 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 14:03:43 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-1e72243f-1ef1-4c76-b1e6-bbf14484f84d tempest-VolumeDependencyTests-966777309 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 14:03:43 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-1e72243f-1ef1-4c76-b1e6-bbf14484f84d tempest-VolumeDependencyTests-966777309 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 14:03:43 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-1e72243f-1ef1-4c76-b1e6-bbf14484f84d tempest-VolumeDependencyTests-966777309 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 14:03:43 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-1e72243f-1ef1-4c76-b1e6-bbf14484f84d tempest-VolumeDependencyTests-966777309 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 14:03:43 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-1e72243f-1ef1-4c76-b1e6-bbf14484f84d tempest-VolumeDependencyTests-966777309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:03:43 devstack sudo[103652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 Jul 13 14:03:43 devstack sudo[103652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:03:44 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-13c8ec24-93bd-4519-8b55-ac1a20116292 tempest-VolumeDependencyTests-966777309 None] Acquiring lock "cinder-7237d372-b074-431a-8efd-5800776ee3dd-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 14:03:44 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-13c8ec24-93bd-4519-8b55-ac1a20116292 tempest-VolumeDependencyTests-966777309 None] Lock "cinder-7237d372-b074-431a-8efd-5800776ee3dd-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 14:03:44 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-13c8ec24-93bd-4519-8b55-ac1a20116292 tempest-VolumeDependencyTests-966777309 None] Acquiring lock "cinder-quobyte-7237d372-b074-431a-8efd-5800776ee3dd" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 14:03:44 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-13c8ec24-93bd-4519-8b55-ac1a20116292 tempest-VolumeDependencyTests-966777309 None] Lock "cinder-quobyte-7237d372-b074-431a-8efd-5800776ee3dd" acquired by "delete_volume" :: waited 0.022s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 14:03:44 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2a01a41-36b1-4fb6-a67e-169b760fc3b5]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 14:03:44 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-13c8ec24-93bd-4519-8b55-ac1a20116292 tempest-VolumeDependencyTests-966777309 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-7237d372-b074-431a-8efd-5800776ee3dd {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:03:44 devstack sudo[103652]: pam_unix(sudo:session): session closed for user root Jul 13 14:03:44 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-1e72243f-1ef1-4c76-b1e6-bbf14484f84d tempest-VolumeDependencyTests-966777309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78" returned: 0 in 0.326s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:03:44 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-1e72243f-1ef1-4c76-b1e6-bbf14484f84d tempest-VolumeDependencyTests-966777309 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 14:03:44 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-1e72243f-1ef1-4c76-b1e6-bbf14484f84d tempest-VolumeDependencyTests-966777309 None] Deleted volume successfully. Jul 13 14:03:44 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-1e72243f-1ef1-4c76-b1e6-bbf14484f84d tempest-VolumeDependencyTests-966777309 None] Lock "cinder-3a022bca-3248-46f9-a63d-cad31a8db027-delete_volume" released by "delete_volume" :: held 1.477s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 14:03:44 devstack sudo[103655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-7237d372-b074-431a-8efd-5800776ee3dd Jul 13 14:03:44 devstack sudo[103655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:03:44 devstack sudo[103655]: pam_unix(sudo:session): session closed for user root Jul 13 14:03:44 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-13c8ec24-93bd-4519-8b55-ac1a20116292 tempest-VolumeDependencyTests-966777309 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-7237d372-b074-431a-8efd-5800776ee3dd" returned: 0 in 0.422s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:03:44 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-13c8ec24-93bd-4519-8b55-ac1a20116292 tempest-VolumeDependencyTests-966777309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-7237d372-b074-431a-8efd-5800776ee3dd {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:03:44 devstack sudo[103662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-7237d372-b074-431a-8efd-5800776ee3dd Jul 13 14:03:44 devstack sudo[103662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:03:44 devstack cinder-volume[87098]: INFO cinder.volume.manager [req-5baa001f-8baa-4769-a010-a00c37552515 req-e2132619-9909-427a-8927-6de8a5748234 tempest-TestStampPattern-1316181496 None] Terminate volume connection completed successfully. Jul 13 14:03:44 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [req-5baa001f-8baa-4769-a010-a00c37552515 req-e2132619-9909-427a-8927-6de8a5748234 tempest-TestStampPattern-1316181496 None] Deleting attachment 85b1a0a0-b99b-4292-a8d2-46c7feb281f6. {{(pid=87098) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 13 14:03:44 devstack sudo[103662]: pam_unix(sudo:session): session closed for user root Jul 13 14:03:44 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-13c8ec24-93bd-4519-8b55-ac1a20116292 tempest-VolumeDependencyTests-966777309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-7237d372-b074-431a-8efd-5800776ee3dd" returned: 0 in 0.306s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:03:44 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-13c8ec24-93bd-4519-8b55-ac1a20116292 tempest-VolumeDependencyTests-966777309 None] Lock "cinder-quobyte-7237d372-b074-431a-8efd-5800776ee3dd" released by "delete_volume" :: held 0.804s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 14:03:45 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-13c8ec24-93bd-4519-8b55-ac1a20116292 tempest-VolumeDependencyTests-966777309 None] Created reservations ['09c4e5dc-1c0c-4dfc-b3ef-3861a75b33b0', '1ff4df50-a36f-40d0-bedf-dd8fbf3afdc4', '794083c7-4250-4c86-9580-7938b3632b56', '9916f4d6-149f-4eef-be89-f120e0398f87'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 14:03:45 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-13c8ec24-93bd-4519-8b55-ac1a20116292 tempest-VolumeDependencyTests-966777309 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 14:03:45 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-13c8ec24-93bd-4519-8b55-ac1a20116292 tempest-VolumeDependencyTests-966777309 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 14:03:45 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-13c8ec24-93bd-4519-8b55-ac1a20116292 tempest-VolumeDependencyTests-966777309 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 14:03:45 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-13c8ec24-93bd-4519-8b55-ac1a20116292 tempest-VolumeDependencyTests-966777309 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 14:03:45 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-13c8ec24-93bd-4519-8b55-ac1a20116292 tempest-VolumeDependencyTests-966777309 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 14:03:45 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-13c8ec24-93bd-4519-8b55-ac1a20116292 tempest-VolumeDependencyTests-966777309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:03:45 devstack sudo[103690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 Jul 13 14:03:45 devstack sudo[103690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:03:45 devstack sudo[103690]: pam_unix(sudo:session): session closed for user root Jul 13 14:03:45 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-13c8ec24-93bd-4519-8b55-ac1a20116292 tempest-VolumeDependencyTests-966777309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78" returned: 0 in 0.260s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:03:45 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-13c8ec24-93bd-4519-8b55-ac1a20116292 tempest-VolumeDependencyTests-966777309 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 14:03:45 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-13c8ec24-93bd-4519-8b55-ac1a20116292 tempest-VolumeDependencyTests-966777309 None] Deleted volume successfully. Jul 13 14:03:45 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-13c8ec24-93bd-4519-8b55-ac1a20116292 tempest-VolumeDependencyTests-966777309 None] Lock "cinder-7237d372-b074-431a-8efd-5800776ee3dd-delete_volume" released by "delete_volume" :: held 1.319s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 14:03:50 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-e03134a6-5a6e-4738-867e-23fc82905253 tempest-TestStampPattern-1316181496 None] Acquiring lock "cinder-eedbbce3-433b-4d33-ad8c-5a1d88c976c0-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 14:03:50 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-e03134a6-5a6e-4738-867e-23fc82905253 tempest-TestStampPattern-1316181496 None] Lock "cinder-eedbbce3-433b-4d33-ad8c-5a1d88c976c0-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 14:03:50 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-e03134a6-5a6e-4738-867e-23fc82905253 tempest-TestStampPattern-1316181496 None] Acquiring lock "cinder-quobyte-eedbbce3-433b-4d33-ad8c-5a1d88c976c0" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 14:03:50 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-e03134a6-5a6e-4738-867e-23fc82905253 tempest-TestStampPattern-1316181496 None] Lock "cinder-quobyte-eedbbce3-433b-4d33-ad8c-5a1d88c976c0" acquired by "delete_volume" :: waited 0.024s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 14:03:50 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[9936e701-7b8b-41a1-b5d8-b35ab3eb10f4]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 14:03:50 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-e03134a6-5a6e-4738-867e-23fc82905253 tempest-TestStampPattern-1316181496 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-eedbbce3-433b-4d33-ad8c-5a1d88c976c0 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:03:50 devstack sudo[103729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-eedbbce3-433b-4d33-ad8c-5a1d88c976c0 Jul 13 14:03:50 devstack sudo[103729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:03:50 devstack sudo[103729]: pam_unix(sudo:session): session closed for user root Jul 13 14:03:50 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-e03134a6-5a6e-4738-867e-23fc82905253 tempest-TestStampPattern-1316181496 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-eedbbce3-433b-4d33-ad8c-5a1d88c976c0" returned: 0 in 0.515s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:03:50 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-e03134a6-5a6e-4738-867e-23fc82905253 tempest-TestStampPattern-1316181496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-eedbbce3-433b-4d33-ad8c-5a1d88c976c0 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:03:50 devstack sudo[103734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-eedbbce3-433b-4d33-ad8c-5a1d88c976c0 Jul 13 14:03:50 devstack sudo[103734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:03:51 devstack sudo[103734]: pam_unix(sudo:session): session closed for user root Jul 13 14:03:51 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-e03134a6-5a6e-4738-867e-23fc82905253 tempest-TestStampPattern-1316181496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-eedbbce3-433b-4d33-ad8c-5a1d88c976c0" returned: 0 in 0.307s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:03:51 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-e03134a6-5a6e-4738-867e-23fc82905253 tempest-TestStampPattern-1316181496 None] Lock "cinder-quobyte-eedbbce3-433b-4d33-ad8c-5a1d88c976c0" released by "delete_volume" :: held 0.880s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 14:03:51 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-e03134a6-5a6e-4738-867e-23fc82905253 tempest-TestStampPattern-1316181496 None] Created reservations ['93c6b14a-31ab-4c7a-8d18-fdf20f0b8879', 'ca858a93-f504-49ff-b3a0-f7f016e3e23f', '9360c361-aa7d-4d1f-b585-ce90f5edfec1', '72b77c3b-891b-4758-99eb-5d5d78203dda'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 14:03:51 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-e03134a6-5a6e-4738-867e-23fc82905253 tempest-TestStampPattern-1316181496 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 14:03:51 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-e03134a6-5a6e-4738-867e-23fc82905253 tempest-TestStampPattern-1316181496 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 14:03:51 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-e03134a6-5a6e-4738-867e-23fc82905253 tempest-TestStampPattern-1316181496 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 14:03:51 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-e03134a6-5a6e-4738-867e-23fc82905253 tempest-TestStampPattern-1316181496 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 14:03:51 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-e03134a6-5a6e-4738-867e-23fc82905253 tempest-TestStampPattern-1316181496 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 14:03:51 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-e03134a6-5a6e-4738-867e-23fc82905253 tempest-TestStampPattern-1316181496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:03:51 devstack sudo[103737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 Jul 13 14:03:51 devstack sudo[103737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:03:51 devstack sudo[103737]: pam_unix(sudo:session): session closed for user root Jul 13 14:03:51 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-e03134a6-5a6e-4738-867e-23fc82905253 tempest-TestStampPattern-1316181496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78" returned: 0 in 0.341s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:03:51 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-e03134a6-5a6e-4738-867e-23fc82905253 tempest-TestStampPattern-1316181496 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 14:03:51 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-e03134a6-5a6e-4738-867e-23fc82905253 tempest-TestStampPattern-1316181496 None] Deleted volume successfully. Jul 13 14:03:51 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-e03134a6-5a6e-4738-867e-23fc82905253 tempest-TestStampPattern-1316181496 None] Lock "cinder-eedbbce3-433b-4d33-ad8c-5a1d88c976c0-delete_volume" released by "delete_volume" :: held 1.553s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 14:03:51 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-83657b20-4b84-4185-ad90-ac4027648f5e tempest-TestStampPattern-1316181496 None] Acquiring lock "cinder-6125f572-4fef-487f-8525-ab2a63b79f3d-delete_snapshot" by "delete_snapshot" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 14:03:51 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-83657b20-4b84-4185-ad90-ac4027648f5e tempest-TestStampPattern-1316181496 None] Lock "cinder-6125f572-4fef-487f-8525-ab2a63b79f3d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 14:03:51 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-83657b20-4b84-4185-ad90-ac4027648f5e tempest-TestStampPattern-1316181496 None] Acquiring lock "cinder-quobyte-55554bd4-18e8-4e7e-a946-d481530b3100" by "delete_snapshot" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 14:03:51 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-83657b20-4b84-4185-ad90-ac4027648f5e tempest-TestStampPattern-1316181496 None] Lock "cinder-quobyte-55554bd4-18e8-4e7e-a946-d481530b3100" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 14:03:51 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-83657b20-4b84-4185-ad90-ac4027648f5e tempest-TestStampPattern-1316181496 None] Acquiring lock "cinder-quobyte-6125f572-4fef-487f-8525-ab2a63b79f3d" by "_delete_snapshot" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 14:03:51 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-83657b20-4b84-4185-ad90-ac4027648f5e tempest-TestStampPattern-1316181496 None] Lock "cinder-quobyte-6125f572-4fef-487f-8525-ab2a63b79f3d" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 14:03:51 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-83657b20-4b84-4185-ad90-ac4027648f5e tempest-TestStampPattern-1316181496 None] Deleting offline snapshot 6125f572-4fef-487f-8525-ab2a63b79f3d of volume 55554bd4-18e8-4e7e-a946-d481530b3100 {{(pid=87098) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 13 14:03:51 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-83657b20-4b84-4185-ad90-ac4027648f5e tempest-TestStampPattern-1316181496 None] snapshot_file for this snap is: volume-55554bd4-18e8-4e7e-a946-d481530b3100.6125f572-4fef-487f-8525-ab2a63b79f3d {{(pid=87098) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 13 14:03:51 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4228571-d51a-482b-a492-acf097775412]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 14:03:51 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-83657b20-4b84-4185-ad90-ac4027648f5e tempest-TestStampPattern-1316181496 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-55554bd4-18e8-4e7e-a946-d481530b3100.6125f572-4fef-487f-8525-ab2a63b79f3d {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:03:52 devstack sudo[103740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-55554bd4-18e8-4e7e-a946-d481530b3100.6125f572-4fef-487f-8525-ab2a63b79f3d Jul 13 14:03:52 devstack sudo[103740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:03:52 devstack sudo[103740]: pam_unix(sudo:session): session closed for user root Jul 13 14:03:52 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-83657b20-4b84-4185-ad90-ac4027648f5e tempest-TestStampPattern-1316181496 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-55554bd4-18e8-4e7e-a946-d481530b3100.6125f572-4fef-487f-8525-ab2a63b79f3d" returned: 0 in 0.463s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:03:52 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-83657b20-4b84-4185-ad90-ac4027648f5e tempest-TestStampPattern-1316181496 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-55554bd4-18e8-4e7e-a946-d481530b3100(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87098) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 13 14:03:52 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c4a99d1-7025-4037-8b00-2f95246481cd]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 14:03:52 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-83657b20-4b84-4185-ad90-ac4027648f5e tempest-TestStampPattern-1316181496 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-55554bd4-18e8-4e7e-a946-d481530b3100 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:03:52 devstack sudo[103745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-55554bd4-18e8-4e7e-a946-d481530b3100 Jul 13 14:03:52 devstack sudo[103745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:03:52 devstack sudo[103745]: pam_unix(sudo:session): session closed for user root Jul 13 14:03:52 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-83657b20-4b84-4185-ad90-ac4027648f5e tempest-TestStampPattern-1316181496 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-55554bd4-18e8-4e7e-a946-d481530b3100" returned: 0 in 0.392s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:03:52 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-83657b20-4b84-4185-ad90-ac4027648f5e tempest-TestStampPattern-1316181496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-55554bd4-18e8-4e7e-a946-d481530b3100.6125f572-4fef-487f-8525-ab2a63b79f3d {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:03:52 devstack sudo[103750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-55554bd4-18e8-4e7e-a946-d481530b3100.6125f572-4fef-487f-8525-ab2a63b79f3d Jul 13 14:03:52 devstack sudo[103750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:03:53 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-1671a77b-7d99-4169-80ae-336d8bdaa20f tempest-VolumeImageDependencyTests-1846275429 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 14:03:53 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-1671a77b-7d99-4169-80ae-336d8bdaa20f tempest-VolumeImageDependencyTests-1846275429 None] Flow 'volume_create_manager' (b1a88b12-5c20-43e5-97fe-cf7deebb2d06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 14:03:53 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-1671a77b-7d99-4169-80ae-336d8bdaa20f tempest-VolumeImageDependencyTests-1846275429 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72fb32c2-8652-40d7-9ba6-769071db3f00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:03:53 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-1671a77b-7d99-4169-80ae-336d8bdaa20f tempest-VolumeImageDependencyTests-1846275429 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72fb32c2-8652-40d7-9ba6-769071db3f00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T12:03:53Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4670ba4-591b-48cd-99c7-221c93586dff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6f567961c5748aa9c6f920b8ad21f44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T12:03:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T12:03:53Z,use_quota=True,user_id='28988c40f1de4ae0bdee2c7de7c23ef0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1147de8b-623b-426c-a13d-7fc824a80f67),volume_type_id=1147de8b-623b-426c-a13d-7fc824a80f67)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:03:53 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-1671a77b-7d99-4169-80ae-336d8bdaa20f tempest-VolumeImageDependencyTests-1846275429 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1853cd3f-8a38-4b2a-abd2-3fe21a2f4263) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:03:53 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-1671a77b-7d99-4169-80ae-336d8bdaa20f tempest-VolumeImageDependencyTests-1846275429 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1853cd3f-8a38-4b2a-abd2-3fe21a2f4263) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:03:53 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-1671a77b-7d99-4169-80ae-336d8bdaa20f tempest-VolumeImageDependencyTests-1846275429 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac9745e9-041e-4adc-a25a-f13c6ef59d84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:03:53 devstack cinder-volume[87098]: DEBUG cinder.image.glance [None req-1671a77b-7d99-4169-80ae-336d8bdaa20f tempest-VolumeImageDependencyTests-1846275429 None] Creating Keystone auth plugin from conf {{(pid=87098) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 13 14:03:53 devstack sudo[103750]: pam_unix(sudo:session): session closed for user root Jul 13 14:03:53 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-83657b20-4b84-4185-ad90-ac4027648f5e tempest-TestStampPattern-1316181496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-55554bd4-18e8-4e7e-a946-d481530b3100.6125f572-4fef-487f-8525-ab2a63b79f3d" returned: 0 in 0.426s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:03:53 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-83657b20-4b84-4185-ad90-ac4027648f5e tempest-TestStampPattern-1316181496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-55554bd4-18e8-4e7e-a946-d481530b3100.6125f572-4fef-487f-8525-ab2a63b79f3d {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:03:53 devstack sudo[103755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-55554bd4-18e8-4e7e-a946-d481530b3100.6125f572-4fef-487f-8525-ab2a63b79f3d Jul 13 14:03:53 devstack sudo[103755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:03:53 devstack sudo[103755]: pam_unix(sudo:session): session closed for user root Jul 13 14:03:53 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-1671a77b-7d99-4169-80ae-336d8bdaa20f tempest-VolumeImageDependencyTests-1846275429 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac9745e9-041e-4adc-a25a-f13c6ef59d84) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'c4670ba4-591b-48cd-99c7-221c93586dff', 'volume_name': 'volume-c4670ba4-591b-48cd-99c7-221c93586dff', 'volume_size': 1, 'image_id': 'cc3e260b-753b-4084-9e80-c1926cccc46c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cc3e260b-753b-4084-9e80-c1926cccc46c', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'cc4076aeecfeb576d9f3b01026b9642e', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'a6f567961c5748aa9c6f920b8ad21f44', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'a7c4a80f8bc16dcfd8bbd8715203b97a3c4991daf7d0e504a5150bb684465a0604142f11b3347be6230a82917e45d27f19bc7e83a21600ca4a9df79025537d54', 'id': 'cc3e260b-753b-4084-9e80-c1926cccc46c', 'created_at': datetime.datetime(2026, 7, 13, 12, 3, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 13, 12, 3, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cc3e260b-753b-4084-9e80-c1926cccc46c/file', 'properties': {}}, 'image_service': }' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:03:53 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-1671a77b-7d99-4169-80ae-336d8bdaa20f tempest-VolumeImageDependencyTests-1846275429 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72ea07ff-c1d8-4a7b-ac7d-b1e9dd3067a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:03:53 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-1671a77b-7d99-4169-80ae-336d8bdaa20f tempest-VolumeImageDependencyTests-1846275429 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72ea07ff-c1d8-4a7b-ac7d-b1e9dd3067a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:03:53 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-1671a77b-7d99-4169-80ae-336d8bdaa20f tempest-VolumeImageDependencyTests-1846275429 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83aa99cf-2b9e-4205-8a9e-2b95af20ab48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:03:53 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-1671a77b-7d99-4169-80ae-336d8bdaa20f tempest-VolumeImageDependencyTests-1846275429 None] Volume c4670ba4-591b-48cd-99c7-221c93586dff: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-c4670ba4-591b-48cd-99c7-221c93586dff', 'volume_size': 1, 'image_id': 'cc3e260b-753b-4084-9e80-c1926cccc46c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cc3e260b-753b-4084-9e80-c1926cccc46c', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'cc4076aeecfeb576d9f3b01026b9642e', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'a6f567961c5748aa9c6f920b8ad21f44', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'a7c4a80f8bc16dcfd8bbd8715203b97a3c4991daf7d0e504a5150bb684465a0604142f11b3347be6230a82917e45d27f19bc7e83a21600ca4a9df79025537d54', 'id': 'cc3e260b-753b-4084-9e80-c1926cccc46c', 'created_at': datetime.datetime(2026, 7, 13, 12, 3, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 13, 12, 3, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cc3e260b-753b-4084-9e80-c1926cccc46c/file', 'properties': {}}, 'image_service': } Jul 13 14:03:53 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-1671a77b-7d99-4169-80ae-336d8bdaa20f tempest-VolumeImageDependencyTests-1846275429 None] Trying to clone c4670ba4-591b-48cd-99c7-221c93586dff from image cc3e260b-753b-4084-9e80-c1926cccc46c at location (None, [{'url': 'file:///opt/stack/data/glance/images/cc3e260b-753b-4084-9e80-c1926cccc46c', 'metadata': {}}]). {{(pid=87098) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 13 14:03:53 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-83657b20-4b84-4185-ad90-ac4027648f5e tempest-TestStampPattern-1316181496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-55554bd4-18e8-4e7e-a946-d481530b3100.6125f572-4fef-487f-8525-ab2a63b79f3d" returned: 0 in 0.281s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:03:53 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-83657b20-4b84-4185-ad90-ac4027648f5e tempest-TestStampPattern-1316181496 None] Lock "cinder-quobyte-6125f572-4fef-487f-8525-ab2a63b79f3d" released by "_delete_snapshot" :: held 1.690s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 14:03:53 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-83657b20-4b84-4185-ad90-ac4027648f5e tempest-TestStampPattern-1316181496 None] Lock "cinder-quobyte-55554bd4-18e8-4e7e-a946-d481530b3100" released by "delete_snapshot" :: held 1.721s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 14:03:53 devstack cinder-volume[87098]: DEBUG cinder.image.image_utils [None req-1671a77b-7d99-4169-80ae-336d8bdaa20f tempest-VolumeImageDependencyTests-1846275429 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_cc3e260b-753b-4084-9e80-c1926cccc46c_2npfysffdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87098) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 13 14:03:53 devstack cinder-volume[87098]: INFO cinder.image.image_utils [None req-1671a77b-7d99-4169-80ae-336d8bdaa20f tempest-VolumeImageDependencyTests-1846275429 None] Image download 0.00 MB at 0.00 MB/s Jul 13 14:03:53 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-83657b20-4b84-4185-ad90-ac4027648f5e tempest-TestStampPattern-1316181496 None] Created reservations ['76857aa0-5a9f-484b-9a03-73de410a4c81', '2bd43171-f600-47db-8ed1-30e0fe0631b7', 'af5fd061-9dd7-4402-825e-ebfc1bc25424', '62cfbe2c-5923-4991-963f-6a80716d7fcf'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 14:03:53 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[aeb9fd5a-e836-40e5-87d0-6e3d23394647]: (4, 'raw') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 14:03:53 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-1671a77b-7d99-4169-80ae-336d8bdaa20f tempest-VolumeImageDependencyTests-1846275429 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cc3e260b-753b-4084-9e80-c1926cccc46c_2npfysffdevstack@QuobyteHD {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:03:53 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-83657b20-4b84-4185-ad90-ac4027648f5e tempest-TestStampPattern-1316181496 None] Delete snapshot completed successfully. Jul 13 14:03:53 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-83657b20-4b84-4185-ad90-ac4027648f5e tempest-TestStampPattern-1316181496 None] Lock "cinder-6125f572-4fef-487f-8525-ab2a63b79f3d-delete_snapshot" released by "delete_snapshot" :: held 1.903s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 14:03:53 devstack sudo[103758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cc3e260b-753b-4084-9e80-c1926cccc46c_2npfysffdevstack@QuobyteHD Jul 13 14:03:53 devstack sudo[103758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:03:54 devstack sudo[103758]: pam_unix(sudo:session): session closed for user root Jul 13 14:03:54 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-1671a77b-7d99-4169-80ae-336d8bdaa20f tempest-VolumeImageDependencyTests-1846275429 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cc3e260b-753b-4084-9e80-c1926cccc46c_2npfysffdevstack@QuobyteHD" returned: 0 in 0.400s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:03:54 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-1671a77b-7d99-4169-80ae-336d8bdaa20f tempest-VolumeImageDependencyTests-1846275429 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cc3e260b-753b-4084-9e80-c1926cccc46c_2npfysffdevstack@QuobyteHD {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:03:54 devstack sudo[103762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cc3e260b-753b-4084-9e80-c1926cccc46c_2npfysffdevstack@QuobyteHD Jul 13 14:03:54 devstack sudo[103762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:03:54 devstack sudo[103762]: pam_unix(sudo:session): session closed for user root Jul 13 14:03:54 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-1671a77b-7d99-4169-80ae-336d8bdaa20f tempest-VolumeImageDependencyTests-1846275429 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cc3e260b-753b-4084-9e80-c1926cccc46c_2npfysffdevstack@QuobyteHD" returned: 1 in 0.348s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:03:54 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-1671a77b-7d99-4169-80ae-336d8bdaa20f tempest-VolumeImageDependencyTests-1846275429 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cc3e260b-753b-4084-9e80-c1926cccc46c_2npfysffdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 13 14:03:54 devstack cinder-volume[87098]: DEBUG cinder.image.image_utils [None req-1671a77b-7d99-4169-80ae-336d8bdaa20f tempest-VolumeImageDependencyTests-1846275429 None] Temporary image cc3e260b-753b-4084-9e80-c1926cccc46c is fetched for user 28988c40f1de4ae0bdee2c7de7c23ef0. {{(pid=87098) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 13 14:03:54 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[adc959ab-f2e4-4b88-9a9b-7b4742b00757]: (4, 'raw') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 14:03:54 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-1671a77b-7d99-4169-80ae-336d8bdaa20f tempest-VolumeImageDependencyTests-1846275429 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cc3e260b-753b-4084-9e80-c1926cccc46c_2npfysffdevstack@QuobyteHD {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:03:54 devstack sudo[103767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cc3e260b-753b-4084-9e80-c1926cccc46c_2npfysffdevstack@QuobyteHD Jul 13 14:03:54 devstack sudo[103767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:03:54 devstack sudo[103767]: pam_unix(sudo:session): session closed for user root Jul 13 14:03:55 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-1671a77b-7d99-4169-80ae-336d8bdaa20f tempest-VolumeImageDependencyTests-1846275429 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cc3e260b-753b-4084-9e80-c1926cccc46c_2npfysffdevstack@QuobyteHD" returned: 0 in 0.445s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:03:55 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-1671a77b-7d99-4169-80ae-336d8bdaa20f tempest-VolumeImageDependencyTests-1846275429 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cc3e260b-753b-4084-9e80-c1926cccc46c_2npfysffdevstack@QuobyteHD {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:03:55 devstack sudo[103773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cc3e260b-753b-4084-9e80-c1926cccc46c_2npfysffdevstack@QuobyteHD Jul 13 14:03:55 devstack sudo[103773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:03:55 devstack sudo[103773]: pam_unix(sudo:session): session closed for user root Jul 13 14:03:55 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-1671a77b-7d99-4169-80ae-336d8bdaa20f tempest-VolumeImageDependencyTests-1846275429 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cc3e260b-753b-4084-9e80-c1926cccc46c_2npfysffdevstack@QuobyteHD" returned: 1 in 0.518s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:03:55 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-1671a77b-7d99-4169-80ae-336d8bdaa20f tempest-VolumeImageDependencyTests-1846275429 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cc3e260b-753b-4084-9e80-c1926cccc46c_2npfysffdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 13 14:03:55 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-1671a77b-7d99-4169-80ae-336d8bdaa20f tempest-VolumeImageDependencyTests-1846275429 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 14:03:55 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-1671a77b-7d99-4169-80ae-336d8bdaa20f tempest-VolumeImageDependencyTests-1846275429 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 14:03:55 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-1671a77b-7d99-4169-80ae-336d8bdaa20f tempest-VolumeImageDependencyTests-1846275429 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T12:03:53Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4670ba4-591b-48cd-99c7-221c93586dff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6f567961c5748aa9c6f920b8ad21f44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T12:03:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T12:03:53Z,use_quota=True,user_id='28988c40f1de4ae0bdee2c7de7c23ef0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1147de8b-623b-426c-a13d-7fc824a80f67),volume_type_id=1147de8b-623b-426c-a13d-7fc824a80f67)}" {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 13 14:03:55 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-1671a77b-7d99-4169-80ae-336d8bdaa20f tempest-VolumeImageDependencyTests-1846275429 None] Creating volume c4670ba4-591b-48cd-99c7-221c93586dff {{(pid=87098) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 13 14:03:55 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-1671a77b-7d99-4169-80ae-336d8bdaa20f tempest-VolumeImageDependencyTests-1846275429 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 14:03:55 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-1671a77b-7d99-4169-80ae-336d8bdaa20f tempest-VolumeImageDependencyTests-1846275429 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 14:03:55 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-1671a77b-7d99-4169-80ae-336d8bdaa20f tempest-VolumeImageDependencyTests-1846275429 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 14:03:55 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-1671a77b-7d99-4169-80ae-336d8bdaa20f tempest-VolumeImageDependencyTests-1846275429 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 14:03:55 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-1671a77b-7d99-4169-80ae-336d8bdaa20f tempest-VolumeImageDependencyTests-1846275429 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 14:03:55 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-1671a77b-7d99-4169-80ae-336d8bdaa20f tempest-VolumeImageDependencyTests-1846275429 None] Selected osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 14:03:55 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-1671a77b-7d99-4169-80ae-336d8bdaa20f tempest-VolumeImageDependencyTests-1846275429 None] casted to osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 Jul 13 14:03:55 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-1671a77b-7d99-4169-80ae-336d8bdaa20f tempest-VolumeImageDependencyTests-1846275429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-c4670ba4-591b-48cd-99c7-221c93586dff 1073741824 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:03:55 devstack sudo[103790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-c4670ba4-591b-48cd-99c7-221c93586dff 1073741824 Jul 13 14:03:55 devstack sudo[103790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:03:56 devstack sudo[103790]: pam_unix(sudo:session): session closed for user root Jul 13 14:03:56 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-1671a77b-7d99-4169-80ae-336d8bdaa20f tempest-VolumeImageDependencyTests-1846275429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-c4670ba4-591b-48cd-99c7-221c93586dff 1073741824" returned: 0 in 0.659s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:03:56 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-1671a77b-7d99-4169-80ae-336d8bdaa20f tempest-VolumeImageDependencyTests-1846275429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-c4670ba4-591b-48cd-99c7-221c93586dff {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:03:56 devstack sudo[103806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-c4670ba4-591b-48cd-99c7-221c93586dff Jul 13 14:03:56 devstack sudo[103806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:03:56 devstack sudo[103806]: pam_unix(sudo:session): session closed for user root Jul 13 14:03:56 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-1671a77b-7d99-4169-80ae-336d8bdaa20f tempest-VolumeImageDependencyTests-1846275429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-c4670ba4-591b-48cd-99c7-221c93586dff" returned: 0 in 0.309s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:03:56 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-1671a77b-7d99-4169-80ae-336d8bdaa20f tempest-VolumeImageDependencyTests-1846275429 None] <== create_volume: return (1041ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'} {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 13 14:03:56 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-1671a77b-7d99-4169-80ae-336d8bdaa20f tempest-VolumeImageDependencyTests-1846275429 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.049s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 14:03:56 devstack cinder-volume[87098]: DEBUG cinder.volume.volume_utils [None req-1671a77b-7d99-4169-80ae-336d8bdaa20f tempest-VolumeImageDependencyTests-1846275429 None] Attempting download of cc3e260b-753b-4084-9e80-c1926cccc46c ((None, [{'url': 'file:///opt/stack/data/glance/images/cc3e260b-753b-4084-9e80-c1926cccc46c', 'metadata': {}}])) to volume c4670ba4-591b-48cd-99c7-221c93586dff. {{(pid=87098) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 13 14:03:56 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[62d5fb88-6a55-46e3-8a71-eccf43bc25f0]: (4, 'raw') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 14:03:56 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-1671a77b-7d99-4169-80ae-336d8bdaa20f tempest-VolumeImageDependencyTests-1846275429 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cc3e260b-753b-4084-9e80-c1926cccc46c_taifu_v1 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:03:56 devstack sudo[103811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cc3e260b-753b-4084-9e80-c1926cccc46c_taifu_v1 Jul 13 14:03:56 devstack sudo[103811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:03:57 devstack sudo[103811]: pam_unix(sudo:session): session closed for user root Jul 13 14:03:57 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-1671a77b-7d99-4169-80ae-336d8bdaa20f tempest-VolumeImageDependencyTests-1846275429 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cc3e260b-753b-4084-9e80-c1926cccc46c_taifu_v1" returned: 0 in 0.405s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:03:57 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-1671a77b-7d99-4169-80ae-336d8bdaa20f tempest-VolumeImageDependencyTests-1846275429 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cc3e260b-753b-4084-9e80-c1926cccc46c_taifu_v1 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:03:57 devstack sudo[103816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cc3e260b-753b-4084-9e80-c1926cccc46c_taifu_v1 Jul 13 14:03:57 devstack sudo[103816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:03:57 devstack sudo[103816]: pam_unix(sudo:session): session closed for user root Jul 13 14:03:57 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-1671a77b-7d99-4169-80ae-336d8bdaa20f tempest-VolumeImageDependencyTests-1846275429 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cc3e260b-753b-4084-9e80-c1926cccc46c_taifu_v1" returned: 1 in 0.440s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:03:57 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-1671a77b-7d99-4169-80ae-336d8bdaa20f tempest-VolumeImageDependencyTests-1846275429 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cc3e260b-753b-4084-9e80-c1926cccc46c_taifu_v1' failed. Not Retrying. {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 13 14:03:57 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1d890bc-1ca1-4024-910f-8049a6e34c9d]: (4, 'raw') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 14:03:57 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-1671a77b-7d99-4169-80ae-336d8bdaa20f tempest-VolumeImageDependencyTests-1846275429 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cc3e260b-753b-4084-9e80-c1926cccc46c_2npfysffdevstack@QuobyteHD {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:03:57 devstack sudo[103820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cc3e260b-753b-4084-9e80-c1926cccc46c_2npfysffdevstack@QuobyteHD Jul 13 14:03:57 devstack sudo[103820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:03:57 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-d59c5e0d-9014-4b28-8dbb-5b713dbe6940 tempest-TestStampPattern-1316181496 None] Acquiring lock "cinder-55554bd4-18e8-4e7e-a946-d481530b3100-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 14:03:57 devstack sudo[103820]: pam_unix(sudo:session): session closed for user root Jul 13 14:03:57 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-1671a77b-7d99-4169-80ae-336d8bdaa20f tempest-VolumeImageDependencyTests-1846275429 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cc3e260b-753b-4084-9e80-c1926cccc46c_2npfysffdevstack@QuobyteHD" returned: 0 in 0.338s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:03:57 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-1671a77b-7d99-4169-80ae-336d8bdaa20f tempest-VolumeImageDependencyTests-1846275429 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cc3e260b-753b-4084-9e80-c1926cccc46c_2npfysffdevstack@QuobyteHD {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:03:57 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-d59c5e0d-9014-4b28-8dbb-5b713dbe6940 tempest-TestStampPattern-1316181496 None] Lock "cinder-55554bd4-18e8-4e7e-a946-d481530b3100-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 14:03:58 devstack sudo[103824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cc3e260b-753b-4084-9e80-c1926cccc46c_2npfysffdevstack@QuobyteHD Jul 13 14:03:58 devstack sudo[103824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:03:58 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-d59c5e0d-9014-4b28-8dbb-5b713dbe6940 tempest-TestStampPattern-1316181496 None] Acquiring lock "cinder-quobyte-55554bd4-18e8-4e7e-a946-d481530b3100" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 14:03:58 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-d59c5e0d-9014-4b28-8dbb-5b713dbe6940 tempest-TestStampPattern-1316181496 None] Lock "cinder-quobyte-55554bd4-18e8-4e7e-a946-d481530b3100" acquired by "delete_volume" :: waited 0.018s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 14:03:58 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d897330-13f7-4353-958d-743af538d856]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 14:03:58 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-d59c5e0d-9014-4b28-8dbb-5b713dbe6940 tempest-TestStampPattern-1316181496 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-55554bd4-18e8-4e7e-a946-d481530b3100 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:03:58 devstack sudo[103826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-55554bd4-18e8-4e7e-a946-d481530b3100 Jul 13 14:03:58 devstack sudo[103826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:03:58 devstack sudo[103824]: pam_unix(sudo:session): session closed for user root Jul 13 14:03:58 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-1671a77b-7d99-4169-80ae-336d8bdaa20f tempest-VolumeImageDependencyTests-1846275429 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cc3e260b-753b-4084-9e80-c1926cccc46c_2npfysffdevstack@QuobyteHD" returned: 1 in 0.393s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:03:58 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-1671a77b-7d99-4169-80ae-336d8bdaa20f tempest-VolumeImageDependencyTests-1846275429 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cc3e260b-753b-4084-9e80-c1926cccc46c_2npfysffdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 13 14:03:58 devstack cinder-volume[87098]: DEBUG cinder.image.image_utils [None req-1671a77b-7d99-4169-80ae-336d8bdaa20f tempest-VolumeImageDependencyTests-1846275429 None] cc3e260b-753b-4084-9e80-c1926cccc46c was raw, converting to raw {{(pid=87098) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 13 14:03:58 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-1671a77b-7d99-4169-80ae-336d8bdaa20f tempest-VolumeImageDependencyTests-1846275429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_cc3e260b-753b-4084-9e80-c1926cccc46c_2npfysffdevstack@QuobyteHD /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-c4670ba4-591b-48cd-99c7-221c93586dff {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:03:58 devstack sudo[103831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_cc3e260b-753b-4084-9e80-c1926cccc46c_2npfysffdevstack@QuobyteHD /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-c4670ba4-591b-48cd-99c7-221c93586dff Jul 13 14:03:58 devstack sudo[103831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:03:58 devstack sudo[103826]: pam_unix(sudo:session): session closed for user root Jul 13 14:03:58 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-d59c5e0d-9014-4b28-8dbb-5b713dbe6940 tempest-TestStampPattern-1316181496 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-55554bd4-18e8-4e7e-a946-d481530b3100" returned: 0 in 0.396s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:03:58 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-d59c5e0d-9014-4b28-8dbb-5b713dbe6940 tempest-TestStampPattern-1316181496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-55554bd4-18e8-4e7e-a946-d481530b3100 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:03:58 devstack sudo[103837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-55554bd4-18e8-4e7e-a946-d481530b3100 Jul 13 14:03:58 devstack sudo[103837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:03:58 devstack sudo[103831]: pam_unix(sudo:session): session closed for user root Jul 13 14:03:58 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-1671a77b-7d99-4169-80ae-336d8bdaa20f tempest-VolumeImageDependencyTests-1846275429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_cc3e260b-753b-4084-9e80-c1926cccc46c_2npfysffdevstack@QuobyteHD /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-c4670ba4-591b-48cd-99c7-221c93586dff" returned: 0 in 0.376s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:03:58 devstack cinder-volume[87098]: DEBUG cinder.image.image_utils [None req-1671a77b-7d99-4169-80ae-336d8bdaa20f tempest-VolumeImageDependencyTests-1846275429 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_cc3e260b-753b-4084-9e80-c1926cccc46c_2npfysffdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-c4670ba4-591b-48cd-99c7-221c93586dff {{(pid=87098) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 13 14:03:58 devstack cinder-volume[87098]: INFO cinder.image.image_utils [None req-1671a77b-7d99-4169-80ae-336d8bdaa20f tempest-VolumeImageDependencyTests-1846275429 None] Converted 0.00 MB image at 0.00 MB/s Jul 13 14:03:58 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-1671a77b-7d99-4169-80ae-336d8bdaa20f tempest-VolumeImageDependencyTests-1846275429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-c4670ba4-591b-48cd-99c7-221c93586dff 1G {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:03:58 devstack sudo[103842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-c4670ba4-591b-48cd-99c7-221c93586dff 1G Jul 13 14:03:58 devstack sudo[103842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:03:58 devstack sudo[103837]: pam_unix(sudo:session): session closed for user root Jul 13 14:03:58 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-d59c5e0d-9014-4b28-8dbb-5b713dbe6940 tempest-TestStampPattern-1316181496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-55554bd4-18e8-4e7e-a946-d481530b3100" returned: 0 in 0.285s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:03:58 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-d59c5e0d-9014-4b28-8dbb-5b713dbe6940 tempest-TestStampPattern-1316181496 None] Lock "cinder-quobyte-55554bd4-18e8-4e7e-a946-d481530b3100" released by "delete_volume" :: held 0.759s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 14:03:58 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-d59c5e0d-9014-4b28-8dbb-5b713dbe6940 tempest-TestStampPattern-1316181496 None] Created reservations ['9bc40773-a238-41ca-bf5c-4c6736cf1bab', 'd5ccc9f6-b5ae-4097-a1b9-e59f8e44706f', '647aad95-b7c2-48ff-b38d-974220d88773', '11a6096e-0dfd-42d1-9ebb-e23446299133'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 14:03:58 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-d59c5e0d-9014-4b28-8dbb-5b713dbe6940 tempest-TestStampPattern-1316181496 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 14:03:58 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-d59c5e0d-9014-4b28-8dbb-5b713dbe6940 tempest-TestStampPattern-1316181496 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 14:03:58 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-d59c5e0d-9014-4b28-8dbb-5b713dbe6940 tempest-TestStampPattern-1316181496 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 14:03:58 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-d59c5e0d-9014-4b28-8dbb-5b713dbe6940 tempest-TestStampPattern-1316181496 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 14:03:58 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-d59c5e0d-9014-4b28-8dbb-5b713dbe6940 tempest-TestStampPattern-1316181496 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 14:03:58 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-d59c5e0d-9014-4b28-8dbb-5b713dbe6940 tempest-TestStampPattern-1316181496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:03:59 devstack sudo[103842]: pam_unix(sudo:session): session closed for user root Jul 13 14:03:59 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-1671a77b-7d99-4169-80ae-336d8bdaa20f tempest-VolumeImageDependencyTests-1846275429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-c4670ba4-591b-48cd-99c7-221c93586dff 1G" returned: 0 in 0.325s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:03:59 devstack sudo[103848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 Jul 13 14:03:59 devstack sudo[103848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:03:59 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[867ea21c-c487-481f-b090-bb2822c603b3]: (4, 'raw') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 14:03:59 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-1671a77b-7d99-4169-80ae-336d8bdaa20f tempest-VolumeImageDependencyTests-1846275429 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-c4670ba4-591b-48cd-99c7-221c93586dff {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:03:59 devstack sudo[103850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-c4670ba4-591b-48cd-99c7-221c93586dff Jul 13 14:03:59 devstack sudo[103850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:03:59 devstack sudo[103848]: pam_unix(sudo:session): session closed for user root Jul 13 14:03:59 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-d59c5e0d-9014-4b28-8dbb-5b713dbe6940 tempest-TestStampPattern-1316181496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78" returned: 0 in 0.370s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:03:59 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-d59c5e0d-9014-4b28-8dbb-5b713dbe6940 tempest-TestStampPattern-1316181496 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 14:03:59 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-d59c5e0d-9014-4b28-8dbb-5b713dbe6940 tempest-TestStampPattern-1316181496 None] Deleted volume successfully. Jul 13 14:03:59 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-d59c5e0d-9014-4b28-8dbb-5b713dbe6940 tempest-TestStampPattern-1316181496 None] Lock "cinder-55554bd4-18e8-4e7e-a946-d481530b3100-delete_volume" released by "delete_volume" :: held 1.449s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 14:03:59 devstack sudo[103850]: pam_unix(sudo:session): session closed for user root Jul 13 14:03:59 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-1671a77b-7d99-4169-80ae-336d8bdaa20f tempest-VolumeImageDependencyTests-1846275429 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-c4670ba4-591b-48cd-99c7-221c93586dff" returned: 0 in 0.431s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:03:59 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-1671a77b-7d99-4169-80ae-336d8bdaa20f tempest-VolumeImageDependencyTests-1846275429 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-c4670ba4-591b-48cd-99c7-221c93586dff {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:03:59 devstack sudo[103855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-c4670ba4-591b-48cd-99c7-221c93586dff Jul 13 14:03:59 devstack sudo[103855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:03:59 devstack sudo[103855]: pam_unix(sudo:session): session closed for user root Jul 13 14:03:59 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-1671a77b-7d99-4169-80ae-336d8bdaa20f tempest-VolumeImageDependencyTests-1846275429 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-c4670ba4-591b-48cd-99c7-221c93586dff" returned: 1 in 0.460s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:03:59 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-1671a77b-7d99-4169-80ae-336d8bdaa20f tempest-VolumeImageDependencyTests-1846275429 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-c4670ba4-591b-48cd-99c7-221c93586dff' failed. Not Retrying. {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 13 14:03:59 devstack cinder-volume[87098]: DEBUG cinder.volume.volume_utils [None req-1671a77b-7d99-4169-80ae-336d8bdaa20f tempest-VolumeImageDependencyTests-1846275429 None] Downloaded image cc3e260b-753b-4084-9e80-c1926cccc46c ((None, [{'url': 'file:///opt/stack/data/glance/images/cc3e260b-753b-4084-9e80-c1926cccc46c', 'metadata': {}}])) to volume c4670ba4-591b-48cd-99c7-221c93586dff successfully. {{(pid=87098) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 13 14:03:59 devstack cinder-volume[87098]: DEBUG cinder.image.image_utils [None req-1671a77b-7d99-4169-80ae-336d8bdaa20f tempest-VolumeImageDependencyTests-1846275429 None] Temporary image cc3e260b-753b-4084-9e80-c1926cccc46c for user 28988c40f1de4ae0bdee2c7de7c23ef0 is deleted. {{(pid=87098) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 13 14:03:59 devstack cinder-volume[87098]: DEBUG cinder.volume.volume_utils [None req-1671a77b-7d99-4169-80ae-336d8bdaa20f tempest-VolumeImageDependencyTests-1846275429 None] Marking volume c4670ba4-591b-48cd-99c7-221c93586dff as bootable. {{(pid=87098) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 13 14:04:00 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-1671a77b-7d99-4169-80ae-336d8bdaa20f tempest-VolumeImageDependencyTests-1846275429 None] Copying metadata from image cc3e260b-753b-4084-9e80-c1926cccc46c to c4670ba4-591b-48cd-99c7-221c93586dff. {{(pid=87098) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 13 14:04:00 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-1671a77b-7d99-4169-80ae-336d8bdaa20f tempest-VolumeImageDependencyTests-1846275429 None] Creating volume glance metadata for volume c4670ba4-591b-48cd-99c7-221c93586dff backed by image cc3e260b-753b-4084-9e80-c1926cccc46c with: {'image_id': 'cc3e260b-753b-4084-9e80-c1926cccc46c', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'cc4076aeecfeb576d9f3b01026b9642e', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87098) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 13 14:04:00 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-1671a77b-7d99-4169-80ae-336d8bdaa20f tempest-VolumeImageDependencyTests-1846275429 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83aa99cf-2b9e-4205-8a9e-2b95af20ab48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c4670ba4-591b-48cd-99c7-221c93586dff', 'volume_size': 1, 'image_id': 'cc3e260b-753b-4084-9e80-c1926cccc46c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cc3e260b-753b-4084-9e80-c1926cccc46c', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'cc4076aeecfeb576d9f3b01026b9642e', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'a6f567961c5748aa9c6f920b8ad21f44', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'a7c4a80f8bc16dcfd8bbd8715203b97a3c4991daf7d0e504a5150bb684465a0604142f11b3347be6230a82917e45d27f19bc7e83a21600ca4a9df79025537d54', 'id': 'cc3e260b-753b-4084-9e80-c1926cccc46c', 'created_at': datetime.datetime(2026, 7, 13, 12, 3, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 13, 12, 3, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cc3e260b-753b-4084-9e80-c1926cccc46c/file', 'properties': {}}, 'image_service': }' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:04:00 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-1671a77b-7d99-4169-80ae-336d8bdaa20f tempest-VolumeImageDependencyTests-1846275429 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d8d4105-8c1e-4fd7-bba0-590fa499336f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:04:00 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-1671a77b-7d99-4169-80ae-336d8bdaa20f tempest-VolumeImageDependencyTests-1846275429 None] Volume volume-c4670ba4-591b-48cd-99c7-221c93586dff (c4670ba4-591b-48cd-99c7-221c93586dff): created successfully Jul 13 14:04:00 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-1671a77b-7d99-4169-80ae-336d8bdaa20f tempest-VolumeImageDependencyTests-1846275429 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d8d4105-8c1e-4fd7-bba0-590fa499336f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:04:00 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-1671a77b-7d99-4169-80ae-336d8bdaa20f tempest-VolumeImageDependencyTests-1846275429 None] Flow 'volume_create_manager' (b1a88b12-5c20-43e5-97fe-cf7deebb2d06) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 14:04:00 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-1671a77b-7d99-4169-80ae-336d8bdaa20f tempest-VolumeImageDependencyTests-1846275429 None] Created volume successfully. Jul 13 14:04:00 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-9884d6a0-02b9-469a-8b0c-25d7acc65462 tempest-VolumeImageDependencyTests-1846275429 None] Acquiring lock "cinder-c4670ba4-591b-48cd-99c7-221c93586dff-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 14:04:00 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-9884d6a0-02b9-469a-8b0c-25d7acc65462 tempest-VolumeImageDependencyTests-1846275429 None] Lock "cinder-c4670ba4-591b-48cd-99c7-221c93586dff-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 14:04:00 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-9884d6a0-02b9-469a-8b0c-25d7acc65462 tempest-VolumeImageDependencyTests-1846275429 None] Acquiring lock "cinder-quobyte-c4670ba4-591b-48cd-99c7-221c93586dff" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 14:04:00 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-9884d6a0-02b9-469a-8b0c-25d7acc65462 tempest-VolumeImageDependencyTests-1846275429 None] Lock "cinder-quobyte-c4670ba4-591b-48cd-99c7-221c93586dff" acquired by "delete_volume" :: waited 0.023s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 14:04:00 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[29e53286-43bf-4392-a59b-70121e745f2c]: (4, 'raw') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 14:04:00 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-9884d6a0-02b9-469a-8b0c-25d7acc65462 tempest-VolumeImageDependencyTests-1846275429 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-c4670ba4-591b-48cd-99c7-221c93586dff {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:04:01 devstack sudo[103861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-c4670ba4-591b-48cd-99c7-221c93586dff Jul 13 14:04:01 devstack sudo[103861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:04:01 devstack sudo[103861]: pam_unix(sudo:session): session closed for user root Jul 13 14:04:01 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-9884d6a0-02b9-469a-8b0c-25d7acc65462 tempest-VolumeImageDependencyTests-1846275429 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-c4670ba4-591b-48cd-99c7-221c93586dff" returned: 0 in 0.439s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:04:01 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-9884d6a0-02b9-469a-8b0c-25d7acc65462 tempest-VolumeImageDependencyTests-1846275429 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-c4670ba4-591b-48cd-99c7-221c93586dff {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:04:01 devstack sudo[103866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-c4670ba4-591b-48cd-99c7-221c93586dff Jul 13 14:04:01 devstack sudo[103866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:04:01 devstack sudo[103866]: pam_unix(sudo:session): session closed for user root Jul 13 14:04:01 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-9884d6a0-02b9-469a-8b0c-25d7acc65462 tempest-VolumeImageDependencyTests-1846275429 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-c4670ba4-591b-48cd-99c7-221c93586dff" returned: 1 in 0.383s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:04:01 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-9884d6a0-02b9-469a-8b0c-25d7acc65462 tempest-VolumeImageDependencyTests-1846275429 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-c4670ba4-591b-48cd-99c7-221c93586dff' failed. Not Retrying. {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 13 14:04:01 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-9884d6a0-02b9-469a-8b0c-25d7acc65462 tempest-VolumeImageDependencyTests-1846275429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-c4670ba4-591b-48cd-99c7-221c93586dff {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:04:01 devstack sudo[103871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-c4670ba4-591b-48cd-99c7-221c93586dff Jul 13 14:04:01 devstack sudo[103871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:04:02 devstack sudo[103871]: pam_unix(sudo:session): session closed for user root Jul 13 14:04:02 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-9884d6a0-02b9-469a-8b0c-25d7acc65462 tempest-VolumeImageDependencyTests-1846275429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-c4670ba4-591b-48cd-99c7-221c93586dff" returned: 0 in 0.301s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:04:02 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-9884d6a0-02b9-469a-8b0c-25d7acc65462 tempest-VolumeImageDependencyTests-1846275429 None] Lock "cinder-quobyte-c4670ba4-591b-48cd-99c7-221c93586dff" released by "delete_volume" :: held 1.198s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 14:04:02 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-9884d6a0-02b9-469a-8b0c-25d7acc65462 tempest-VolumeImageDependencyTests-1846275429 None] Created reservations ['0788b3a7-a64b-42ef-a225-ef88878b298c', 'c26f47a1-0be8-48ef-98e6-663d4c388b3d', '6617e44e-6f41-46f7-a224-5ef1d9a25db0', '2414ad57-02f0-4fb7-8e14-06ce0c8ef395'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 14:04:02 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-9884d6a0-02b9-469a-8b0c-25d7acc65462 tempest-VolumeImageDependencyTests-1846275429 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 14:04:02 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-9884d6a0-02b9-469a-8b0c-25d7acc65462 tempest-VolumeImageDependencyTests-1846275429 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 14:04:02 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-9884d6a0-02b9-469a-8b0c-25d7acc65462 tempest-VolumeImageDependencyTests-1846275429 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 14:04:02 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-9884d6a0-02b9-469a-8b0c-25d7acc65462 tempest-VolumeImageDependencyTests-1846275429 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 14:04:02 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-9884d6a0-02b9-469a-8b0c-25d7acc65462 tempest-VolumeImageDependencyTests-1846275429 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 14:04:02 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-9884d6a0-02b9-469a-8b0c-25d7acc65462 tempest-VolumeImageDependencyTests-1846275429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:04:02 devstack sudo[103874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 Jul 13 14:04:02 devstack sudo[103874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:04:02 devstack sudo[103874]: pam_unix(sudo:session): session closed for user root Jul 13 14:04:02 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-9884d6a0-02b9-469a-8b0c-25d7acc65462 tempest-VolumeImageDependencyTests-1846275429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78" returned: 0 in 0.258s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:04:02 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-9884d6a0-02b9-469a-8b0c-25d7acc65462 tempest-VolumeImageDependencyTests-1846275429 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 14:04:02 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-9884d6a0-02b9-469a-8b0c-25d7acc65462 tempest-VolumeImageDependencyTests-1846275429 None] Deleted volume successfully. Jul 13 14:04:02 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-9884d6a0-02b9-469a-8b0c-25d7acc65462 tempest-VolumeImageDependencyTests-1846275429 None] Lock "cinder-c4670ba4-591b-48cd-99c7-221c93586dff-delete_volume" released by "delete_volume" :: held 1.720s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 14:04:04 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc7aa081-dad4-4a01-8d28-b50034d55761 tempest-SnapshotDependencyTests-1130162876 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 14:04:04 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-fc7aa081-dad4-4a01-8d28-b50034d55761 tempest-SnapshotDependencyTests-1130162876 None] Flow 'volume_create_manager' (4adf949b-328f-4b62-bea1-b2b5404df97b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 14:04:04 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-fc7aa081-dad4-4a01-8d28-b50034d55761 tempest-SnapshotDependencyTests-1130162876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c87ce73-f46d-40c8-9eff-23cbef49eebe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:04:04 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-fc7aa081-dad4-4a01-8d28-b50034d55761 tempest-SnapshotDependencyTests-1130162876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c87ce73-f46d-40c8-9eff-23cbef49eebe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T12:04:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-529042285',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28849c7a-f537-4e4d-8508-8e324a039a5b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4511003d0ac64d26980f42aca8828517',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T12:04:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T12:04:04Z,use_quota=True,user_id='fd3e679516eb463b926270706962f35c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1147de8b-623b-426c-a13d-7fc824a80f67),volume_type_id=1147de8b-623b-426c-a13d-7fc824a80f67)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:04:04 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-fc7aa081-dad4-4a01-8d28-b50034d55761 tempest-SnapshotDependencyTests-1130162876 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c8e5aa7-1d60-4d39-a5f7-83fe8f975e1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:04:04 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-fc7aa081-dad4-4a01-8d28-b50034d55761 tempest-SnapshotDependencyTests-1130162876 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c8e5aa7-1d60-4d39-a5f7-83fe8f975e1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:04:04 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-fc7aa081-dad4-4a01-8d28-b50034d55761 tempest-SnapshotDependencyTests-1130162876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92556a3a-3e75-435e-a0c5-d788f39eaf4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:04:04 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-fc7aa081-dad4-4a01-8d28-b50034d55761 tempest-SnapshotDependencyTests-1130162876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92556a3a-3e75-435e-a0c5-d788f39eaf4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '28849c7a-f537-4e4d-8508-8e324a039a5b', 'volume_name': 'volume-28849c7a-f537-4e4d-8508-8e324a039a5b', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:04:04 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-fc7aa081-dad4-4a01-8d28-b50034d55761 tempest-SnapshotDependencyTests-1130162876 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce28f6a3-ffce-4db7-a066-78ccfd1dc911) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:04:04 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-fc7aa081-dad4-4a01-8d28-b50034d55761 tempest-SnapshotDependencyTests-1130162876 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce28f6a3-ffce-4db7-a066-78ccfd1dc911) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:04:04 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-fc7aa081-dad4-4a01-8d28-b50034d55761 tempest-SnapshotDependencyTests-1130162876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (489b25f3-b6b2-4811-8a15-ad4a52466310) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:04:04 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-fc7aa081-dad4-4a01-8d28-b50034d55761 tempest-SnapshotDependencyTests-1130162876 None] Volume 28849c7a-f537-4e4d-8508-8e324a039a5b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-28849c7a-f537-4e4d-8508-8e324a039a5b', 'volume_size': 1} Jul 13 14:04:04 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-fc7aa081-dad4-4a01-8d28-b50034d55761 tempest-SnapshotDependencyTests-1130162876 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 14:04:04 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-fc7aa081-dad4-4a01-8d28-b50034d55761 tempest-SnapshotDependencyTests-1130162876 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 14:04:04 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-fc7aa081-dad4-4a01-8d28-b50034d55761 tempest-SnapshotDependencyTests-1130162876 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T12:04:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-529042285',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28849c7a-f537-4e4d-8508-8e324a039a5b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4511003d0ac64d26980f42aca8828517',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T12:04:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T12:04:04Z,use_quota=True,user_id='fd3e679516eb463b926270706962f35c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1147de8b-623b-426c-a13d-7fc824a80f67),volume_type_id=1147de8b-623b-426c-a13d-7fc824a80f67)}" {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 13 14:04:04 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-fc7aa081-dad4-4a01-8d28-b50034d55761 tempest-SnapshotDependencyTests-1130162876 None] Creating volume 28849c7a-f537-4e4d-8508-8e324a039a5b {{(pid=87098) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 13 14:04:04 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-fc7aa081-dad4-4a01-8d28-b50034d55761 tempest-SnapshotDependencyTests-1130162876 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 14:04:04 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-fc7aa081-dad4-4a01-8d28-b50034d55761 tempest-SnapshotDependencyTests-1130162876 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 14:04:04 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-fc7aa081-dad4-4a01-8d28-b50034d55761 tempest-SnapshotDependencyTests-1130162876 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 14:04:04 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-fc7aa081-dad4-4a01-8d28-b50034d55761 tempest-SnapshotDependencyTests-1130162876 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 14:04:04 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-fc7aa081-dad4-4a01-8d28-b50034d55761 tempest-SnapshotDependencyTests-1130162876 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 14:04:04 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-fc7aa081-dad4-4a01-8d28-b50034d55761 tempest-SnapshotDependencyTests-1130162876 None] Selected osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 14:04:04 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-fc7aa081-dad4-4a01-8d28-b50034d55761 tempest-SnapshotDependencyTests-1130162876 None] casted to osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 Jul 13 14:04:04 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-fc7aa081-dad4-4a01-8d28-b50034d55761 tempest-SnapshotDependencyTests-1130162876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-28849c7a-f537-4e4d-8508-8e324a039a5b 1073741824 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:04:04 devstack sudo[103877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-28849c7a-f537-4e4d-8508-8e324a039a5b 1073741824 Jul 13 14:04:04 devstack sudo[103877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:04:04 devstack sudo[103877]: pam_unix(sudo:session): session closed for user root Jul 13 14:04:04 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-fc7aa081-dad4-4a01-8d28-b50034d55761 tempest-SnapshotDependencyTests-1130162876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-28849c7a-f537-4e4d-8508-8e324a039a5b 1073741824" returned: 0 in 0.570s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:04:04 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-fc7aa081-dad4-4a01-8d28-b50034d55761 tempest-SnapshotDependencyTests-1130162876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-28849c7a-f537-4e4d-8508-8e324a039a5b {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:04:04 devstack sudo[103883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-28849c7a-f537-4e4d-8508-8e324a039a5b Jul 13 14:04:04 devstack sudo[103883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:04:05 devstack sudo[103883]: pam_unix(sudo:session): session closed for user root Jul 13 14:04:05 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-fc7aa081-dad4-4a01-8d28-b50034d55761 tempest-SnapshotDependencyTests-1130162876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-28849c7a-f537-4e4d-8508-8e324a039a5b" returned: 0 in 0.326s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:04:05 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-fc7aa081-dad4-4a01-8d28-b50034d55761 tempest-SnapshotDependencyTests-1130162876 None] <== create_volume: return (949ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'} {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 13 14:04:05 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-fc7aa081-dad4-4a01-8d28-b50034d55761 tempest-SnapshotDependencyTests-1130162876 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.953s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 14:04:05 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-fc7aa081-dad4-4a01-8d28-b50034d55761 tempest-SnapshotDependencyTests-1130162876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (489b25f3-b6b2-4811-8a15-ad4a52466310) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-28849c7a-f537-4e4d-8508-8e324a039a5b', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:04:05 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-fc7aa081-dad4-4a01-8d28-b50034d55761 tempest-SnapshotDependencyTests-1130162876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (854e92e7-6a56-4838-b27c-58fe11fd879a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:04:05 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-fc7aa081-dad4-4a01-8d28-b50034d55761 tempest-SnapshotDependencyTests-1130162876 None] Volume volume-28849c7a-f537-4e4d-8508-8e324a039a5b (28849c7a-f537-4e4d-8508-8e324a039a5b): created successfully Jul 13 14:04:05 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-fc7aa081-dad4-4a01-8d28-b50034d55761 tempest-SnapshotDependencyTests-1130162876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (854e92e7-6a56-4838-b27c-58fe11fd879a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:04:05 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-fc7aa081-dad4-4a01-8d28-b50034d55761 tempest-SnapshotDependencyTests-1130162876 None] Flow 'volume_create_manager' (4adf949b-328f-4b62-bea1-b2b5404df97b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 14:04:05 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-fc7aa081-dad4-4a01-8d28-b50034d55761 tempest-SnapshotDependencyTests-1130162876 None] Created volume successfully. Jul 13 14:04:06 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-7a2b381e-0a55-4ce6-8e81-0e0c6a741270 tempest-SnapshotDependencyTests-1130162876 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 14:04:06 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-7a2b381e-0a55-4ce6-8e81-0e0c6a741270 tempest-SnapshotDependencyTests-1130162876 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 14:04:06 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-7a2b381e-0a55-4ce6-8e81-0e0c6a741270 tempest-SnapshotDependencyTests-1130162876 None] Creating offline snapshot 16fa2495-cd64-4300-89b1-7ad608587346 of volume 28849c7a-f537-4e4d-8508-8e324a039a5b {{(pid=87098) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 13 14:04:06 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[37769da8-55e9-4d10-90d6-535235a46d0e]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 14:04:06 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-7a2b381e-0a55-4ce6-8e81-0e0c6a741270 tempest-SnapshotDependencyTests-1130162876 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-28849c7a-f537-4e4d-8508-8e324a039a5b {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:04:06 devstack sudo[103887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-28849c7a-f537-4e4d-8508-8e324a039a5b Jul 13 14:04:06 devstack sudo[103887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:04:06 devstack sudo[103887]: pam_unix(sudo:session): session closed for user root Jul 13 14:04:06 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-7a2b381e-0a55-4ce6-8e81-0e0c6a741270 tempest-SnapshotDependencyTests-1130162876 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-28849c7a-f537-4e4d-8508-8e324a039a5b" returned: 0 in 0.390s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:04:06 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-7a2b381e-0a55-4ce6-8e81-0e0c6a741270 tempest-SnapshotDependencyTests-1130162876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-28849c7a-f537-4e4d-8508-8e324a039a5b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-28849c7a-f537-4e4d-8508-8e324a039a5b.16fa2495-cd64-4300-89b1-7ad608587346 1G {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:04:06 devstack sudo[103893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-28849c7a-f537-4e4d-8508-8e324a039a5b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-28849c7a-f537-4e4d-8508-8e324a039a5b.16fa2495-cd64-4300-89b1-7ad608587346 1G Jul 13 14:04:06 devstack sudo[103893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:04:07 devstack sudo[103893]: pam_unix(sudo:session): session closed for user root Jul 13 14:04:07 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-7a2b381e-0a55-4ce6-8e81-0e0c6a741270 tempest-SnapshotDependencyTests-1130162876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-28849c7a-f537-4e4d-8508-8e324a039a5b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-28849c7a-f537-4e4d-8508-8e324a039a5b.16fa2495-cd64-4300-89b1-7ad608587346 1G" returned: 0 in 0.439s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:04:07 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-7a2b381e-0a55-4ce6-8e81-0e0c6a741270 tempest-SnapshotDependencyTests-1130162876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-28849c7a-f537-4e4d-8508-8e324a039a5b -F qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-28849c7a-f537-4e4d-8508-8e324a039a5b.16fa2495-cd64-4300-89b1-7ad608587346 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:04:07 devstack sudo[103900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-28849c7a-f537-4e4d-8508-8e324a039a5b -F qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-28849c7a-f537-4e4d-8508-8e324a039a5b.16fa2495-cd64-4300-89b1-7ad608587346 Jul 13 14:04:07 devstack sudo[103900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:04:07 devstack sudo[103900]: pam_unix(sudo:session): session closed for user root Jul 13 14:04:07 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-7a2b381e-0a55-4ce6-8e81-0e0c6a741270 tempest-SnapshotDependencyTests-1130162876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-28849c7a-f537-4e4d-8508-8e324a039a5b -F qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-28849c7a-f537-4e4d-8508-8e324a039a5b.16fa2495-cd64-4300-89b1-7ad608587346" returned: 0 in 0.289s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:04:07 devstack cinder-volume[87098]: WARNING cinder.volume.drivers.remotefs [None req-7a2b381e-0a55-4ce6-8e81-0e0c6a741270 tempest-SnapshotDependencyTests-1130162876 None] /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-28849c7a-f537-4e4d-8508-8e324a039a5b.16fa2495-cd64-4300-89b1-7ad608587346 is being set with open permissions: ugo+rw Jul 13 14:04:07 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-7a2b381e-0a55-4ce6-8e81-0e0c6a741270 tempest-SnapshotDependencyTests-1130162876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-28849c7a-f537-4e4d-8508-8e324a039a5b.16fa2495-cd64-4300-89b1-7ad608587346 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:04:07 devstack sudo[103905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-28849c7a-f537-4e4d-8508-8e324a039a5b.16fa2495-cd64-4300-89b1-7ad608587346 Jul 13 14:04:07 devstack sudo[103905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:04:07 devstack sudo[103905]: pam_unix(sudo:session): session closed for user root Jul 13 14:04:07 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-7a2b381e-0a55-4ce6-8e81-0e0c6a741270 tempest-SnapshotDependencyTests-1130162876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-28849c7a-f537-4e4d-8508-8e324a039a5b.16fa2495-cd64-4300-89b1-7ad608587346" returned: 0 in 0.259s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:04:07 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-7a2b381e-0a55-4ce6-8e81-0e0c6a741270 tempest-SnapshotDependencyTests-1130162876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-28849c7a-f537-4e4d-8508-8e324a039a5b.info {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:04:07 devstack sudo[103908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-28849c7a-f537-4e4d-8508-8e324a039a5b.info Jul 13 14:04:07 devstack sudo[103908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:04:08 devstack sudo[103908]: pam_unix(sudo:session): session closed for user root Jul 13 14:04:08 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-7a2b381e-0a55-4ce6-8e81-0e0c6a741270 tempest-SnapshotDependencyTests-1130162876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-28849c7a-f537-4e4d-8508-8e324a039a5b.info" returned: 0 in 0.318s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:04:08 devstack cinder-volume[87098]: WARNING cinder.volume.drivers.remotefs [None req-7a2b381e-0a55-4ce6-8e81-0e0c6a741270 tempest-SnapshotDependencyTests-1130162876 None] /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-28849c7a-f537-4e4d-8508-8e324a039a5b.info is being set with open permissions: ugo+rw Jul 13 14:04:08 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-7a2b381e-0a55-4ce6-8e81-0e0c6a741270 tempest-SnapshotDependencyTests-1130162876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-28849c7a-f537-4e4d-8508-8e324a039a5b.info {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:04:08 devstack sudo[103911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-28849c7a-f537-4e4d-8508-8e324a039a5b.info Jul 13 14:04:08 devstack sudo[103911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:04:08 devstack sudo[103911]: pam_unix(sudo:session): session closed for user root Jul 13 14:04:08 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-7a2b381e-0a55-4ce6-8e81-0e0c6a741270 tempest-SnapshotDependencyTests-1130162876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-28849c7a-f537-4e4d-8508-8e324a039a5b.info" returned: 0 in 0.274s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:04:08 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-7a2b381e-0a55-4ce6-8e81-0e0c6a741270 tempest-SnapshotDependencyTests-1130162876 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.065s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 14:04:08 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-7a2b381e-0a55-4ce6-8e81-0e0c6a741270 tempest-SnapshotDependencyTests-1130162876 None] Create snapshot completed successfully Jul 13 14:04:10 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-220d527b-dd08-4c1c-ae30-3d2bd84c3f95 tempest-SnapshotDependencyTests-1130162876 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 14:04:10 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-220d527b-dd08-4c1c-ae30-3d2bd84c3f95 tempest-SnapshotDependencyTests-1130162876 None] Flow 'volume_create_manager' (34e10b6f-59b9-4b4b-a1af-26cfa97cf712) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 14:04:10 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-220d527b-dd08-4c1c-ae30-3d2bd84c3f95 tempest-SnapshotDependencyTests-1130162876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9d7ec63-4684-40f2-9d8d-cd67b6a22606) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:04:10 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-220d527b-dd08-4c1c-ae30-3d2bd84c3f95 tempest-SnapshotDependencyTests-1130162876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9d7ec63-4684-40f2-9d8d-cd67b6a22606) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T12:04:10Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=908d9ff4-1e57-488b-a695-7f136818a257,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4511003d0ac64d26980f42aca8828517',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T12:04:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=16fa2495-cd64-4300-89b1-7ad608587346,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T12:04:10Z,use_quota=True,user_id='fd3e679516eb463b926270706962f35c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1147de8b-623b-426c-a13d-7fc824a80f67),volume_type_id=1147de8b-623b-426c-a13d-7fc824a80f67)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:04:10 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-220d527b-dd08-4c1c-ae30-3d2bd84c3f95 tempest-SnapshotDependencyTests-1130162876 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5af8889-f020-41be-bf90-e0aea93aca7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:04:10 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-220d527b-dd08-4c1c-ae30-3d2bd84c3f95 tempest-SnapshotDependencyTests-1130162876 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5af8889-f020-41be-bf90-e0aea93aca7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:04:10 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-220d527b-dd08-4c1c-ae30-3d2bd84c3f95 tempest-SnapshotDependencyTests-1130162876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e169d97-b94f-407b-b97b-83f550fa435c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:04:10 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-220d527b-dd08-4c1c-ae30-3d2bd84c3f95 tempest-SnapshotDependencyTests-1130162876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e169d97-b94f-407b-b97b-83f550fa435c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '908d9ff4-1e57-488b-a695-7f136818a257', 'volume_name': 'volume-908d9ff4-1e57-488b-a695-7f136818a257', 'volume_size': 1, 'snapshot_id': '16fa2495-cd64-4300-89b1-7ad608587346'}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:04:10 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-220d527b-dd08-4c1c-ae30-3d2bd84c3f95 tempest-SnapshotDependencyTests-1130162876 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff1c85ae-e307-4e77-9a4e-e622bca35470) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:04:10 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-220d527b-dd08-4c1c-ae30-3d2bd84c3f95 tempest-SnapshotDependencyTests-1130162876 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff1c85ae-e307-4e77-9a4e-e622bca35470) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:04:10 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-220d527b-dd08-4c1c-ae30-3d2bd84c3f95 tempest-SnapshotDependencyTests-1130162876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ecb1bcf3-1e07-42a5-8f0c-819654d67ff1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:04:10 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-220d527b-dd08-4c1c-ae30-3d2bd84c3f95 tempest-SnapshotDependencyTests-1130162876 None] Volume 908d9ff4-1e57-488b-a695-7f136818a257: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-908d9ff4-1e57-488b-a695-7f136818a257', 'volume_size': 1, 'snapshot_id': '16fa2495-cd64-4300-89b1-7ad608587346'} Jul 13 14:04:10 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-220d527b-dd08-4c1c-ae30-3d2bd84c3f95 tempest-SnapshotDependencyTests-1130162876 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 14:04:10 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-220d527b-dd08-4c1c-ae30-3d2bd84c3f95 tempest-SnapshotDependencyTests-1130162876 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 14:04:10 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-220d527b-dd08-4c1c-ae30-3d2bd84c3f95 tempest-SnapshotDependencyTests-1130162876 None] Acquiring lock "cinder-quobyte-16fa2495-cd64-4300-89b1-7ad608587346-908d9ff4-1e57-488b-a695-7f136818a257" by "_create_volume_from_snapshot" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 14:04:10 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-220d527b-dd08-4c1c-ae30-3d2bd84c3f95 tempest-SnapshotDependencyTests-1130162876 None] Lock "cinder-quobyte-16fa2495-cd64-4300-89b1-7ad608587346-908d9ff4-1e57-488b-a695-7f136818a257" acquired by "_create_volume_from_snapshot" :: waited 0.016s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 14:04:10 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-220d527b-dd08-4c1c-ae30-3d2bd84c3f95 tempest-SnapshotDependencyTests-1130162876 None] Creating volume 908d9ff4-1e57-488b-a695-7f136818a257 from snapshot 16fa2495-cd64-4300-89b1-7ad608587346 {{(pid=87098) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 13 14:04:10 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-220d527b-dd08-4c1c-ae30-3d2bd84c3f95 tempest-SnapshotDependencyTests-1130162876 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 14:04:10 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-220d527b-dd08-4c1c-ae30-3d2bd84c3f95 tempest-SnapshotDependencyTests-1130162876 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 14:04:10 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-220d527b-dd08-4c1c-ae30-3d2bd84c3f95 tempest-SnapshotDependencyTests-1130162876 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 14:04:10 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-220d527b-dd08-4c1c-ae30-3d2bd84c3f95 tempest-SnapshotDependencyTests-1130162876 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 14:04:10 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-220d527b-dd08-4c1c-ae30-3d2bd84c3f95 tempest-SnapshotDependencyTests-1130162876 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 14:04:10 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-220d527b-dd08-4c1c-ae30-3d2bd84c3f95 tempest-SnapshotDependencyTests-1130162876 None] Selected osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 14:04:10 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-220d527b-dd08-4c1c-ae30-3d2bd84c3f95 tempest-SnapshotDependencyTests-1130162876 None] Acquiring lock "cinder-quobyte-908d9ff4-1e57-488b-a695-7f136818a257" by "_copy_volume_from_snapshot" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 14:04:10 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-220d527b-dd08-4c1c-ae30-3d2bd84c3f95 tempest-SnapshotDependencyTests-1130162876 None] Lock "cinder-quobyte-908d9ff4-1e57-488b-a695-7f136818a257" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 14:04:10 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-220d527b-dd08-4c1c-ae30-3d2bd84c3f95 tempest-SnapshotDependencyTests-1130162876 None] snapshot: 16fa2495-cd64-4300-89b1-7ad608587346, volume: 908d9ff4-1e57-488b-a695-7f136818a257, {{(pid=87098) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 13 14:04:10 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-220d527b-dd08-4c1c-ae30-3d2bd84c3f95 tempest-SnapshotDependencyTests-1130162876 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 14:04:10 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-220d527b-dd08-4c1c-ae30-3d2bd84c3f95 tempest-SnapshotDependencyTests-1130162876 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 14:04:10 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-220d527b-dd08-4c1c-ae30-3d2bd84c3f95 tempest-SnapshotDependencyTests-1130162876 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 14:04:10 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-220d527b-dd08-4c1c-ae30-3d2bd84c3f95 tempest-SnapshotDependencyTests-1130162876 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 14:04:10 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-220d527b-dd08-4c1c-ae30-3d2bd84c3f95 tempest-SnapshotDependencyTests-1130162876 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 14:04:10 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[129190e3-bcf4-4a95-893c-fe527d33e0ae]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 14:04:10 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-220d527b-dd08-4c1c-ae30-3d2bd84c3f95 tempest-SnapshotDependencyTests-1130162876 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-28849c7a-f537-4e4d-8508-8e324a039a5b.16fa2495-cd64-4300-89b1-7ad608587346 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:04:10 devstack sudo[103915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-28849c7a-f537-4e4d-8508-8e324a039a5b.16fa2495-cd64-4300-89b1-7ad608587346 Jul 13 14:04:10 devstack sudo[103915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:04:10 devstack sudo[103915]: pam_unix(sudo:session): session closed for user root Jul 13 14:04:10 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-220d527b-dd08-4c1c-ae30-3d2bd84c3f95 tempest-SnapshotDependencyTests-1130162876 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-28849c7a-f537-4e4d-8508-8e324a039a5b.16fa2495-cd64-4300-89b1-7ad608587346" returned: 0 in 0.365s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:04:10 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-220d527b-dd08-4c1c-ae30-3d2bd84c3f95 tempest-SnapshotDependencyTests-1130162876 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-28849c7a-f537-4e4d-8508-8e324a039a5b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87098) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 13 14:04:10 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-220d527b-dd08-4c1c-ae30-3d2bd84c3f95 tempest-SnapshotDependencyTests-1130162876 None] will copy from snapshot at /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-28849c7a-f537-4e4d-8508-8e324a039a5b {{(pid=87098) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 13 14:04:10 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-220d527b-dd08-4c1c-ae30-3d2bd84c3f95 tempest-SnapshotDependencyTests-1130162876 None] Creating direct copy from snapshot {{(pid=87098) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 13 14:04:10 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec070f3f-8a98-4ef0-94c8-1f4c37526332]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 14:04:10 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-220d527b-dd08-4c1c-ae30-3d2bd84c3f95 tempest-SnapshotDependencyTests-1130162876 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-28849c7a-f537-4e4d-8508-8e324a039a5b {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:04:10 devstack sudo[103920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-28849c7a-f537-4e4d-8508-8e324a039a5b Jul 13 14:04:10 devstack sudo[103920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:04:11 devstack sudo[103920]: pam_unix(sudo:session): session closed for user root Jul 13 14:04:11 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-220d527b-dd08-4c1c-ae30-3d2bd84c3f95 tempest-SnapshotDependencyTests-1130162876 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-28849c7a-f537-4e4d-8508-8e324a039a5b" returned: 0 in 0.370s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:04:11 devstack cinder-volume[87098]: DEBUG cinder.utils [None req-220d527b-dd08-4c1c-ae30-3d2bd84c3f95 tempest-SnapshotDependencyTests-1130162876 None] Path /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-908d9ff4-1e57-488b-a695-7f136818a257 not found in is_blk_device check {{(pid=87098) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 13 14:04:11 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-220d527b-dd08-4c1c-ae30-3d2bd84c3f95 tempest-SnapshotDependencyTests-1130162876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-28849c7a-f537-4e4d-8508-8e324a039a5b /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-908d9ff4-1e57-488b-a695-7f136818a257 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:04:11 devstack sudo[103925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-28849c7a-f537-4e4d-8508-8e324a039a5b /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-908d9ff4-1e57-488b-a695-7f136818a257 Jul 13 14:04:11 devstack sudo[103925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:04:15 devstack sudo[103925]: pam_unix(sudo:session): session closed for user root Jul 13 14:04:15 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-220d527b-dd08-4c1c-ae30-3d2bd84c3f95 tempest-SnapshotDependencyTests-1130162876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-28849c7a-f537-4e4d-8508-8e324a039a5b /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-908d9ff4-1e57-488b-a695-7f136818a257" returned: 0 in 4.850s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:04:15 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7f6903d-b0ff-4d54-bbd2-03807bad19ab]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 14:04:15 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-220d527b-dd08-4c1c-ae30-3d2bd84c3f95 tempest-SnapshotDependencyTests-1130162876 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-28849c7a-f537-4e4d-8508-8e324a039a5b {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:04:16 devstack sudo[103976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-28849c7a-f537-4e4d-8508-8e324a039a5b Jul 13 14:04:16 devstack sudo[103976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:04:16 devstack sudo[103976]: pam_unix(sudo:session): session closed for user root Jul 13 14:04:16 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-220d527b-dd08-4c1c-ae30-3d2bd84c3f95 tempest-SnapshotDependencyTests-1130162876 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-28849c7a-f537-4e4d-8508-8e324a039a5b" returned: 0 in 0.568s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:04:16 devstack cinder-volume[87098]: DEBUG cinder.image.image_utils [None req-220d527b-dd08-4c1c-ae30-3d2bd84c3f95 tempest-SnapshotDependencyTests-1130162876 None] Image conversion details: src /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-28849c7a-f537-4e4d-8508-8e324a039a5b, size 1024.00 MB, duration 4.85 sec, destination /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-908d9ff4-1e57-488b-a695-7f136818a257 {{(pid=87098) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 13 14:04:16 devstack cinder-volume[87098]: INFO cinder.image.image_utils [None req-220d527b-dd08-4c1c-ae30-3d2bd84c3f95 tempest-SnapshotDependencyTests-1130162876 None] Converted 1024.00 MB image at 211.06 MB/s Jul 13 14:04:16 devstack cinder-volume[87098]: WARNING cinder.volume.drivers.remotefs [None req-220d527b-dd08-4c1c-ae30-3d2bd84c3f95 tempest-SnapshotDependencyTests-1130162876 None] /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-908d9ff4-1e57-488b-a695-7f136818a257 is being set with open permissions: ugo+rw Jul 13 14:04:16 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-220d527b-dd08-4c1c-ae30-3d2bd84c3f95 tempest-SnapshotDependencyTests-1130162876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-908d9ff4-1e57-488b-a695-7f136818a257 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:04:16 devstack sudo[103981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-908d9ff4-1e57-488b-a695-7f136818a257 Jul 13 14:04:16 devstack sudo[103981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:04:16 devstack sudo[103981]: pam_unix(sudo:session): session closed for user root Jul 13 14:04:16 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-220d527b-dd08-4c1c-ae30-3d2bd84c3f95 tempest-SnapshotDependencyTests-1130162876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-908d9ff4-1e57-488b-a695-7f136818a257" returned: 0 in 0.249s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:04:16 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-220d527b-dd08-4c1c-ae30-3d2bd84c3f95 tempest-SnapshotDependencyTests-1130162876 None] Lock "cinder-quobyte-908d9ff4-1e57-488b-a695-7f136818a257" released by "_copy_volume_from_snapshot" :: held 6.500s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 14:04:16 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-220d527b-dd08-4c1c-ae30-3d2bd84c3f95 tempest-SnapshotDependencyTests-1130162876 None] Lock "cinder-quobyte-16fa2495-cd64-4300-89b1-7ad608587346-908d9ff4-1e57-488b-a695-7f136818a257" released by "_create_volume_from_snapshot" :: held 6.533s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 14:04:16 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-220d527b-dd08-4c1c-ae30-3d2bd84c3f95 tempest-SnapshotDependencyTests-1130162876 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.550s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 14:04:16 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-220d527b-dd08-4c1c-ae30-3d2bd84c3f95 tempest-SnapshotDependencyTests-1130162876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ecb1bcf3-1e07-42a5-8f0c-819654d67ff1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-908d9ff4-1e57-488b-a695-7f136818a257', 'volume_size': 1, 'snapshot_id': '16fa2495-cd64-4300-89b1-7ad608587346'}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:04:16 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-220d527b-dd08-4c1c-ae30-3d2bd84c3f95 tempest-SnapshotDependencyTests-1130162876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43fb1035-49af-4858-9cc4-af61a59028c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:04:16 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-220d527b-dd08-4c1c-ae30-3d2bd84c3f95 tempest-SnapshotDependencyTests-1130162876 None] Volume volume-908d9ff4-1e57-488b-a695-7f136818a257 (908d9ff4-1e57-488b-a695-7f136818a257): created successfully Jul 13 14:04:16 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-220d527b-dd08-4c1c-ae30-3d2bd84c3f95 tempest-SnapshotDependencyTests-1130162876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43fb1035-49af-4858-9cc4-af61a59028c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:04:16 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-220d527b-dd08-4c1c-ae30-3d2bd84c3f95 tempest-SnapshotDependencyTests-1130162876 None] Flow 'volume_create_manager' (34e10b6f-59b9-4b4b-a1af-26cfa97cf712) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 14:04:16 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-220d527b-dd08-4c1c-ae30-3d2bd84c3f95 tempest-SnapshotDependencyTests-1130162876 None] Created volume successfully. Jul 13 14:04:17 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-c0da3326-b4f1-4f29-885c-8975b1204056 tempest-SnapshotDependencyTests-1130162876 None] Acquiring lock "cinder-16fa2495-cd64-4300-89b1-7ad608587346-delete_snapshot" by "delete_snapshot" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 14:04:17 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-c0da3326-b4f1-4f29-885c-8975b1204056 tempest-SnapshotDependencyTests-1130162876 None] Lock "cinder-16fa2495-cd64-4300-89b1-7ad608587346-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 14:04:17 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-c0da3326-b4f1-4f29-885c-8975b1204056 tempest-SnapshotDependencyTests-1130162876 None] Acquiring lock "cinder-quobyte-28849c7a-f537-4e4d-8508-8e324a039a5b" by "delete_snapshot" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 14:04:17 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-4f978df3-7c48-4efa-a3b7-c985501c872a tempest-VolumeAndVolumeTypeFromImageTest-1093108321 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 14:04:17 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-4f978df3-7c48-4efa-a3b7-c985501c872a tempest-VolumeAndVolumeTypeFromImageTest-1093108321 None] Flow 'volume_create_manager' (7dcd5694-a6cc-45a3-adfa-ece50a61ec59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 14:04:17 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-4f978df3-7c48-4efa-a3b7-c985501c872a tempest-VolumeAndVolumeTypeFromImageTest-1093108321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b09061c-b5bf-48ed-bb9d-81feb9dbb4e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:04:17 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-c0da3326-b4f1-4f29-885c-8975b1204056 tempest-SnapshotDependencyTests-1130162876 None] Lock "cinder-quobyte-28849c7a-f537-4e4d-8508-8e324a039a5b" acquired by "delete_snapshot" :: waited 0.043s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 14:04:17 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-c0da3326-b4f1-4f29-885c-8975b1204056 tempest-SnapshotDependencyTests-1130162876 None] Acquiring lock "cinder-quobyte-16fa2495-cd64-4300-89b1-7ad608587346" by "_delete_snapshot" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 14:04:17 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-4f978df3-7c48-4efa-a3b7-c985501c872a tempest-VolumeAndVolumeTypeFromImageTest-1093108321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b09061c-b5bf-48ed-bb9d-81feb9dbb4e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T12:04:18Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=038b40ba-7e38-46bf-99d4-10aa45f60185,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44bc42d03b8c45028f102de7716a8a88',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T12:04:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T12:04:18Z,use_quota=True,user_id='608aad3c8ee243809d9f31f6d157cd95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01550d02-8233-4931-8fb8-3828c577c5f8),volume_type_id=01550d02-8233-4931-8fb8-3828c577c5f8)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:04:17 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-4f978df3-7c48-4efa-a3b7-c985501c872a tempest-VolumeAndVolumeTypeFromImageTest-1093108321 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4bca876-50f6-4b1a-9512-9dbb546e26cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:04:17 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-4f978df3-7c48-4efa-a3b7-c985501c872a tempest-VolumeAndVolumeTypeFromImageTest-1093108321 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4bca876-50f6-4b1a-9512-9dbb546e26cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:04:17 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-4f978df3-7c48-4efa-a3b7-c985501c872a tempest-VolumeAndVolumeTypeFromImageTest-1093108321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e12b26d6-3d1c-4747-badf-9c3242660bdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:04:17 devstack cinder-volume[87098]: DEBUG cinder.image.glance [None req-4f978df3-7c48-4efa-a3b7-c985501c872a tempest-VolumeAndVolumeTypeFromImageTest-1093108321 None] Creating Keystone auth plugin from conf {{(pid=87098) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 13 14:04:17 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-c0da3326-b4f1-4f29-885c-8975b1204056 tempest-SnapshotDependencyTests-1130162876 None] Lock "cinder-quobyte-16fa2495-cd64-4300-89b1-7ad608587346" acquired by "_delete_snapshot" :: waited 0.038s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 14:04:17 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-c0da3326-b4f1-4f29-885c-8975b1204056 tempest-SnapshotDependencyTests-1130162876 None] Deleting offline snapshot 16fa2495-cd64-4300-89b1-7ad608587346 of volume 28849c7a-f537-4e4d-8508-8e324a039a5b {{(pid=87098) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 13 14:04:17 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-c0da3326-b4f1-4f29-885c-8975b1204056 tempest-SnapshotDependencyTests-1130162876 None] snapshot_file for this snap is: volume-28849c7a-f537-4e4d-8508-8e324a039a5b.16fa2495-cd64-4300-89b1-7ad608587346 {{(pid=87098) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 13 14:04:17 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[018f3d6f-2bac-4675-832f-24ddf2785a5e]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 14:04:17 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-c0da3326-b4f1-4f29-885c-8975b1204056 tempest-SnapshotDependencyTests-1130162876 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-28849c7a-f537-4e4d-8508-8e324a039a5b.16fa2495-cd64-4300-89b1-7ad608587346 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:04:18 devstack sudo[103985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-28849c7a-f537-4e4d-8508-8e324a039a5b.16fa2495-cd64-4300-89b1-7ad608587346 Jul 13 14:04:18 devstack sudo[103985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:04:18 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-4f978df3-7c48-4efa-a3b7-c985501c872a tempest-VolumeAndVolumeTypeFromImageTest-1093108321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e12b26d6-3d1c-4747-badf-9c3242660bdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '038b40ba-7e38-46bf-99d4-10aa45f60185', 'volume_name': 'volume-038b40ba-7e38-46bf-99d4-10aa45f60185', 'volume_size': 1, 'image_id': '896253da-e88a-47a9-be45-c026ca408011', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/896253da-e88a-47a9-be45-c026ca408011', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '98813b8dbfa081e929ef351cd95e4af4', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '44bc42d03b8c45028f102de7716a8a88', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'f8d67dcd9d5ba1c0529c041566b72b72880c49e881318374691538018554b12bfb61ad7cab5cb091798d485864f6255782ea2d2cdc7f71836383b14858d85213', 'id': '896253da-e88a-47a9-be45-c026ca408011', 'created_at': datetime.datetime(2026, 7, 13, 12, 4, 16, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 13, 12, 4, 17, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/896253da-e88a-47a9-be45-c026ca408011/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:04:18 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-4f978df3-7c48-4efa-a3b7-c985501c872a tempest-VolumeAndVolumeTypeFromImageTest-1093108321 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (572c75e9-786a-47af-90cd-c06bea1406a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:04:18 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-4f978df3-7c48-4efa-a3b7-c985501c872a tempest-VolumeAndVolumeTypeFromImageTest-1093108321 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (572c75e9-786a-47af-90cd-c06bea1406a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:04:18 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-4f978df3-7c48-4efa-a3b7-c985501c872a tempest-VolumeAndVolumeTypeFromImageTest-1093108321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2eaa16c-3fd9-4c56-b4f5-536cd2ed458e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:04:18 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-4f978df3-7c48-4efa-a3b7-c985501c872a tempest-VolumeAndVolumeTypeFromImageTest-1093108321 None] Volume 038b40ba-7e38-46bf-99d4-10aa45f60185: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-038b40ba-7e38-46bf-99d4-10aa45f60185', 'volume_size': 1, 'image_id': '896253da-e88a-47a9-be45-c026ca408011', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/896253da-e88a-47a9-be45-c026ca408011', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '98813b8dbfa081e929ef351cd95e4af4', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '44bc42d03b8c45028f102de7716a8a88', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'f8d67dcd9d5ba1c0529c041566b72b72880c49e881318374691538018554b12bfb61ad7cab5cb091798d485864f6255782ea2d2cdc7f71836383b14858d85213', 'id': '896253da-e88a-47a9-be45-c026ca408011', 'created_at': datetime.datetime(2026, 7, 13, 12, 4, 16, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 13, 12, 4, 17, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/896253da-e88a-47a9-be45-c026ca408011/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jul 13 14:04:18 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-4f978df3-7c48-4efa-a3b7-c985501c872a tempest-VolumeAndVolumeTypeFromImageTest-1093108321 None] Trying to clone 038b40ba-7e38-46bf-99d4-10aa45f60185 from image 896253da-e88a-47a9-be45-c026ca408011 at location (None, [{'url': 'file:///opt/stack/data/glance/images/896253da-e88a-47a9-be45-c026ca408011', 'metadata': {}}]). {{(pid=87098) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 13 14:04:18 devstack cinder-volume[87098]: DEBUG cinder.image.image_utils [None req-4f978df3-7c48-4efa-a3b7-c985501c872a tempest-VolumeAndVolumeTypeFromImageTest-1093108321 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_896253da-e88a-47a9-be45-c026ca408011_ygh7_sjodevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87098) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 13 14:04:18 devstack cinder-volume[87098]: INFO cinder.image.image_utils [None req-4f978df3-7c48-4efa-a3b7-c985501c872a tempest-VolumeAndVolumeTypeFromImageTest-1093108321 None] Image download 0.00 MB at 0.00 MB/s Jul 13 14:04:18 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[02334c7f-bdea-49b4-9e23-7530357b601c]: (4, 'raw') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 14:04:18 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-4f978df3-7c48-4efa-a3b7-c985501c872a tempest-VolumeAndVolumeTypeFromImageTest-1093108321 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_896253da-e88a-47a9-be45-c026ca408011_ygh7_sjodevstack@QuobyteHD {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:04:18 devstack sudo[103985]: pam_unix(sudo:session): session closed for user root Jul 13 14:04:18 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-c0da3326-b4f1-4f29-885c-8975b1204056 tempest-SnapshotDependencyTests-1130162876 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-28849c7a-f537-4e4d-8508-8e324a039a5b.16fa2495-cd64-4300-89b1-7ad608587346" returned: 0 in 0.381s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:04:18 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-c0da3326-b4f1-4f29-885c-8975b1204056 tempest-SnapshotDependencyTests-1130162876 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-28849c7a-f537-4e4d-8508-8e324a039a5b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87098) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 13 14:04:18 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7933314-261a-4fc2-852a-704bb888bf48]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 14:04:18 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-c0da3326-b4f1-4f29-885c-8975b1204056 tempest-SnapshotDependencyTests-1130162876 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-28849c7a-f537-4e4d-8508-8e324a039a5b {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:04:18 devstack sudo[103992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_896253da-e88a-47a9-be45-c026ca408011_ygh7_sjodevstack@QuobyteHD Jul 13 14:04:18 devstack sudo[103992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:04:18 devstack sudo[103994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-28849c7a-f537-4e4d-8508-8e324a039a5b Jul 13 14:04:18 devstack sudo[103994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:04:18 devstack sudo[103992]: pam_unix(sudo:session): session closed for user root Jul 13 14:04:18 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-4f978df3-7c48-4efa-a3b7-c985501c872a tempest-VolumeAndVolumeTypeFromImageTest-1093108321 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_896253da-e88a-47a9-be45-c026ca408011_ygh7_sjodevstack@QuobyteHD" returned: 0 in 0.338s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:04:18 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-4f978df3-7c48-4efa-a3b7-c985501c872a tempest-VolumeAndVolumeTypeFromImageTest-1093108321 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_896253da-e88a-47a9-be45-c026ca408011_ygh7_sjodevstack@QuobyteHD {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:04:18 devstack sudo[103999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_896253da-e88a-47a9-be45-c026ca408011_ygh7_sjodevstack@QuobyteHD Jul 13 14:04:18 devstack sudo[103999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:04:18 devstack sudo[103994]: pam_unix(sudo:session): session closed for user root Jul 13 14:04:18 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-c0da3326-b4f1-4f29-885c-8975b1204056 tempest-SnapshotDependencyTests-1130162876 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-28849c7a-f537-4e4d-8508-8e324a039a5b" returned: 0 in 0.374s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:04:18 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-c0da3326-b4f1-4f29-885c-8975b1204056 tempest-SnapshotDependencyTests-1130162876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-28849c7a-f537-4e4d-8508-8e324a039a5b.16fa2495-cd64-4300-89b1-7ad608587346 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:04:18 devstack sudo[104004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-28849c7a-f537-4e4d-8508-8e324a039a5b.16fa2495-cd64-4300-89b1-7ad608587346 Jul 13 14:04:18 devstack sudo[104004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:04:18 devstack sudo[103999]: pam_unix(sudo:session): session closed for user root Jul 13 14:04:18 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-4f978df3-7c48-4efa-a3b7-c985501c872a tempest-VolumeAndVolumeTypeFromImageTest-1093108321 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_896253da-e88a-47a9-be45-c026ca408011_ygh7_sjodevstack@QuobyteHD" returned: 1 in 0.340s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:04:18 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-4f978df3-7c48-4efa-a3b7-c985501c872a tempest-VolumeAndVolumeTypeFromImageTest-1093108321 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_896253da-e88a-47a9-be45-c026ca408011_ygh7_sjodevstack@QuobyteHD' failed. Not Retrying. {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 13 14:04:18 devstack cinder-volume[87098]: DEBUG cinder.image.image_utils [None req-4f978df3-7c48-4efa-a3b7-c985501c872a tempest-VolumeAndVolumeTypeFromImageTest-1093108321 None] Temporary image 896253da-e88a-47a9-be45-c026ca408011 is fetched for user 608aad3c8ee243809d9f31f6d157cd95. {{(pid=87098) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 13 14:04:19 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[42b933aa-b2d6-4faf-8f33-ee41a8f4d0db]: (4, 'raw') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 14:04:19 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-4f978df3-7c48-4efa-a3b7-c985501c872a tempest-VolumeAndVolumeTypeFromImageTest-1093108321 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_896253da-e88a-47a9-be45-c026ca408011_ygh7_sjodevstack@QuobyteHD {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:04:19 devstack sudo[104004]: pam_unix(sudo:session): session closed for user root Jul 13 14:04:19 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-c0da3326-b4f1-4f29-885c-8975b1204056 tempest-SnapshotDependencyTests-1130162876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-28849c7a-f537-4e4d-8508-8e324a039a5b.16fa2495-cd64-4300-89b1-7ad608587346" returned: 0 in 0.346s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:04:19 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-c0da3326-b4f1-4f29-885c-8975b1204056 tempest-SnapshotDependencyTests-1130162876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-28849c7a-f537-4e4d-8508-8e324a039a5b.16fa2495-cd64-4300-89b1-7ad608587346 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:04:19 devstack sudo[104014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-28849c7a-f537-4e4d-8508-8e324a039a5b.16fa2495-cd64-4300-89b1-7ad608587346 Jul 13 14:04:19 devstack sudo[104014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:04:19 devstack sudo[104013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_896253da-e88a-47a9-be45-c026ca408011_ygh7_sjodevstack@QuobyteHD Jul 13 14:04:19 devstack sudo[104013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:04:19 devstack sudo[104014]: pam_unix(sudo:session): session closed for user root Jul 13 14:04:19 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-c0da3326-b4f1-4f29-885c-8975b1204056 tempest-SnapshotDependencyTests-1130162876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-28849c7a-f537-4e4d-8508-8e324a039a5b.16fa2495-cd64-4300-89b1-7ad608587346" returned: 0 in 0.261s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:04:19 devstack sudo[104013]: pam_unix(sudo:session): session closed for user root Jul 13 14:04:19 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-4f978df3-7c48-4efa-a3b7-c985501c872a tempest-VolumeAndVolumeTypeFromImageTest-1093108321 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_896253da-e88a-47a9-be45-c026ca408011_ygh7_sjodevstack@QuobyteHD" returned: 0 in 0.351s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:04:19 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-4f978df3-7c48-4efa-a3b7-c985501c872a tempest-VolumeAndVolumeTypeFromImageTest-1093108321 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_896253da-e88a-47a9-be45-c026ca408011_ygh7_sjodevstack@QuobyteHD {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:04:19 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-c0da3326-b4f1-4f29-885c-8975b1204056 tempest-SnapshotDependencyTests-1130162876 None] Lock "cinder-quobyte-16fa2495-cd64-4300-89b1-7ad608587346" released by "_delete_snapshot" :: held 1.487s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 14:04:19 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-c0da3326-b4f1-4f29-885c-8975b1204056 tempest-SnapshotDependencyTests-1130162876 None] Lock "cinder-quobyte-28849c7a-f537-4e4d-8508-8e324a039a5b" released by "delete_snapshot" :: held 1.536s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 14:04:19 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-c0da3326-b4f1-4f29-885c-8975b1204056 tempest-SnapshotDependencyTests-1130162876 None] Created reservations ['a7b70b15-b2c7-4831-8053-f112a7690ef0', '9f8ba432-5f8c-4a8f-a32d-e7441810e9de', '5527b422-e57e-4ee5-8d9c-98264e6a0334', '4d9a829b-a42e-4dc3-8769-7242eecc052c'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 14:04:19 devstack sudo[104026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_896253da-e88a-47a9-be45-c026ca408011_ygh7_sjodevstack@QuobyteHD Jul 13 14:04:19 devstack sudo[104026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:04:19 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-c0da3326-b4f1-4f29-885c-8975b1204056 tempest-SnapshotDependencyTests-1130162876 None] Delete snapshot completed successfully. Jul 13 14:04:19 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-c0da3326-b4f1-4f29-885c-8975b1204056 tempest-SnapshotDependencyTests-1130162876 None] Lock "cinder-16fa2495-cd64-4300-89b1-7ad608587346-delete_snapshot" released by "delete_snapshot" :: held 1.697s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 14:04:19 devstack sudo[104026]: pam_unix(sudo:session): session closed for user root Jul 13 14:04:19 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-4f978df3-7c48-4efa-a3b7-c985501c872a tempest-VolumeAndVolumeTypeFromImageTest-1093108321 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_896253da-e88a-47a9-be45-c026ca408011_ygh7_sjodevstack@QuobyteHD" returned: 1 in 0.332s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:04:19 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-4f978df3-7c48-4efa-a3b7-c985501c872a tempest-VolumeAndVolumeTypeFromImageTest-1093108321 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_896253da-e88a-47a9-be45-c026ca408011_ygh7_sjodevstack@QuobyteHD' failed. Not Retrying. {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 13 14:04:19 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-4f978df3-7c48-4efa-a3b7-c985501c872a tempest-VolumeAndVolumeTypeFromImageTest-1093108321 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 14:04:19 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-4f978df3-7c48-4efa-a3b7-c985501c872a tempest-VolumeAndVolumeTypeFromImageTest-1093108321 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 14:04:19 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-4f978df3-7c48-4efa-a3b7-c985501c872a tempest-VolumeAndVolumeTypeFromImageTest-1093108321 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T12:04:18Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=038b40ba-7e38-46bf-99d4-10aa45f60185,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44bc42d03b8c45028f102de7716a8a88',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T12:04:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T12:04:18Z,use_quota=True,user_id='608aad3c8ee243809d9f31f6d157cd95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01550d02-8233-4931-8fb8-3828c577c5f8),volume_type_id=01550d02-8233-4931-8fb8-3828c577c5f8)}" {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 13 14:04:19 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-4f978df3-7c48-4efa-a3b7-c985501c872a tempest-VolumeAndVolumeTypeFromImageTest-1093108321 None] Creating volume 038b40ba-7e38-46bf-99d4-10aa45f60185 {{(pid=87098) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 13 14:04:19 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-4f978df3-7c48-4efa-a3b7-c985501c872a tempest-VolumeAndVolumeTypeFromImageTest-1093108321 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 14:04:19 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-4f978df3-7c48-4efa-a3b7-c985501c872a tempest-VolumeAndVolumeTypeFromImageTest-1093108321 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 14:04:19 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-4f978df3-7c48-4efa-a3b7-c985501c872a tempest-VolumeAndVolumeTypeFromImageTest-1093108321 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 14:04:19 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-4f978df3-7c48-4efa-a3b7-c985501c872a tempest-VolumeAndVolumeTypeFromImageTest-1093108321 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 14:04:19 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-4f978df3-7c48-4efa-a3b7-c985501c872a tempest-VolumeAndVolumeTypeFromImageTest-1093108321 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 14:04:19 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-4f978df3-7c48-4efa-a3b7-c985501c872a tempest-VolumeAndVolumeTypeFromImageTest-1093108321 None] Selected osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 14:04:19 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-4f978df3-7c48-4efa-a3b7-c985501c872a tempest-VolumeAndVolumeTypeFromImageTest-1093108321 None] casted to osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 Jul 13 14:04:19 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-4f978df3-7c48-4efa-a3b7-c985501c872a tempest-VolumeAndVolumeTypeFromImageTest-1093108321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-038b40ba-7e38-46bf-99d4-10aa45f60185 1073741824 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:04:19 devstack sudo[104031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-038b40ba-7e38-46bf-99d4-10aa45f60185 1073741824 Jul 13 14:04:19 devstack sudo[104031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:04:19 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-2cea3303-ec39-4b45-81ea-e33e7e0163b5 tempest-SnapshotDependencyTests-1130162876 None] Acquiring lock "cinder-28849c7a-f537-4e4d-8508-8e324a039a5b-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 14:04:20 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-2cea3303-ec39-4b45-81ea-e33e7e0163b5 tempest-SnapshotDependencyTests-1130162876 None] Lock "cinder-28849c7a-f537-4e4d-8508-8e324a039a5b-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 14:04:20 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-2cea3303-ec39-4b45-81ea-e33e7e0163b5 tempest-SnapshotDependencyTests-1130162876 None] Acquiring lock "cinder-quobyte-28849c7a-f537-4e4d-8508-8e324a039a5b" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 14:04:20 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-2cea3303-ec39-4b45-81ea-e33e7e0163b5 tempest-SnapshotDependencyTests-1130162876 None] Lock "cinder-quobyte-28849c7a-f537-4e4d-8508-8e324a039a5b" acquired by "delete_volume" :: waited 0.022s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 14:04:20 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[21e85284-a472-4ea6-9ff9-fca01a477f46]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 14:04:20 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-2cea3303-ec39-4b45-81ea-e33e7e0163b5 tempest-SnapshotDependencyTests-1130162876 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-28849c7a-f537-4e4d-8508-8e324a039a5b {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:04:20 devstack sudo[104031]: pam_unix(sudo:session): session closed for user root Jul 13 14:04:20 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-4f978df3-7c48-4efa-a3b7-c985501c872a tempest-VolumeAndVolumeTypeFromImageTest-1093108321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-038b40ba-7e38-46bf-99d4-10aa45f60185 1073741824" returned: 0 in 0.484s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:04:20 devstack sudo[104036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-28849c7a-f537-4e4d-8508-8e324a039a5b Jul 13 14:04:20 devstack sudo[104036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:04:20 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-4f978df3-7c48-4efa-a3b7-c985501c872a tempest-VolumeAndVolumeTypeFromImageTest-1093108321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-038b40ba-7e38-46bf-99d4-10aa45f60185 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:04:20 devstack sudo[104038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-038b40ba-7e38-46bf-99d4-10aa45f60185 Jul 13 14:04:20 devstack sudo[104038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:04:20 devstack sudo[104036]: pam_unix(sudo:session): session closed for user root Jul 13 14:04:20 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-2cea3303-ec39-4b45-81ea-e33e7e0163b5 tempest-SnapshotDependencyTests-1130162876 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-28849c7a-f537-4e4d-8508-8e324a039a5b" returned: 0 in 0.369s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:04:20 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-2cea3303-ec39-4b45-81ea-e33e7e0163b5 tempest-SnapshotDependencyTests-1130162876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-28849c7a-f537-4e4d-8508-8e324a039a5b {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:04:20 devstack sudo[104038]: pam_unix(sudo:session): session closed for user root Jul 13 14:04:20 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-4f978df3-7c48-4efa-a3b7-c985501c872a tempest-VolumeAndVolumeTypeFromImageTest-1093108321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-038b40ba-7e38-46bf-99d4-10aa45f60185" returned: 0 in 0.253s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:04:20 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-4f978df3-7c48-4efa-a3b7-c985501c872a tempest-VolumeAndVolumeTypeFromImageTest-1093108321 None] <== create_volume: return (780ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'} {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 13 14:04:20 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-4f978df3-7c48-4efa-a3b7-c985501c872a tempest-VolumeAndVolumeTypeFromImageTest-1093108321 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.783s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 14:04:20 devstack sudo[104044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-28849c7a-f537-4e4d-8508-8e324a039a5b Jul 13 14:04:20 devstack sudo[104044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:04:20 devstack cinder-volume[87098]: DEBUG cinder.volume.volume_utils [None req-4f978df3-7c48-4efa-a3b7-c985501c872a tempest-VolumeAndVolumeTypeFromImageTest-1093108321 None] Attempting download of 896253da-e88a-47a9-be45-c026ca408011 ((None, [{'url': 'file:///opt/stack/data/glance/images/896253da-e88a-47a9-be45-c026ca408011', 'metadata': {}}])) to volume 038b40ba-7e38-46bf-99d4-10aa45f60185. {{(pid=87098) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 13 14:04:20 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[be0625a6-2f1f-40d0-8959-db55165909c7]: (4, 'raw') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 14:04:20 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-4f978df3-7c48-4efa-a3b7-c985501c872a tempest-VolumeAndVolumeTypeFromImageTest-1093108321 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_896253da-e88a-47a9-be45-c026ca408011_ntvy2m93 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:04:20 devstack sudo[104046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_896253da-e88a-47a9-be45-c026ca408011_ntvy2m93 Jul 13 14:04:20 devstack sudo[104046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:04:20 devstack sudo[104044]: pam_unix(sudo:session): session closed for user root Jul 13 14:04:20 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-2cea3303-ec39-4b45-81ea-e33e7e0163b5 tempest-SnapshotDependencyTests-1130162876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-28849c7a-f537-4e4d-8508-8e324a039a5b" returned: 0 in 0.260s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:04:20 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-2cea3303-ec39-4b45-81ea-e33e7e0163b5 tempest-SnapshotDependencyTests-1130162876 None] Lock "cinder-quobyte-28849c7a-f537-4e4d-8508-8e324a039a5b" released by "delete_volume" :: held 0.697s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 14:04:20 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-2cea3303-ec39-4b45-81ea-e33e7e0163b5 tempest-SnapshotDependencyTests-1130162876 None] Created reservations ['a87911b1-ccb4-457a-82d2-a4a48c253372', '5894afc0-cacd-44b6-92be-0368712af604', '9a03fa72-e10c-428e-9d6f-2ad71ee7cdb2', '098dca90-c6ec-46a0-8d39-84190577f3d3'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 14:04:20 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-2cea3303-ec39-4b45-81ea-e33e7e0163b5 tempest-SnapshotDependencyTests-1130162876 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 14:04:20 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-2cea3303-ec39-4b45-81ea-e33e7e0163b5 tempest-SnapshotDependencyTests-1130162876 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 14:04:20 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-2cea3303-ec39-4b45-81ea-e33e7e0163b5 tempest-SnapshotDependencyTests-1130162876 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 14:04:20 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-2cea3303-ec39-4b45-81ea-e33e7e0163b5 tempest-SnapshotDependencyTests-1130162876 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 14:04:20 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-2cea3303-ec39-4b45-81ea-e33e7e0163b5 tempest-SnapshotDependencyTests-1130162876 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 14:04:20 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-2cea3303-ec39-4b45-81ea-e33e7e0163b5 tempest-SnapshotDependencyTests-1130162876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:04:20 devstack sudo[104046]: pam_unix(sudo:session): session closed for user root Jul 13 14:04:20 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-4f978df3-7c48-4efa-a3b7-c985501c872a tempest-VolumeAndVolumeTypeFromImageTest-1093108321 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_896253da-e88a-47a9-be45-c026ca408011_ntvy2m93" returned: 0 in 0.333s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:04:20 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-4f978df3-7c48-4efa-a3b7-c985501c872a tempest-VolumeAndVolumeTypeFromImageTest-1093108321 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_896253da-e88a-47a9-be45-c026ca408011_ntvy2m93 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:04:20 devstack sudo[104051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 Jul 13 14:04:20 devstack sudo[104051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:04:21 devstack sudo[104053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_896253da-e88a-47a9-be45-c026ca408011_ntvy2m93 Jul 13 14:04:21 devstack sudo[104053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:04:21 devstack sudo[104051]: pam_unix(sudo:session): session closed for user root Jul 13 14:04:21 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-12be95ec-ad07-4421-a71f-451f05eab726 tempest-SnapshotDependencyTests-1130162876 None] Acquiring lock "cinder-908d9ff4-1e57-488b-a695-7f136818a257-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 14:04:21 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-2cea3303-ec39-4b45-81ea-e33e7e0163b5 tempest-SnapshotDependencyTests-1130162876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78" returned: 0 in 0.269s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:04:21 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-2cea3303-ec39-4b45-81ea-e33e7e0163b5 tempest-SnapshotDependencyTests-1130162876 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 14:04:21 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-2cea3303-ec39-4b45-81ea-e33e7e0163b5 tempest-SnapshotDependencyTests-1130162876 None] Deleted volume successfully. Jul 13 14:04:21 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-12be95ec-ad07-4421-a71f-451f05eab726 tempest-SnapshotDependencyTests-1130162876 None] Lock "cinder-908d9ff4-1e57-488b-a695-7f136818a257-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 14:04:21 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-2cea3303-ec39-4b45-81ea-e33e7e0163b5 tempest-SnapshotDependencyTests-1130162876 None] Lock "cinder-28849c7a-f537-4e4d-8508-8e324a039a5b-delete_volume" released by "delete_volume" :: held 1.208s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 14:04:21 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-12be95ec-ad07-4421-a71f-451f05eab726 tempest-SnapshotDependencyTests-1130162876 None] Acquiring lock "cinder-quobyte-908d9ff4-1e57-488b-a695-7f136818a257" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 14:04:21 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-12be95ec-ad07-4421-a71f-451f05eab726 tempest-SnapshotDependencyTests-1130162876 None] Lock "cinder-quobyte-908d9ff4-1e57-488b-a695-7f136818a257" acquired by "delete_volume" :: waited 0.013s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 14:04:21 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[0288d0c6-b2c2-4a06-ade2-5e06aab6fc6a]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 14:04:21 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-12be95ec-ad07-4421-a71f-451f05eab726 tempest-SnapshotDependencyTests-1130162876 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-908d9ff4-1e57-488b-a695-7f136818a257 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:04:21 devstack sudo[104053]: pam_unix(sudo:session): session closed for user root Jul 13 14:04:21 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-4f978df3-7c48-4efa-a3b7-c985501c872a tempest-VolumeAndVolumeTypeFromImageTest-1093108321 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_896253da-e88a-47a9-be45-c026ca408011_ntvy2m93" returned: 1 in 0.377s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:04:21 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-4f978df3-7c48-4efa-a3b7-c985501c872a tempest-VolumeAndVolumeTypeFromImageTest-1093108321 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_896253da-e88a-47a9-be45-c026ca408011_ntvy2m93' failed. Not Retrying. {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 13 14:04:21 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2057084-87c2-45e6-8244-255d052fcc28]: (4, 'raw') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 14:04:21 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-4f978df3-7c48-4efa-a3b7-c985501c872a tempest-VolumeAndVolumeTypeFromImageTest-1093108321 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_896253da-e88a-47a9-be45-c026ca408011_ygh7_sjodevstack@QuobyteHD {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:04:21 devstack sudo[104058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-908d9ff4-1e57-488b-a695-7f136818a257 Jul 13 14:04:21 devstack sudo[104058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:04:21 devstack sudo[104059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_896253da-e88a-47a9-be45-c026ca408011_ygh7_sjodevstack@QuobyteHD Jul 13 14:04:21 devstack sudo[104059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:04:21 devstack sudo[104058]: pam_unix(sudo:session): session closed for user root Jul 13 14:04:21 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-12be95ec-ad07-4421-a71f-451f05eab726 tempest-SnapshotDependencyTests-1130162876 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-908d9ff4-1e57-488b-a695-7f136818a257" returned: 0 in 0.353s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:04:21 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-12be95ec-ad07-4421-a71f-451f05eab726 tempest-SnapshotDependencyTests-1130162876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-908d9ff4-1e57-488b-a695-7f136818a257 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:04:21 devstack sudo[104067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-908d9ff4-1e57-488b-a695-7f136818a257 Jul 13 14:04:21 devstack sudo[104059]: pam_unix(sudo:session): session closed for user root Jul 13 14:04:21 devstack sudo[104067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:04:21 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-4f978df3-7c48-4efa-a3b7-c985501c872a tempest-VolumeAndVolumeTypeFromImageTest-1093108321 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_896253da-e88a-47a9-be45-c026ca408011_ygh7_sjodevstack@QuobyteHD" returned: 0 in 0.339s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:04:21 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-4f978df3-7c48-4efa-a3b7-c985501c872a tempest-VolumeAndVolumeTypeFromImageTest-1093108321 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_896253da-e88a-47a9-be45-c026ca408011_ygh7_sjodevstack@QuobyteHD {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:04:21 devstack sudo[104069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_896253da-e88a-47a9-be45-c026ca408011_ygh7_sjodevstack@QuobyteHD Jul 13 14:04:21 devstack sudo[104069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:04:21 devstack sudo[104067]: pam_unix(sudo:session): session closed for user root Jul 13 14:04:21 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-12be95ec-ad07-4421-a71f-451f05eab726 tempest-SnapshotDependencyTests-1130162876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-908d9ff4-1e57-488b-a695-7f136818a257" returned: 0 in 0.242s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:04:21 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-12be95ec-ad07-4421-a71f-451f05eab726 tempest-SnapshotDependencyTests-1130162876 None] Lock "cinder-quobyte-908d9ff4-1e57-488b-a695-7f136818a257" released by "delete_volume" :: held 0.632s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 14:04:21 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-12be95ec-ad07-4421-a71f-451f05eab726 tempest-SnapshotDependencyTests-1130162876 None] Created reservations ['d5af69f0-e0c5-406a-a7c1-f90ab1f27e58', 'b76b839c-dd19-48ab-8af9-ef53b456e7fe', 'f1085a79-b6f5-45b3-a4cb-67219dea8e4c', 'c072bfab-dc07-4762-9622-a5be54d9ec80'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 14:04:21 devstack sudo[104069]: pam_unix(sudo:session): session closed for user root Jul 13 14:04:21 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-4f978df3-7c48-4efa-a3b7-c985501c872a tempest-VolumeAndVolumeTypeFromImageTest-1093108321 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_896253da-e88a-47a9-be45-c026ca408011_ygh7_sjodevstack@QuobyteHD" returned: 1 in 0.333s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:04:21 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-4f978df3-7c48-4efa-a3b7-c985501c872a tempest-VolumeAndVolumeTypeFromImageTest-1093108321 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_896253da-e88a-47a9-be45-c026ca408011_ygh7_sjodevstack@QuobyteHD' failed. Not Retrying. {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 13 14:04:21 devstack cinder-volume[87098]: DEBUG cinder.image.image_utils [None req-4f978df3-7c48-4efa-a3b7-c985501c872a tempest-VolumeAndVolumeTypeFromImageTest-1093108321 None] 896253da-e88a-47a9-be45-c026ca408011 was raw, converting to raw {{(pid=87098) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 13 14:04:21 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-4f978df3-7c48-4efa-a3b7-c985501c872a tempest-VolumeAndVolumeTypeFromImageTest-1093108321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_896253da-e88a-47a9-be45-c026ca408011_ygh7_sjodevstack@QuobyteHD /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-038b40ba-7e38-46bf-99d4-10aa45f60185 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:04:22 devstack sudo[104075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_896253da-e88a-47a9-be45-c026ca408011_ygh7_sjodevstack@QuobyteHD /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-038b40ba-7e38-46bf-99d4-10aa45f60185 Jul 13 14:04:22 devstack sudo[104075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:04:22 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-12be95ec-ad07-4421-a71f-451f05eab726 tempest-SnapshotDependencyTests-1130162876 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 14:04:22 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-12be95ec-ad07-4421-a71f-451f05eab726 tempest-SnapshotDependencyTests-1130162876 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 14:04:22 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-12be95ec-ad07-4421-a71f-451f05eab726 tempest-SnapshotDependencyTests-1130162876 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 14:04:22 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-12be95ec-ad07-4421-a71f-451f05eab726 tempest-SnapshotDependencyTests-1130162876 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 14:04:22 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-12be95ec-ad07-4421-a71f-451f05eab726 tempest-SnapshotDependencyTests-1130162876 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 14:04:22 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-12be95ec-ad07-4421-a71f-451f05eab726 tempest-SnapshotDependencyTests-1130162876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:04:22 devstack sudo[104077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 Jul 13 14:04:22 devstack sudo[104077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:04:22 devstack sudo[104077]: pam_unix(sudo:session): session closed for user root Jul 13 14:04:22 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-12be95ec-ad07-4421-a71f-451f05eab726 tempest-SnapshotDependencyTests-1130162876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78" returned: 0 in 0.255s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:04:22 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-12be95ec-ad07-4421-a71f-451f05eab726 tempest-SnapshotDependencyTests-1130162876 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 14:04:22 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-12be95ec-ad07-4421-a71f-451f05eab726 tempest-SnapshotDependencyTests-1130162876 None] Deleted volume successfully. Jul 13 14:04:22 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-12be95ec-ad07-4421-a71f-451f05eab726 tempest-SnapshotDependencyTests-1130162876 None] Lock "cinder-908d9ff4-1e57-488b-a695-7f136818a257-delete_volume" released by "delete_volume" :: held 1.131s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 14:04:22 devstack sudo[104075]: pam_unix(sudo:session): session closed for user root Jul 13 14:04:22 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-4f978df3-7c48-4efa-a3b7-c985501c872a tempest-VolumeAndVolumeTypeFromImageTest-1093108321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_896253da-e88a-47a9-be45-c026ca408011_ygh7_sjodevstack@QuobyteHD /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-038b40ba-7e38-46bf-99d4-10aa45f60185" returned: 0 in 0.360s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:04:22 devstack cinder-volume[87098]: DEBUG cinder.image.image_utils [None req-4f978df3-7c48-4efa-a3b7-c985501c872a tempest-VolumeAndVolumeTypeFromImageTest-1093108321 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_896253da-e88a-47a9-be45-c026ca408011_ygh7_sjodevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-038b40ba-7e38-46bf-99d4-10aa45f60185 {{(pid=87098) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 13 14:04:22 devstack cinder-volume[87098]: INFO cinder.image.image_utils [None req-4f978df3-7c48-4efa-a3b7-c985501c872a tempest-VolumeAndVolumeTypeFromImageTest-1093108321 None] Converted 0.00 MB image at 0.00 MB/s Jul 13 14:04:22 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-4f978df3-7c48-4efa-a3b7-c985501c872a tempest-VolumeAndVolumeTypeFromImageTest-1093108321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-038b40ba-7e38-46bf-99d4-10aa45f60185 1G {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:04:22 devstack sudo[104083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-038b40ba-7e38-46bf-99d4-10aa45f60185 1G Jul 13 14:04:22 devstack sudo[104083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:04:22 devstack sudo[104083]: pam_unix(sudo:session): session closed for user root Jul 13 14:04:22 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-4f978df3-7c48-4efa-a3b7-c985501c872a tempest-VolumeAndVolumeTypeFromImageTest-1093108321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-038b40ba-7e38-46bf-99d4-10aa45f60185 1G" returned: 0 in 0.287s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:04:22 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[cda15c59-c935-4db4-8b68-7dc7e3703e60]: (4, 'raw') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 14:04:22 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-4f978df3-7c48-4efa-a3b7-c985501c872a tempest-VolumeAndVolumeTypeFromImageTest-1093108321 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-038b40ba-7e38-46bf-99d4-10aa45f60185 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:04:22 devstack sudo[104088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-038b40ba-7e38-46bf-99d4-10aa45f60185 Jul 13 14:04:22 devstack sudo[104088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:04:23 devstack sudo[104088]: pam_unix(sudo:session): session closed for user root Jul 13 14:04:23 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-4f978df3-7c48-4efa-a3b7-c985501c872a tempest-VolumeAndVolumeTypeFromImageTest-1093108321 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-038b40ba-7e38-46bf-99d4-10aa45f60185" returned: 0 in 0.365s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:04:23 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-4f978df3-7c48-4efa-a3b7-c985501c872a tempest-VolumeAndVolumeTypeFromImageTest-1093108321 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-038b40ba-7e38-46bf-99d4-10aa45f60185 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:04:23 devstack sudo[104092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-038b40ba-7e38-46bf-99d4-10aa45f60185 Jul 13 14:04:23 devstack sudo[104092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:04:23 devstack sudo[104092]: pam_unix(sudo:session): session closed for user root Jul 13 14:04:23 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-4f978df3-7c48-4efa-a3b7-c985501c872a tempest-VolumeAndVolumeTypeFromImageTest-1093108321 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-038b40ba-7e38-46bf-99d4-10aa45f60185" returned: 1 in 0.421s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:04:23 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-4f978df3-7c48-4efa-a3b7-c985501c872a tempest-VolumeAndVolumeTypeFromImageTest-1093108321 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-038b40ba-7e38-46bf-99d4-10aa45f60185' failed. Not Retrying. {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 13 14:04:23 devstack cinder-volume[87098]: DEBUG cinder.volume.volume_utils [None req-4f978df3-7c48-4efa-a3b7-c985501c872a tempest-VolumeAndVolumeTypeFromImageTest-1093108321 None] Downloaded image 896253da-e88a-47a9-be45-c026ca408011 ((None, [{'url': 'file:///opt/stack/data/glance/images/896253da-e88a-47a9-be45-c026ca408011', 'metadata': {}}])) to volume 038b40ba-7e38-46bf-99d4-10aa45f60185 successfully. {{(pid=87098) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 13 14:04:23 devstack cinder-volume[87098]: DEBUG cinder.image.image_utils [None req-4f978df3-7c48-4efa-a3b7-c985501c872a tempest-VolumeAndVolumeTypeFromImageTest-1093108321 None] Temporary image 896253da-e88a-47a9-be45-c026ca408011 for user 608aad3c8ee243809d9f31f6d157cd95 is deleted. {{(pid=87098) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 13 14:04:23 devstack cinder-volume[87098]: DEBUG cinder.volume.volume_utils [None req-4f978df3-7c48-4efa-a3b7-c985501c872a tempest-VolumeAndVolumeTypeFromImageTest-1093108321 None] Marking volume 038b40ba-7e38-46bf-99d4-10aa45f60185 as bootable. {{(pid=87098) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 13 14:04:23 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-4f978df3-7c48-4efa-a3b7-c985501c872a tempest-VolumeAndVolumeTypeFromImageTest-1093108321 None] Copying metadata from image 896253da-e88a-47a9-be45-c026ca408011 to 038b40ba-7e38-46bf-99d4-10aa45f60185. {{(pid=87098) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 13 14:04:23 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-4f978df3-7c48-4efa-a3b7-c985501c872a tempest-VolumeAndVolumeTypeFromImageTest-1093108321 None] Creating volume glance metadata for volume 038b40ba-7e38-46bf-99d4-10aa45f60185 backed by image 896253da-e88a-47a9-be45-c026ca408011 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '896253da-e88a-47a9-be45-c026ca408011', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '98813b8dbfa081e929ef351cd95e4af4', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87098) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 13 14:04:23 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-4f978df3-7c48-4efa-a3b7-c985501c872a tempest-VolumeAndVolumeTypeFromImageTest-1093108321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2eaa16c-3fd9-4c56-b4f5-536cd2ed458e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-038b40ba-7e38-46bf-99d4-10aa45f60185', 'volume_size': 1, 'image_id': '896253da-e88a-47a9-be45-c026ca408011', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/896253da-e88a-47a9-be45-c026ca408011', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '98813b8dbfa081e929ef351cd95e4af4', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '44bc42d03b8c45028f102de7716a8a88', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'f8d67dcd9d5ba1c0529c041566b72b72880c49e881318374691538018554b12bfb61ad7cab5cb091798d485864f6255782ea2d2cdc7f71836383b14858d85213', 'id': '896253da-e88a-47a9-be45-c026ca408011', 'created_at': datetime.datetime(2026, 7, 13, 12, 4, 16, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 13, 12, 4, 17, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/896253da-e88a-47a9-be45-c026ca408011/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:04:23 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-4f978df3-7c48-4efa-a3b7-c985501c872a tempest-VolumeAndVolumeTypeFromImageTest-1093108321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9f2ab18-6e23-4478-bc29-53a383d0b73a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:04:23 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-4f978df3-7c48-4efa-a3b7-c985501c872a tempest-VolumeAndVolumeTypeFromImageTest-1093108321 None] Volume volume-038b40ba-7e38-46bf-99d4-10aa45f60185 (038b40ba-7e38-46bf-99d4-10aa45f60185): created successfully Jul 13 14:04:23 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-4f978df3-7c48-4efa-a3b7-c985501c872a tempest-VolumeAndVolumeTypeFromImageTest-1093108321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9f2ab18-6e23-4478-bc29-53a383d0b73a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:04:23 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-4f978df3-7c48-4efa-a3b7-c985501c872a tempest-VolumeAndVolumeTypeFromImageTest-1093108321 None] Flow 'volume_create_manager' (7dcd5694-a6cc-45a3-adfa-ece50a61ec59) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 14:04:23 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-4f978df3-7c48-4efa-a3b7-c985501c872a tempest-VolumeAndVolumeTypeFromImageTest-1093108321 None] Created volume successfully. Jul 13 14:04:24 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-678c3c06-f007-4e73-9f62-c07d023c3e51 tempest-VolumeAndVolumeTypeFromImageTest-1093108321 None] Acquiring lock "cinder-038b40ba-7e38-46bf-99d4-10aa45f60185-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 14:04:24 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-678c3c06-f007-4e73-9f62-c07d023c3e51 tempest-VolumeAndVolumeTypeFromImageTest-1093108321 None] Lock "cinder-038b40ba-7e38-46bf-99d4-10aa45f60185-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 14:04:24 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-678c3c06-f007-4e73-9f62-c07d023c3e51 tempest-VolumeAndVolumeTypeFromImageTest-1093108321 None] Acquiring lock "cinder-quobyte-038b40ba-7e38-46bf-99d4-10aa45f60185" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 14:04:24 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-678c3c06-f007-4e73-9f62-c07d023c3e51 tempest-VolumeAndVolumeTypeFromImageTest-1093108321 None] Lock "cinder-quobyte-038b40ba-7e38-46bf-99d4-10aa45f60185" acquired by "delete_volume" :: waited 0.024s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 14:04:24 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[42bc2aec-d2a6-417b-b917-f19e692b2c06]: (4, 'raw') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 14:04:24 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-678c3c06-f007-4e73-9f62-c07d023c3e51 tempest-VolumeAndVolumeTypeFromImageTest-1093108321 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-038b40ba-7e38-46bf-99d4-10aa45f60185 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:04:24 devstack sudo[104099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-038b40ba-7e38-46bf-99d4-10aa45f60185 Jul 13 14:04:24 devstack sudo[104099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:04:24 devstack sudo[104099]: pam_unix(sudo:session): session closed for user root Jul 13 14:04:24 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-678c3c06-f007-4e73-9f62-c07d023c3e51 tempest-VolumeAndVolumeTypeFromImageTest-1093108321 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-038b40ba-7e38-46bf-99d4-10aa45f60185" returned: 0 in 0.384s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:04:24 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-678c3c06-f007-4e73-9f62-c07d023c3e51 tempest-VolumeAndVolumeTypeFromImageTest-1093108321 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-038b40ba-7e38-46bf-99d4-10aa45f60185 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:04:24 devstack sudo[104103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-038b40ba-7e38-46bf-99d4-10aa45f60185 Jul 13 14:04:24 devstack sudo[104103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:04:25 devstack sudo[104103]: pam_unix(sudo:session): session closed for user root Jul 13 14:04:25 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-678c3c06-f007-4e73-9f62-c07d023c3e51 tempest-VolumeAndVolumeTypeFromImageTest-1093108321 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-038b40ba-7e38-46bf-99d4-10aa45f60185" returned: 1 in 0.378s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:04:25 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-678c3c06-f007-4e73-9f62-c07d023c3e51 tempest-VolumeAndVolumeTypeFromImageTest-1093108321 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-038b40ba-7e38-46bf-99d4-10aa45f60185' failed. Not Retrying. {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 13 14:04:25 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-678c3c06-f007-4e73-9f62-c07d023c3e51 tempest-VolumeAndVolumeTypeFromImageTest-1093108321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-038b40ba-7e38-46bf-99d4-10aa45f60185 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:04:25 devstack sudo[104108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-038b40ba-7e38-46bf-99d4-10aa45f60185 Jul 13 14:04:25 devstack sudo[104108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:04:25 devstack sudo[104108]: pam_unix(sudo:session): session closed for user root Jul 13 14:04:25 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-678c3c06-f007-4e73-9f62-c07d023c3e51 tempest-VolumeAndVolumeTypeFromImageTest-1093108321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-038b40ba-7e38-46bf-99d4-10aa45f60185" returned: 0 in 0.292s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:04:25 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-678c3c06-f007-4e73-9f62-c07d023c3e51 tempest-VolumeAndVolumeTypeFromImageTest-1093108321 None] Lock "cinder-quobyte-038b40ba-7e38-46bf-99d4-10aa45f60185" released by "delete_volume" :: held 1.118s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 14:04:25 devstack cinder-volume[87098]: WARNING cinder.quota [None req-678c3c06-f007-4e73-9f62-c07d023c3e51 tempest-VolumeAndVolumeTypeFromImageTest-1093108321 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jul 13 14:04:25 devstack cinder-volume[87098]: WARNING cinder.quota [None req-678c3c06-f007-4e73-9f62-c07d023c3e51 tempest-VolumeAndVolumeTypeFromImageTest-1093108321 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jul 13 14:04:25 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-678c3c06-f007-4e73-9f62-c07d023c3e51 tempest-VolumeAndVolumeTypeFromImageTest-1093108321 None] Created reservations ['caa8edd7-304c-45c6-897b-8a5284e87b55', 'f8919957-3553-4c0d-9b16-0e89c505694a', '10e216ce-c994-4eb7-b68a-3f4a210c907c', '1869379d-0177-44ff-a71c-4ff1f50b3a6a'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 14:04:25 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-678c3c06-f007-4e73-9f62-c07d023c3e51 tempest-VolumeAndVolumeTypeFromImageTest-1093108321 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 14:04:25 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-678c3c06-f007-4e73-9f62-c07d023c3e51 tempest-VolumeAndVolumeTypeFromImageTest-1093108321 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 14:04:25 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-678c3c06-f007-4e73-9f62-c07d023c3e51 tempest-VolumeAndVolumeTypeFromImageTest-1093108321 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 14:04:25 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-678c3c06-f007-4e73-9f62-c07d023c3e51 tempest-VolumeAndVolumeTypeFromImageTest-1093108321 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 14:04:25 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-678c3c06-f007-4e73-9f62-c07d023c3e51 tempest-VolumeAndVolumeTypeFromImageTest-1093108321 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 14:04:25 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-678c3c06-f007-4e73-9f62-c07d023c3e51 tempest-VolumeAndVolumeTypeFromImageTest-1093108321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:04:25 devstack sudo[104111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 Jul 13 14:04:25 devstack sudo[104111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:04:25 devstack sudo[104111]: pam_unix(sudo:session): session closed for user root Jul 13 14:04:25 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-678c3c06-f007-4e73-9f62-c07d023c3e51 tempest-VolumeAndVolumeTypeFromImageTest-1093108321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78" returned: 0 in 0.276s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:04:25 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-678c3c06-f007-4e73-9f62-c07d023c3e51 tempest-VolumeAndVolumeTypeFromImageTest-1093108321 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 14:04:25 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-678c3c06-f007-4e73-9f62-c07d023c3e51 tempest-VolumeAndVolumeTypeFromImageTest-1093108321 None] Deleted volume successfully. Jul 13 14:04:25 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-678c3c06-f007-4e73-9f62-c07d023c3e51 tempest-VolumeAndVolumeTypeFromImageTest-1093108321 None] Lock "cinder-038b40ba-7e38-46bf-99d4-10aa45f60185-delete_volume" released by "delete_volume" :: held 1.619s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 14:04:29 devstack cinder-volume[87098]: DEBUG oslo_service.periodic_task [None req-727a1692-ea28-4a77-b327-0d94e8f01efb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87098) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 13 14:04:29 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-727a1692-ea28-4a77-b327-0d94e8f01efb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 14:04:29 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-727a1692-ea28-4a77-b327-0d94e8f01efb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 14:04:29 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-727a1692-ea28-4a77-b327-0d94e8f01efb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 14:04:29 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-727a1692-ea28-4a77-b327-0d94e8f01efb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 14:04:29 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-727a1692-ea28-4a77-b327-0d94e8f01efb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 14:04:29 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-727a1692-ea28-4a77-b327-0d94e8f01efb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:04:29 devstack sudo[104117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 Jul 13 14:04:29 devstack sudo[104117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:04:29 devstack sudo[104117]: pam_unix(sudo:session): session closed for user root Jul 13 14:04:29 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-727a1692-ea28-4a77-b327-0d94e8f01efb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78" returned: 0 in 0.341s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:04:29 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-727a1692-ea28-4a77-b327-0d94e8f01efb None None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 14:04:29 devstack cinder-volume[87098]: DEBUG oslo_service.periodic_task [None req-727a1692-ea28-4a77-b327-0d94e8f01efb None None] Running periodic task VolumeManager._thread_info {{(pid=87098) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 13 14:04:29 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-727a1692-ea28-4a77-b327-0d94e8f01efb None None] thread count: 28 {{(pid=87098) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 13 14:04:29 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-727a1692-ea28-4a77-b327-0d94e8f01efb None None] thread info: [<_MainThread(MainThread, started 127988054597760)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87098) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 13 14:04:31 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-b0f2414d-7ffd-41be-985b-2a17cd9bd8e7 tempest-CreateVolumesFromSnapshotTest-513203005 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 14:04:31 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-b0f2414d-7ffd-41be-985b-2a17cd9bd8e7 tempest-CreateVolumesFromSnapshotTest-513203005 None] Flow 'volume_create_manager' (d0aadaea-7d23-4e6a-bb0e-9013241b899a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 14:04:31 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-b0f2414d-7ffd-41be-985b-2a17cd9bd8e7 tempest-CreateVolumesFromSnapshotTest-513203005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d36c594-26d3-4f45-85b2-c021376d1cf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:04:31 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-b0f2414d-7ffd-41be-985b-2a17cd9bd8e7 tempest-CreateVolumesFromSnapshotTest-513203005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d36c594-26d3-4f45-85b2-c021376d1cf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T12:04:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-367924094',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f13635f-d209-4fab-8641-5121af84c9bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c4fdb162c26475b94e9a8f76ed56478',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T12:04:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T12:04:31Z,use_quota=True,user_id='678beaf52717445dab07e761bb377e3e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1147de8b-623b-426c-a13d-7fc824a80f67),volume_type_id=1147de8b-623b-426c-a13d-7fc824a80f67)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:04:31 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-b0f2414d-7ffd-41be-985b-2a17cd9bd8e7 tempest-CreateVolumesFromSnapshotTest-513203005 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3408ace-341a-4a66-921d-e4050a29530e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:04:31 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-b0f2414d-7ffd-41be-985b-2a17cd9bd8e7 tempest-CreateVolumesFromSnapshotTest-513203005 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3408ace-341a-4a66-921d-e4050a29530e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:04:31 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-b0f2414d-7ffd-41be-985b-2a17cd9bd8e7 tempest-CreateVolumesFromSnapshotTest-513203005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (837985bb-5f0d-4825-b4fc-6a5952fd45ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:04:31 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-b0f2414d-7ffd-41be-985b-2a17cd9bd8e7 tempest-CreateVolumesFromSnapshotTest-513203005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (837985bb-5f0d-4825-b4fc-6a5952fd45ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6f13635f-d209-4fab-8641-5121af84c9bd', 'volume_name': 'volume-6f13635f-d209-4fab-8641-5121af84c9bd', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:04:31 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-b0f2414d-7ffd-41be-985b-2a17cd9bd8e7 tempest-CreateVolumesFromSnapshotTest-513203005 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf5a71f1-c78e-480a-9fa0-c2688ebf30c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:04:31 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-b0f2414d-7ffd-41be-985b-2a17cd9bd8e7 tempest-CreateVolumesFromSnapshotTest-513203005 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf5a71f1-c78e-480a-9fa0-c2688ebf30c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:04:31 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-b0f2414d-7ffd-41be-985b-2a17cd9bd8e7 tempest-CreateVolumesFromSnapshotTest-513203005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55536179-f96a-4899-a864-c8df3821f909) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:04:31 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-b0f2414d-7ffd-41be-985b-2a17cd9bd8e7 tempest-CreateVolumesFromSnapshotTest-513203005 None] Volume 6f13635f-d209-4fab-8641-5121af84c9bd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6f13635f-d209-4fab-8641-5121af84c9bd', 'volume_size': 1} Jul 13 14:04:31 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-b0f2414d-7ffd-41be-985b-2a17cd9bd8e7 tempest-CreateVolumesFromSnapshotTest-513203005 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 14:04:31 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-b0f2414d-7ffd-41be-985b-2a17cd9bd8e7 tempest-CreateVolumesFromSnapshotTest-513203005 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 14:04:31 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-b0f2414d-7ffd-41be-985b-2a17cd9bd8e7 tempest-CreateVolumesFromSnapshotTest-513203005 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T12:04:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-367924094',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f13635f-d209-4fab-8641-5121af84c9bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c4fdb162c26475b94e9a8f76ed56478',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T12:04:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T12:04:31Z,use_quota=True,user_id='678beaf52717445dab07e761bb377e3e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1147de8b-623b-426c-a13d-7fc824a80f67),volume_type_id=1147de8b-623b-426c-a13d-7fc824a80f67)}" {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 13 14:04:31 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-b0f2414d-7ffd-41be-985b-2a17cd9bd8e7 tempest-CreateVolumesFromSnapshotTest-513203005 None] Creating volume 6f13635f-d209-4fab-8641-5121af84c9bd {{(pid=87098) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 13 14:04:31 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-b0f2414d-7ffd-41be-985b-2a17cd9bd8e7 tempest-CreateVolumesFromSnapshotTest-513203005 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 14:04:31 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-b0f2414d-7ffd-41be-985b-2a17cd9bd8e7 tempest-CreateVolumesFromSnapshotTest-513203005 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 14:04:31 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-b0f2414d-7ffd-41be-985b-2a17cd9bd8e7 tempest-CreateVolumesFromSnapshotTest-513203005 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 14:04:31 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-b0f2414d-7ffd-41be-985b-2a17cd9bd8e7 tempest-CreateVolumesFromSnapshotTest-513203005 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 14:04:31 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-b0f2414d-7ffd-41be-985b-2a17cd9bd8e7 tempest-CreateVolumesFromSnapshotTest-513203005 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 14:04:31 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-b0f2414d-7ffd-41be-985b-2a17cd9bd8e7 tempest-CreateVolumesFromSnapshotTest-513203005 None] Selected osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 14:04:31 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-b0f2414d-7ffd-41be-985b-2a17cd9bd8e7 tempest-CreateVolumesFromSnapshotTest-513203005 None] casted to osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 Jul 13 14:04:31 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-b0f2414d-7ffd-41be-985b-2a17cd9bd8e7 tempest-CreateVolumesFromSnapshotTest-513203005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-6f13635f-d209-4fab-8641-5121af84c9bd 1073741824 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:04:31 devstack sudo[104122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-6f13635f-d209-4fab-8641-5121af84c9bd 1073741824 Jul 13 14:04:31 devstack sudo[104122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:04:31 devstack sudo[104122]: pam_unix(sudo:session): session closed for user root Jul 13 14:04:31 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-b0f2414d-7ffd-41be-985b-2a17cd9bd8e7 tempest-CreateVolumesFromSnapshotTest-513203005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-6f13635f-d209-4fab-8641-5121af84c9bd 1073741824" returned: 0 in 0.456s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:04:31 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-b0f2414d-7ffd-41be-985b-2a17cd9bd8e7 tempest-CreateVolumesFromSnapshotTest-513203005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-6f13635f-d209-4fab-8641-5121af84c9bd {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:04:31 devstack sudo[104127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-6f13635f-d209-4fab-8641-5121af84c9bd Jul 13 14:04:31 devstack sudo[104127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:04:32 devstack sudo[104127]: pam_unix(sudo:session): session closed for user root Jul 13 14:04:32 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-b0f2414d-7ffd-41be-985b-2a17cd9bd8e7 tempest-CreateVolumesFromSnapshotTest-513203005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-6f13635f-d209-4fab-8641-5121af84c9bd" returned: 0 in 0.255s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:04:32 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-b0f2414d-7ffd-41be-985b-2a17cd9bd8e7 tempest-CreateVolumesFromSnapshotTest-513203005 None] <== create_volume: return (757ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'} {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 13 14:04:32 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-b0f2414d-7ffd-41be-985b-2a17cd9bd8e7 tempest-CreateVolumesFromSnapshotTest-513203005 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.760s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 14:04:32 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-b0f2414d-7ffd-41be-985b-2a17cd9bd8e7 tempest-CreateVolumesFromSnapshotTest-513203005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55536179-f96a-4899-a864-c8df3821f909) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6f13635f-d209-4fab-8641-5121af84c9bd', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:04:32 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-b0f2414d-7ffd-41be-985b-2a17cd9bd8e7 tempest-CreateVolumesFromSnapshotTest-513203005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58f8b2c0-17bb-4360-ac1f-f2ee3c05369a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:04:32 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-b0f2414d-7ffd-41be-985b-2a17cd9bd8e7 tempest-CreateVolumesFromSnapshotTest-513203005 None] Volume volume-6f13635f-d209-4fab-8641-5121af84c9bd (6f13635f-d209-4fab-8641-5121af84c9bd): created successfully Jul 13 14:04:32 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-b0f2414d-7ffd-41be-985b-2a17cd9bd8e7 tempest-CreateVolumesFromSnapshotTest-513203005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58f8b2c0-17bb-4360-ac1f-f2ee3c05369a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:04:32 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-b0f2414d-7ffd-41be-985b-2a17cd9bd8e7 tempest-CreateVolumesFromSnapshotTest-513203005 None] Flow 'volume_create_manager' (d0aadaea-7d23-4e6a-bb0e-9013241b899a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 14:04:32 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-b0f2414d-7ffd-41be-985b-2a17cd9bd8e7 tempest-CreateVolumesFromSnapshotTest-513203005 None] Created volume successfully. Jul 13 14:04:33 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-c212f127-89f1-4af6-8f5e-c5bd33ac1289 tempest-CreateVolumesFromSnapshotTest-513203005 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 14:04:33 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-c212f127-89f1-4af6-8f5e-c5bd33ac1289 tempest-CreateVolumesFromSnapshotTest-513203005 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 14:04:33 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-c212f127-89f1-4af6-8f5e-c5bd33ac1289 tempest-CreateVolumesFromSnapshotTest-513203005 None] Creating offline snapshot 4ea251ec-063d-4bae-af47-6512ab034a3d of volume 6f13635f-d209-4fab-8641-5121af84c9bd {{(pid=87098) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 13 14:04:33 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[26e0fa02-f882-46c9-bd22-207454302ef5]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 14:04:33 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-c212f127-89f1-4af6-8f5e-c5bd33ac1289 tempest-CreateVolumesFromSnapshotTest-513203005 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-6f13635f-d209-4fab-8641-5121af84c9bd {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:04:33 devstack sudo[104130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-6f13635f-d209-4fab-8641-5121af84c9bd Jul 13 14:04:33 devstack sudo[104130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:04:33 devstack sudo[104130]: pam_unix(sudo:session): session closed for user root Jul 13 14:04:33 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-c212f127-89f1-4af6-8f5e-c5bd33ac1289 tempest-CreateVolumesFromSnapshotTest-513203005 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-6f13635f-d209-4fab-8641-5121af84c9bd" returned: 0 in 0.361s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:04:33 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-c212f127-89f1-4af6-8f5e-c5bd33ac1289 tempest-CreateVolumesFromSnapshotTest-513203005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-6f13635f-d209-4fab-8641-5121af84c9bd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-6f13635f-d209-4fab-8641-5121af84c9bd.4ea251ec-063d-4bae-af47-6512ab034a3d 1G {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:04:33 devstack sudo[104135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-6f13635f-d209-4fab-8641-5121af84c9bd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-6f13635f-d209-4fab-8641-5121af84c9bd.4ea251ec-063d-4bae-af47-6512ab034a3d 1G Jul 13 14:04:33 devstack sudo[104135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:04:34 devstack sudo[104135]: pam_unix(sudo:session): session closed for user root Jul 13 14:04:34 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-c212f127-89f1-4af6-8f5e-c5bd33ac1289 tempest-CreateVolumesFromSnapshotTest-513203005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-6f13635f-d209-4fab-8641-5121af84c9bd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-6f13635f-d209-4fab-8641-5121af84c9bd.4ea251ec-063d-4bae-af47-6512ab034a3d 1G" returned: 0 in 0.395s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:04:34 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-c212f127-89f1-4af6-8f5e-c5bd33ac1289 tempest-CreateVolumesFromSnapshotTest-513203005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6f13635f-d209-4fab-8641-5121af84c9bd -F qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-6f13635f-d209-4fab-8641-5121af84c9bd.4ea251ec-063d-4bae-af47-6512ab034a3d {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:04:34 devstack sudo[104141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6f13635f-d209-4fab-8641-5121af84c9bd -F qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-6f13635f-d209-4fab-8641-5121af84c9bd.4ea251ec-063d-4bae-af47-6512ab034a3d Jul 13 14:04:34 devstack sudo[104141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:04:34 devstack sudo[104141]: pam_unix(sudo:session): session closed for user root Jul 13 14:04:34 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-c212f127-89f1-4af6-8f5e-c5bd33ac1289 tempest-CreateVolumesFromSnapshotTest-513203005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6f13635f-d209-4fab-8641-5121af84c9bd -F qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-6f13635f-d209-4fab-8641-5121af84c9bd.4ea251ec-063d-4bae-af47-6512ab034a3d" returned: 0 in 0.297s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:04:34 devstack cinder-volume[87098]: WARNING cinder.volume.drivers.remotefs [None req-c212f127-89f1-4af6-8f5e-c5bd33ac1289 tempest-CreateVolumesFromSnapshotTest-513203005 None] /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-6f13635f-d209-4fab-8641-5121af84c9bd.4ea251ec-063d-4bae-af47-6512ab034a3d is being set with open permissions: ugo+rw Jul 13 14:04:34 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-c212f127-89f1-4af6-8f5e-c5bd33ac1289 tempest-CreateVolumesFromSnapshotTest-513203005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-6f13635f-d209-4fab-8641-5121af84c9bd.4ea251ec-063d-4bae-af47-6512ab034a3d {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:04:34 devstack sudo[104146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-6f13635f-d209-4fab-8641-5121af84c9bd.4ea251ec-063d-4bae-af47-6512ab034a3d Jul 13 14:04:34 devstack sudo[104146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:04:34 devstack sudo[104146]: pam_unix(sudo:session): session closed for user root Jul 13 14:04:34 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-c212f127-89f1-4af6-8f5e-c5bd33ac1289 tempest-CreateVolumesFromSnapshotTest-513203005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-6f13635f-d209-4fab-8641-5121af84c9bd.4ea251ec-063d-4bae-af47-6512ab034a3d" returned: 0 in 0.244s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:04:34 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-c212f127-89f1-4af6-8f5e-c5bd33ac1289 tempest-CreateVolumesFromSnapshotTest-513203005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-6f13635f-d209-4fab-8641-5121af84c9bd.info {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:04:34 devstack sudo[104149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-6f13635f-d209-4fab-8641-5121af84c9bd.info Jul 13 14:04:34 devstack sudo[104149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:04:35 devstack sudo[104149]: pam_unix(sudo:session): session closed for user root Jul 13 14:04:35 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-c212f127-89f1-4af6-8f5e-c5bd33ac1289 tempest-CreateVolumesFromSnapshotTest-513203005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-6f13635f-d209-4fab-8641-5121af84c9bd.info" returned: 0 in 0.272s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:04:35 devstack cinder-volume[87098]: WARNING cinder.volume.drivers.remotefs [None req-c212f127-89f1-4af6-8f5e-c5bd33ac1289 tempest-CreateVolumesFromSnapshotTest-513203005 None] /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-6f13635f-d209-4fab-8641-5121af84c9bd.info is being set with open permissions: ugo+rw Jul 13 14:04:35 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-c212f127-89f1-4af6-8f5e-c5bd33ac1289 tempest-CreateVolumesFromSnapshotTest-513203005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-6f13635f-d209-4fab-8641-5121af84c9bd.info {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:04:35 devstack sudo[104152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-6f13635f-d209-4fab-8641-5121af84c9bd.info Jul 13 14:04:35 devstack sudo[104152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:04:35 devstack sudo[104152]: pam_unix(sudo:session): session closed for user root Jul 13 14:04:35 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-c212f127-89f1-4af6-8f5e-c5bd33ac1289 tempest-CreateVolumesFromSnapshotTest-513203005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-6f13635f-d209-4fab-8641-5121af84c9bd.info" returned: 0 in 0.247s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:04:35 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-c212f127-89f1-4af6-8f5e-c5bd33ac1289 tempest-CreateVolumesFromSnapshotTest-513203005 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.898s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 14:04:35 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-c212f127-89f1-4af6-8f5e-c5bd33ac1289 tempest-CreateVolumesFromSnapshotTest-513203005 None] Create snapshot completed successfully Jul 13 14:04:36 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-5670368f-375c-4ee2-a0f1-316dc0d368e2 tempest-CreateVolumesFromSnapshotTest-513203005 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 14:04:36 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-5670368f-375c-4ee2-a0f1-316dc0d368e2 tempest-CreateVolumesFromSnapshotTest-513203005 None] Flow 'volume_create_manager' (9d79250e-17f7-4df1-a41a-100f7250de8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 14:04:36 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-5670368f-375c-4ee2-a0f1-316dc0d368e2 tempest-CreateVolumesFromSnapshotTest-513203005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6757db8-b1bd-473c-aec9-8c7fa8c0b837) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:04:36 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-5670368f-375c-4ee2-a0f1-316dc0d368e2 tempest-CreateVolumesFromSnapshotTest-513203005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6757db8-b1bd-473c-aec9-8c7fa8c0b837) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T12:04:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2031963032',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18527bba-cc65-4dad-97bb-c83c12819648,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c4fdb162c26475b94e9a8f76ed56478',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T12:04:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T12:04:36Z,use_quota=True,user_id='678beaf52717445dab07e761bb377e3e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1147de8b-623b-426c-a13d-7fc824a80f67),volume_type_id=1147de8b-623b-426c-a13d-7fc824a80f67)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:04:36 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-5670368f-375c-4ee2-a0f1-316dc0d368e2 tempest-CreateVolumesFromSnapshotTest-513203005 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98da3a2c-700a-401f-b7ac-b51c11b10434) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:04:36 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-5670368f-375c-4ee2-a0f1-316dc0d368e2 tempest-CreateVolumesFromSnapshotTest-513203005 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98da3a2c-700a-401f-b7ac-b51c11b10434) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:04:36 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-5670368f-375c-4ee2-a0f1-316dc0d368e2 tempest-CreateVolumesFromSnapshotTest-513203005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89cfbd2e-1e41-49a5-928a-ab4c2e409494) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:04:36 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-5670368f-375c-4ee2-a0f1-316dc0d368e2 tempest-CreateVolumesFromSnapshotTest-513203005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89cfbd2e-1e41-49a5-928a-ab4c2e409494) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '18527bba-cc65-4dad-97bb-c83c12819648', 'volume_name': 'volume-18527bba-cc65-4dad-97bb-c83c12819648', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:04:36 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-5670368f-375c-4ee2-a0f1-316dc0d368e2 tempest-CreateVolumesFromSnapshotTest-513203005 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be77fcd6-a186-44fe-b053-33ef37e39502) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:04:36 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-5670368f-375c-4ee2-a0f1-316dc0d368e2 tempest-CreateVolumesFromSnapshotTest-513203005 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be77fcd6-a186-44fe-b053-33ef37e39502) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:04:36 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-5670368f-375c-4ee2-a0f1-316dc0d368e2 tempest-CreateVolumesFromSnapshotTest-513203005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a441b644-69c4-4031-976a-b6af6226d923) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:04:36 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-5670368f-375c-4ee2-a0f1-316dc0d368e2 tempest-CreateVolumesFromSnapshotTest-513203005 None] Volume 18527bba-cc65-4dad-97bb-c83c12819648: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-18527bba-cc65-4dad-97bb-c83c12819648', 'volume_size': 1} Jul 13 14:04:36 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-5670368f-375c-4ee2-a0f1-316dc0d368e2 tempest-CreateVolumesFromSnapshotTest-513203005 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 14:04:36 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-5670368f-375c-4ee2-a0f1-316dc0d368e2 tempest-CreateVolumesFromSnapshotTest-513203005 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 14:04:36 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-5670368f-375c-4ee2-a0f1-316dc0d368e2 tempest-CreateVolumesFromSnapshotTest-513203005 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T12:04:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2031963032',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18527bba-cc65-4dad-97bb-c83c12819648,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c4fdb162c26475b94e9a8f76ed56478',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T12:04:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T12:04:36Z,use_quota=True,user_id='678beaf52717445dab07e761bb377e3e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1147de8b-623b-426c-a13d-7fc824a80f67),volume_type_id=1147de8b-623b-426c-a13d-7fc824a80f67)}" {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 13 14:04:36 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-5670368f-375c-4ee2-a0f1-316dc0d368e2 tempest-CreateVolumesFromSnapshotTest-513203005 None] Creating volume 18527bba-cc65-4dad-97bb-c83c12819648 {{(pid=87098) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 13 14:04:36 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-5670368f-375c-4ee2-a0f1-316dc0d368e2 tempest-CreateVolumesFromSnapshotTest-513203005 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 14:04:36 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-5670368f-375c-4ee2-a0f1-316dc0d368e2 tempest-CreateVolumesFromSnapshotTest-513203005 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 14:04:36 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-5670368f-375c-4ee2-a0f1-316dc0d368e2 tempest-CreateVolumesFromSnapshotTest-513203005 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 14:04:36 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-5670368f-375c-4ee2-a0f1-316dc0d368e2 tempest-CreateVolumesFromSnapshotTest-513203005 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 14:04:36 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-5670368f-375c-4ee2-a0f1-316dc0d368e2 tempest-CreateVolumesFromSnapshotTest-513203005 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 14:04:36 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-5670368f-375c-4ee2-a0f1-316dc0d368e2 tempest-CreateVolumesFromSnapshotTest-513203005 None] Selected osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 14:04:36 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-5670368f-375c-4ee2-a0f1-316dc0d368e2 tempest-CreateVolumesFromSnapshotTest-513203005 None] casted to osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 Jul 13 14:04:36 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-5670368f-375c-4ee2-a0f1-316dc0d368e2 tempest-CreateVolumesFromSnapshotTest-513203005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-18527bba-cc65-4dad-97bb-c83c12819648 1073741824 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:04:36 devstack sudo[104155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-18527bba-cc65-4dad-97bb-c83c12819648 1073741824 Jul 13 14:04:36 devstack sudo[104155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:04:36 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-e877b38d-f4a5-4aaf-9080-9bd8cc0adf67 tempest-CreateVolumesFromSnapshotTest-513203005 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 14:04:36 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-e877b38d-f4a5-4aaf-9080-9bd8cc0adf67 tempest-CreateVolumesFromSnapshotTest-513203005 None] Flow 'volume_create_manager' (89170dd0-0466-44cd-8430-8049169ae4c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 14:04:36 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-e877b38d-f4a5-4aaf-9080-9bd8cc0adf67 tempest-CreateVolumesFromSnapshotTest-513203005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ec69a00-ffed-4e7c-969b-a850686c6c61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:04:36 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-e877b38d-f4a5-4aaf-9080-9bd8cc0adf67 tempest-CreateVolumesFromSnapshotTest-513203005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ec69a00-ffed-4e7c-969b-a850686c6c61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T12:04:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-178107392',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9dd9dbeb-fbcb-47b3-b7cd-81a318924f96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c4fdb162c26475b94e9a8f76ed56478',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T12:04:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T12:04:36Z,use_quota=True,user_id='678beaf52717445dab07e761bb377e3e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1147de8b-623b-426c-a13d-7fc824a80f67),volume_type_id=1147de8b-623b-426c-a13d-7fc824a80f67)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:04:36 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-e877b38d-f4a5-4aaf-9080-9bd8cc0adf67 tempest-CreateVolumesFromSnapshotTest-513203005 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48b7c6ab-a008-4343-b9d0-f8dc2bdb3205) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:04:36 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-e877b38d-f4a5-4aaf-9080-9bd8cc0adf67 tempest-CreateVolumesFromSnapshotTest-513203005 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48b7c6ab-a008-4343-b9d0-f8dc2bdb3205) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:04:36 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-e877b38d-f4a5-4aaf-9080-9bd8cc0adf67 tempest-CreateVolumesFromSnapshotTest-513203005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c804854b-5f8f-4f05-ad86-b79fa9bf9ad3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:04:36 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-e877b38d-f4a5-4aaf-9080-9bd8cc0adf67 tempest-CreateVolumesFromSnapshotTest-513203005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c804854b-5f8f-4f05-ad86-b79fa9bf9ad3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9dd9dbeb-fbcb-47b3-b7cd-81a318924f96', 'volume_name': 'volume-9dd9dbeb-fbcb-47b3-b7cd-81a318924f96', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:04:36 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-e877b38d-f4a5-4aaf-9080-9bd8cc0adf67 tempest-CreateVolumesFromSnapshotTest-513203005 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c78d048-0df3-49b0-85c0-19dc90a431e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:04:36 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-e877b38d-f4a5-4aaf-9080-9bd8cc0adf67 tempest-CreateVolumesFromSnapshotTest-513203005 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c78d048-0df3-49b0-85c0-19dc90a431e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:04:36 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-e877b38d-f4a5-4aaf-9080-9bd8cc0adf67 tempest-CreateVolumesFromSnapshotTest-513203005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1f9976f-bc5d-49b6-b4f4-8f78543c1265) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:04:36 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-e877b38d-f4a5-4aaf-9080-9bd8cc0adf67 tempest-CreateVolumesFromSnapshotTest-513203005 None] Volume 9dd9dbeb-fbcb-47b3-b7cd-81a318924f96: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9dd9dbeb-fbcb-47b3-b7cd-81a318924f96', 'volume_size': 1} Jul 13 14:04:36 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-e877b38d-f4a5-4aaf-9080-9bd8cc0adf67 tempest-CreateVolumesFromSnapshotTest-513203005 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 14:04:36 devstack sudo[104155]: pam_unix(sudo:session): session closed for user root Jul 13 14:04:36 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-5670368f-375c-4ee2-a0f1-316dc0d368e2 tempest-CreateVolumesFromSnapshotTest-513203005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-18527bba-cc65-4dad-97bb-c83c12819648 1073741824" returned: 0 in 0.507s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:04:36 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-5670368f-375c-4ee2-a0f1-316dc0d368e2 tempest-CreateVolumesFromSnapshotTest-513203005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-18527bba-cc65-4dad-97bb-c83c12819648 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:04:36 devstack sudo[104161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-18527bba-cc65-4dad-97bb-c83c12819648 Jul 13 14:04:36 devstack sudo[104161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:04:36 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-24415d5b-d170-4030-bc65-99e80ee09b13 tempest-CreateVolumesFromSnapshotTest-513203005 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 14:04:36 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-24415d5b-d170-4030-bc65-99e80ee09b13 tempest-CreateVolumesFromSnapshotTest-513203005 None] Flow 'volume_create_manager' (9793a74f-aa39-47f5-a6d9-8613b0d0b81e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 14:04:36 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-24415d5b-d170-4030-bc65-99e80ee09b13 tempest-CreateVolumesFromSnapshotTest-513203005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b89cfeab-cd5d-45b8-9bf6-c5c2fc2ffdc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:04:36 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-24415d5b-d170-4030-bc65-99e80ee09b13 tempest-CreateVolumesFromSnapshotTest-513203005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b89cfeab-cd5d-45b8-9bf6-c5c2fc2ffdc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T12:04:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-397928145',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3099d1f-a017-4ce4-9b9e-9ccbd8e9c08a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c4fdb162c26475b94e9a8f76ed56478',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T12:04:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T12:04:37Z,use_quota=True,user_id='678beaf52717445dab07e761bb377e3e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1147de8b-623b-426c-a13d-7fc824a80f67),volume_type_id=1147de8b-623b-426c-a13d-7fc824a80f67)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:04:36 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-24415d5b-d170-4030-bc65-99e80ee09b13 tempest-CreateVolumesFromSnapshotTest-513203005 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c1bcb90-4685-4cef-9c02-2e36c6c63aa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:04:36 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-24415d5b-d170-4030-bc65-99e80ee09b13 tempest-CreateVolumesFromSnapshotTest-513203005 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c1bcb90-4685-4cef-9c02-2e36c6c63aa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:04:36 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-24415d5b-d170-4030-bc65-99e80ee09b13 tempest-CreateVolumesFromSnapshotTest-513203005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8302f481-4629-4371-b1c3-7d31696039ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:04:36 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-24415d5b-d170-4030-bc65-99e80ee09b13 tempest-CreateVolumesFromSnapshotTest-513203005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8302f481-4629-4371-b1c3-7d31696039ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a3099d1f-a017-4ce4-9b9e-9ccbd8e9c08a', 'volume_name': 'volume-a3099d1f-a017-4ce4-9b9e-9ccbd8e9c08a', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:04:36 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-24415d5b-d170-4030-bc65-99e80ee09b13 tempest-CreateVolumesFromSnapshotTest-513203005 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9de93276-1fb5-482a-a814-e6b2cebba9e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:04:36 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-24415d5b-d170-4030-bc65-99e80ee09b13 tempest-CreateVolumesFromSnapshotTest-513203005 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9de93276-1fb5-482a-a814-e6b2cebba9e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:04:36 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-24415d5b-d170-4030-bc65-99e80ee09b13 tempest-CreateVolumesFromSnapshotTest-513203005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d4ee860-0395-4f6d-a767-9c706361657a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:04:36 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-24415d5b-d170-4030-bc65-99e80ee09b13 tempest-CreateVolumesFromSnapshotTest-513203005 None] Volume a3099d1f-a017-4ce4-9b9e-9ccbd8e9c08a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a3099d1f-a017-4ce4-9b9e-9ccbd8e9c08a', 'volume_size': 1} Jul 13 14:04:36 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-24415d5b-d170-4030-bc65-99e80ee09b13 tempest-CreateVolumesFromSnapshotTest-513203005 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 14:04:36 devstack sudo[104161]: pam_unix(sudo:session): session closed for user root Jul 13 14:04:36 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-5670368f-375c-4ee2-a0f1-316dc0d368e2 tempest-CreateVolumesFromSnapshotTest-513203005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-18527bba-cc65-4dad-97bb-c83c12819648" returned: 0 in 0.265s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:04:36 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-5670368f-375c-4ee2-a0f1-316dc0d368e2 tempest-CreateVolumesFromSnapshotTest-513203005 None] <== create_volume: return (812ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'} {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 13 14:04:36 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-5670368f-375c-4ee2-a0f1-316dc0d368e2 tempest-CreateVolumesFromSnapshotTest-513203005 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.814s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 14:04:36 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-e877b38d-f4a5-4aaf-9080-9bd8cc0adf67 tempest-CreateVolumesFromSnapshotTest-513203005 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.447s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 14:04:36 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-e877b38d-f4a5-4aaf-9080-9bd8cc0adf67 tempest-CreateVolumesFromSnapshotTest-513203005 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T12:04:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-178107392',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9dd9dbeb-fbcb-47b3-b7cd-81a318924f96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c4fdb162c26475b94e9a8f76ed56478',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T12:04:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T12:04:36Z,use_quota=True,user_id='678beaf52717445dab07e761bb377e3e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1147de8b-623b-426c-a13d-7fc824a80f67),volume_type_id=1147de8b-623b-426c-a13d-7fc824a80f67)}" {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 13 14:04:36 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-e877b38d-f4a5-4aaf-9080-9bd8cc0adf67 tempest-CreateVolumesFromSnapshotTest-513203005 None] Creating volume 9dd9dbeb-fbcb-47b3-b7cd-81a318924f96 {{(pid=87098) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 13 14:04:36 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-e877b38d-f4a5-4aaf-9080-9bd8cc0adf67 tempest-CreateVolumesFromSnapshotTest-513203005 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 14:04:36 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-e877b38d-f4a5-4aaf-9080-9bd8cc0adf67 tempest-CreateVolumesFromSnapshotTest-513203005 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 14:04:36 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-e877b38d-f4a5-4aaf-9080-9bd8cc0adf67 tempest-CreateVolumesFromSnapshotTest-513203005 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 14:04:36 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-e877b38d-f4a5-4aaf-9080-9bd8cc0adf67 tempest-CreateVolumesFromSnapshotTest-513203005 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 14:04:36 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-e877b38d-f4a5-4aaf-9080-9bd8cc0adf67 tempest-CreateVolumesFromSnapshotTest-513203005 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 14:04:36 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-e877b38d-f4a5-4aaf-9080-9bd8cc0adf67 tempest-CreateVolumesFromSnapshotTest-513203005 None] Selected osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 14:04:36 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-e877b38d-f4a5-4aaf-9080-9bd8cc0adf67 tempest-CreateVolumesFromSnapshotTest-513203005 None] casted to osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 Jul 13 14:04:36 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-e877b38d-f4a5-4aaf-9080-9bd8cc0adf67 tempest-CreateVolumesFromSnapshotTest-513203005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-9dd9dbeb-fbcb-47b3-b7cd-81a318924f96 1073741824 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:04:37 devstack sudo[104164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-9dd9dbeb-fbcb-47b3-b7cd-81a318924f96 1073741824 Jul 13 14:04:37 devstack sudo[104164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:04:37 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-5670368f-375c-4ee2-a0f1-316dc0d368e2 tempest-CreateVolumesFromSnapshotTest-513203005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a441b644-69c4-4031-976a-b6af6226d923) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-18527bba-cc65-4dad-97bb-c83c12819648', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:04:37 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-5670368f-375c-4ee2-a0f1-316dc0d368e2 tempest-CreateVolumesFromSnapshotTest-513203005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58904204-9742-4b10-b59a-483ef9463e4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:04:37 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-5670368f-375c-4ee2-a0f1-316dc0d368e2 tempest-CreateVolumesFromSnapshotTest-513203005 None] Volume volume-18527bba-cc65-4dad-97bb-c83c12819648 (18527bba-cc65-4dad-97bb-c83c12819648): created successfully Jul 13 14:04:37 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-5670368f-375c-4ee2-a0f1-316dc0d368e2 tempest-CreateVolumesFromSnapshotTest-513203005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58904204-9742-4b10-b59a-483ef9463e4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:04:37 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-5670368f-375c-4ee2-a0f1-316dc0d368e2 tempest-CreateVolumesFromSnapshotTest-513203005 None] Flow 'volume_create_manager' (9d79250e-17f7-4df1-a41a-100f7250de8e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 14:04:37 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-5670368f-375c-4ee2-a0f1-316dc0d368e2 tempest-CreateVolumesFromSnapshotTest-513203005 None] Created volume successfully. Jul 13 14:04:37 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-6b6b18da-cb1c-4ed6-9ac7-513df266cb1e tempest-CreateVolumesFromSnapshotTest-513203005 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 14:04:37 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-6b6b18da-cb1c-4ed6-9ac7-513df266cb1e tempest-CreateVolumesFromSnapshotTest-513203005 None] Flow 'volume_create_manager' (2f1b1a7f-ca4b-409f-81ec-4a474158e4a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 14:04:37 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-6b6b18da-cb1c-4ed6-9ac7-513df266cb1e tempest-CreateVolumesFromSnapshotTest-513203005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (916b2140-ba78-45a1-8402-2e8fcb078788) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:04:37 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-6b6b18da-cb1c-4ed6-9ac7-513df266cb1e tempest-CreateVolumesFromSnapshotTest-513203005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (916b2140-ba78-45a1-8402-2e8fcb078788) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T12:04:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-738226703',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e3b7d36-e0c3-49e9-8e5c-8346513886fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c4fdb162c26475b94e9a8f76ed56478',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T12:04:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T12:04:37Z,use_quota=True,user_id='678beaf52717445dab07e761bb377e3e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1147de8b-623b-426c-a13d-7fc824a80f67),volume_type_id=1147de8b-623b-426c-a13d-7fc824a80f67)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:04:37 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-6b6b18da-cb1c-4ed6-9ac7-513df266cb1e tempest-CreateVolumesFromSnapshotTest-513203005 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70d6bb27-cbc5-4ed0-9571-5d3a25f43230) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:04:37 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-6b6b18da-cb1c-4ed6-9ac7-513df266cb1e tempest-CreateVolumesFromSnapshotTest-513203005 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70d6bb27-cbc5-4ed0-9571-5d3a25f43230) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:04:37 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-6b6b18da-cb1c-4ed6-9ac7-513df266cb1e tempest-CreateVolumesFromSnapshotTest-513203005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8da02fd-f0ab-45ca-bd74-24febbcce239) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:04:37 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-6b6b18da-cb1c-4ed6-9ac7-513df266cb1e tempest-CreateVolumesFromSnapshotTest-513203005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8da02fd-f0ab-45ca-bd74-24febbcce239) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6e3b7d36-e0c3-49e9-8e5c-8346513886fc', 'volume_name': 'volume-6e3b7d36-e0c3-49e9-8e5c-8346513886fc', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:04:37 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-6b6b18da-cb1c-4ed6-9ac7-513df266cb1e tempest-CreateVolumesFromSnapshotTest-513203005 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86045599-b413-485c-8394-e6278cc381eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:04:37 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-6b6b18da-cb1c-4ed6-9ac7-513df266cb1e tempest-CreateVolumesFromSnapshotTest-513203005 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86045599-b413-485c-8394-e6278cc381eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:04:37 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-6b6b18da-cb1c-4ed6-9ac7-513df266cb1e tempest-CreateVolumesFromSnapshotTest-513203005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8420e347-acc7-48f0-873e-2c817b98bf2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:04:37 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-6b6b18da-cb1c-4ed6-9ac7-513df266cb1e tempest-CreateVolumesFromSnapshotTest-513203005 None] Volume 6e3b7d36-e0c3-49e9-8e5c-8346513886fc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6e3b7d36-e0c3-49e9-8e5c-8346513886fc', 'volume_size': 1} Jul 13 14:04:37 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-6b6b18da-cb1c-4ed6-9ac7-513df266cb1e tempest-CreateVolumesFromSnapshotTest-513203005 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 14:04:37 devstack sudo[104164]: pam_unix(sudo:session): session closed for user root Jul 13 14:04:37 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-e877b38d-f4a5-4aaf-9080-9bd8cc0adf67 tempest-CreateVolumesFromSnapshotTest-513203005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-9dd9dbeb-fbcb-47b3-b7cd-81a318924f96 1073741824" returned: 0 in 0.499s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:04:37 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-e877b38d-f4a5-4aaf-9080-9bd8cc0adf67 tempest-CreateVolumesFromSnapshotTest-513203005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-9dd9dbeb-fbcb-47b3-b7cd-81a318924f96 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:04:37 devstack sudo[104171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-9dd9dbeb-fbcb-47b3-b7cd-81a318924f96 Jul 13 14:04:37 devstack sudo[104171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:04:37 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-772b9f1e-1049-4903-a014-af6b367100db tempest-CreateVolumesFromSnapshotTest-513203005 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 14:04:37 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-772b9f1e-1049-4903-a014-af6b367100db tempest-CreateVolumesFromSnapshotTest-513203005 None] Flow 'volume_create_manager' (c0b7dd42-ae83-4bb6-b770-b1a73b1c4ec3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 14:04:37 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-772b9f1e-1049-4903-a014-af6b367100db tempest-CreateVolumesFromSnapshotTest-513203005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8af56019-df27-4fd1-b537-53aca6de3dab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:04:37 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-772b9f1e-1049-4903-a014-af6b367100db tempest-CreateVolumesFromSnapshotTest-513203005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8af56019-df27-4fd1-b537-53aca6de3dab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T12:04:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-747411639',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab703f6f-88b7-4848-98d8-f25ddeb7b7f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c4fdb162c26475b94e9a8f76ed56478',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T12:04:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T12:04:38Z,use_quota=True,user_id='678beaf52717445dab07e761bb377e3e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1147de8b-623b-426c-a13d-7fc824a80f67),volume_type_id=1147de8b-623b-426c-a13d-7fc824a80f67)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:04:37 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-772b9f1e-1049-4903-a014-af6b367100db tempest-CreateVolumesFromSnapshotTest-513203005 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d23ff792-0342-40d7-9b38-af33b227424f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:04:37 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-772b9f1e-1049-4903-a014-af6b367100db tempest-CreateVolumesFromSnapshotTest-513203005 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d23ff792-0342-40d7-9b38-af33b227424f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:04:37 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-772b9f1e-1049-4903-a014-af6b367100db tempest-CreateVolumesFromSnapshotTest-513203005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c06ce8bb-66a1-49de-bd99-d1a3fb2169ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:04:37 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-772b9f1e-1049-4903-a014-af6b367100db tempest-CreateVolumesFromSnapshotTest-513203005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c06ce8bb-66a1-49de-bd99-d1a3fb2169ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ab703f6f-88b7-4848-98d8-f25ddeb7b7f2', 'volume_name': 'volume-ab703f6f-88b7-4848-98d8-f25ddeb7b7f2', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:04:37 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-772b9f1e-1049-4903-a014-af6b367100db tempest-CreateVolumesFromSnapshotTest-513203005 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75596df0-6510-4966-8703-127e05ec4a14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:04:37 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-772b9f1e-1049-4903-a014-af6b367100db tempest-CreateVolumesFromSnapshotTest-513203005 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75596df0-6510-4966-8703-127e05ec4a14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:04:37 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-772b9f1e-1049-4903-a014-af6b367100db tempest-CreateVolumesFromSnapshotTest-513203005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01b454bf-c78e-4767-a896-3709ebdd1010) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:04:37 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-772b9f1e-1049-4903-a014-af6b367100db tempest-CreateVolumesFromSnapshotTest-513203005 None] Volume ab703f6f-88b7-4848-98d8-f25ddeb7b7f2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ab703f6f-88b7-4848-98d8-f25ddeb7b7f2', 'volume_size': 1} Jul 13 14:04:37 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-772b9f1e-1049-4903-a014-af6b367100db tempest-CreateVolumesFromSnapshotTest-513203005 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 14:04:37 devstack sudo[104171]: pam_unix(sudo:session): session closed for user root Jul 13 14:04:37 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-e877b38d-f4a5-4aaf-9080-9bd8cc0adf67 tempest-CreateVolumesFromSnapshotTest-513203005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-9dd9dbeb-fbcb-47b3-b7cd-81a318924f96" returned: 0 in 0.259s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:04:37 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-e877b38d-f4a5-4aaf-9080-9bd8cc0adf67 tempest-CreateVolumesFromSnapshotTest-513203005 None] <== create_volume: return (799ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'} {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 13 14:04:37 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-e877b38d-f4a5-4aaf-9080-9bd8cc0adf67 tempest-CreateVolumesFromSnapshotTest-513203005 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.802s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 14:04:37 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-24415d5b-d170-4030-bc65-99e80ee09b13 tempest-CreateVolumesFromSnapshotTest-513203005 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.857s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 14:04:37 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-24415d5b-d170-4030-bc65-99e80ee09b13 tempest-CreateVolumesFromSnapshotTest-513203005 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T12:04:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-397928145',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3099d1f-a017-4ce4-9b9e-9ccbd8e9c08a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c4fdb162c26475b94e9a8f76ed56478',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T12:04:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T12:04:37Z,use_quota=True,user_id='678beaf52717445dab07e761bb377e3e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1147de8b-623b-426c-a13d-7fc824a80f67),volume_type_id=1147de8b-623b-426c-a13d-7fc824a80f67)}" {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 13 14:04:37 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-24415d5b-d170-4030-bc65-99e80ee09b13 tempest-CreateVolumesFromSnapshotTest-513203005 None] Creating volume a3099d1f-a017-4ce4-9b9e-9ccbd8e9c08a {{(pid=87098) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 13 14:04:37 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-24415d5b-d170-4030-bc65-99e80ee09b13 tempest-CreateVolumesFromSnapshotTest-513203005 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 14:04:37 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-24415d5b-d170-4030-bc65-99e80ee09b13 tempest-CreateVolumesFromSnapshotTest-513203005 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 14:04:37 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-24415d5b-d170-4030-bc65-99e80ee09b13 tempest-CreateVolumesFromSnapshotTest-513203005 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 14:04:37 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-24415d5b-d170-4030-bc65-99e80ee09b13 tempest-CreateVolumesFromSnapshotTest-513203005 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 14:04:37 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-24415d5b-d170-4030-bc65-99e80ee09b13 tempest-CreateVolumesFromSnapshotTest-513203005 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 14:04:37 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-24415d5b-d170-4030-bc65-99e80ee09b13 tempest-CreateVolumesFromSnapshotTest-513203005 None] Selected osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 14:04:37 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-24415d5b-d170-4030-bc65-99e80ee09b13 tempest-CreateVolumesFromSnapshotTest-513203005 None] casted to osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 Jul 13 14:04:37 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-24415d5b-d170-4030-bc65-99e80ee09b13 tempest-CreateVolumesFromSnapshotTest-513203005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-a3099d1f-a017-4ce4-9b9e-9ccbd8e9c08a 1073741824 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:04:37 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-e877b38d-f4a5-4aaf-9080-9bd8cc0adf67 tempest-CreateVolumesFromSnapshotTest-513203005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1f9976f-bc5d-49b6-b4f4-8f78543c1265) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9dd9dbeb-fbcb-47b3-b7cd-81a318924f96', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:04:37 devstack sudo[104174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-a3099d1f-a017-4ce4-9b9e-9ccbd8e9c08a 1073741824 Jul 13 14:04:37 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-e877b38d-f4a5-4aaf-9080-9bd8cc0adf67 tempest-CreateVolumesFromSnapshotTest-513203005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae00b257-d4dd-4d67-8d85-ae1b6f4c2b3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:04:37 devstack sudo[104174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:04:37 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-e877b38d-f4a5-4aaf-9080-9bd8cc0adf67 tempest-CreateVolumesFromSnapshotTest-513203005 None] Volume volume-9dd9dbeb-fbcb-47b3-b7cd-81a318924f96 (9dd9dbeb-fbcb-47b3-b7cd-81a318924f96): created successfully Jul 13 14:04:37 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-e877b38d-f4a5-4aaf-9080-9bd8cc0adf67 tempest-CreateVolumesFromSnapshotTest-513203005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae00b257-d4dd-4d67-8d85-ae1b6f4c2b3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:04:37 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-e877b38d-f4a5-4aaf-9080-9bd8cc0adf67 tempest-CreateVolumesFromSnapshotTest-513203005 None] Flow 'volume_create_manager' (89170dd0-0466-44cd-8430-8049169ae4c1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 14:04:37 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-e877b38d-f4a5-4aaf-9080-9bd8cc0adf67 tempest-CreateVolumesFromSnapshotTest-513203005 None] Created volume successfully. Jul 13 14:04:38 devstack sudo[104174]: pam_unix(sudo:session): session closed for user root Jul 13 14:04:38 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-24415d5b-d170-4030-bc65-99e80ee09b13 tempest-CreateVolumesFromSnapshotTest-513203005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-a3099d1f-a017-4ce4-9b9e-9ccbd8e9c08a 1073741824" returned: 0 in 0.404s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:04:38 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-24415d5b-d170-4030-bc65-99e80ee09b13 tempest-CreateVolumesFromSnapshotTest-513203005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-a3099d1f-a017-4ce4-9b9e-9ccbd8e9c08a {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:04:38 devstack sudo[104180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-a3099d1f-a017-4ce4-9b9e-9ccbd8e9c08a Jul 13 14:04:38 devstack sudo[104180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:04:38 devstack sudo[104180]: pam_unix(sudo:session): session closed for user root Jul 13 14:04:38 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-24415d5b-d170-4030-bc65-99e80ee09b13 tempest-CreateVolumesFromSnapshotTest-513203005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-a3099d1f-a017-4ce4-9b9e-9ccbd8e9c08a" returned: 0 in 0.239s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:04:38 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-24415d5b-d170-4030-bc65-99e80ee09b13 tempest-CreateVolumesFromSnapshotTest-513203005 None] <== create_volume: return (678ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'} {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 13 14:04:38 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-24415d5b-d170-4030-bc65-99e80ee09b13 tempest-CreateVolumesFromSnapshotTest-513203005 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.681s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 14:04:38 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-6b6b18da-cb1c-4ed6-9ac7-513df266cb1e tempest-CreateVolumesFromSnapshotTest-513203005 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.135s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 14:04:38 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-6b6b18da-cb1c-4ed6-9ac7-513df266cb1e tempest-CreateVolumesFromSnapshotTest-513203005 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T12:04:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-738226703',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e3b7d36-e0c3-49e9-8e5c-8346513886fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c4fdb162c26475b94e9a8f76ed56478',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T12:04:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T12:04:37Z,use_quota=True,user_id='678beaf52717445dab07e761bb377e3e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1147de8b-623b-426c-a13d-7fc824a80f67),volume_type_id=1147de8b-623b-426c-a13d-7fc824a80f67)}" {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 13 14:04:38 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-6b6b18da-cb1c-4ed6-9ac7-513df266cb1e tempest-CreateVolumesFromSnapshotTest-513203005 None] Creating volume 6e3b7d36-e0c3-49e9-8e5c-8346513886fc {{(pid=87098) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 13 14:04:38 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-6b6b18da-cb1c-4ed6-9ac7-513df266cb1e tempest-CreateVolumesFromSnapshotTest-513203005 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 14:04:38 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-6b6b18da-cb1c-4ed6-9ac7-513df266cb1e tempest-CreateVolumesFromSnapshotTest-513203005 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 14:04:38 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-6b6b18da-cb1c-4ed6-9ac7-513df266cb1e tempest-CreateVolumesFromSnapshotTest-513203005 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 14:04:38 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-6b6b18da-cb1c-4ed6-9ac7-513df266cb1e tempest-CreateVolumesFromSnapshotTest-513203005 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 14:04:38 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-6b6b18da-cb1c-4ed6-9ac7-513df266cb1e tempest-CreateVolumesFromSnapshotTest-513203005 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 14:04:38 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-6b6b18da-cb1c-4ed6-9ac7-513df266cb1e tempest-CreateVolumesFromSnapshotTest-513203005 None] Selected osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 14:04:38 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-6b6b18da-cb1c-4ed6-9ac7-513df266cb1e tempest-CreateVolumesFromSnapshotTest-513203005 None] casted to osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 Jul 13 14:04:38 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-6b6b18da-cb1c-4ed6-9ac7-513df266cb1e tempest-CreateVolumesFromSnapshotTest-513203005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-6e3b7d36-e0c3-49e9-8e5c-8346513886fc 1073741824 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:04:38 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-24415d5b-d170-4030-bc65-99e80ee09b13 tempest-CreateVolumesFromSnapshotTest-513203005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d4ee860-0395-4f6d-a767-9c706361657a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a3099d1f-a017-4ce4-9b9e-9ccbd8e9c08a', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:04:38 devstack sudo[104183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-6e3b7d36-e0c3-49e9-8e5c-8346513886fc 1073741824 Jul 13 14:04:38 devstack sudo[104183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:04:38 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-24415d5b-d170-4030-bc65-99e80ee09b13 tempest-CreateVolumesFromSnapshotTest-513203005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03eba654-8e26-4c08-b607-f6820bfee943) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:04:38 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-24415d5b-d170-4030-bc65-99e80ee09b13 tempest-CreateVolumesFromSnapshotTest-513203005 None] Volume volume-a3099d1f-a017-4ce4-9b9e-9ccbd8e9c08a (a3099d1f-a017-4ce4-9b9e-9ccbd8e9c08a): created successfully Jul 13 14:04:38 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-24415d5b-d170-4030-bc65-99e80ee09b13 tempest-CreateVolumesFromSnapshotTest-513203005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03eba654-8e26-4c08-b607-f6820bfee943) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:04:38 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-24415d5b-d170-4030-bc65-99e80ee09b13 tempest-CreateVolumesFromSnapshotTest-513203005 None] Flow 'volume_create_manager' (9793a74f-aa39-47f5-a6d9-8613b0d0b81e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 14:04:38 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-24415d5b-d170-4030-bc65-99e80ee09b13 tempest-CreateVolumesFromSnapshotTest-513203005 None] Created volume successfully. Jul 13 14:04:38 devstack sudo[104183]: pam_unix(sudo:session): session closed for user root Jul 13 14:04:38 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-6b6b18da-cb1c-4ed6-9ac7-513df266cb1e tempest-CreateVolumesFromSnapshotTest-513203005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-6e3b7d36-e0c3-49e9-8e5c-8346513886fc 1073741824" returned: 0 in 0.399s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:04:38 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-6b6b18da-cb1c-4ed6-9ac7-513df266cb1e tempest-CreateVolumesFromSnapshotTest-513203005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-6e3b7d36-e0c3-49e9-8e5c-8346513886fc {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:04:38 devstack sudo[104189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-6e3b7d36-e0c3-49e9-8e5c-8346513886fc Jul 13 14:04:38 devstack sudo[104189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:04:39 devstack sudo[104189]: pam_unix(sudo:session): session closed for user root Jul 13 14:04:39 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-6b6b18da-cb1c-4ed6-9ac7-513df266cb1e tempest-CreateVolumesFromSnapshotTest-513203005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-6e3b7d36-e0c3-49e9-8e5c-8346513886fc" returned: 0 in 0.242s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:04:39 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-6b6b18da-cb1c-4ed6-9ac7-513df266cb1e tempest-CreateVolumesFromSnapshotTest-513203005 None] <== create_volume: return (679ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'} {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 13 14:04:39 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-6b6b18da-cb1c-4ed6-9ac7-513df266cb1e tempest-CreateVolumesFromSnapshotTest-513203005 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.681s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 14:04:39 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-772b9f1e-1049-4903-a014-af6b367100db tempest-CreateVolumesFromSnapshotTest-513203005 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.444s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 14:04:39 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-772b9f1e-1049-4903-a014-af6b367100db tempest-CreateVolumesFromSnapshotTest-513203005 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T12:04:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-747411639',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab703f6f-88b7-4848-98d8-f25ddeb7b7f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c4fdb162c26475b94e9a8f76ed56478',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T12:04:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T12:04:38Z,use_quota=True,user_id='678beaf52717445dab07e761bb377e3e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1147de8b-623b-426c-a13d-7fc824a80f67),volume_type_id=1147de8b-623b-426c-a13d-7fc824a80f67)}" {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 13 14:04:39 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-772b9f1e-1049-4903-a014-af6b367100db tempest-CreateVolumesFromSnapshotTest-513203005 None] Creating volume ab703f6f-88b7-4848-98d8-f25ddeb7b7f2 {{(pid=87098) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 13 14:04:39 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-772b9f1e-1049-4903-a014-af6b367100db tempest-CreateVolumesFromSnapshotTest-513203005 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 14:04:39 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-772b9f1e-1049-4903-a014-af6b367100db tempest-CreateVolumesFromSnapshotTest-513203005 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 14:04:39 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-772b9f1e-1049-4903-a014-af6b367100db tempest-CreateVolumesFromSnapshotTest-513203005 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 14:04:39 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-772b9f1e-1049-4903-a014-af6b367100db tempest-CreateVolumesFromSnapshotTest-513203005 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 14:04:39 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-772b9f1e-1049-4903-a014-af6b367100db tempest-CreateVolumesFromSnapshotTest-513203005 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 14:04:39 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-772b9f1e-1049-4903-a014-af6b367100db tempest-CreateVolumesFromSnapshotTest-513203005 None] Selected osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 14:04:39 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-772b9f1e-1049-4903-a014-af6b367100db tempest-CreateVolumesFromSnapshotTest-513203005 None] casted to osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 Jul 13 14:04:39 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-772b9f1e-1049-4903-a014-af6b367100db tempest-CreateVolumesFromSnapshotTest-513203005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-ab703f6f-88b7-4848-98d8-f25ddeb7b7f2 1073741824 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:04:39 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-6b6b18da-cb1c-4ed6-9ac7-513df266cb1e tempest-CreateVolumesFromSnapshotTest-513203005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8420e347-acc7-48f0-873e-2c817b98bf2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6e3b7d36-e0c3-49e9-8e5c-8346513886fc', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:04:39 devstack sudo[104192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-ab703f6f-88b7-4848-98d8-f25ddeb7b7f2 1073741824 Jul 13 14:04:39 devstack sudo[104192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:04:39 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-6b6b18da-cb1c-4ed6-9ac7-513df266cb1e tempest-CreateVolumesFromSnapshotTest-513203005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5020898e-1d3b-47fa-92a9-fa7cbc4218b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:04:39 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-6b6b18da-cb1c-4ed6-9ac7-513df266cb1e tempest-CreateVolumesFromSnapshotTest-513203005 None] Volume volume-6e3b7d36-e0c3-49e9-8e5c-8346513886fc (6e3b7d36-e0c3-49e9-8e5c-8346513886fc): created successfully Jul 13 14:04:39 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-6b6b18da-cb1c-4ed6-9ac7-513df266cb1e tempest-CreateVolumesFromSnapshotTest-513203005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5020898e-1d3b-47fa-92a9-fa7cbc4218b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:04:39 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-6b6b18da-cb1c-4ed6-9ac7-513df266cb1e tempest-CreateVolumesFromSnapshotTest-513203005 None] Flow 'volume_create_manager' (2f1b1a7f-ca4b-409f-81ec-4a474158e4a6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 14:04:39 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-6b6b18da-cb1c-4ed6-9ac7-513df266cb1e tempest-CreateVolumesFromSnapshotTest-513203005 None] Created volume successfully. Jul 13 14:04:39 devstack sudo[104192]: pam_unix(sudo:session): session closed for user root Jul 13 14:04:39 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-772b9f1e-1049-4903-a014-af6b367100db tempest-CreateVolumesFromSnapshotTest-513203005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-ab703f6f-88b7-4848-98d8-f25ddeb7b7f2 1073741824" returned: 0 in 0.398s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:04:39 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-772b9f1e-1049-4903-a014-af6b367100db tempest-CreateVolumesFromSnapshotTest-513203005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-ab703f6f-88b7-4848-98d8-f25ddeb7b7f2 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:04:39 devstack sudo[104197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-ab703f6f-88b7-4848-98d8-f25ddeb7b7f2 Jul 13 14:04:39 devstack sudo[104197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:04:39 devstack sudo[104197]: pam_unix(sudo:session): session closed for user root Jul 13 14:04:39 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-772b9f1e-1049-4903-a014-af6b367100db tempest-CreateVolumesFromSnapshotTest-513203005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-ab703f6f-88b7-4848-98d8-f25ddeb7b7f2" returned: 0 in 0.254s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:04:39 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-772b9f1e-1049-4903-a014-af6b367100db tempest-CreateVolumesFromSnapshotTest-513203005 None] <== create_volume: return (686ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'} {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 13 14:04:39 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-772b9f1e-1049-4903-a014-af6b367100db tempest-CreateVolumesFromSnapshotTest-513203005 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.689s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 14:04:39 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-772b9f1e-1049-4903-a014-af6b367100db tempest-CreateVolumesFromSnapshotTest-513203005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01b454bf-c78e-4767-a896-3709ebdd1010) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ab703f6f-88b7-4848-98d8-f25ddeb7b7f2', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:04:39 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-772b9f1e-1049-4903-a014-af6b367100db tempest-CreateVolumesFromSnapshotTest-513203005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d011d89a-c76d-47db-bd99-990d0e4a610d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:04:39 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-772b9f1e-1049-4903-a014-af6b367100db tempest-CreateVolumesFromSnapshotTest-513203005 None] Volume volume-ab703f6f-88b7-4848-98d8-f25ddeb7b7f2 (ab703f6f-88b7-4848-98d8-f25ddeb7b7f2): created successfully Jul 13 14:04:39 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-772b9f1e-1049-4903-a014-af6b367100db tempest-CreateVolumesFromSnapshotTest-513203005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d011d89a-c76d-47db-bd99-990d0e4a610d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:04:39 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-772b9f1e-1049-4903-a014-af6b367100db tempest-CreateVolumesFromSnapshotTest-513203005 None] Flow 'volume_create_manager' (c0b7dd42-ae83-4bb6-b770-b1a73b1c4ec3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 14:04:39 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-772b9f1e-1049-4903-a014-af6b367100db tempest-CreateVolumesFromSnapshotTest-513203005 None] Created volume successfully. Jul 13 14:04:41 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-e49a29ec-f91c-4e34-83b9-bec793409841 tempest-CreateVolumesFromSnapshotTest-513203005 None] Acquiring lock "cinder-ab703f6f-88b7-4848-98d8-f25ddeb7b7f2-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 14:04:41 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-e49a29ec-f91c-4e34-83b9-bec793409841 tempest-CreateVolumesFromSnapshotTest-513203005 None] Lock "cinder-ab703f6f-88b7-4848-98d8-f25ddeb7b7f2-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 14:04:41 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-e49a29ec-f91c-4e34-83b9-bec793409841 tempest-CreateVolumesFromSnapshotTest-513203005 None] Acquiring lock "cinder-quobyte-ab703f6f-88b7-4848-98d8-f25ddeb7b7f2" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 14:04:41 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-e49a29ec-f91c-4e34-83b9-bec793409841 tempest-CreateVolumesFromSnapshotTest-513203005 None] Lock "cinder-quobyte-ab703f6f-88b7-4848-98d8-f25ddeb7b7f2" acquired by "delete_volume" :: waited 0.016s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 14:04:41 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0c37bc3-eed4-4dfa-bc5f-387a2d915ce8]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 14:04:41 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-e49a29ec-f91c-4e34-83b9-bec793409841 tempest-CreateVolumesFromSnapshotTest-513203005 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-ab703f6f-88b7-4848-98d8-f25ddeb7b7f2 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:04:41 devstack sudo[104200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-ab703f6f-88b7-4848-98d8-f25ddeb7b7f2 Jul 13 14:04:41 devstack sudo[104200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:04:41 devstack sudo[104200]: pam_unix(sudo:session): session closed for user root Jul 13 14:04:41 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-e49a29ec-f91c-4e34-83b9-bec793409841 tempest-CreateVolumesFromSnapshotTest-513203005 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-ab703f6f-88b7-4848-98d8-f25ddeb7b7f2" returned: 0 in 0.354s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:04:41 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-e49a29ec-f91c-4e34-83b9-bec793409841 tempest-CreateVolumesFromSnapshotTest-513203005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-ab703f6f-88b7-4848-98d8-f25ddeb7b7f2 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:04:41 devstack sudo[104205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-ab703f6f-88b7-4848-98d8-f25ddeb7b7f2 Jul 13 14:04:41 devstack sudo[104205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:04:41 devstack sudo[104205]: pam_unix(sudo:session): session closed for user root Jul 13 14:04:41 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-e49a29ec-f91c-4e34-83b9-bec793409841 tempest-CreateVolumesFromSnapshotTest-513203005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-ab703f6f-88b7-4848-98d8-f25ddeb7b7f2" returned: 0 in 0.245s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:04:41 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-e49a29ec-f91c-4e34-83b9-bec793409841 tempest-CreateVolumesFromSnapshotTest-513203005 None] Lock "cinder-quobyte-ab703f6f-88b7-4848-98d8-f25ddeb7b7f2" released by "delete_volume" :: held 0.635s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 14:04:41 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-e49a29ec-f91c-4e34-83b9-bec793409841 tempest-CreateVolumesFromSnapshotTest-513203005 None] Created reservations ['969b006c-96e1-4f45-8eb4-0f77906d1ad0', '0707d5c4-07f7-4a28-b487-a75dc503ed15', '664a617a-67f7-4083-a866-3b87826b5823', 'cc6f4fb2-9510-4488-8378-f91d4292a338'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 14:04:41 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-e49a29ec-f91c-4e34-83b9-bec793409841 tempest-CreateVolumesFromSnapshotTest-513203005 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 14:04:41 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-e49a29ec-f91c-4e34-83b9-bec793409841 tempest-CreateVolumesFromSnapshotTest-513203005 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 14:04:41 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-e49a29ec-f91c-4e34-83b9-bec793409841 tempest-CreateVolumesFromSnapshotTest-513203005 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 14:04:41 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-e49a29ec-f91c-4e34-83b9-bec793409841 tempest-CreateVolumesFromSnapshotTest-513203005 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 14:04:41 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-e49a29ec-f91c-4e34-83b9-bec793409841 tempest-CreateVolumesFromSnapshotTest-513203005 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 14:04:41 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-e49a29ec-f91c-4e34-83b9-bec793409841 tempest-CreateVolumesFromSnapshotTest-513203005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:04:41 devstack sudo[104208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 Jul 13 14:04:41 devstack sudo[104208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:04:42 devstack sudo[104208]: pam_unix(sudo:session): session closed for user root Jul 13 14:04:42 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-e49a29ec-f91c-4e34-83b9-bec793409841 tempest-CreateVolumesFromSnapshotTest-513203005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78" returned: 0 in 0.263s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:04:42 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-e49a29ec-f91c-4e34-83b9-bec793409841 tempest-CreateVolumesFromSnapshotTest-513203005 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 14:04:42 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-e49a29ec-f91c-4e34-83b9-bec793409841 tempest-CreateVolumesFromSnapshotTest-513203005 None] Deleted volume successfully. Jul 13 14:04:42 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-e49a29ec-f91c-4e34-83b9-bec793409841 tempest-CreateVolumesFromSnapshotTest-513203005 None] Lock "cinder-ab703f6f-88b7-4848-98d8-f25ddeb7b7f2-delete_volume" released by "delete_volume" :: held 1.087s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 14:04:42 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-9491476e-2693-4931-8f0a-dfa3e30cc4b7 tempest-CreateVolumesFromSnapshotTest-513203005 None] Acquiring lock "cinder-6e3b7d36-e0c3-49e9-8e5c-8346513886fc-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 14:04:42 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-9491476e-2693-4931-8f0a-dfa3e30cc4b7 tempest-CreateVolumesFromSnapshotTest-513203005 None] Lock "cinder-6e3b7d36-e0c3-49e9-8e5c-8346513886fc-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 14:04:42 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-9491476e-2693-4931-8f0a-dfa3e30cc4b7 tempest-CreateVolumesFromSnapshotTest-513203005 None] Acquiring lock "cinder-quobyte-6e3b7d36-e0c3-49e9-8e5c-8346513886fc" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 14:04:42 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-9491476e-2693-4931-8f0a-dfa3e30cc4b7 tempest-CreateVolumesFromSnapshotTest-513203005 None] Lock "cinder-quobyte-6e3b7d36-e0c3-49e9-8e5c-8346513886fc" acquired by "delete_volume" :: waited 0.015s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 14:04:42 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[dee47c82-e118-431f-9fd2-9f078e96acec]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 14:04:42 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-9491476e-2693-4931-8f0a-dfa3e30cc4b7 tempest-CreateVolumesFromSnapshotTest-513203005 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-6e3b7d36-e0c3-49e9-8e5c-8346513886fc {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:04:42 devstack sudo[104211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-6e3b7d36-e0c3-49e9-8e5c-8346513886fc Jul 13 14:04:42 devstack sudo[104211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:04:42 devstack sudo[104211]: pam_unix(sudo:session): session closed for user root Jul 13 14:04:42 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-9491476e-2693-4931-8f0a-dfa3e30cc4b7 tempest-CreateVolumesFromSnapshotTest-513203005 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-6e3b7d36-e0c3-49e9-8e5c-8346513886fc" returned: 0 in 0.352s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:04:42 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-9491476e-2693-4931-8f0a-dfa3e30cc4b7 tempest-CreateVolumesFromSnapshotTest-513203005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-6e3b7d36-e0c3-49e9-8e5c-8346513886fc {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:04:42 devstack sudo[104216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-6e3b7d36-e0c3-49e9-8e5c-8346513886fc Jul 13 14:04:42 devstack sudo[104216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:04:42 devstack sudo[104216]: pam_unix(sudo:session): session closed for user root Jul 13 14:04:42 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-9491476e-2693-4931-8f0a-dfa3e30cc4b7 tempest-CreateVolumesFromSnapshotTest-513203005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-6e3b7d36-e0c3-49e9-8e5c-8346513886fc" returned: 0 in 0.246s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:04:42 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-9491476e-2693-4931-8f0a-dfa3e30cc4b7 tempest-CreateVolumesFromSnapshotTest-513203005 None] Lock "cinder-quobyte-6e3b7d36-e0c3-49e9-8e5c-8346513886fc" released by "delete_volume" :: held 0.637s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 14:04:42 devstack cinder-volume[87098]: DEBUG dbcounter [-] [87098] Writing DB stats cinder:SELECT=100,cinder:INSERT=41,cinder:UPDATE=122,cinder:DELETE=13 {{(pid=87098) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 13 14:04:42 devstack cinder-volume[87098]: DEBUG dbcounter [-] [87098] Writing DB stats cinder:SELECT=105,cinder:INSERT=37,cinder:UPDATE=126,cinder:DELETE=8 {{(pid=87098) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 13 14:04:42 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-9491476e-2693-4931-8f0a-dfa3e30cc4b7 tempest-CreateVolumesFromSnapshotTest-513203005 None] Created reservations ['b3daf764-e790-4a98-852f-2a5afc86a50e', '5c55308e-1d1a-4953-a8d4-d4cc922f58b9', '4fe1f940-9843-4e5e-9069-7349a6de35a7', 'a996eda2-dcc6-43e2-8987-dffba5e9077c'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 14:04:42 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-9491476e-2693-4931-8f0a-dfa3e30cc4b7 tempest-CreateVolumesFromSnapshotTest-513203005 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 14:04:42 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-9491476e-2693-4931-8f0a-dfa3e30cc4b7 tempest-CreateVolumesFromSnapshotTest-513203005 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 14:04:42 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-9491476e-2693-4931-8f0a-dfa3e30cc4b7 tempest-CreateVolumesFromSnapshotTest-513203005 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 14:04:42 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-9491476e-2693-4931-8f0a-dfa3e30cc4b7 tempest-CreateVolumesFromSnapshotTest-513203005 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 14:04:42 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-9491476e-2693-4931-8f0a-dfa3e30cc4b7 tempest-CreateVolumesFromSnapshotTest-513203005 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 14:04:42 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-9491476e-2693-4931-8f0a-dfa3e30cc4b7 tempest-CreateVolumesFromSnapshotTest-513203005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:04:43 devstack sudo[104219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 Jul 13 14:04:43 devstack sudo[104219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:04:43 devstack sudo[104219]: pam_unix(sudo:session): session closed for user root Jul 13 14:04:43 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-9491476e-2693-4931-8f0a-dfa3e30cc4b7 tempest-CreateVolumesFromSnapshotTest-513203005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78" returned: 0 in 0.241s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:04:43 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-9491476e-2693-4931-8f0a-dfa3e30cc4b7 tempest-CreateVolumesFromSnapshotTest-513203005 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 14:04:43 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-9491476e-2693-4931-8f0a-dfa3e30cc4b7 tempest-CreateVolumesFromSnapshotTest-513203005 None] Deleted volume successfully. Jul 13 14:04:43 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-9491476e-2693-4931-8f0a-dfa3e30cc4b7 tempest-CreateVolumesFromSnapshotTest-513203005 None] Lock "cinder-6e3b7d36-e0c3-49e9-8e5c-8346513886fc-delete_volume" released by "delete_volume" :: held 1.083s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 14:04:43 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-cd6f6f9b-9895-4246-a00e-83a4b276b886 tempest-CreateVolumesFromSnapshotTest-513203005 None] Acquiring lock "cinder-a3099d1f-a017-4ce4-9b9e-9ccbd8e9c08a-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 14:04:43 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-cd6f6f9b-9895-4246-a00e-83a4b276b886 tempest-CreateVolumesFromSnapshotTest-513203005 None] Lock "cinder-a3099d1f-a017-4ce4-9b9e-9ccbd8e9c08a-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 14:04:43 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-cd6f6f9b-9895-4246-a00e-83a4b276b886 tempest-CreateVolumesFromSnapshotTest-513203005 None] Acquiring lock "cinder-quobyte-a3099d1f-a017-4ce4-9b9e-9ccbd8e9c08a" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 14:04:43 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-cd6f6f9b-9895-4246-a00e-83a4b276b886 tempest-CreateVolumesFromSnapshotTest-513203005 None] Lock "cinder-quobyte-a3099d1f-a017-4ce4-9b9e-9ccbd8e9c08a" acquired by "delete_volume" :: waited 0.015s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 14:04:43 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[0254cf79-4102-45a8-9079-bafa9ab055eb]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 14:04:43 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-cd6f6f9b-9895-4246-a00e-83a4b276b886 tempest-CreateVolumesFromSnapshotTest-513203005 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-a3099d1f-a017-4ce4-9b9e-9ccbd8e9c08a {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:04:43 devstack sudo[104222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-a3099d1f-a017-4ce4-9b9e-9ccbd8e9c08a Jul 13 14:04:43 devstack sudo[104222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:04:43 devstack sudo[104222]: pam_unix(sudo:session): session closed for user root Jul 13 14:04:43 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-cd6f6f9b-9895-4246-a00e-83a4b276b886 tempest-CreateVolumesFromSnapshotTest-513203005 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-a3099d1f-a017-4ce4-9b9e-9ccbd8e9c08a" returned: 0 in 0.348s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:04:43 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-cd6f6f9b-9895-4246-a00e-83a4b276b886 tempest-CreateVolumesFromSnapshotTest-513203005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-a3099d1f-a017-4ce4-9b9e-9ccbd8e9c08a {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:04:43 devstack sudo[104227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-a3099d1f-a017-4ce4-9b9e-9ccbd8e9c08a Jul 13 14:04:43 devstack sudo[104227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:04:44 devstack sudo[104227]: pam_unix(sudo:session): session closed for user root Jul 13 14:04:44 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-cd6f6f9b-9895-4246-a00e-83a4b276b886 tempest-CreateVolumesFromSnapshotTest-513203005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-a3099d1f-a017-4ce4-9b9e-9ccbd8e9c08a" returned: 0 in 0.251s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:04:44 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-cd6f6f9b-9895-4246-a00e-83a4b276b886 tempest-CreateVolumesFromSnapshotTest-513203005 None] Lock "cinder-quobyte-a3099d1f-a017-4ce4-9b9e-9ccbd8e9c08a" released by "delete_volume" :: held 0.639s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 14:04:44 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-cd6f6f9b-9895-4246-a00e-83a4b276b886 tempest-CreateVolumesFromSnapshotTest-513203005 None] Created reservations ['e68caa2a-ac95-44f7-9053-614345cc2d38', '8468d666-d76d-48a0-8066-213aa9031f4c', 'c8cbf5af-d80c-4899-8a0c-116f4431edec', '789d1560-ada2-4a95-992a-8bfa667c3da6'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 14:04:44 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-cd6f6f9b-9895-4246-a00e-83a4b276b886 tempest-CreateVolumesFromSnapshotTest-513203005 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 14:04:44 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-cd6f6f9b-9895-4246-a00e-83a4b276b886 tempest-CreateVolumesFromSnapshotTest-513203005 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 14:04:44 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-cd6f6f9b-9895-4246-a00e-83a4b276b886 tempest-CreateVolumesFromSnapshotTest-513203005 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 14:04:44 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-cd6f6f9b-9895-4246-a00e-83a4b276b886 tempest-CreateVolumesFromSnapshotTest-513203005 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 14:04:44 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-cd6f6f9b-9895-4246-a00e-83a4b276b886 tempest-CreateVolumesFromSnapshotTest-513203005 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 14:04:44 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-cd6f6f9b-9895-4246-a00e-83a4b276b886 tempest-CreateVolumesFromSnapshotTest-513203005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:04:44 devstack sudo[104230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 Jul 13 14:04:44 devstack sudo[104230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:04:44 devstack sudo[104230]: pam_unix(sudo:session): session closed for user root Jul 13 14:04:44 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-cd6f6f9b-9895-4246-a00e-83a4b276b886 tempest-CreateVolumesFromSnapshotTest-513203005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78" returned: 0 in 0.233s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:04:44 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-cd6f6f9b-9895-4246-a00e-83a4b276b886 tempest-CreateVolumesFromSnapshotTest-513203005 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 14:04:44 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-cd6f6f9b-9895-4246-a00e-83a4b276b886 tempest-CreateVolumesFromSnapshotTest-513203005 None] Deleted volume successfully. Jul 13 14:04:44 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-cd6f6f9b-9895-4246-a00e-83a4b276b886 tempest-CreateVolumesFromSnapshotTest-513203005 None] Lock "cinder-a3099d1f-a017-4ce4-9b9e-9ccbd8e9c08a-delete_volume" released by "delete_volume" :: held 1.059s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 14:04:44 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-0d08a000-40c3-45c7-bead-a8510ffc909e tempest-CreateVolumesFromSnapshotTest-513203005 None] Acquiring lock "cinder-9dd9dbeb-fbcb-47b3-b7cd-81a318924f96-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 14:04:44 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-0d08a000-40c3-45c7-bead-a8510ffc909e tempest-CreateVolumesFromSnapshotTest-513203005 None] Lock "cinder-9dd9dbeb-fbcb-47b3-b7cd-81a318924f96-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 14:04:44 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-0d08a000-40c3-45c7-bead-a8510ffc909e tempest-CreateVolumesFromSnapshotTest-513203005 None] Acquiring lock "cinder-quobyte-9dd9dbeb-fbcb-47b3-b7cd-81a318924f96" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 14:04:44 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-0d08a000-40c3-45c7-bead-a8510ffc909e tempest-CreateVolumesFromSnapshotTest-513203005 None] Lock "cinder-quobyte-9dd9dbeb-fbcb-47b3-b7cd-81a318924f96" acquired by "delete_volume" :: waited 0.014s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 14:04:44 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[284e391a-7d58-4e53-80fc-716ee730ef42]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 14:04:44 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-0d08a000-40c3-45c7-bead-a8510ffc909e tempest-CreateVolumesFromSnapshotTest-513203005 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-9dd9dbeb-fbcb-47b3-b7cd-81a318924f96 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:04:44 devstack sudo[104233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-9dd9dbeb-fbcb-47b3-b7cd-81a318924f96 Jul 13 14:04:44 devstack sudo[104233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:04:44 devstack sudo[104233]: pam_unix(sudo:session): session closed for user root Jul 13 14:04:44 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-0d08a000-40c3-45c7-bead-a8510ffc909e tempest-CreateVolumesFromSnapshotTest-513203005 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-9dd9dbeb-fbcb-47b3-b7cd-81a318924f96" returned: 0 in 0.361s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:04:44 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-0d08a000-40c3-45c7-bead-a8510ffc909e tempest-CreateVolumesFromSnapshotTest-513203005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-9dd9dbeb-fbcb-47b3-b7cd-81a318924f96 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:04:44 devstack sudo[104238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-9dd9dbeb-fbcb-47b3-b7cd-81a318924f96 Jul 13 14:04:44 devstack sudo[104238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:04:45 devstack sudo[104238]: pam_unix(sudo:session): session closed for user root Jul 13 14:04:45 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-0d08a000-40c3-45c7-bead-a8510ffc909e tempest-CreateVolumesFromSnapshotTest-513203005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-9dd9dbeb-fbcb-47b3-b7cd-81a318924f96" returned: 0 in 0.238s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:04:45 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-0d08a000-40c3-45c7-bead-a8510ffc909e tempest-CreateVolumesFromSnapshotTest-513203005 None] Lock "cinder-quobyte-9dd9dbeb-fbcb-47b3-b7cd-81a318924f96" released by "delete_volume" :: held 0.638s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 14:04:45 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-0d08a000-40c3-45c7-bead-a8510ffc909e tempest-CreateVolumesFromSnapshotTest-513203005 None] Created reservations ['d8d95558-384d-4b23-9d3b-287007060227', '188e3c1f-22f3-47c5-9e57-08121e1f55e9', 'bada0750-a2de-44ea-8bd6-c4544dac91e4', '0cadc8f3-0299-4a3c-9661-affa8e8af760'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 14:04:45 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-0d08a000-40c3-45c7-bead-a8510ffc909e tempest-CreateVolumesFromSnapshotTest-513203005 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 14:04:45 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-0d08a000-40c3-45c7-bead-a8510ffc909e tempest-CreateVolumesFromSnapshotTest-513203005 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 14:04:45 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-0d08a000-40c3-45c7-bead-a8510ffc909e tempest-CreateVolumesFromSnapshotTest-513203005 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 14:04:45 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-0d08a000-40c3-45c7-bead-a8510ffc909e tempest-CreateVolumesFromSnapshotTest-513203005 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 14:04:45 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-0d08a000-40c3-45c7-bead-a8510ffc909e tempest-CreateVolumesFromSnapshotTest-513203005 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 14:04:45 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-0d08a000-40c3-45c7-bead-a8510ffc909e tempest-CreateVolumesFromSnapshotTest-513203005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:04:45 devstack sudo[104241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 Jul 13 14:04:45 devstack sudo[104241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:04:45 devstack sudo[104241]: pam_unix(sudo:session): session closed for user root Jul 13 14:04:45 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-0d08a000-40c3-45c7-bead-a8510ffc909e tempest-CreateVolumesFromSnapshotTest-513203005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78" returned: 0 in 0.240s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:04:45 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-0d08a000-40c3-45c7-bead-a8510ffc909e tempest-CreateVolumesFromSnapshotTest-513203005 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 14:04:45 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-0d08a000-40c3-45c7-bead-a8510ffc909e tempest-CreateVolumesFromSnapshotTest-513203005 None] Deleted volume successfully. Jul 13 14:04:45 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-0d08a000-40c3-45c7-bead-a8510ffc909e tempest-CreateVolumesFromSnapshotTest-513203005 None] Lock "cinder-9dd9dbeb-fbcb-47b3-b7cd-81a318924f96-delete_volume" released by "delete_volume" :: held 1.064s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 14:04:45 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-0724c9d4-f44a-4cf3-a06f-295fd6e33d9b tempest-CreateVolumesFromSnapshotTest-513203005 None] Acquiring lock "cinder-18527bba-cc65-4dad-97bb-c83c12819648-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 14:04:45 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-0724c9d4-f44a-4cf3-a06f-295fd6e33d9b tempest-CreateVolumesFromSnapshotTest-513203005 None] Lock "cinder-18527bba-cc65-4dad-97bb-c83c12819648-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 14:04:45 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-0724c9d4-f44a-4cf3-a06f-295fd6e33d9b tempest-CreateVolumesFromSnapshotTest-513203005 None] Acquiring lock "cinder-quobyte-18527bba-cc65-4dad-97bb-c83c12819648" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 14:04:45 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-0724c9d4-f44a-4cf3-a06f-295fd6e33d9b tempest-CreateVolumesFromSnapshotTest-513203005 None] Lock "cinder-quobyte-18527bba-cc65-4dad-97bb-c83c12819648" acquired by "delete_volume" :: waited 0.015s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 14:04:45 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[79a645ce-f278-42d3-b52e-00056195dc1e]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 14:04:45 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-0724c9d4-f44a-4cf3-a06f-295fd6e33d9b tempest-CreateVolumesFromSnapshotTest-513203005 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-18527bba-cc65-4dad-97bb-c83c12819648 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:04:45 devstack sudo[104244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-18527bba-cc65-4dad-97bb-c83c12819648 Jul 13 14:04:45 devstack sudo[104244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:04:46 devstack sudo[104244]: pam_unix(sudo:session): session closed for user root Jul 13 14:04:46 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-0724c9d4-f44a-4cf3-a06f-295fd6e33d9b tempest-CreateVolumesFromSnapshotTest-513203005 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-18527bba-cc65-4dad-97bb-c83c12819648" returned: 0 in 0.363s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:04:46 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-0724c9d4-f44a-4cf3-a06f-295fd6e33d9b tempest-CreateVolumesFromSnapshotTest-513203005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-18527bba-cc65-4dad-97bb-c83c12819648 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:04:46 devstack sudo[104249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-18527bba-cc65-4dad-97bb-c83c12819648 Jul 13 14:04:46 devstack sudo[104249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:04:46 devstack sudo[104249]: pam_unix(sudo:session): session closed for user root Jul 13 14:04:46 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-0724c9d4-f44a-4cf3-a06f-295fd6e33d9b tempest-CreateVolumesFromSnapshotTest-513203005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-18527bba-cc65-4dad-97bb-c83c12819648" returned: 0 in 0.254s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:04:46 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-0724c9d4-f44a-4cf3-a06f-295fd6e33d9b tempest-CreateVolumesFromSnapshotTest-513203005 None] Lock "cinder-quobyte-18527bba-cc65-4dad-97bb-c83c12819648" released by "delete_volume" :: held 0.653s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 14:04:46 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-0724c9d4-f44a-4cf3-a06f-295fd6e33d9b tempest-CreateVolumesFromSnapshotTest-513203005 None] Created reservations ['40d3053d-6b1f-4fbb-ad2a-1f8edaab2d7a', '2f838517-7209-4b01-a0ab-e3ae5c20fa16', 'a30d151f-51fd-4347-9416-2f4ea3bfa897', 'b1b4a564-2f5c-4382-bfd1-94736b624890'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 14:04:46 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-0724c9d4-f44a-4cf3-a06f-295fd6e33d9b tempest-CreateVolumesFromSnapshotTest-513203005 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 14:04:46 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-0724c9d4-f44a-4cf3-a06f-295fd6e33d9b tempest-CreateVolumesFromSnapshotTest-513203005 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 14:04:46 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-0724c9d4-f44a-4cf3-a06f-295fd6e33d9b tempest-CreateVolumesFromSnapshotTest-513203005 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 14:04:46 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-0724c9d4-f44a-4cf3-a06f-295fd6e33d9b tempest-CreateVolumesFromSnapshotTest-513203005 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 14:04:46 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-0724c9d4-f44a-4cf3-a06f-295fd6e33d9b tempest-CreateVolumesFromSnapshotTest-513203005 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 14:04:46 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-0724c9d4-f44a-4cf3-a06f-295fd6e33d9b tempest-CreateVolumesFromSnapshotTest-513203005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:04:46 devstack sudo[104252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 Jul 13 14:04:46 devstack sudo[104252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:04:46 devstack sudo[104252]: pam_unix(sudo:session): session closed for user root Jul 13 14:04:46 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-0724c9d4-f44a-4cf3-a06f-295fd6e33d9b tempest-CreateVolumesFromSnapshotTest-513203005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78" returned: 0 in 0.249s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:04:46 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-0724c9d4-f44a-4cf3-a06f-295fd6e33d9b tempest-CreateVolumesFromSnapshotTest-513203005 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 14:04:46 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-0724c9d4-f44a-4cf3-a06f-295fd6e33d9b tempest-CreateVolumesFromSnapshotTest-513203005 None] Deleted volume successfully. Jul 13 14:04:46 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-0724c9d4-f44a-4cf3-a06f-295fd6e33d9b tempest-CreateVolumesFromSnapshotTest-513203005 None] Lock "cinder-18527bba-cc65-4dad-97bb-c83c12819648-delete_volume" released by "delete_volume" :: held 1.125s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 14:04:46 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-023ba6ef-927f-42ed-940e-0c31346947b1 tempest-CreateVolumesFromSnapshotTest-513203005 None] Acquiring lock "cinder-4ea251ec-063d-4bae-af47-6512ab034a3d-delete_snapshot" by "delete_snapshot" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 14:04:46 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-023ba6ef-927f-42ed-940e-0c31346947b1 tempest-CreateVolumesFromSnapshotTest-513203005 None] Lock "cinder-4ea251ec-063d-4bae-af47-6512ab034a3d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 14:04:46 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-023ba6ef-927f-42ed-940e-0c31346947b1 tempest-CreateVolumesFromSnapshotTest-513203005 None] Acquiring lock "cinder-quobyte-6f13635f-d209-4fab-8641-5121af84c9bd" by "delete_snapshot" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 14:04:46 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-023ba6ef-927f-42ed-940e-0c31346947b1 tempest-CreateVolumesFromSnapshotTest-513203005 None] Lock "cinder-quobyte-6f13635f-d209-4fab-8641-5121af84c9bd" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 14:04:46 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-023ba6ef-927f-42ed-940e-0c31346947b1 tempest-CreateVolumesFromSnapshotTest-513203005 None] Acquiring lock "cinder-quobyte-4ea251ec-063d-4bae-af47-6512ab034a3d" by "_delete_snapshot" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 14:04:46 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-023ba6ef-927f-42ed-940e-0c31346947b1 tempest-CreateVolumesFromSnapshotTest-513203005 None] Lock "cinder-quobyte-4ea251ec-063d-4bae-af47-6512ab034a3d" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 14:04:46 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-023ba6ef-927f-42ed-940e-0c31346947b1 tempest-CreateVolumesFromSnapshotTest-513203005 None] Deleting offline snapshot 4ea251ec-063d-4bae-af47-6512ab034a3d of volume 6f13635f-d209-4fab-8641-5121af84c9bd {{(pid=87098) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 13 14:04:46 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-023ba6ef-927f-42ed-940e-0c31346947b1 tempest-CreateVolumesFromSnapshotTest-513203005 None] snapshot_file for this snap is: volume-6f13635f-d209-4fab-8641-5121af84c9bd.4ea251ec-063d-4bae-af47-6512ab034a3d {{(pid=87098) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 13 14:04:46 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bf6180c-d29e-4e83-89dc-044283796f6a]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 14:04:46 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-023ba6ef-927f-42ed-940e-0c31346947b1 tempest-CreateVolumesFromSnapshotTest-513203005 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-6f13635f-d209-4fab-8641-5121af84c9bd.4ea251ec-063d-4bae-af47-6512ab034a3d {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:04:46 devstack sudo[104255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-6f13635f-d209-4fab-8641-5121af84c9bd.4ea251ec-063d-4bae-af47-6512ab034a3d Jul 13 14:04:46 devstack sudo[104255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:04:47 devstack sudo[104255]: pam_unix(sudo:session): session closed for user root Jul 13 14:04:47 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-023ba6ef-927f-42ed-940e-0c31346947b1 tempest-CreateVolumesFromSnapshotTest-513203005 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-6f13635f-d209-4fab-8641-5121af84c9bd.4ea251ec-063d-4bae-af47-6512ab034a3d" returned: 0 in 0.344s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:04:47 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-023ba6ef-927f-42ed-940e-0c31346947b1 tempest-CreateVolumesFromSnapshotTest-513203005 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6f13635f-d209-4fab-8641-5121af84c9bd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87098) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 13 14:04:47 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[2666447c-4a21-462f-9097-11af178603c3]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 14:04:47 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-023ba6ef-927f-42ed-940e-0c31346947b1 tempest-CreateVolumesFromSnapshotTest-513203005 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-6f13635f-d209-4fab-8641-5121af84c9bd {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:04:47 devstack sudo[104261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-6f13635f-d209-4fab-8641-5121af84c9bd Jul 13 14:04:47 devstack sudo[104261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:04:47 devstack sudo[104261]: pam_unix(sudo:session): session closed for user root Jul 13 14:04:47 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-023ba6ef-927f-42ed-940e-0c31346947b1 tempest-CreateVolumesFromSnapshotTest-513203005 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-6f13635f-d209-4fab-8641-5121af84c9bd" returned: 0 in 0.340s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:04:47 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-023ba6ef-927f-42ed-940e-0c31346947b1 tempest-CreateVolumesFromSnapshotTest-513203005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-6f13635f-d209-4fab-8641-5121af84c9bd.4ea251ec-063d-4bae-af47-6512ab034a3d {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:04:47 devstack sudo[104266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-6f13635f-d209-4fab-8641-5121af84c9bd.4ea251ec-063d-4bae-af47-6512ab034a3d Jul 13 14:04:47 devstack sudo[104266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:04:47 devstack sudo[104266]: pam_unix(sudo:session): session closed for user root Jul 13 14:04:47 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-023ba6ef-927f-42ed-940e-0c31346947b1 tempest-CreateVolumesFromSnapshotTest-513203005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-6f13635f-d209-4fab-8641-5121af84c9bd.4ea251ec-063d-4bae-af47-6512ab034a3d" returned: 0 in 0.318s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:04:47 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-023ba6ef-927f-42ed-940e-0c31346947b1 tempest-CreateVolumesFromSnapshotTest-513203005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-6f13635f-d209-4fab-8641-5121af84c9bd.4ea251ec-063d-4bae-af47-6512ab034a3d {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:04:47 devstack sudo[104271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-6f13635f-d209-4fab-8641-5121af84c9bd.4ea251ec-063d-4bae-af47-6512ab034a3d Jul 13 14:04:47 devstack sudo[104271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:04:48 devstack sudo[104271]: pam_unix(sudo:session): session closed for user root Jul 13 14:04:48 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-023ba6ef-927f-42ed-940e-0c31346947b1 tempest-CreateVolumesFromSnapshotTest-513203005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-6f13635f-d209-4fab-8641-5121af84c9bd.4ea251ec-063d-4bae-af47-6512ab034a3d" returned: 0 in 0.236s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:04:48 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-023ba6ef-927f-42ed-940e-0c31346947b1 tempest-CreateVolumesFromSnapshotTest-513203005 None] Lock "cinder-quobyte-4ea251ec-063d-4bae-af47-6512ab034a3d" released by "_delete_snapshot" :: held 1.332s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 14:04:48 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-023ba6ef-927f-42ed-940e-0c31346947b1 tempest-CreateVolumesFromSnapshotTest-513203005 None] Lock "cinder-quobyte-6f13635f-d209-4fab-8641-5121af84c9bd" released by "delete_snapshot" :: held 1.354s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 14:04:48 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-023ba6ef-927f-42ed-940e-0c31346947b1 tempest-CreateVolumesFromSnapshotTest-513203005 None] Created reservations ['d9a2b73c-da5f-4a4a-9d77-0d422ca9773a', '14e0244e-40cc-4d6d-9fdb-ccbed9d9ce15', 'ea6c859a-1df7-44b9-a1ea-a81c0c01bba2', '18128f5a-b914-4bff-9c26-3f78aa3b6251'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 14:04:48 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-023ba6ef-927f-42ed-940e-0c31346947b1 tempest-CreateVolumesFromSnapshotTest-513203005 None] Delete snapshot completed successfully. Jul 13 14:04:48 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-023ba6ef-927f-42ed-940e-0c31346947b1 tempest-CreateVolumesFromSnapshotTest-513203005 None] Lock "cinder-4ea251ec-063d-4bae-af47-6512ab034a3d-delete_snapshot" released by "delete_snapshot" :: held 1.474s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 14:04:48 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-b4698f19-beb0-470e-a3a6-2b890c8cbfc9 tempest-CreateVolumesFromSnapshotTest-513203005 None] Acquiring lock "cinder-6f13635f-d209-4fab-8641-5121af84c9bd-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 14:04:49 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-b4698f19-beb0-470e-a3a6-2b890c8cbfc9 tempest-CreateVolumesFromSnapshotTest-513203005 None] Lock "cinder-6f13635f-d209-4fab-8641-5121af84c9bd-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 14:04:49 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-b4698f19-beb0-470e-a3a6-2b890c8cbfc9 tempest-CreateVolumesFromSnapshotTest-513203005 None] Acquiring lock "cinder-quobyte-6f13635f-d209-4fab-8641-5121af84c9bd" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 14:04:49 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-b4698f19-beb0-470e-a3a6-2b890c8cbfc9 tempest-CreateVolumesFromSnapshotTest-513203005 None] Lock "cinder-quobyte-6f13635f-d209-4fab-8641-5121af84c9bd" acquired by "delete_volume" :: waited 0.017s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 14:04:49 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a23b772-fab3-43e3-ab51-4d77ac1bfccc]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 14:04:49 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-b4698f19-beb0-470e-a3a6-2b890c8cbfc9 tempest-CreateVolumesFromSnapshotTest-513203005 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-6f13635f-d209-4fab-8641-5121af84c9bd {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:04:49 devstack sudo[104276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-6f13635f-d209-4fab-8641-5121af84c9bd Jul 13 14:04:49 devstack sudo[104276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:04:49 devstack sudo[104276]: pam_unix(sudo:session): session closed for user root Jul 13 14:04:49 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-b4698f19-beb0-470e-a3a6-2b890c8cbfc9 tempest-CreateVolumesFromSnapshotTest-513203005 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-6f13635f-d209-4fab-8641-5121af84c9bd" returned: 0 in 0.355s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:04:49 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-b4698f19-beb0-470e-a3a6-2b890c8cbfc9 tempest-CreateVolumesFromSnapshotTest-513203005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-6f13635f-d209-4fab-8641-5121af84c9bd {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:04:49 devstack sudo[104281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-6f13635f-d209-4fab-8641-5121af84c9bd Jul 13 14:04:49 devstack sudo[104281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:04:49 devstack sudo[104281]: pam_unix(sudo:session): session closed for user root Jul 13 14:04:49 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-b4698f19-beb0-470e-a3a6-2b890c8cbfc9 tempest-CreateVolumesFromSnapshotTest-513203005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-6f13635f-d209-4fab-8641-5121af84c9bd" returned: 0 in 0.243s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:04:49 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-b4698f19-beb0-470e-a3a6-2b890c8cbfc9 tempest-CreateVolumesFromSnapshotTest-513203005 None] Lock "cinder-quobyte-6f13635f-d209-4fab-8641-5121af84c9bd" released by "delete_volume" :: held 0.669s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 14:04:49 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-b4698f19-beb0-470e-a3a6-2b890c8cbfc9 tempest-CreateVolumesFromSnapshotTest-513203005 None] Created reservations ['515c2c75-e4d1-4e6d-bcd1-722eeefb48e9', 'fbf336bf-2753-468c-b148-80ab97b0967e', '5bae7b15-b68a-4d4b-835c-999193e282f0', '1f641ce9-470a-49c5-b052-4ab1b09d0b3d'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 14:04:49 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-b4698f19-beb0-470e-a3a6-2b890c8cbfc9 tempest-CreateVolumesFromSnapshotTest-513203005 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 14:04:49 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-b4698f19-beb0-470e-a3a6-2b890c8cbfc9 tempest-CreateVolumesFromSnapshotTest-513203005 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 14:04:49 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-b4698f19-beb0-470e-a3a6-2b890c8cbfc9 tempest-CreateVolumesFromSnapshotTest-513203005 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 14:04:49 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-b4698f19-beb0-470e-a3a6-2b890c8cbfc9 tempest-CreateVolumesFromSnapshotTest-513203005 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 14:04:49 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-b4698f19-beb0-470e-a3a6-2b890c8cbfc9 tempest-CreateVolumesFromSnapshotTest-513203005 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 14:04:49 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-b4698f19-beb0-470e-a3a6-2b890c8cbfc9 tempest-CreateVolumesFromSnapshotTest-513203005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:04:49 devstack sudo[104284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 Jul 13 14:04:49 devstack sudo[104284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:04:50 devstack sudo[104284]: pam_unix(sudo:session): session closed for user root Jul 13 14:04:50 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-b4698f19-beb0-470e-a3a6-2b890c8cbfc9 tempest-CreateVolumesFromSnapshotTest-513203005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78" returned: 0 in 0.262s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:04:50 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-b4698f19-beb0-470e-a3a6-2b890c8cbfc9 tempest-CreateVolumesFromSnapshotTest-513203005 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 14:04:50 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-b4698f19-beb0-470e-a3a6-2b890c8cbfc9 tempest-CreateVolumesFromSnapshotTest-513203005 None] Deleted volume successfully. Jul 13 14:04:50 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-b4698f19-beb0-470e-a3a6-2b890c8cbfc9 tempest-CreateVolumesFromSnapshotTest-513203005 None] Lock "cinder-6f13635f-d209-4fab-8641-5121af84c9bd-delete_volume" released by "delete_volume" :: held 1.119s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 14:04:53 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-19edbbde-3d71-41f7-a471-adf19bd482b2 tempest-ProjectReaderTests-1831968860 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 14:04:53 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-19edbbde-3d71-41f7-a471-adf19bd482b2 tempest-ProjectReaderTests-1831968860 None] Flow 'volume_create_manager' (5e816192-af5a-41f0-bbd3-fe76763d67d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 14:04:53 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-19edbbde-3d71-41f7-a471-adf19bd482b2 tempest-ProjectReaderTests-1831968860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68cdecba-ae01-4de9-a850-6b5a399fc7be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:04:53 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-19edbbde-3d71-41f7-a471-adf19bd482b2 tempest-ProjectReaderTests-1831968860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68cdecba-ae01-4de9-a850-6b5a399fc7be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T12:04:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-226876171',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c42184c-86fc-44e1-9ae2-fb2c335a30cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e9d9502bfd4b441e8c9d9c6c42cb2bcc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T12:04:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T12:04:53Z,use_quota=True,user_id='fc9838ce084d4aff95a430be2041392d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1147de8b-623b-426c-a13d-7fc824a80f67),volume_type_id=1147de8b-623b-426c-a13d-7fc824a80f67)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:04:53 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-19edbbde-3d71-41f7-a471-adf19bd482b2 tempest-ProjectReaderTests-1831968860 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8142a90e-f7d2-40fc-827a-72a3d7bd7771) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:04:53 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-19edbbde-3d71-41f7-a471-adf19bd482b2 tempest-ProjectReaderTests-1831968860 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8142a90e-f7d2-40fc-827a-72a3d7bd7771) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:04:53 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-19edbbde-3d71-41f7-a471-adf19bd482b2 tempest-ProjectReaderTests-1831968860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3bb4080-1372-42e2-8d62-8c00b0842576) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:04:53 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-19edbbde-3d71-41f7-a471-adf19bd482b2 tempest-ProjectReaderTests-1831968860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3bb4080-1372-42e2-8d62-8c00b0842576) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3c42184c-86fc-44e1-9ae2-fb2c335a30cc', 'volume_name': 'volume-3c42184c-86fc-44e1-9ae2-fb2c335a30cc', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:04:53 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-19edbbde-3d71-41f7-a471-adf19bd482b2 tempest-ProjectReaderTests-1831968860 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0244181-c6b1-4605-b7ea-cfa78b47deec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:04:53 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-19edbbde-3d71-41f7-a471-adf19bd482b2 tempest-ProjectReaderTests-1831968860 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0244181-c6b1-4605-b7ea-cfa78b47deec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:04:53 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-19edbbde-3d71-41f7-a471-adf19bd482b2 tempest-ProjectReaderTests-1831968860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1c2d954-3d0b-4bc2-b30e-86f66972981b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:04:53 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-19edbbde-3d71-41f7-a471-adf19bd482b2 tempest-ProjectReaderTests-1831968860 None] Volume 3c42184c-86fc-44e1-9ae2-fb2c335a30cc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3c42184c-86fc-44e1-9ae2-fb2c335a30cc', 'volume_size': 1} Jul 13 14:04:53 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-19edbbde-3d71-41f7-a471-adf19bd482b2 tempest-ProjectReaderTests-1831968860 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 14:04:53 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-19edbbde-3d71-41f7-a471-adf19bd482b2 tempest-ProjectReaderTests-1831968860 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 14:04:53 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-19edbbde-3d71-41f7-a471-adf19bd482b2 tempest-ProjectReaderTests-1831968860 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T12:04:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-226876171',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c42184c-86fc-44e1-9ae2-fb2c335a30cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e9d9502bfd4b441e8c9d9c6c42cb2bcc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T12:04:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T12:04:53Z,use_quota=True,user_id='fc9838ce084d4aff95a430be2041392d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1147de8b-623b-426c-a13d-7fc824a80f67),volume_type_id=1147de8b-623b-426c-a13d-7fc824a80f67)}" {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 13 14:04:53 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-19edbbde-3d71-41f7-a471-adf19bd482b2 tempest-ProjectReaderTests-1831968860 None] Creating volume 3c42184c-86fc-44e1-9ae2-fb2c335a30cc {{(pid=87098) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 13 14:04:53 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-19edbbde-3d71-41f7-a471-adf19bd482b2 tempest-ProjectReaderTests-1831968860 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 14:04:53 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-19edbbde-3d71-41f7-a471-adf19bd482b2 tempest-ProjectReaderTests-1831968860 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 14:04:53 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-19edbbde-3d71-41f7-a471-adf19bd482b2 tempest-ProjectReaderTests-1831968860 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 14:04:53 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-19edbbde-3d71-41f7-a471-adf19bd482b2 tempest-ProjectReaderTests-1831968860 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 14:04:53 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-19edbbde-3d71-41f7-a471-adf19bd482b2 tempest-ProjectReaderTests-1831968860 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 14:04:53 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-19edbbde-3d71-41f7-a471-adf19bd482b2 tempest-ProjectReaderTests-1831968860 None] Selected osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 14:04:53 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-19edbbde-3d71-41f7-a471-adf19bd482b2 tempest-ProjectReaderTests-1831968860 None] casted to osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 Jul 13 14:04:53 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-19edbbde-3d71-41f7-a471-adf19bd482b2 tempest-ProjectReaderTests-1831968860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-3c42184c-86fc-44e1-9ae2-fb2c335a30cc 1073741824 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:04:53 devstack sudo[104287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-3c42184c-86fc-44e1-9ae2-fb2c335a30cc 1073741824 Jul 13 14:04:53 devstack sudo[104287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:04:53 devstack sudo[104287]: pam_unix(sudo:session): session closed for user root Jul 13 14:04:53 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-19edbbde-3d71-41f7-a471-adf19bd482b2 tempest-ProjectReaderTests-1831968860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-3c42184c-86fc-44e1-9ae2-fb2c335a30cc 1073741824" returned: 0 in 0.406s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:04:53 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-19edbbde-3d71-41f7-a471-adf19bd482b2 tempest-ProjectReaderTests-1831968860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-3c42184c-86fc-44e1-9ae2-fb2c335a30cc {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:04:53 devstack sudo[104293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-3c42184c-86fc-44e1-9ae2-fb2c335a30cc Jul 13 14:04:53 devstack sudo[104293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:04:54 devstack sudo[104293]: pam_unix(sudo:session): session closed for user root Jul 13 14:04:54 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-19edbbde-3d71-41f7-a471-adf19bd482b2 tempest-ProjectReaderTests-1831968860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-3c42184c-86fc-44e1-9ae2-fb2c335a30cc" returned: 0 in 0.250s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:04:54 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-19edbbde-3d71-41f7-a471-adf19bd482b2 tempest-ProjectReaderTests-1831968860 None] <== create_volume: return (696ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'} {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 13 14:04:54 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-19edbbde-3d71-41f7-a471-adf19bd482b2 tempest-ProjectReaderTests-1831968860 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.698s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 14:04:54 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-19edbbde-3d71-41f7-a471-adf19bd482b2 tempest-ProjectReaderTests-1831968860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1c2d954-3d0b-4bc2-b30e-86f66972981b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3c42184c-86fc-44e1-9ae2-fb2c335a30cc', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:04:54 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-19edbbde-3d71-41f7-a471-adf19bd482b2 tempest-ProjectReaderTests-1831968860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06cfb807-fa09-45a9-bceb-0a485bec1c91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:04:54 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-19edbbde-3d71-41f7-a471-adf19bd482b2 tempest-ProjectReaderTests-1831968860 None] Volume volume-3c42184c-86fc-44e1-9ae2-fb2c335a30cc (3c42184c-86fc-44e1-9ae2-fb2c335a30cc): created successfully Jul 13 14:04:54 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-19edbbde-3d71-41f7-a471-adf19bd482b2 tempest-ProjectReaderTests-1831968860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06cfb807-fa09-45a9-bceb-0a485bec1c91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:04:54 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-19edbbde-3d71-41f7-a471-adf19bd482b2 tempest-ProjectReaderTests-1831968860 None] Flow 'volume_create_manager' (5e816192-af5a-41f0-bbd3-fe76763d67d5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 14:04:54 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-19edbbde-3d71-41f7-a471-adf19bd482b2 tempest-ProjectReaderTests-1831968860 None] Created volume successfully. Jul 13 14:04:54 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-b3024c99-7bad-4879-a97a-6195f0dc694a tempest-ProjectReaderTests-1831968860 None] Acquiring lock "cinder-3c42184c-86fc-44e1-9ae2-fb2c335a30cc-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 14:04:54 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-b3024c99-7bad-4879-a97a-6195f0dc694a tempest-ProjectReaderTests-1831968860 None] Lock "cinder-3c42184c-86fc-44e1-9ae2-fb2c335a30cc-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 14:04:54 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-b3024c99-7bad-4879-a97a-6195f0dc694a tempest-ProjectReaderTests-1831968860 None] Acquiring lock "cinder-quobyte-3c42184c-86fc-44e1-9ae2-fb2c335a30cc" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 14:04:54 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-b3024c99-7bad-4879-a97a-6195f0dc694a tempest-ProjectReaderTests-1831968860 None] Lock "cinder-quobyte-3c42184c-86fc-44e1-9ae2-fb2c335a30cc" acquired by "delete_volume" :: waited 0.013s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 14:04:54 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[017f8b00-52f2-4ac3-ba3a-7153c5c55a00]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 14:04:54 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-b3024c99-7bad-4879-a97a-6195f0dc694a tempest-ProjectReaderTests-1831968860 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-3c42184c-86fc-44e1-9ae2-fb2c335a30cc {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:04:54 devstack sudo[104296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-3c42184c-86fc-44e1-9ae2-fb2c335a30cc Jul 13 14:04:54 devstack sudo[104296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:04:54 devstack sudo[104296]: pam_unix(sudo:session): session closed for user root Jul 13 14:04:54 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-b3024c99-7bad-4879-a97a-6195f0dc694a tempest-ProjectReaderTests-1831968860 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-3c42184c-86fc-44e1-9ae2-fb2c335a30cc" returned: 0 in 0.346s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:04:54 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-b3024c99-7bad-4879-a97a-6195f0dc694a tempest-ProjectReaderTests-1831968860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-3c42184c-86fc-44e1-9ae2-fb2c335a30cc {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:04:54 devstack sudo[104301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-3c42184c-86fc-44e1-9ae2-fb2c335a30cc Jul 13 14:04:54 devstack sudo[104301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:04:55 devstack sudo[104301]: pam_unix(sudo:session): session closed for user root Jul 13 14:04:55 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-b3024c99-7bad-4879-a97a-6195f0dc694a tempest-ProjectReaderTests-1831968860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-3c42184c-86fc-44e1-9ae2-fb2c335a30cc" returned: 0 in 0.275s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:04:55 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-b3024c99-7bad-4879-a97a-6195f0dc694a tempest-ProjectReaderTests-1831968860 None] Lock "cinder-quobyte-3c42184c-86fc-44e1-9ae2-fb2c335a30cc" released by "delete_volume" :: held 0.661s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 14:04:55 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-b3024c99-7bad-4879-a97a-6195f0dc694a tempest-ProjectReaderTests-1831968860 None] Created reservations ['8bde65ca-0408-4715-9618-6473140b1d9f', '92bd071b-fa9d-4b7b-a34c-7b6c2195ddd8', '15dcaa6b-2446-457f-be23-f26c66d8bf11', 'afa4711e-ff0a-4f00-bf92-3f833384239a'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 14:04:55 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-b3024c99-7bad-4879-a97a-6195f0dc694a tempest-ProjectReaderTests-1831968860 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 14:04:55 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-b3024c99-7bad-4879-a97a-6195f0dc694a tempest-ProjectReaderTests-1831968860 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 14:04:55 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-b3024c99-7bad-4879-a97a-6195f0dc694a tempest-ProjectReaderTests-1831968860 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 14:04:55 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-b3024c99-7bad-4879-a97a-6195f0dc694a tempest-ProjectReaderTests-1831968860 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 14:04:55 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-b3024c99-7bad-4879-a97a-6195f0dc694a tempest-ProjectReaderTests-1831968860 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 14:04:55 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-b3024c99-7bad-4879-a97a-6195f0dc694a tempest-ProjectReaderTests-1831968860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:04:55 devstack sudo[104304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 Jul 13 14:04:55 devstack sudo[104304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:04:55 devstack sudo[104304]: pam_unix(sudo:session): session closed for user root Jul 13 14:04:55 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-b3024c99-7bad-4879-a97a-6195f0dc694a tempest-ProjectReaderTests-1831968860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78" returned: 0 in 0.238s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:04:55 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-b3024c99-7bad-4879-a97a-6195f0dc694a tempest-ProjectReaderTests-1831968860 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 14:04:55 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-b3024c99-7bad-4879-a97a-6195f0dc694a tempest-ProjectReaderTests-1831968860 None] Deleted volume successfully. Jul 13 14:04:55 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-b3024c99-7bad-4879-a97a-6195f0dc694a tempest-ProjectReaderTests-1831968860 None] Lock "cinder-3c42184c-86fc-44e1-9ae2-fb2c335a30cc-delete_volume" released by "delete_volume" :: held 1.072s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 14:04:56 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-a6bfb104-e097-4b1c-9ae9-b1e7128de276 tempest-ProjectReaderTests-1831968860 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 14:04:56 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-a6bfb104-e097-4b1c-9ae9-b1e7128de276 tempest-ProjectReaderTests-1831968860 None] Flow 'volume_create_manager' (f0f910ee-c155-4e51-af5a-86d8d4c805df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 14:04:56 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-a6bfb104-e097-4b1c-9ae9-b1e7128de276 tempest-ProjectReaderTests-1831968860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ecd1ccb-c0d4-4c1b-b368-4a3f0a54ce73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:04:56 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-a6bfb104-e097-4b1c-9ae9-b1e7128de276 tempest-ProjectReaderTests-1831968860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ecd1ccb-c0d4-4c1b-b368-4a3f0a54ce73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T12:04:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-841583969',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31c580f6-0889-4eaa-b7d5-fdfa253f42b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e9d9502bfd4b441e8c9d9c6c42cb2bcc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T12:04:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T12:04:56Z,use_quota=True,user_id='fc9838ce084d4aff95a430be2041392d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1147de8b-623b-426c-a13d-7fc824a80f67),volume_type_id=1147de8b-623b-426c-a13d-7fc824a80f67)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:04:56 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-a6bfb104-e097-4b1c-9ae9-b1e7128de276 tempest-ProjectReaderTests-1831968860 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e1952fc-87d2-463d-93ed-2ad77f97eeeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:04:56 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-a6bfb104-e097-4b1c-9ae9-b1e7128de276 tempest-ProjectReaderTests-1831968860 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e1952fc-87d2-463d-93ed-2ad77f97eeeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:04:56 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-a6bfb104-e097-4b1c-9ae9-b1e7128de276 tempest-ProjectReaderTests-1831968860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af282586-94d7-4e73-8886-1798b540b9cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:04:56 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-a6bfb104-e097-4b1c-9ae9-b1e7128de276 tempest-ProjectReaderTests-1831968860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af282586-94d7-4e73-8886-1798b540b9cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '31c580f6-0889-4eaa-b7d5-fdfa253f42b6', 'volume_name': 'volume-31c580f6-0889-4eaa-b7d5-fdfa253f42b6', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:04:56 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-a6bfb104-e097-4b1c-9ae9-b1e7128de276 tempest-ProjectReaderTests-1831968860 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (584202f0-42a6-43b8-bb87-455a948e6e9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:04:56 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-a6bfb104-e097-4b1c-9ae9-b1e7128de276 tempest-ProjectReaderTests-1831968860 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (584202f0-42a6-43b8-bb87-455a948e6e9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:04:56 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-a6bfb104-e097-4b1c-9ae9-b1e7128de276 tempest-ProjectReaderTests-1831968860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4848702f-d679-49dd-980f-4134e7f53086) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:04:56 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-a6bfb104-e097-4b1c-9ae9-b1e7128de276 tempest-ProjectReaderTests-1831968860 None] Volume 31c580f6-0889-4eaa-b7d5-fdfa253f42b6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-31c580f6-0889-4eaa-b7d5-fdfa253f42b6', 'volume_size': 1} Jul 13 14:04:56 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-a6bfb104-e097-4b1c-9ae9-b1e7128de276 tempest-ProjectReaderTests-1831968860 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 14:04:56 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-a6bfb104-e097-4b1c-9ae9-b1e7128de276 tempest-ProjectReaderTests-1831968860 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 14:04:56 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-a6bfb104-e097-4b1c-9ae9-b1e7128de276 tempest-ProjectReaderTests-1831968860 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T12:04:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-841583969',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31c580f6-0889-4eaa-b7d5-fdfa253f42b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e9d9502bfd4b441e8c9d9c6c42cb2bcc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T12:04:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T12:04:56Z,use_quota=True,user_id='fc9838ce084d4aff95a430be2041392d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1147de8b-623b-426c-a13d-7fc824a80f67),volume_type_id=1147de8b-623b-426c-a13d-7fc824a80f67)}" {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 13 14:04:56 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-a6bfb104-e097-4b1c-9ae9-b1e7128de276 tempest-ProjectReaderTests-1831968860 None] Creating volume 31c580f6-0889-4eaa-b7d5-fdfa253f42b6 {{(pid=87098) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 13 14:04:56 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-a6bfb104-e097-4b1c-9ae9-b1e7128de276 tempest-ProjectReaderTests-1831968860 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 14:04:56 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-a6bfb104-e097-4b1c-9ae9-b1e7128de276 tempest-ProjectReaderTests-1831968860 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 14:04:56 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-a6bfb104-e097-4b1c-9ae9-b1e7128de276 tempest-ProjectReaderTests-1831968860 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 14:04:56 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-a6bfb104-e097-4b1c-9ae9-b1e7128de276 tempest-ProjectReaderTests-1831968860 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 14:04:56 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-a6bfb104-e097-4b1c-9ae9-b1e7128de276 tempest-ProjectReaderTests-1831968860 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 14:04:56 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-a6bfb104-e097-4b1c-9ae9-b1e7128de276 tempest-ProjectReaderTests-1831968860 None] Selected osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 14:04:56 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-a6bfb104-e097-4b1c-9ae9-b1e7128de276 tempest-ProjectReaderTests-1831968860 None] casted to osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 Jul 13 14:04:56 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-a6bfb104-e097-4b1c-9ae9-b1e7128de276 tempest-ProjectReaderTests-1831968860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-31c580f6-0889-4eaa-b7d5-fdfa253f42b6 1073741824 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:04:56 devstack sudo[104307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-31c580f6-0889-4eaa-b7d5-fdfa253f42b6 1073741824 Jul 13 14:04:56 devstack sudo[104307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:04:56 devstack sudo[104307]: pam_unix(sudo:session): session closed for user root Jul 13 14:04:56 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-a6bfb104-e097-4b1c-9ae9-b1e7128de276 tempest-ProjectReaderTests-1831968860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-31c580f6-0889-4eaa-b7d5-fdfa253f42b6 1073741824" returned: 0 in 0.413s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:04:56 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-a6bfb104-e097-4b1c-9ae9-b1e7128de276 tempest-ProjectReaderTests-1831968860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-31c580f6-0889-4eaa-b7d5-fdfa253f42b6 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:04:56 devstack sudo[104312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-31c580f6-0889-4eaa-b7d5-fdfa253f42b6 Jul 13 14:04:56 devstack sudo[104312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:04:56 devstack sudo[104312]: pam_unix(sudo:session): session closed for user root Jul 13 14:04:56 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-a6bfb104-e097-4b1c-9ae9-b1e7128de276 tempest-ProjectReaderTests-1831968860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-31c580f6-0889-4eaa-b7d5-fdfa253f42b6" returned: 0 in 0.243s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:04:56 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-a6bfb104-e097-4b1c-9ae9-b1e7128de276 tempest-ProjectReaderTests-1831968860 None] <== create_volume: return (700ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'} {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 13 14:04:56 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-a6bfb104-e097-4b1c-9ae9-b1e7128de276 tempest-ProjectReaderTests-1831968860 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.703s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 14:04:56 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-a6bfb104-e097-4b1c-9ae9-b1e7128de276 tempest-ProjectReaderTests-1831968860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4848702f-d679-49dd-980f-4134e7f53086) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-31c580f6-0889-4eaa-b7d5-fdfa253f42b6', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:04:56 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-a6bfb104-e097-4b1c-9ae9-b1e7128de276 tempest-ProjectReaderTests-1831968860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64ef15b2-32c1-4f66-a68e-8222c9f1d7bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:04:56 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-a6bfb104-e097-4b1c-9ae9-b1e7128de276 tempest-ProjectReaderTests-1831968860 None] Volume volume-31c580f6-0889-4eaa-b7d5-fdfa253f42b6 (31c580f6-0889-4eaa-b7d5-fdfa253f42b6): created successfully Jul 13 14:04:56 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-a6bfb104-e097-4b1c-9ae9-b1e7128de276 tempest-ProjectReaderTests-1831968860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64ef15b2-32c1-4f66-a68e-8222c9f1d7bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:04:56 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-a6bfb104-e097-4b1c-9ae9-b1e7128de276 tempest-ProjectReaderTests-1831968860 None] Flow 'volume_create_manager' (f0f910ee-c155-4e51-af5a-86d8d4c805df) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 14:04:56 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-a6bfb104-e097-4b1c-9ae9-b1e7128de276 tempest-ProjectReaderTests-1831968860 None] Created volume successfully. Jul 13 14:04:57 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-9f98075c-f546-4022-ba44-61ea1f6d02fd tempest-ProjectReaderTests-1831968860 None] Acquiring lock "cinder-31c580f6-0889-4eaa-b7d5-fdfa253f42b6-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 14:04:57 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-9f98075c-f546-4022-ba44-61ea1f6d02fd tempest-ProjectReaderTests-1831968860 None] Lock "cinder-31c580f6-0889-4eaa-b7d5-fdfa253f42b6-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 14:04:57 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-9f98075c-f546-4022-ba44-61ea1f6d02fd tempest-ProjectReaderTests-1831968860 None] Acquiring lock "cinder-quobyte-31c580f6-0889-4eaa-b7d5-fdfa253f42b6" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 14:04:57 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-9f98075c-f546-4022-ba44-61ea1f6d02fd tempest-ProjectReaderTests-1831968860 None] Lock "cinder-quobyte-31c580f6-0889-4eaa-b7d5-fdfa253f42b6" acquired by "delete_volume" :: waited 0.017s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 14:04:57 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[f91a1f3f-a53e-438a-9a2f-5803ac538129]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 14:04:57 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-9f98075c-f546-4022-ba44-61ea1f6d02fd tempest-ProjectReaderTests-1831968860 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-31c580f6-0889-4eaa-b7d5-fdfa253f42b6 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:04:57 devstack sudo[104316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-31c580f6-0889-4eaa-b7d5-fdfa253f42b6 Jul 13 14:04:57 devstack sudo[104316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:04:57 devstack sudo[104316]: pam_unix(sudo:session): session closed for user root Jul 13 14:04:57 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-9f98075c-f546-4022-ba44-61ea1f6d02fd tempest-ProjectReaderTests-1831968860 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-31c580f6-0889-4eaa-b7d5-fdfa253f42b6" returned: 0 in 0.345s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:04:57 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-9f98075c-f546-4022-ba44-61ea1f6d02fd tempest-ProjectReaderTests-1831968860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-31c580f6-0889-4eaa-b7d5-fdfa253f42b6 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:04:57 devstack sudo[104322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-31c580f6-0889-4eaa-b7d5-fdfa253f42b6 Jul 13 14:04:57 devstack sudo[104322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:04:57 devstack sudo[104322]: pam_unix(sudo:session): session closed for user root Jul 13 14:04:57 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-9f98075c-f546-4022-ba44-61ea1f6d02fd tempest-ProjectReaderTests-1831968860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-31c580f6-0889-4eaa-b7d5-fdfa253f42b6" returned: 0 in 0.233s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:04:57 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-9f98075c-f546-4022-ba44-61ea1f6d02fd tempest-ProjectReaderTests-1831968860 None] Lock "cinder-quobyte-31c580f6-0889-4eaa-b7d5-fdfa253f42b6" released by "delete_volume" :: held 0.615s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 14:04:57 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-9f98075c-f546-4022-ba44-61ea1f6d02fd tempest-ProjectReaderTests-1831968860 None] Created reservations ['8401d5f2-fe57-4dfa-a73d-816ebf7eef68', '75185c19-5b26-4ef4-9da5-f3097c5b33e6', '6f81ba5d-39d5-449c-8b54-db8d993f8c1a', '7be5f487-c3b4-4794-8116-d1ccf096e69a'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 14:04:57 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-9f98075c-f546-4022-ba44-61ea1f6d02fd tempest-ProjectReaderTests-1831968860 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 14:04:57 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-9f98075c-f546-4022-ba44-61ea1f6d02fd tempest-ProjectReaderTests-1831968860 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 14:04:57 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-9f98075c-f546-4022-ba44-61ea1f6d02fd tempest-ProjectReaderTests-1831968860 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 14:04:57 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-9f98075c-f546-4022-ba44-61ea1f6d02fd tempest-ProjectReaderTests-1831968860 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 14:04:57 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-9f98075c-f546-4022-ba44-61ea1f6d02fd tempest-ProjectReaderTests-1831968860 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 14:04:57 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-9f98075c-f546-4022-ba44-61ea1f6d02fd tempest-ProjectReaderTests-1831968860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:04:57 devstack sudo[104325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 Jul 13 14:04:57 devstack sudo[104325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:04:58 devstack sudo[104325]: pam_unix(sudo:session): session closed for user root Jul 13 14:04:58 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-9f98075c-f546-4022-ba44-61ea1f6d02fd tempest-ProjectReaderTests-1831968860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78" returned: 0 in 0.252s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:04:58 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-9f98075c-f546-4022-ba44-61ea1f6d02fd tempest-ProjectReaderTests-1831968860 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 14:04:58 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-9f98075c-f546-4022-ba44-61ea1f6d02fd tempest-ProjectReaderTests-1831968860 None] Deleted volume successfully. Jul 13 14:04:58 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-9f98075c-f546-4022-ba44-61ea1f6d02fd tempest-ProjectReaderTests-1831968860 None] Lock "cinder-31c580f6-0889-4eaa-b7d5-fdfa253f42b6-delete_volume" released by "delete_volume" :: held 1.048s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 14:05:07 devstack cinder-volume[87098]: DEBUG dbcounter [-] [87098] Writing DB stats cinder:UPDATE=66,cinder:SELECT=42,cinder:DELETE=6,cinder:INSERT=17 {{(pid=87098) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 13 14:05:08 devstack cinder-volume[87098]: DEBUG dbcounter [-] [87098] Writing DB stats cinder:SELECT=43,cinder:INSERT=17,cinder:UPDATE=68,cinder:DELETE=3 {{(pid=87098) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 13 14:05:14 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f936063-5b98-4932-8e2f-5d9b5812c27e tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 14:05:14 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-5f936063-5b98-4932-8e2f-5d9b5812c27e tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] Flow 'volume_create_manager' (13e5322d-53f4-44e1-86fc-91610b874682) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 14:05:14 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-5f936063-5b98-4932-8e2f-5d9b5812c27e tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b046f0b-3eee-401d-bcec-337b9ee904ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:05:14 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-bdb478a6-026d-4357-9b1e-713cc61c660e tempest-CreateVolumesFromImageTest-2023936333 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 14:05:14 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-bdb478a6-026d-4357-9b1e-713cc61c660e tempest-CreateVolumesFromImageTest-2023936333 None] Flow 'volume_create_manager' (91078102-904e-4806-88d6-11f3982d2c0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 14:05:14 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-bdb478a6-026d-4357-9b1e-713cc61c660e tempest-CreateVolumesFromImageTest-2023936333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5434ed96-7f62-4f21-8d1c-1a398ce82af1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:05:14 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-5f936063-5b98-4932-8e2f-5d9b5812c27e tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b046f0b-3eee-401d-bcec-337b9ee904ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T12:05:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1834256304',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d070bd2-2d07-479c-af1c-755e25180abc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce428363f37447a983feb0713c40c3fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T12:05:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T12:05:14Z,use_quota=True,user_id='ff04b5282f6b4624ad35bd88c7edcc0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1147de8b-623b-426c-a13d-7fc824a80f67),volume_type_id=1147de8b-623b-426c-a13d-7fc824a80f67)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:05:14 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-5f936063-5b98-4932-8e2f-5d9b5812c27e tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85aed951-0899-40ed-aca5-86555f10c6c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:05:14 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-5f936063-5b98-4932-8e2f-5d9b5812c27e tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85aed951-0899-40ed-aca5-86555f10c6c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:05:14 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-5f936063-5b98-4932-8e2f-5d9b5812c27e tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3695ceca-63c1-4389-bf93-e715acc54510) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:05:14 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-5f936063-5b98-4932-8e2f-5d9b5812c27e tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3695ceca-63c1-4389-bf93-e715acc54510) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4d070bd2-2d07-479c-af1c-755e25180abc', 'volume_name': 'volume-4d070bd2-2d07-479c-af1c-755e25180abc', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:05:14 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-5f936063-5b98-4932-8e2f-5d9b5812c27e tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f9d0b76-c19f-49d1-ac77-73f6b118f6fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:05:14 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-5f936063-5b98-4932-8e2f-5d9b5812c27e tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f9d0b76-c19f-49d1-ac77-73f6b118f6fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:05:14 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-5f936063-5b98-4932-8e2f-5d9b5812c27e tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6614a802-c80b-4db3-bed9-447d582c8989) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:05:14 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-5f936063-5b98-4932-8e2f-5d9b5812c27e tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] Volume 4d070bd2-2d07-479c-af1c-755e25180abc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4d070bd2-2d07-479c-af1c-755e25180abc', 'volume_size': 1} Jul 13 14:05:14 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-5f936063-5b98-4932-8e2f-5d9b5812c27e tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 14:05:14 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-5f936063-5b98-4932-8e2f-5d9b5812c27e tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 14:05:14 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-5f936063-5b98-4932-8e2f-5d9b5812c27e tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T12:05:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1834256304',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d070bd2-2d07-479c-af1c-755e25180abc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce428363f37447a983feb0713c40c3fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T12:05:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T12:05:14Z,use_quota=True,user_id='ff04b5282f6b4624ad35bd88c7edcc0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1147de8b-623b-426c-a13d-7fc824a80f67),volume_type_id=1147de8b-623b-426c-a13d-7fc824a80f67)}" {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 13 14:05:14 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-5f936063-5b98-4932-8e2f-5d9b5812c27e tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] Creating volume 4d070bd2-2d07-479c-af1c-755e25180abc {{(pid=87098) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 13 14:05:14 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-5f936063-5b98-4932-8e2f-5d9b5812c27e tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 14:05:14 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-5f936063-5b98-4932-8e2f-5d9b5812c27e tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 14:05:14 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-5f936063-5b98-4932-8e2f-5d9b5812c27e tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 14:05:14 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-5f936063-5b98-4932-8e2f-5d9b5812c27e tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 14:05:14 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-5f936063-5b98-4932-8e2f-5d9b5812c27e tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 14:05:14 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-5f936063-5b98-4932-8e2f-5d9b5812c27e tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] Selected osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 14:05:14 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-5f936063-5b98-4932-8e2f-5d9b5812c27e tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] casted to osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 Jul 13 14:05:14 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-5f936063-5b98-4932-8e2f-5d9b5812c27e tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-4d070bd2-2d07-479c-af1c-755e25180abc 1073741824 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:05:14 devstack sudo[104384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-4d070bd2-2d07-479c-af1c-755e25180abc 1073741824 Jul 13 14:05:14 devstack sudo[104384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:05:14 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-bdb478a6-026d-4357-9b1e-713cc61c660e tempest-CreateVolumesFromImageTest-2023936333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5434ed96-7f62-4f21-8d1c-1a398ce82af1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T12:05:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-771214429',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0492cad4-2b54-476d-a2b1-49689cc4e80a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16626c0502e94380875bb6db7ec33fcb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T12:05:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T12:05:14Z,use_quota=True,user_id='1e590a8fc18d4a218e5b0405fa278118',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1147de8b-623b-426c-a13d-7fc824a80f67),volume_type_id=1147de8b-623b-426c-a13d-7fc824a80f67)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:05:14 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-bdb478a6-026d-4357-9b1e-713cc61c660e tempest-CreateVolumesFromImageTest-2023936333 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15a7a020-e2e5-401d-895c-88dce88dedfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:05:14 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-bdb478a6-026d-4357-9b1e-713cc61c660e tempest-CreateVolumesFromImageTest-2023936333 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15a7a020-e2e5-401d-895c-88dce88dedfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:05:14 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-bdb478a6-026d-4357-9b1e-713cc61c660e tempest-CreateVolumesFromImageTest-2023936333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd3d7047-66c1-44bf-8ece-152ddaf9651d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:05:14 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-bdb478a6-026d-4357-9b1e-713cc61c660e tempest-CreateVolumesFromImageTest-2023936333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd3d7047-66c1-44bf-8ece-152ddaf9651d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0492cad4-2b54-476d-a2b1-49689cc4e80a', 'volume_name': 'volume-0492cad4-2b54-476d-a2b1-49689cc4e80a', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:05:14 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-bdb478a6-026d-4357-9b1e-713cc61c660e tempest-CreateVolumesFromImageTest-2023936333 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e27f3ee2-f9d4-4d33-96c6-288f4af0bf28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:05:14 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-bdb478a6-026d-4357-9b1e-713cc61c660e tempest-CreateVolumesFromImageTest-2023936333 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e27f3ee2-f9d4-4d33-96c6-288f4af0bf28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:05:14 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-bdb478a6-026d-4357-9b1e-713cc61c660e tempest-CreateVolumesFromImageTest-2023936333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ef2b457-3874-4de3-8c95-ef2bdcd20aec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:05:14 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-bdb478a6-026d-4357-9b1e-713cc61c660e tempest-CreateVolumesFromImageTest-2023936333 None] Volume 0492cad4-2b54-476d-a2b1-49689cc4e80a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0492cad4-2b54-476d-a2b1-49689cc4e80a', 'volume_size': 1} Jul 13 14:05:14 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-bdb478a6-026d-4357-9b1e-713cc61c660e tempest-CreateVolumesFromImageTest-2023936333 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 14:05:14 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-4cd7dd67-8b50-43e0-a32b-9eb9a10636b1 tempest-CreateVolumesFromImageTest-2023936333 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 14:05:14 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-4cd7dd67-8b50-43e0-a32b-9eb9a10636b1 tempest-CreateVolumesFromImageTest-2023936333 None] Flow 'volume_create_manager' (d1f863a9-d57f-4e14-b3cc-2c4fda83ab47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 14:05:14 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-4cd7dd67-8b50-43e0-a32b-9eb9a10636b1 tempest-CreateVolumesFromImageTest-2023936333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98935037-e1a5-407e-811d-58d7631c1191) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:05:14 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-4cd7dd67-8b50-43e0-a32b-9eb9a10636b1 tempest-CreateVolumesFromImageTest-2023936333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98935037-e1a5-407e-811d-58d7631c1191) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T12:05:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1648731789',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c535624d-d908-4fc0-a974-a77a0ffed6d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16626c0502e94380875bb6db7ec33fcb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T12:05:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T12:05:14Z,use_quota=True,user_id='1e590a8fc18d4a218e5b0405fa278118',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1147de8b-623b-426c-a13d-7fc824a80f67),volume_type_id=1147de8b-623b-426c-a13d-7fc824a80f67)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:05:14 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-4cd7dd67-8b50-43e0-a32b-9eb9a10636b1 tempest-CreateVolumesFromImageTest-2023936333 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9987e75e-c0d1-4486-b371-a093fbec8a33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:05:14 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-4cd7dd67-8b50-43e0-a32b-9eb9a10636b1 tempest-CreateVolumesFromImageTest-2023936333 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9987e75e-c0d1-4486-b371-a093fbec8a33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:05:14 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-4cd7dd67-8b50-43e0-a32b-9eb9a10636b1 tempest-CreateVolumesFromImageTest-2023936333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f935e67-bc40-4127-b006-f2f890e4d7bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:05:14 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-4cd7dd67-8b50-43e0-a32b-9eb9a10636b1 tempest-CreateVolumesFromImageTest-2023936333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f935e67-bc40-4127-b006-f2f890e4d7bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c535624d-d908-4fc0-a974-a77a0ffed6d3', 'volume_name': 'volume-c535624d-d908-4fc0-a974-a77a0ffed6d3', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:05:14 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-4cd7dd67-8b50-43e0-a32b-9eb9a10636b1 tempest-CreateVolumesFromImageTest-2023936333 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1939cf7f-c330-4d5b-9500-eeadfe628d7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:05:14 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-4cd7dd67-8b50-43e0-a32b-9eb9a10636b1 tempest-CreateVolumesFromImageTest-2023936333 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1939cf7f-c330-4d5b-9500-eeadfe628d7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:05:14 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-4cd7dd67-8b50-43e0-a32b-9eb9a10636b1 tempest-CreateVolumesFromImageTest-2023936333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d471e6c-e668-4932-93ef-61128ad06db3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:05:14 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-4cd7dd67-8b50-43e0-a32b-9eb9a10636b1 tempest-CreateVolumesFromImageTest-2023936333 None] Volume c535624d-d908-4fc0-a974-a77a0ffed6d3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c535624d-d908-4fc0-a974-a77a0ffed6d3', 'volume_size': 1} Jul 13 14:05:14 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-4cd7dd67-8b50-43e0-a32b-9eb9a10636b1 tempest-CreateVolumesFromImageTest-2023936333 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 14:05:15 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-9dccdfbb-f0ab-4cb7-b190-deaac6e57ecd tempest-CreateVolumesFromImageTest-2023936333 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 14:05:15 devstack sudo[104384]: pam_unix(sudo:session): session closed for user root Jul 13 14:05:15 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-9dccdfbb-f0ab-4cb7-b190-deaac6e57ecd tempest-CreateVolumesFromImageTest-2023936333 None] Flow 'volume_create_manager' (5a7fc418-a7c2-4d68-8511-efe2e8cfcdcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 14:05:15 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-9dccdfbb-f0ab-4cb7-b190-deaac6e57ecd tempest-CreateVolumesFromImageTest-2023936333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c23bee9-ee34-4dea-963a-cc423d42839b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:05:15 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-7ba4d4e6-b358-4658-b783-f742e8f107e6 tempest-CreateVolumesFromSnapshotTest-61948078 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 14:05:15 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-7ba4d4e6-b358-4658-b783-f742e8f107e6 tempest-CreateVolumesFromSnapshotTest-61948078 None] Flow 'volume_create_manager' (0c7abcf8-97c4-42b4-8f4a-defae2464b08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 14:05:15 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-7ba4d4e6-b358-4658-b783-f742e8f107e6 tempest-CreateVolumesFromSnapshotTest-61948078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eff7fea9-984e-435a-bbe6-054fcc57cfea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:05:15 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-5f936063-5b98-4932-8e2f-5d9b5812c27e tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-4d070bd2-2d07-479c-af1c-755e25180abc 1073741824" returned: 0 in 0.964s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:05:15 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-9dccdfbb-f0ab-4cb7-b190-deaac6e57ecd tempest-CreateVolumesFromImageTest-2023936333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c23bee9-ee34-4dea-963a-cc423d42839b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T12:05:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1471636158',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52ed089e-51f8-4a31-94ad-916b18b90d5b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16626c0502e94380875bb6db7ec33fcb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T12:05:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T12:05:15Z,use_quota=True,user_id='1e590a8fc18d4a218e5b0405fa278118',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1147de8b-623b-426c-a13d-7fc824a80f67),volume_type_id=1147de8b-623b-426c-a13d-7fc824a80f67)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:05:15 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-9dccdfbb-f0ab-4cb7-b190-deaac6e57ecd tempest-CreateVolumesFromImageTest-2023936333 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c43a738c-db0e-4917-b00d-f9ae20c47c1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:05:15 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-9dccdfbb-f0ab-4cb7-b190-deaac6e57ecd tempest-CreateVolumesFromImageTest-2023936333 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c43a738c-db0e-4917-b00d-f9ae20c47c1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:05:15 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-9dccdfbb-f0ab-4cb7-b190-deaac6e57ecd tempest-CreateVolumesFromImageTest-2023936333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9c67c5e-d796-44a6-ba02-3bc3438df07f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:05:15 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-9dccdfbb-f0ab-4cb7-b190-deaac6e57ecd tempest-CreateVolumesFromImageTest-2023936333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9c67c5e-d796-44a6-ba02-3bc3438df07f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '52ed089e-51f8-4a31-94ad-916b18b90d5b', 'volume_name': 'volume-52ed089e-51f8-4a31-94ad-916b18b90d5b', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:05:15 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-9dccdfbb-f0ab-4cb7-b190-deaac6e57ecd tempest-CreateVolumesFromImageTest-2023936333 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad6f3761-152a-4376-b309-a3b443f0c2f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:05:15 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-9dccdfbb-f0ab-4cb7-b190-deaac6e57ecd tempest-CreateVolumesFromImageTest-2023936333 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad6f3761-152a-4376-b309-a3b443f0c2f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:05:15 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-9dccdfbb-f0ab-4cb7-b190-deaac6e57ecd tempest-CreateVolumesFromImageTest-2023936333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5a2ff14-2cbb-459c-af1c-982e2109ba6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:05:15 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-9dccdfbb-f0ab-4cb7-b190-deaac6e57ecd tempest-CreateVolumesFromImageTest-2023936333 None] Volume 52ed089e-51f8-4a31-94ad-916b18b90d5b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-52ed089e-51f8-4a31-94ad-916b18b90d5b', 'volume_size': 1} Jul 13 14:05:15 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-9dccdfbb-f0ab-4cb7-b190-deaac6e57ecd tempest-CreateVolumesFromImageTest-2023936333 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 14:05:15 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-7ba4d4e6-b358-4658-b783-f742e8f107e6 tempest-CreateVolumesFromSnapshotTest-61948078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eff7fea9-984e-435a-bbe6-054fcc57cfea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T12:05:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-446546692',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47619ab5-bc64-413d-bb7d-e74c118fdb97,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f84a0aabc104f4da5cc693a0132f06c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T12:05:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T12:05:15Z,use_quota=True,user_id='1955b577a12b4d9daf79921a01a6e1d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1147de8b-623b-426c-a13d-7fc824a80f67),volume_type_id=1147de8b-623b-426c-a13d-7fc824a80f67)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:05:15 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-7ba4d4e6-b358-4658-b783-f742e8f107e6 tempest-CreateVolumesFromSnapshotTest-61948078 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e3616aa-5a19-4c7f-ac79-5594ef7c7fd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:05:15 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-7ba4d4e6-b358-4658-b783-f742e8f107e6 tempest-CreateVolumesFromSnapshotTest-61948078 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e3616aa-5a19-4c7f-ac79-5594ef7c7fd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:05:15 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-7ba4d4e6-b358-4658-b783-f742e8f107e6 tempest-CreateVolumesFromSnapshotTest-61948078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01007767-0342-4545-aba3-67ca01663c57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:05:15 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-7ba4d4e6-b358-4658-b783-f742e8f107e6 tempest-CreateVolumesFromSnapshotTest-61948078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01007767-0342-4545-aba3-67ca01663c57) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '47619ab5-bc64-413d-bb7d-e74c118fdb97', 'volume_name': 'volume-47619ab5-bc64-413d-bb7d-e74c118fdb97', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:05:15 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-7ba4d4e6-b358-4658-b783-f742e8f107e6 tempest-CreateVolumesFromSnapshotTest-61948078 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52d7c92f-96f8-46b3-9283-67ec68aa17bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:05:15 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-7ba4d4e6-b358-4658-b783-f742e8f107e6 tempest-CreateVolumesFromSnapshotTest-61948078 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52d7c92f-96f8-46b3-9283-67ec68aa17bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:05:15 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-7ba4d4e6-b358-4658-b783-f742e8f107e6 tempest-CreateVolumesFromSnapshotTest-61948078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18f6c4f2-1e9c-4b2c-8708-f88a0c07a622) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:05:15 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-7ba4d4e6-b358-4658-b783-f742e8f107e6 tempest-CreateVolumesFromSnapshotTest-61948078 None] Volume 47619ab5-bc64-413d-bb7d-e74c118fdb97: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-47619ab5-bc64-413d-bb7d-e74c118fdb97', 'volume_size': 1} Jul 13 14:05:15 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-7ba4d4e6-b358-4658-b783-f742e8f107e6 tempest-CreateVolumesFromSnapshotTest-61948078 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 14:05:15 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-67653463-565b-409a-989b-ea7b00635c4d tempest-CreateVolumesFromImageTest-2023936333 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 14:05:15 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-67653463-565b-409a-989b-ea7b00635c4d tempest-CreateVolumesFromImageTest-2023936333 None] Flow 'volume_create_manager' (7a3d056e-56c1-4d18-8509-5674b7799fbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 14:05:15 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-67653463-565b-409a-989b-ea7b00635c4d tempest-CreateVolumesFromImageTest-2023936333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eebdbbde-a62a-4a64-b319-008db451fd56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:05:15 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-5f936063-5b98-4932-8e2f-5d9b5812c27e tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-4d070bd2-2d07-479c-af1c-755e25180abc {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:05:15 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-67653463-565b-409a-989b-ea7b00635c4d tempest-CreateVolumesFromImageTest-2023936333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eebdbbde-a62a-4a64-b319-008db451fd56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T12:05:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1594393654',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd5e6b83-8d85-4b89-b0cf-5a1df3139a18,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16626c0502e94380875bb6db7ec33fcb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T12:05:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T12:05:15Z,use_quota=True,user_id='1e590a8fc18d4a218e5b0405fa278118',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1147de8b-623b-426c-a13d-7fc824a80f67),volume_type_id=1147de8b-623b-426c-a13d-7fc824a80f67)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:05:15 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-67653463-565b-409a-989b-ea7b00635c4d tempest-CreateVolumesFromImageTest-2023936333 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82a2d609-ef5a-4b30-9e74-e10b96f75664) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:05:15 devstack sudo[104414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-4d070bd2-2d07-479c-af1c-755e25180abc Jul 13 14:05:15 devstack sudo[104414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:05:15 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-67653463-565b-409a-989b-ea7b00635c4d tempest-CreateVolumesFromImageTest-2023936333 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82a2d609-ef5a-4b30-9e74-e10b96f75664) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:05:15 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-67653463-565b-409a-989b-ea7b00635c4d tempest-CreateVolumesFromImageTest-2023936333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef69f303-d201-4442-a1e9-a5c30639003e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:05:15 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-67653463-565b-409a-989b-ea7b00635c4d tempest-CreateVolumesFromImageTest-2023936333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef69f303-d201-4442-a1e9-a5c30639003e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cd5e6b83-8d85-4b89-b0cf-5a1df3139a18', 'volume_name': 'volume-cd5e6b83-8d85-4b89-b0cf-5a1df3139a18', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:05:15 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-67653463-565b-409a-989b-ea7b00635c4d tempest-CreateVolumesFromImageTest-2023936333 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a2bbb86-bc5e-42fe-97f4-a43432ecb8ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:05:15 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-67653463-565b-409a-989b-ea7b00635c4d tempest-CreateVolumesFromImageTest-2023936333 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a2bbb86-bc5e-42fe-97f4-a43432ecb8ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:05:15 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-67653463-565b-409a-989b-ea7b00635c4d tempest-CreateVolumesFromImageTest-2023936333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e632f5af-0148-4e67-a6b5-5ee6eedca088) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:05:15 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-67653463-565b-409a-989b-ea7b00635c4d tempest-CreateVolumesFromImageTest-2023936333 None] Volume cd5e6b83-8d85-4b89-b0cf-5a1df3139a18: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cd5e6b83-8d85-4b89-b0cf-5a1df3139a18', 'volume_size': 1} Jul 13 14:05:15 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-67653463-565b-409a-989b-ea7b00635c4d tempest-CreateVolumesFromImageTest-2023936333 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 14:05:15 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-cac5837c-88f9-4e15-bbd3-9d83f3e178f0 tempest-CreateVolumesFromImageTest-2023936333 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 14:05:15 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-cac5837c-88f9-4e15-bbd3-9d83f3e178f0 tempest-CreateVolumesFromImageTest-2023936333 None] Flow 'volume_create_manager' (074d7a6d-bf9c-45c0-9f05-7a6b6e4ca0e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 14:05:15 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-cac5837c-88f9-4e15-bbd3-9d83f3e178f0 tempest-CreateVolumesFromImageTest-2023936333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69a8de07-7fc0-4aab-90d0-97711b790d3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:05:15 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-cac5837c-88f9-4e15-bbd3-9d83f3e178f0 tempest-CreateVolumesFromImageTest-2023936333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69a8de07-7fc0-4aab-90d0-97711b790d3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T12:05:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-861283907',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d7b9d30-7299-4a2c-83dc-9e9dcd2cf61a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16626c0502e94380875bb6db7ec33fcb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T12:05:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T12:05:16Z,use_quota=True,user_id='1e590a8fc18d4a218e5b0405fa278118',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1147de8b-623b-426c-a13d-7fc824a80f67),volume_type_id=1147de8b-623b-426c-a13d-7fc824a80f67)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:05:15 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-cac5837c-88f9-4e15-bbd3-9d83f3e178f0 tempest-CreateVolumesFromImageTest-2023936333 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (198805f5-a8ab-4b3c-a4f7-34f4433540e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:05:15 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-cac5837c-88f9-4e15-bbd3-9d83f3e178f0 tempest-CreateVolumesFromImageTest-2023936333 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (198805f5-a8ab-4b3c-a4f7-34f4433540e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:05:15 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-cac5837c-88f9-4e15-bbd3-9d83f3e178f0 tempest-CreateVolumesFromImageTest-2023936333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (599a7a9e-1f65-491a-9f2f-00f26b5c3119) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:05:15 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-cac5837c-88f9-4e15-bbd3-9d83f3e178f0 tempest-CreateVolumesFromImageTest-2023936333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (599a7a9e-1f65-491a-9f2f-00f26b5c3119) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4d7b9d30-7299-4a2c-83dc-9e9dcd2cf61a', 'volume_name': 'volume-4d7b9d30-7299-4a2c-83dc-9e9dcd2cf61a', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:05:15 devstack sudo[104414]: pam_unix(sudo:session): session closed for user root Jul 13 14:05:15 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-cac5837c-88f9-4e15-bbd3-9d83f3e178f0 tempest-CreateVolumesFromImageTest-2023936333 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5b08054-a2d9-4907-9227-724ffb8ed9d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:05:15 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-cac5837c-88f9-4e15-bbd3-9d83f3e178f0 tempest-CreateVolumesFromImageTest-2023936333 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5b08054-a2d9-4907-9227-724ffb8ed9d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:05:15 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-cac5837c-88f9-4e15-bbd3-9d83f3e178f0 tempest-CreateVolumesFromImageTest-2023936333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7b298cd-c9cb-40de-8980-012b73dead12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:05:15 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-cac5837c-88f9-4e15-bbd3-9d83f3e178f0 tempest-CreateVolumesFromImageTest-2023936333 None] Volume 4d7b9d30-7299-4a2c-83dc-9e9dcd2cf61a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4d7b9d30-7299-4a2c-83dc-9e9dcd2cf61a', 'volume_size': 1} Jul 13 14:05:15 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-cac5837c-88f9-4e15-bbd3-9d83f3e178f0 tempest-CreateVolumesFromImageTest-2023936333 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 14:05:15 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-5f936063-5b98-4932-8e2f-5d9b5812c27e tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-4d070bd2-2d07-479c-af1c-755e25180abc" returned: 0 in 0.364s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:05:15 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-5f936063-5b98-4932-8e2f-5d9b5812c27e tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] <== create_volume: return (1522ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'} {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 13 14:05:15 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-5f936063-5b98-4932-8e2f-5d9b5812c27e tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.525s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 14:05:15 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-bdb478a6-026d-4357-9b1e-713cc61c660e tempest-CreateVolumesFromImageTest-2023936333 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.424s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 14:05:15 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-bdb478a6-026d-4357-9b1e-713cc61c660e tempest-CreateVolumesFromImageTest-2023936333 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T12:05:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-771214429',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0492cad4-2b54-476d-a2b1-49689cc4e80a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16626c0502e94380875bb6db7ec33fcb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T12:05:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T12:05:14Z,use_quota=True,user_id='1e590a8fc18d4a218e5b0405fa278118',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1147de8b-623b-426c-a13d-7fc824a80f67),volume_type_id=1147de8b-623b-426c-a13d-7fc824a80f67)}" {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 13 14:05:15 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-bdb478a6-026d-4357-9b1e-713cc61c660e tempest-CreateVolumesFromImageTest-2023936333 None] Creating volume 0492cad4-2b54-476d-a2b1-49689cc4e80a {{(pid=87098) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 13 14:05:15 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-bdb478a6-026d-4357-9b1e-713cc61c660e tempest-CreateVolumesFromImageTest-2023936333 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 14:05:15 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-bdb478a6-026d-4357-9b1e-713cc61c660e tempest-CreateVolumesFromImageTest-2023936333 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 14:05:15 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-bdb478a6-026d-4357-9b1e-713cc61c660e tempest-CreateVolumesFromImageTest-2023936333 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 14:05:15 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-bdb478a6-026d-4357-9b1e-713cc61c660e tempest-CreateVolumesFromImageTest-2023936333 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 14:05:15 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-bdb478a6-026d-4357-9b1e-713cc61c660e tempest-CreateVolumesFromImageTest-2023936333 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 14:05:15 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-bdb478a6-026d-4357-9b1e-713cc61c660e tempest-CreateVolumesFromImageTest-2023936333 None] Selected osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 14:05:15 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-bdb478a6-026d-4357-9b1e-713cc61c660e tempest-CreateVolumesFromImageTest-2023936333 None] casted to osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 Jul 13 14:05:15 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-bdb478a6-026d-4357-9b1e-713cc61c660e tempest-CreateVolumesFromImageTest-2023936333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-0492cad4-2b54-476d-a2b1-49689cc4e80a 1073741824 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:05:15 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-5f936063-5b98-4932-8e2f-5d9b5812c27e tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6614a802-c80b-4db3-bed9-447d582c8989) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4d070bd2-2d07-479c-af1c-755e25180abc', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:05:15 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-5f936063-5b98-4932-8e2f-5d9b5812c27e tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a1ecb05-ac90-490c-a8e1-a7d5863d0f21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:05:15 devstack sudo[104417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-0492cad4-2b54-476d-a2b1-49689cc4e80a 1073741824 Jul 13 14:05:15 devstack sudo[104417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:05:15 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-5f936063-5b98-4932-8e2f-5d9b5812c27e tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] Volume volume-4d070bd2-2d07-479c-af1c-755e25180abc (4d070bd2-2d07-479c-af1c-755e25180abc): created successfully Jul 13 14:05:15 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-5f936063-5b98-4932-8e2f-5d9b5812c27e tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a1ecb05-ac90-490c-a8e1-a7d5863d0f21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:05:15 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-5f936063-5b98-4932-8e2f-5d9b5812c27e tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] Flow 'volume_create_manager' (13e5322d-53f4-44e1-86fc-91610b874682) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 14:05:15 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-5f936063-5b98-4932-8e2f-5d9b5812c27e tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] Created volume successfully. Jul 13 14:05:16 devstack sudo[104417]: pam_unix(sudo:session): session closed for user root Jul 13 14:05:16 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-bdb478a6-026d-4357-9b1e-713cc61c660e tempest-CreateVolumesFromImageTest-2023936333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-0492cad4-2b54-476d-a2b1-49689cc4e80a 1073741824" returned: 0 in 0.493s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:05:16 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-bdb478a6-026d-4357-9b1e-713cc61c660e tempest-CreateVolumesFromImageTest-2023936333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-0492cad4-2b54-476d-a2b1-49689cc4e80a {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:05:16 devstack sudo[104424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-0492cad4-2b54-476d-a2b1-49689cc4e80a Jul 13 14:05:16 devstack sudo[104424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:05:16 devstack sudo[104424]: pam_unix(sudo:session): session closed for user root Jul 13 14:05:16 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-bdb478a6-026d-4357-9b1e-713cc61c660e tempest-CreateVolumesFromImageTest-2023936333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-0492cad4-2b54-476d-a2b1-49689cc4e80a" returned: 0 in 0.248s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:05:16 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-bdb478a6-026d-4357-9b1e-713cc61c660e tempest-CreateVolumesFromImageTest-2023936333 None] <== create_volume: return (781ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'} {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 13 14:05:16 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-bdb478a6-026d-4357-9b1e-713cc61c660e tempest-CreateVolumesFromImageTest-2023936333 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.784s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 14:05:16 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-4cd7dd67-8b50-43e0-a32b-9eb9a10636b1 tempest-CreateVolumesFromImageTest-2023936333 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.074s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 14:05:16 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-4cd7dd67-8b50-43e0-a32b-9eb9a10636b1 tempest-CreateVolumesFromImageTest-2023936333 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T12:05:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1648731789',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c535624d-d908-4fc0-a974-a77a0ffed6d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16626c0502e94380875bb6db7ec33fcb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T12:05:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T12:05:14Z,use_quota=True,user_id='1e590a8fc18d4a218e5b0405fa278118',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1147de8b-623b-426c-a13d-7fc824a80f67),volume_type_id=1147de8b-623b-426c-a13d-7fc824a80f67)}" {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 13 14:05:16 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-4cd7dd67-8b50-43e0-a32b-9eb9a10636b1 tempest-CreateVolumesFromImageTest-2023936333 None] Creating volume c535624d-d908-4fc0-a974-a77a0ffed6d3 {{(pid=87098) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 13 14:05:16 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-4cd7dd67-8b50-43e0-a32b-9eb9a10636b1 tempest-CreateVolumesFromImageTest-2023936333 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 14:05:16 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-4cd7dd67-8b50-43e0-a32b-9eb9a10636b1 tempest-CreateVolumesFromImageTest-2023936333 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 14:05:16 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-4cd7dd67-8b50-43e0-a32b-9eb9a10636b1 tempest-CreateVolumesFromImageTest-2023936333 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 14:05:16 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-4cd7dd67-8b50-43e0-a32b-9eb9a10636b1 tempest-CreateVolumesFromImageTest-2023936333 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 14:05:16 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-4cd7dd67-8b50-43e0-a32b-9eb9a10636b1 tempest-CreateVolumesFromImageTest-2023936333 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 14:05:16 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-4cd7dd67-8b50-43e0-a32b-9eb9a10636b1 tempest-CreateVolumesFromImageTest-2023936333 None] Selected osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 14:05:16 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-4cd7dd67-8b50-43e0-a32b-9eb9a10636b1 tempest-CreateVolumesFromImageTest-2023936333 None] casted to osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 Jul 13 14:05:16 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-4cd7dd67-8b50-43e0-a32b-9eb9a10636b1 tempest-CreateVolumesFromImageTest-2023936333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-c535624d-d908-4fc0-a974-a77a0ffed6d3 1073741824 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:05:16 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-bdb478a6-026d-4357-9b1e-713cc61c660e tempest-CreateVolumesFromImageTest-2023936333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ef2b457-3874-4de3-8c95-ef2bdcd20aec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0492cad4-2b54-476d-a2b1-49689cc4e80a', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:05:16 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-bdb478a6-026d-4357-9b1e-713cc61c660e tempest-CreateVolumesFromImageTest-2023936333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (316a2085-8d1e-4ed4-a809-54d688d927b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:05:16 devstack sudo[104427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-c535624d-d908-4fc0-a974-a77a0ffed6d3 1073741824 Jul 13 14:05:16 devstack sudo[104427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:05:16 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-bdb478a6-026d-4357-9b1e-713cc61c660e tempest-CreateVolumesFromImageTest-2023936333 None] Volume volume-0492cad4-2b54-476d-a2b1-49689cc4e80a (0492cad4-2b54-476d-a2b1-49689cc4e80a): created successfully Jul 13 14:05:16 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-bdb478a6-026d-4357-9b1e-713cc61c660e tempest-CreateVolumesFromImageTest-2023936333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (316a2085-8d1e-4ed4-a809-54d688d927b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:05:16 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-bdb478a6-026d-4357-9b1e-713cc61c660e tempest-CreateVolumesFromImageTest-2023936333 None] Flow 'volume_create_manager' (91078102-904e-4806-88d6-11f3982d2c0e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 14:05:16 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-bdb478a6-026d-4357-9b1e-713cc61c660e tempest-CreateVolumesFromImageTest-2023936333 None] Created volume successfully. Jul 13 14:05:17 devstack sudo[104427]: pam_unix(sudo:session): session closed for user root Jul 13 14:05:17 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-4cd7dd67-8b50-43e0-a32b-9eb9a10636b1 tempest-CreateVolumesFromImageTest-2023936333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-c535624d-d908-4fc0-a974-a77a0ffed6d3 1073741824" returned: 0 in 0.520s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:05:17 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-4cd7dd67-8b50-43e0-a32b-9eb9a10636b1 tempest-CreateVolumesFromImageTest-2023936333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-c535624d-d908-4fc0-a974-a77a0ffed6d3 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:05:17 devstack sudo[104434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-c535624d-d908-4fc0-a974-a77a0ffed6d3 Jul 13 14:05:17 devstack sudo[104434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:05:17 devstack sudo[104434]: pam_unix(sudo:session): session closed for user root Jul 13 14:05:17 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-4cd7dd67-8b50-43e0-a32b-9eb9a10636b1 tempest-CreateVolumesFromImageTest-2023936333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-c535624d-d908-4fc0-a974-a77a0ffed6d3" returned: 0 in 0.278s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:05:17 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-4cd7dd67-8b50-43e0-a32b-9eb9a10636b1 tempest-CreateVolumesFromImageTest-2023936333 None] <== create_volume: return (845ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'} {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 13 14:05:17 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-4cd7dd67-8b50-43e0-a32b-9eb9a10636b1 tempest-CreateVolumesFromImageTest-2023936333 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.848s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 14:05:17 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-9dccdfbb-f0ab-4cb7-b190-deaac6e57ecd tempest-CreateVolumesFromImageTest-2023936333 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.122s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 14:05:17 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-9dccdfbb-f0ab-4cb7-b190-deaac6e57ecd tempest-CreateVolumesFromImageTest-2023936333 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T12:05:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1471636158',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52ed089e-51f8-4a31-94ad-916b18b90d5b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16626c0502e94380875bb6db7ec33fcb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T12:05:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T12:05:15Z,use_quota=True,user_id='1e590a8fc18d4a218e5b0405fa278118',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1147de8b-623b-426c-a13d-7fc824a80f67),volume_type_id=1147de8b-623b-426c-a13d-7fc824a80f67)}" {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 13 14:05:17 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-9dccdfbb-f0ab-4cb7-b190-deaac6e57ecd tempest-CreateVolumesFromImageTest-2023936333 None] Creating volume 52ed089e-51f8-4a31-94ad-916b18b90d5b {{(pid=87098) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 13 14:05:17 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-9dccdfbb-f0ab-4cb7-b190-deaac6e57ecd tempest-CreateVolumesFromImageTest-2023936333 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 14:05:17 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-9dccdfbb-f0ab-4cb7-b190-deaac6e57ecd tempest-CreateVolumesFromImageTest-2023936333 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 14:05:17 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-9dccdfbb-f0ab-4cb7-b190-deaac6e57ecd tempest-CreateVolumesFromImageTest-2023936333 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 14:05:17 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-9dccdfbb-f0ab-4cb7-b190-deaac6e57ecd tempest-CreateVolumesFromImageTest-2023936333 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 14:05:17 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-9dccdfbb-f0ab-4cb7-b190-deaac6e57ecd tempest-CreateVolumesFromImageTest-2023936333 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 14:05:17 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-9dccdfbb-f0ab-4cb7-b190-deaac6e57ecd tempest-CreateVolumesFromImageTest-2023936333 None] Selected osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 14:05:17 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-9dccdfbb-f0ab-4cb7-b190-deaac6e57ecd tempest-CreateVolumesFromImageTest-2023936333 None] casted to osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 Jul 13 14:05:17 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-9dccdfbb-f0ab-4cb7-b190-deaac6e57ecd tempest-CreateVolumesFromImageTest-2023936333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-52ed089e-51f8-4a31-94ad-916b18b90d5b 1073741824 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:05:17 devstack sudo[104437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-52ed089e-51f8-4a31-94ad-916b18b90d5b 1073741824 Jul 13 14:05:17 devstack sudo[104437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:05:17 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-4cd7dd67-8b50-43e0-a32b-9eb9a10636b1 tempest-CreateVolumesFromImageTest-2023936333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d471e6c-e668-4932-93ef-61128ad06db3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c535624d-d908-4fc0-a974-a77a0ffed6d3', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:05:17 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-4cd7dd67-8b50-43e0-a32b-9eb9a10636b1 tempest-CreateVolumesFromImageTest-2023936333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea4cee4c-9611-4208-b216-e7060c2d0a9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:05:17 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-4cd7dd67-8b50-43e0-a32b-9eb9a10636b1 tempest-CreateVolumesFromImageTest-2023936333 None] Volume volume-c535624d-d908-4fc0-a974-a77a0ffed6d3 (c535624d-d908-4fc0-a974-a77a0ffed6d3): created successfully Jul 13 14:05:17 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-4cd7dd67-8b50-43e0-a32b-9eb9a10636b1 tempest-CreateVolumesFromImageTest-2023936333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea4cee4c-9611-4208-b216-e7060c2d0a9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:05:17 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-4cd7dd67-8b50-43e0-a32b-9eb9a10636b1 tempest-CreateVolumesFromImageTest-2023936333 None] Flow 'volume_create_manager' (d1f863a9-d57f-4e14-b3cc-2c4fda83ab47) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 14:05:17 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b9bf4dd-d0aa-4973-91b8-3e55cdc725d3 tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 14:05:17 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-5b9bf4dd-d0aa-4973-91b8-3e55cdc725d3 tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] Flow 'volume_create_manager' (0eda7882-a75b-43f9-8755-7a9100e35ded) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 14:05:17 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-5b9bf4dd-d0aa-4973-91b8-3e55cdc725d3 tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6602498-9726-4e50-aa89-7d3ef569e61f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:05:17 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-5b9bf4dd-d0aa-4973-91b8-3e55cdc725d3 tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6602498-9726-4e50-aa89-7d3ef569e61f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T12:05:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1223597488',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ca97dda-8158-4574-86d3-1e1b556f6b1a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce428363f37447a983feb0713c40c3fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T12:05:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T12:05:17Z,use_quota=True,user_id='ff04b5282f6b4624ad35bd88c7edcc0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1147de8b-623b-426c-a13d-7fc824a80f67),volume_type_id=1147de8b-623b-426c-a13d-7fc824a80f67)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:05:17 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-5b9bf4dd-d0aa-4973-91b8-3e55cdc725d3 tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (977741a4-8eb4-428c-94d1-6ee50d96c0c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:05:17 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-5b9bf4dd-d0aa-4973-91b8-3e55cdc725d3 tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (977741a4-8eb4-428c-94d1-6ee50d96c0c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:05:17 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-5b9bf4dd-d0aa-4973-91b8-3e55cdc725d3 tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5bb38599-9dd7-407c-b307-161c89e89b48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:05:17 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-5b9bf4dd-d0aa-4973-91b8-3e55cdc725d3 tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5bb38599-9dd7-407c-b307-161c89e89b48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1ca97dda-8158-4574-86d3-1e1b556f6b1a', 'volume_name': 'volume-1ca97dda-8158-4574-86d3-1e1b556f6b1a', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:05:17 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-5b9bf4dd-d0aa-4973-91b8-3e55cdc725d3 tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14dffda6-fb55-4c37-8da3-4bb90640d30d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:05:17 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-5b9bf4dd-d0aa-4973-91b8-3e55cdc725d3 tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14dffda6-fb55-4c37-8da3-4bb90640d30d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:05:17 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-5b9bf4dd-d0aa-4973-91b8-3e55cdc725d3 tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f62fe795-2c68-480e-804f-34411f2b5c77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:05:17 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-5b9bf4dd-d0aa-4973-91b8-3e55cdc725d3 tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] Volume 1ca97dda-8158-4574-86d3-1e1b556f6b1a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1ca97dda-8158-4574-86d3-1e1b556f6b1a', 'volume_size': 1} Jul 13 14:05:17 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-5b9bf4dd-d0aa-4973-91b8-3e55cdc725d3 tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 14:05:17 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-4cd7dd67-8b50-43e0-a32b-9eb9a10636b1 tempest-CreateVolumesFromImageTest-2023936333 None] Created volume successfully. Jul 13 14:05:17 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-5df61d87-7d36-4566-86d0-5d8e78fda849 tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 14:05:17 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-5df61d87-7d36-4566-86d0-5d8e78fda849 tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] Flow 'volume_create_manager' (be4400c4-6aa5-452a-9f15-b34956bf7beb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 14:05:17 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-5df61d87-7d36-4566-86d0-5d8e78fda849 tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8b9423d-b263-415b-97da-926896f9b39a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:05:18 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-5df61d87-7d36-4566-86d0-5d8e78fda849 tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8b9423d-b263-415b-97da-926896f9b39a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T12:05:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1018139855',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=094b9914-584b-481f-9218-bddb49e0aa75,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce428363f37447a983feb0713c40c3fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T12:05:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T12:05:18Z,use_quota=True,user_id='ff04b5282f6b4624ad35bd88c7edcc0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1147de8b-623b-426c-a13d-7fc824a80f67),volume_type_id=1147de8b-623b-426c-a13d-7fc824a80f67)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:05:18 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-5df61d87-7d36-4566-86d0-5d8e78fda849 tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (552b86a7-acff-4c81-8e81-fabfe8bfe746) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:05:18 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-5df61d87-7d36-4566-86d0-5d8e78fda849 tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (552b86a7-acff-4c81-8e81-fabfe8bfe746) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:05:18 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-5df61d87-7d36-4566-86d0-5d8e78fda849 tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67e03468-f58e-451b-8c65-9d6d0ee79e50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:05:18 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-5df61d87-7d36-4566-86d0-5d8e78fda849 tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67e03468-f58e-451b-8c65-9d6d0ee79e50) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '094b9914-584b-481f-9218-bddb49e0aa75', 'volume_name': 'volume-094b9914-584b-481f-9218-bddb49e0aa75', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:05:18 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-5df61d87-7d36-4566-86d0-5d8e78fda849 tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07fc2f38-c876-4494-a719-8e50f461e3f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:05:18 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-5df61d87-7d36-4566-86d0-5d8e78fda849 tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07fc2f38-c876-4494-a719-8e50f461e3f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:05:18 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-5df61d87-7d36-4566-86d0-5d8e78fda849 tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (edc6dab8-f0de-40ab-a971-94ee13d88061) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:05:18 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-5df61d87-7d36-4566-86d0-5d8e78fda849 tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] Volume 094b9914-584b-481f-9218-bddb49e0aa75: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-094b9914-584b-481f-9218-bddb49e0aa75', 'volume_size': 1} Jul 13 14:05:18 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-5df61d87-7d36-4566-86d0-5d8e78fda849 tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 14:05:18 devstack sudo[104437]: pam_unix(sudo:session): session closed for user root Jul 13 14:05:18 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-9dccdfbb-f0ab-4cb7-b190-deaac6e57ecd tempest-CreateVolumesFromImageTest-2023936333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-52ed089e-51f8-4a31-94ad-916b18b90d5b 1073741824" returned: 0 in 0.653s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:05:18 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-9dccdfbb-f0ab-4cb7-b190-deaac6e57ecd tempest-CreateVolumesFromImageTest-2023936333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-52ed089e-51f8-4a31-94ad-916b18b90d5b {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:05:18 devstack sudo[104443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-52ed089e-51f8-4a31-94ad-916b18b90d5b Jul 13 14:05:18 devstack sudo[104443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:05:18 devstack sudo[104443]: pam_unix(sudo:session): session closed for user root Jul 13 14:05:18 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-9dccdfbb-f0ab-4cb7-b190-deaac6e57ecd tempest-CreateVolumesFromImageTest-2023936333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-52ed089e-51f8-4a31-94ad-916b18b90d5b" returned: 0 in 0.337s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:05:18 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-9dccdfbb-f0ab-4cb7-b190-deaac6e57ecd tempest-CreateVolumesFromImageTest-2023936333 None] <== create_volume: return (1041ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'} {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 13 14:05:18 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-9dccdfbb-f0ab-4cb7-b190-deaac6e57ecd tempest-CreateVolumesFromImageTest-2023936333 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.045s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 14:05:18 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-7ba4d4e6-b358-4658-b783-f742e8f107e6 tempest-CreateVolumesFromSnapshotTest-61948078 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.112s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 14:05:18 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-7ba4d4e6-b358-4658-b783-f742e8f107e6 tempest-CreateVolumesFromSnapshotTest-61948078 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T12:05:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-446546692',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47619ab5-bc64-413d-bb7d-e74c118fdb97,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f84a0aabc104f4da5cc693a0132f06c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T12:05:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T12:05:15Z,use_quota=True,user_id='1955b577a12b4d9daf79921a01a6e1d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1147de8b-623b-426c-a13d-7fc824a80f67),volume_type_id=1147de8b-623b-426c-a13d-7fc824a80f67)}" {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 13 14:05:18 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-7ba4d4e6-b358-4658-b783-f742e8f107e6 tempest-CreateVolumesFromSnapshotTest-61948078 None] Creating volume 47619ab5-bc64-413d-bb7d-e74c118fdb97 {{(pid=87098) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 13 14:05:18 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-7ba4d4e6-b358-4658-b783-f742e8f107e6 tempest-CreateVolumesFromSnapshotTest-61948078 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 14:05:18 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-7ba4d4e6-b358-4658-b783-f742e8f107e6 tempest-CreateVolumesFromSnapshotTest-61948078 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 14:05:18 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-7ba4d4e6-b358-4658-b783-f742e8f107e6 tempest-CreateVolumesFromSnapshotTest-61948078 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 14:05:18 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-7ba4d4e6-b358-4658-b783-f742e8f107e6 tempest-CreateVolumesFromSnapshotTest-61948078 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 14:05:18 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-7ba4d4e6-b358-4658-b783-f742e8f107e6 tempest-CreateVolumesFromSnapshotTest-61948078 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 14:05:18 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-7ba4d4e6-b358-4658-b783-f742e8f107e6 tempest-CreateVolumesFromSnapshotTest-61948078 None] Selected osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 14:05:18 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-7ba4d4e6-b358-4658-b783-f742e8f107e6 tempest-CreateVolumesFromSnapshotTest-61948078 None] casted to osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 Jul 13 14:05:18 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-7ba4d4e6-b358-4658-b783-f742e8f107e6 tempest-CreateVolumesFromSnapshotTest-61948078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-47619ab5-bc64-413d-bb7d-e74c118fdb97 1073741824 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:05:18 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-9dccdfbb-f0ab-4cb7-b190-deaac6e57ecd tempest-CreateVolumesFromImageTest-2023936333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5a2ff14-2cbb-459c-af1c-982e2109ba6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-52ed089e-51f8-4a31-94ad-916b18b90d5b', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:05:18 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-9dccdfbb-f0ab-4cb7-b190-deaac6e57ecd tempest-CreateVolumesFromImageTest-2023936333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6a1261e-8748-4701-8c8e-ad4f18a03313) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:05:18 devstack sudo[104448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-47619ab5-bc64-413d-bb7d-e74c118fdb97 1073741824 Jul 13 14:05:18 devstack sudo[104448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:05:18 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-9dccdfbb-f0ab-4cb7-b190-deaac6e57ecd tempest-CreateVolumesFromImageTest-2023936333 None] Volume volume-52ed089e-51f8-4a31-94ad-916b18b90d5b (52ed089e-51f8-4a31-94ad-916b18b90d5b): created successfully Jul 13 14:05:18 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-9dccdfbb-f0ab-4cb7-b190-deaac6e57ecd tempest-CreateVolumesFromImageTest-2023936333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6a1261e-8748-4701-8c8e-ad4f18a03313) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:05:18 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-9dccdfbb-f0ab-4cb7-b190-deaac6e57ecd tempest-CreateVolumesFromImageTest-2023936333 None] Flow 'volume_create_manager' (5a7fc418-a7c2-4d68-8511-efe2e8cfcdcc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 14:05:18 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-9dccdfbb-f0ab-4cb7-b190-deaac6e57ecd tempest-CreateVolumesFromImageTest-2023936333 None] Created volume successfully. Jul 13 14:05:18 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-d181d778-ab8c-4c5d-ad95-7ce7bb3af05c tempest-VolumeAndVolumeTypeFromImageTest-1673490618 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 14:05:18 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-d181d778-ab8c-4c5d-ad95-7ce7bb3af05c tempest-VolumeAndVolumeTypeFromImageTest-1673490618 None] Flow 'volume_create_manager' (8a9e3889-5565-49e7-a60a-4e38d2a8b334) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 14:05:18 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-d181d778-ab8c-4c5d-ad95-7ce7bb3af05c tempest-VolumeAndVolumeTypeFromImageTest-1673490618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c759a353-c294-46d6-9469-0bdacf5f3b7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:05:18 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-d181d778-ab8c-4c5d-ad95-7ce7bb3af05c tempest-VolumeAndVolumeTypeFromImageTest-1673490618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c759a353-c294-46d6-9469-0bdacf5f3b7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T12:05:18Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5e90e7d-df2e-43bb-a085-9e92d1b8cc13,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a7117fae06a426bade2b7c96cff132a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T12:05:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T12:05:18Z,use_quota=True,user_id='21537734620d49f2a57d390cd897ccc5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cc0678a5-f28e-4e6f-a202-9685a57e54fc),volume_type_id=cc0678a5-f28e-4e6f-a202-9685a57e54fc)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:05:18 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-d181d778-ab8c-4c5d-ad95-7ce7bb3af05c tempest-VolumeAndVolumeTypeFromImageTest-1673490618 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5210a691-13a5-4b7e-afe4-ee38e81d2cce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:05:18 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-d181d778-ab8c-4c5d-ad95-7ce7bb3af05c tempest-VolumeAndVolumeTypeFromImageTest-1673490618 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5210a691-13a5-4b7e-afe4-ee38e81d2cce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:05:18 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-d181d778-ab8c-4c5d-ad95-7ce7bb3af05c tempest-VolumeAndVolumeTypeFromImageTest-1673490618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1dd283e2-a809-41b0-8c87-4d2f50a8b11f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:05:18 devstack cinder-volume[87098]: DEBUG cinder.image.glance [None req-d181d778-ab8c-4c5d-ad95-7ce7bb3af05c tempest-VolumeAndVolumeTypeFromImageTest-1673490618 None] Creating Keystone auth plugin from conf {{(pid=87098) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 13 14:05:18 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-f47b92a6-7eee-4666-8ebd-d80ba5562046 tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 14:05:18 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-f47b92a6-7eee-4666-8ebd-d80ba5562046 tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] Flow 'volume_create_manager' (590372af-f28e-4718-b149-e4ca6cb5ab89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 14:05:18 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-f47b92a6-7eee-4666-8ebd-d80ba5562046 tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9fe48c46-ed81-4ea6-83a0-39457492cfdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:05:18 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-f47b92a6-7eee-4666-8ebd-d80ba5562046 tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9fe48c46-ed81-4ea6-83a0-39457492cfdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T12:05:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-273983385',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23f43f57-77c9-4a9c-a0c1-1917e27b248e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce428363f37447a983feb0713c40c3fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T12:05:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T12:05:19Z,use_quota=True,user_id='ff04b5282f6b4624ad35bd88c7edcc0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1147de8b-623b-426c-a13d-7fc824a80f67),volume_type_id=1147de8b-623b-426c-a13d-7fc824a80f67)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:05:18 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-f47b92a6-7eee-4666-8ebd-d80ba5562046 tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb13fd7d-55ea-4554-81a4-70b7dd16455f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:05:18 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-f47b92a6-7eee-4666-8ebd-d80ba5562046 tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb13fd7d-55ea-4554-81a4-70b7dd16455f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:05:18 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-f47b92a6-7eee-4666-8ebd-d80ba5562046 tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3ca414b-ce02-4567-bfb4-e368e5d41317) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:05:18 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-f47b92a6-7eee-4666-8ebd-d80ba5562046 tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3ca414b-ce02-4567-bfb4-e368e5d41317) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '23f43f57-77c9-4a9c-a0c1-1917e27b248e', 'volume_name': 'volume-23f43f57-77c9-4a9c-a0c1-1917e27b248e', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:05:18 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-f47b92a6-7eee-4666-8ebd-d80ba5562046 tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1188bb4d-861c-45e9-9d2a-6dc1fd66420b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:05:18 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-f47b92a6-7eee-4666-8ebd-d80ba5562046 tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1188bb4d-861c-45e9-9d2a-6dc1fd66420b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:05:18 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-f47b92a6-7eee-4666-8ebd-d80ba5562046 tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48233625-a361-4213-9126-1ce07037c435) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:05:18 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-f47b92a6-7eee-4666-8ebd-d80ba5562046 tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] Volume 23f43f57-77c9-4a9c-a0c1-1917e27b248e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-23f43f57-77c9-4a9c-a0c1-1917e27b248e', 'volume_size': 1} Jul 13 14:05:18 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-f47b92a6-7eee-4666-8ebd-d80ba5562046 tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 14:05:18 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-38268e11-d422-4e7e-8b0f-86df8956a930 tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 14:05:18 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-38268e11-d422-4e7e-8b0f-86df8956a930 tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] Flow 'volume_create_manager' (4dd06e24-7b7f-4310-9bbd-a6d945562c82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 14:05:18 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-38268e11-d422-4e7e-8b0f-86df8956a930 tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa746c47-eb57-4c8b-ae6f-794ab2b2afb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:05:18 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-38268e11-d422-4e7e-8b0f-86df8956a930 tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa746c47-eb57-4c8b-ae6f-794ab2b2afb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T12:05:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-554825025',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=765d95bf-d33b-47c1-82e9-720767f8d76b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce428363f37447a983feb0713c40c3fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T12:05:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T12:05:19Z,use_quota=True,user_id='ff04b5282f6b4624ad35bd88c7edcc0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1147de8b-623b-426c-a13d-7fc824a80f67),volume_type_id=1147de8b-623b-426c-a13d-7fc824a80f67)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:05:18 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-38268e11-d422-4e7e-8b0f-86df8956a930 tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac72ac5b-8d7b-439a-87c3-58cad3316e85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:05:18 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-38268e11-d422-4e7e-8b0f-86df8956a930 tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac72ac5b-8d7b-439a-87c3-58cad3316e85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:05:18 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-38268e11-d422-4e7e-8b0f-86df8956a930 tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23b92043-a62d-404c-95d2-d193be279a0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:05:18 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-38268e11-d422-4e7e-8b0f-86df8956a930 tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23b92043-a62d-404c-95d2-d193be279a0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '765d95bf-d33b-47c1-82e9-720767f8d76b', 'volume_name': 'volume-765d95bf-d33b-47c1-82e9-720767f8d76b', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:05:19 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-38268e11-d422-4e7e-8b0f-86df8956a930 tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (502825ec-10fd-48e3-8ff5-180f104b5e4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:05:19 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-38268e11-d422-4e7e-8b0f-86df8956a930 tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (502825ec-10fd-48e3-8ff5-180f104b5e4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:05:19 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-38268e11-d422-4e7e-8b0f-86df8956a930 tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b2269ac-24a7-4577-a6dd-e932feafccac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:05:19 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-38268e11-d422-4e7e-8b0f-86df8956a930 tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] Volume 765d95bf-d33b-47c1-82e9-720767f8d76b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-765d95bf-d33b-47c1-82e9-720767f8d76b', 'volume_size': 1} Jul 13 14:05:19 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-38268e11-d422-4e7e-8b0f-86df8956a930 tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 14:05:19 devstack sudo[104448]: pam_unix(sudo:session): session closed for user root Jul 13 14:05:19 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-d181d778-ab8c-4c5d-ad95-7ce7bb3af05c tempest-VolumeAndVolumeTypeFromImageTest-1673490618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1dd283e2-a809-41b0-8c87-4d2f50a8b11f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'd5e90e7d-df2e-43bb-a085-9e92d1b8cc13', 'volume_name': 'volume-d5e90e7d-df2e-43bb-a085-9e92d1b8cc13', 'volume_size': 1, 'image_id': 'c863dcc3-ec31-44d0-b4fd-21cc18530275', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c863dcc3-ec31-44d0-b4fd-21cc18530275', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '204ffc83de30b7cb0457658abb845cf5', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '1a7117fae06a426bade2b7c96cff132a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'da24bc72f4429b1e99514033de51b3344189a41c5391b94acac233c78cdab795424a41c27cdcb6444c0e20b5213a85981a61d8b2842f10542cff78ca126242f2', 'id': 'c863dcc3-ec31-44d0-b4fd-21cc18530275', 'created_at': datetime.datetime(2026, 7, 13, 12, 5, 16, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 13, 12, 5, 17, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c863dcc3-ec31-44d0-b4fd-21cc18530275/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:05:19 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-d181d778-ab8c-4c5d-ad95-7ce7bb3af05c tempest-VolumeAndVolumeTypeFromImageTest-1673490618 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b4a4853-6509-4875-beeb-ddb5660c98a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:05:19 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-d181d778-ab8c-4c5d-ad95-7ce7bb3af05c tempest-VolumeAndVolumeTypeFromImageTest-1673490618 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b4a4853-6509-4875-beeb-ddb5660c98a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:05:19 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-d181d778-ab8c-4c5d-ad95-7ce7bb3af05c tempest-VolumeAndVolumeTypeFromImageTest-1673490618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00c86e4e-1554-4379-b16b-3d4ee4cbe439) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:05:19 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-d181d778-ab8c-4c5d-ad95-7ce7bb3af05c tempest-VolumeAndVolumeTypeFromImageTest-1673490618 None] Volume d5e90e7d-df2e-43bb-a085-9e92d1b8cc13: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-d5e90e7d-df2e-43bb-a085-9e92d1b8cc13', 'volume_size': 1, 'image_id': 'c863dcc3-ec31-44d0-b4fd-21cc18530275', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c863dcc3-ec31-44d0-b4fd-21cc18530275', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '204ffc83de30b7cb0457658abb845cf5', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '1a7117fae06a426bade2b7c96cff132a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'da24bc72f4429b1e99514033de51b3344189a41c5391b94acac233c78cdab795424a41c27cdcb6444c0e20b5213a85981a61d8b2842f10542cff78ca126242f2', 'id': 'c863dcc3-ec31-44d0-b4fd-21cc18530275', 'created_at': datetime.datetime(2026, 7, 13, 12, 5, 16, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 13, 12, 5, 17, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c863dcc3-ec31-44d0-b4fd-21cc18530275/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jul 13 14:05:19 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-d181d778-ab8c-4c5d-ad95-7ce7bb3af05c tempest-VolumeAndVolumeTypeFromImageTest-1673490618 None] Trying to clone d5e90e7d-df2e-43bb-a085-9e92d1b8cc13 from image c863dcc3-ec31-44d0-b4fd-21cc18530275 at location (None, [{'url': 'file:///opt/stack/data/glance/images/c863dcc3-ec31-44d0-b4fd-21cc18530275', 'metadata': {}}]). {{(pid=87098) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 13 14:05:19 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-7ba4d4e6-b358-4658-b783-f742e8f107e6 tempest-CreateVolumesFromSnapshotTest-61948078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-47619ab5-bc64-413d-bb7d-e74c118fdb97 1073741824" returned: 0 in 0.653s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:05:19 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-7ba4d4e6-b358-4658-b783-f742e8f107e6 tempest-CreateVolumesFromSnapshotTest-61948078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-47619ab5-bc64-413d-bb7d-e74c118fdb97 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:05:19 devstack sudo[104454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-47619ab5-bc64-413d-bb7d-e74c118fdb97 Jul 13 14:05:19 devstack sudo[104454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:05:19 devstack cinder-volume[87098]: DEBUG cinder.image.image_utils [None req-d181d778-ab8c-4c5d-ad95-7ce7bb3af05c tempest-VolumeAndVolumeTypeFromImageTest-1673490618 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_c863dcc3-ec31-44d0-b4fd-21cc18530275_wm4fhypqdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87098) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 13 14:05:19 devstack cinder-volume[87098]: INFO cinder.image.image_utils [None req-d181d778-ab8c-4c5d-ad95-7ce7bb3af05c tempest-VolumeAndVolumeTypeFromImageTest-1673490618 None] Image download 0.00 MB at 0.00 MB/s Jul 13 14:05:19 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-7122a7d7-2616-4c8d-9e74-fba008f8a5e5 tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 14:05:19 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-7122a7d7-2616-4c8d-9e74-fba008f8a5e5 tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] Flow 'volume_create_manager' (428f9a79-39c0-40a5-9e22-f582383dc279) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 14:05:19 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-7122a7d7-2616-4c8d-9e74-fba008f8a5e5 tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a9a6aeb-b199-43ee-827e-e4524c1c2dec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:05:19 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-7122a7d7-2616-4c8d-9e74-fba008f8a5e5 tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a9a6aeb-b199-43ee-827e-e4524c1c2dec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T12:05:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1198966441',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=178da845-c43e-45d4-95a0-050b7f646f4e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce428363f37447a983feb0713c40c3fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T12:05:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T12:05:19Z,use_quota=True,user_id='ff04b5282f6b4624ad35bd88c7edcc0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1147de8b-623b-426c-a13d-7fc824a80f67),volume_type_id=1147de8b-623b-426c-a13d-7fc824a80f67)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:05:19 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-7122a7d7-2616-4c8d-9e74-fba008f8a5e5 tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6b9a418-9cd3-4867-8b38-e8c992c332cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:05:19 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-7122a7d7-2616-4c8d-9e74-fba008f8a5e5 tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6b9a418-9cd3-4867-8b38-e8c992c332cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:05:19 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-7122a7d7-2616-4c8d-9e74-fba008f8a5e5 tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8e625f8-aa71-4295-83a0-ee6e8ac7ddac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:05:19 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-7122a7d7-2616-4c8d-9e74-fba008f8a5e5 tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8e625f8-aa71-4295-83a0-ee6e8ac7ddac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '178da845-c43e-45d4-95a0-050b7f646f4e', 'volume_name': 'volume-178da845-c43e-45d4-95a0-050b7f646f4e', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:05:19 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-7122a7d7-2616-4c8d-9e74-fba008f8a5e5 tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5241a79e-246a-4660-aac8-c494b2a26e05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:05:19 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-7122a7d7-2616-4c8d-9e74-fba008f8a5e5 tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5241a79e-246a-4660-aac8-c494b2a26e05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:05:19 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-7122a7d7-2616-4c8d-9e74-fba008f8a5e5 tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2133bfbb-4784-435b-98f6-44da8cb20df8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:05:19 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-7122a7d7-2616-4c8d-9e74-fba008f8a5e5 tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] Volume 178da845-c43e-45d4-95a0-050b7f646f4e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-178da845-c43e-45d4-95a0-050b7f646f4e', 'volume_size': 1} Jul 13 14:05:19 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-7122a7d7-2616-4c8d-9e74-fba008f8a5e5 tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 14:05:19 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7842b06-69b5-4638-bb56-a43482cadc55]: (4, 'raw') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 14:05:19 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-d181d778-ab8c-4c5d-ad95-7ce7bb3af05c tempest-VolumeAndVolumeTypeFromImageTest-1673490618 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c863dcc3-ec31-44d0-b4fd-21cc18530275_wm4fhypqdevstack@QuobyteHD {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:05:19 devstack sudo[104454]: pam_unix(sudo:session): session closed for user root Jul 13 14:05:19 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-7ba4d4e6-b358-4658-b783-f742e8f107e6 tempest-CreateVolumesFromSnapshotTest-61948078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-47619ab5-bc64-413d-bb7d-e74c118fdb97" returned: 0 in 0.317s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:05:19 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-7ba4d4e6-b358-4658-b783-f742e8f107e6 tempest-CreateVolumesFromSnapshotTest-61948078 None] <== create_volume: return (1016ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'} {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 13 14:05:19 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-7ba4d4e6-b358-4658-b783-f742e8f107e6 tempest-CreateVolumesFromSnapshotTest-61948078 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.019s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 14:05:19 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-67653463-565b-409a-989b-ea7b00635c4d tempest-CreateVolumesFromImageTest-2023936333 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.987s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 14:05:19 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-67653463-565b-409a-989b-ea7b00635c4d tempest-CreateVolumesFromImageTest-2023936333 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T12:05:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1594393654',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd5e6b83-8d85-4b89-b0cf-5a1df3139a18,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16626c0502e94380875bb6db7ec33fcb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T12:05:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T12:05:15Z,use_quota=True,user_id='1e590a8fc18d4a218e5b0405fa278118',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1147de8b-623b-426c-a13d-7fc824a80f67),volume_type_id=1147de8b-623b-426c-a13d-7fc824a80f67)}" {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 13 14:05:19 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-67653463-565b-409a-989b-ea7b00635c4d tempest-CreateVolumesFromImageTest-2023936333 None] Creating volume cd5e6b83-8d85-4b89-b0cf-5a1df3139a18 {{(pid=87098) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 13 14:05:19 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-67653463-565b-409a-989b-ea7b00635c4d tempest-CreateVolumesFromImageTest-2023936333 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 14:05:19 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-67653463-565b-409a-989b-ea7b00635c4d tempest-CreateVolumesFromImageTest-2023936333 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 14:05:19 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-67653463-565b-409a-989b-ea7b00635c4d tempest-CreateVolumesFromImageTest-2023936333 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 14:05:19 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-67653463-565b-409a-989b-ea7b00635c4d tempest-CreateVolumesFromImageTest-2023936333 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 14:05:19 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-67653463-565b-409a-989b-ea7b00635c4d tempest-CreateVolumesFromImageTest-2023936333 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 14:05:19 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-67653463-565b-409a-989b-ea7b00635c4d tempest-CreateVolumesFromImageTest-2023936333 None] Selected osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 14:05:19 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-67653463-565b-409a-989b-ea7b00635c4d tempest-CreateVolumesFromImageTest-2023936333 None] casted to osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 Jul 13 14:05:19 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-67653463-565b-409a-989b-ea7b00635c4d tempest-CreateVolumesFromImageTest-2023936333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-cd5e6b83-8d85-4b89-b0cf-5a1df3139a18 1073741824 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:05:19 devstack sudo[104462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c863dcc3-ec31-44d0-b4fd-21cc18530275_wm4fhypqdevstack@QuobyteHD Jul 13 14:05:19 devstack sudo[104462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:05:19 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-7ba4d4e6-b358-4658-b783-f742e8f107e6 tempest-CreateVolumesFromSnapshotTest-61948078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18f6c4f2-1e9c-4b2c-8708-f88a0c07a622) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-47619ab5-bc64-413d-bb7d-e74c118fdb97', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:05:19 devstack sudo[104464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-cd5e6b83-8d85-4b89-b0cf-5a1df3139a18 1073741824 Jul 13 14:05:19 devstack sudo[104464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:05:19 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-7ba4d4e6-b358-4658-b783-f742e8f107e6 tempest-CreateVolumesFromSnapshotTest-61948078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4eafc6c3-31b4-4ce6-8b1d-a39416db9de4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:05:19 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-7ba4d4e6-b358-4658-b783-f742e8f107e6 tempest-CreateVolumesFromSnapshotTest-61948078 None] Volume volume-47619ab5-bc64-413d-bb7d-e74c118fdb97 (47619ab5-bc64-413d-bb7d-e74c118fdb97): created successfully Jul 13 14:05:19 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-7ba4d4e6-b358-4658-b783-f742e8f107e6 tempest-CreateVolumesFromSnapshotTest-61948078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4eafc6c3-31b4-4ce6-8b1d-a39416db9de4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:05:19 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-7ba4d4e6-b358-4658-b783-f742e8f107e6 tempest-CreateVolumesFromSnapshotTest-61948078 None] Flow 'volume_create_manager' (0c7abcf8-97c4-42b4-8f4a-defae2464b08) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 14:05:19 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-7ba4d4e6-b358-4658-b783-f742e8f107e6 tempest-CreateVolumesFromSnapshotTest-61948078 None] Created volume successfully. Jul 13 14:05:19 devstack sudo[104462]: pam_unix(sudo:session): session closed for user root Jul 13 14:05:19 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-d181d778-ab8c-4c5d-ad95-7ce7bb3af05c tempest-VolumeAndVolumeTypeFromImageTest-1673490618 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c863dcc3-ec31-44d0-b4fd-21cc18530275_wm4fhypqdevstack@QuobyteHD" returned: 0 in 0.336s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:05:19 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-d181d778-ab8c-4c5d-ad95-7ce7bb3af05c tempest-VolumeAndVolumeTypeFromImageTest-1673490618 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c863dcc3-ec31-44d0-b4fd-21cc18530275_wm4fhypqdevstack@QuobyteHD {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:05:19 devstack sudo[104471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c863dcc3-ec31-44d0-b4fd-21cc18530275_wm4fhypqdevstack@QuobyteHD Jul 13 14:05:19 devstack sudo[104471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:05:19 devstack sudo[104464]: pam_unix(sudo:session): session closed for user root Jul 13 14:05:19 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-67653463-565b-409a-989b-ea7b00635c4d tempest-CreateVolumesFromImageTest-2023936333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-cd5e6b83-8d85-4b89-b0cf-5a1df3139a18 1073741824" returned: 0 in 0.419s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:05:19 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-67653463-565b-409a-989b-ea7b00635c4d tempest-CreateVolumesFromImageTest-2023936333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-cd5e6b83-8d85-4b89-b0cf-5a1df3139a18 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:05:19 devstack sudo[104474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-cd5e6b83-8d85-4b89-b0cf-5a1df3139a18 Jul 13 14:05:19 devstack sudo[104474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:05:20 devstack sudo[104471]: pam_unix(sudo:session): session closed for user root Jul 13 14:05:20 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-d181d778-ab8c-4c5d-ad95-7ce7bb3af05c tempest-VolumeAndVolumeTypeFromImageTest-1673490618 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c863dcc3-ec31-44d0-b4fd-21cc18530275_wm4fhypqdevstack@QuobyteHD" returned: 1 in 0.337s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:05:20 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-d181d778-ab8c-4c5d-ad95-7ce7bb3af05c tempest-VolumeAndVolumeTypeFromImageTest-1673490618 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c863dcc3-ec31-44d0-b4fd-21cc18530275_wm4fhypqdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 13 14:05:20 devstack cinder-volume[87098]: DEBUG cinder.image.image_utils [None req-d181d778-ab8c-4c5d-ad95-7ce7bb3af05c tempest-VolumeAndVolumeTypeFromImageTest-1673490618 None] Temporary image c863dcc3-ec31-44d0-b4fd-21cc18530275 is fetched for user 21537734620d49f2a57d390cd897ccc5. {{(pid=87098) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 13 14:05:20 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[47641b4e-e882-4ba4-a172-a18d51dae511]: (4, 'raw') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 14:05:20 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-d181d778-ab8c-4c5d-ad95-7ce7bb3af05c tempest-VolumeAndVolumeTypeFromImageTest-1673490618 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c863dcc3-ec31-44d0-b4fd-21cc18530275_wm4fhypqdevstack@QuobyteHD {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:05:20 devstack sudo[104474]: pam_unix(sudo:session): session closed for user root Jul 13 14:05:20 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-67653463-565b-409a-989b-ea7b00635c4d tempest-CreateVolumesFromImageTest-2023936333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-cd5e6b83-8d85-4b89-b0cf-5a1df3139a18" returned: 0 in 0.323s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:05:20 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-67653463-565b-409a-989b-ea7b00635c4d tempest-CreateVolumesFromImageTest-2023936333 None] <== create_volume: return (792ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'} {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 13 14:05:20 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-67653463-565b-409a-989b-ea7b00635c4d tempest-CreateVolumesFromImageTest-2023936333 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.795s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 14:05:20 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-cac5837c-88f9-4e15-bbd3-9d83f3e178f0 tempest-CreateVolumesFromImageTest-2023936333 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.520s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 14:05:20 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-cac5837c-88f9-4e15-bbd3-9d83f3e178f0 tempest-CreateVolumesFromImageTest-2023936333 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T12:05:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-861283907',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d7b9d30-7299-4a2c-83dc-9e9dcd2cf61a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16626c0502e94380875bb6db7ec33fcb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T12:05:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T12:05:16Z,use_quota=True,user_id='1e590a8fc18d4a218e5b0405fa278118',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1147de8b-623b-426c-a13d-7fc824a80f67),volume_type_id=1147de8b-623b-426c-a13d-7fc824a80f67)}" {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 13 14:05:20 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-cac5837c-88f9-4e15-bbd3-9d83f3e178f0 tempest-CreateVolumesFromImageTest-2023936333 None] Creating volume 4d7b9d30-7299-4a2c-83dc-9e9dcd2cf61a {{(pid=87098) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 13 14:05:20 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-cac5837c-88f9-4e15-bbd3-9d83f3e178f0 tempest-CreateVolumesFromImageTest-2023936333 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 14:05:20 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-cac5837c-88f9-4e15-bbd3-9d83f3e178f0 tempest-CreateVolumesFromImageTest-2023936333 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 14:05:20 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-cac5837c-88f9-4e15-bbd3-9d83f3e178f0 tempest-CreateVolumesFromImageTest-2023936333 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 14:05:20 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-cac5837c-88f9-4e15-bbd3-9d83f3e178f0 tempest-CreateVolumesFromImageTest-2023936333 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 14:05:20 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-cac5837c-88f9-4e15-bbd3-9d83f3e178f0 tempest-CreateVolumesFromImageTest-2023936333 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 14:05:20 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-cac5837c-88f9-4e15-bbd3-9d83f3e178f0 tempest-CreateVolumesFromImageTest-2023936333 None] Selected osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 14:05:20 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-cac5837c-88f9-4e15-bbd3-9d83f3e178f0 tempest-CreateVolumesFromImageTest-2023936333 None] casted to osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 Jul 13 14:05:20 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-cac5837c-88f9-4e15-bbd3-9d83f3e178f0 tempest-CreateVolumesFromImageTest-2023936333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-4d7b9d30-7299-4a2c-83dc-9e9dcd2cf61a 1073741824 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:05:20 devstack sudo[104481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-4d7b9d30-7299-4a2c-83dc-9e9dcd2cf61a 1073741824 Jul 13 14:05:20 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-67653463-565b-409a-989b-ea7b00635c4d tempest-CreateVolumesFromImageTest-2023936333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e632f5af-0148-4e67-a6b5-5ee6eedca088) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cd5e6b83-8d85-4b89-b0cf-5a1df3139a18', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:05:20 devstack sudo[104481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:05:20 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-67653463-565b-409a-989b-ea7b00635c4d tempest-CreateVolumesFromImageTest-2023936333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2891d779-6fe8-4f22-b55c-e92c73f15eb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:05:20 devstack sudo[104479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c863dcc3-ec31-44d0-b4fd-21cc18530275_wm4fhypqdevstack@QuobyteHD Jul 13 14:05:20 devstack sudo[104479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:05:20 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-67653463-565b-409a-989b-ea7b00635c4d tempest-CreateVolumesFromImageTest-2023936333 None] Volume volume-cd5e6b83-8d85-4b89-b0cf-5a1df3139a18 (cd5e6b83-8d85-4b89-b0cf-5a1df3139a18): created successfully Jul 13 14:05:20 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-67653463-565b-409a-989b-ea7b00635c4d tempest-CreateVolumesFromImageTest-2023936333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2891d779-6fe8-4f22-b55c-e92c73f15eb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:05:20 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-67653463-565b-409a-989b-ea7b00635c4d tempest-CreateVolumesFromImageTest-2023936333 None] Flow 'volume_create_manager' (7a3d056e-56c1-4d18-8509-5674b7799fbf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 14:05:20 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-810dbbe7-17b6-4d92-afa6-9aaa29594547 tempest-CreateVolumesFromSnapshotTest-61948078 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 14:05:20 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-67653463-565b-409a-989b-ea7b00635c4d tempest-CreateVolumesFromImageTest-2023936333 None] Created volume successfully. Jul 13 14:05:20 devstack sudo[104479]: pam_unix(sudo:session): session closed for user root Jul 13 14:05:20 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-d181d778-ab8c-4c5d-ad95-7ce7bb3af05c tempest-VolumeAndVolumeTypeFromImageTest-1673490618 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c863dcc3-ec31-44d0-b4fd-21cc18530275_wm4fhypqdevstack@QuobyteHD" returned: 0 in 0.408s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:05:20 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-d181d778-ab8c-4c5d-ad95-7ce7bb3af05c tempest-VolumeAndVolumeTypeFromImageTest-1673490618 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c863dcc3-ec31-44d0-b4fd-21cc18530275_wm4fhypqdevstack@QuobyteHD {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:05:20 devstack sudo[104489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c863dcc3-ec31-44d0-b4fd-21cc18530275_wm4fhypqdevstack@QuobyteHD Jul 13 14:05:20 devstack sudo[104489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:05:20 devstack sudo[104481]: pam_unix(sudo:session): session closed for user root Jul 13 14:05:20 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-cac5837c-88f9-4e15-bbd3-9d83f3e178f0 tempest-CreateVolumesFromImageTest-2023936333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-4d7b9d30-7299-4a2c-83dc-9e9dcd2cf61a 1073741824" returned: 0 in 0.459s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:05:20 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-cac5837c-88f9-4e15-bbd3-9d83f3e178f0 tempest-CreateVolumesFromImageTest-2023936333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-4d7b9d30-7299-4a2c-83dc-9e9dcd2cf61a {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:05:20 devstack sudo[104491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-4d7b9d30-7299-4a2c-83dc-9e9dcd2cf61a Jul 13 14:05:20 devstack sudo[104491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:05:20 devstack sudo[104489]: pam_unix(sudo:session): session closed for user root Jul 13 14:05:20 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-d181d778-ab8c-4c5d-ad95-7ce7bb3af05c tempest-VolumeAndVolumeTypeFromImageTest-1673490618 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c863dcc3-ec31-44d0-b4fd-21cc18530275_wm4fhypqdevstack@QuobyteHD" returned: 1 in 0.338s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:05:20 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-d181d778-ab8c-4c5d-ad95-7ce7bb3af05c tempest-VolumeAndVolumeTypeFromImageTest-1673490618 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c863dcc3-ec31-44d0-b4fd-21cc18530275_wm4fhypqdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 13 14:05:20 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-d181d778-ab8c-4c5d-ad95-7ce7bb3af05c tempest-VolumeAndVolumeTypeFromImageTest-1673490618 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 14:05:21 devstack sudo[104491]: pam_unix(sudo:session): session closed for user root Jul 13 14:05:21 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-cac5837c-88f9-4e15-bbd3-9d83f3e178f0 tempest-CreateVolumesFromImageTest-2023936333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-4d7b9d30-7299-4a2c-83dc-9e9dcd2cf61a" returned: 0 in 0.238s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:05:21 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-cac5837c-88f9-4e15-bbd3-9d83f3e178f0 tempest-CreateVolumesFromImageTest-2023936333 None] <== create_volume: return (744ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'} {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 13 14:05:21 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-cac5837c-88f9-4e15-bbd3-9d83f3e178f0 tempest-CreateVolumesFromImageTest-2023936333 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.748s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 14:05:21 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-5b9bf4dd-d0aa-4973-91b8-3e55cdc725d3 tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.342s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 14:05:21 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-5b9bf4dd-d0aa-4973-91b8-3e55cdc725d3 tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T12:05:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1223597488',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ca97dda-8158-4574-86d3-1e1b556f6b1a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce428363f37447a983feb0713c40c3fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T12:05:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T12:05:17Z,use_quota=True,user_id='ff04b5282f6b4624ad35bd88c7edcc0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1147de8b-623b-426c-a13d-7fc824a80f67),volume_type_id=1147de8b-623b-426c-a13d-7fc824a80f67)}" {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 13 14:05:21 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-5b9bf4dd-d0aa-4973-91b8-3e55cdc725d3 tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] Creating volume 1ca97dda-8158-4574-86d3-1e1b556f6b1a {{(pid=87098) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 13 14:05:21 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-5b9bf4dd-d0aa-4973-91b8-3e55cdc725d3 tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 14:05:21 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-5b9bf4dd-d0aa-4973-91b8-3e55cdc725d3 tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 14:05:21 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-5b9bf4dd-d0aa-4973-91b8-3e55cdc725d3 tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 14:05:21 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-5b9bf4dd-d0aa-4973-91b8-3e55cdc725d3 tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 14:05:21 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-5b9bf4dd-d0aa-4973-91b8-3e55cdc725d3 tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 14:05:21 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-5b9bf4dd-d0aa-4973-91b8-3e55cdc725d3 tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] Selected osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 14:05:21 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-5b9bf4dd-d0aa-4973-91b8-3e55cdc725d3 tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] casted to osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 Jul 13 14:05:21 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-5b9bf4dd-d0aa-4973-91b8-3e55cdc725d3 tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-1ca97dda-8158-4574-86d3-1e1b556f6b1a 1073741824 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:05:21 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-cac5837c-88f9-4e15-bbd3-9d83f3e178f0 tempest-CreateVolumesFromImageTest-2023936333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7b298cd-c9cb-40de-8980-012b73dead12) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4d7b9d30-7299-4a2c-83dc-9e9dcd2cf61a', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:05:21 devstack sudo[104497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-1ca97dda-8158-4574-86d3-1e1b556f6b1a 1073741824 Jul 13 14:05:21 devstack sudo[104497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:05:21 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-cac5837c-88f9-4e15-bbd3-9d83f3e178f0 tempest-CreateVolumesFromImageTest-2023936333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (329989cd-01c1-4e56-bf08-df64148e36f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:05:21 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-cac5837c-88f9-4e15-bbd3-9d83f3e178f0 tempest-CreateVolumesFromImageTest-2023936333 None] Volume volume-4d7b9d30-7299-4a2c-83dc-9e9dcd2cf61a (4d7b9d30-7299-4a2c-83dc-9e9dcd2cf61a): created successfully Jul 13 14:05:21 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-cac5837c-88f9-4e15-bbd3-9d83f3e178f0 tempest-CreateVolumesFromImageTest-2023936333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (329989cd-01c1-4e56-bf08-df64148e36f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:05:21 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-cac5837c-88f9-4e15-bbd3-9d83f3e178f0 tempest-CreateVolumesFromImageTest-2023936333 None] Flow 'volume_create_manager' (074d7a6d-bf9c-45c0-9f05-7a6b6e4ca0e3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 14:05:21 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-cac5837c-88f9-4e15-bbd3-9d83f3e178f0 tempest-CreateVolumesFromImageTest-2023936333 None] Created volume successfully. Jul 13 14:05:21 devstack sudo[104497]: pam_unix(sudo:session): session closed for user root Jul 13 14:05:21 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-5b9bf4dd-d0aa-4973-91b8-3e55cdc725d3 tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-1ca97dda-8158-4574-86d3-1e1b556f6b1a 1073741824" returned: 0 in 0.421s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:05:21 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-5b9bf4dd-d0aa-4973-91b8-3e55cdc725d3 tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-1ca97dda-8158-4574-86d3-1e1b556f6b1a {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:05:21 devstack sudo[104502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-1ca97dda-8158-4574-86d3-1e1b556f6b1a Jul 13 14:05:21 devstack sudo[104502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:05:21 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-f3f77ad0-2bed-4bb3-9b10-937efb50666d tempest-CreateVolumesFromImageTest-2023936333 None] Acquiring lock "cinder-4d7b9d30-7299-4a2c-83dc-9e9dcd2cf61a-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 14:05:21 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-f3f77ad0-2bed-4bb3-9b10-937efb50666d tempest-CreateVolumesFromImageTest-2023936333 None] Lock "cinder-4d7b9d30-7299-4a2c-83dc-9e9dcd2cf61a-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 14:05:21 devstack sudo[104502]: pam_unix(sudo:session): session closed for user root Jul 13 14:05:21 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-5b9bf4dd-d0aa-4973-91b8-3e55cdc725d3 tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-1ca97dda-8158-4574-86d3-1e1b556f6b1a" returned: 0 in 0.273s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:05:21 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-5b9bf4dd-d0aa-4973-91b8-3e55cdc725d3 tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] <== create_volume: return (732ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'} {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 13 14:05:21 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-5b9bf4dd-d0aa-4973-91b8-3e55cdc725d3 tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.736s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 14:05:21 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-5df61d87-7d36-4566-86d0-5d8e78fda849 tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.707s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 14:05:21 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-5df61d87-7d36-4566-86d0-5d8e78fda849 tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T12:05:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1018139855',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=094b9914-584b-481f-9218-bddb49e0aa75,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce428363f37447a983feb0713c40c3fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T12:05:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T12:05:18Z,use_quota=True,user_id='ff04b5282f6b4624ad35bd88c7edcc0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1147de8b-623b-426c-a13d-7fc824a80f67),volume_type_id=1147de8b-623b-426c-a13d-7fc824a80f67)}" {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 13 14:05:21 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-5df61d87-7d36-4566-86d0-5d8e78fda849 tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] Creating volume 094b9914-584b-481f-9218-bddb49e0aa75 {{(pid=87098) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 13 14:05:21 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-5df61d87-7d36-4566-86d0-5d8e78fda849 tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 14:05:21 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-5df61d87-7d36-4566-86d0-5d8e78fda849 tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 14:05:21 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-5df61d87-7d36-4566-86d0-5d8e78fda849 tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 14:05:21 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-5df61d87-7d36-4566-86d0-5d8e78fda849 tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 14:05:21 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-5df61d87-7d36-4566-86d0-5d8e78fda849 tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 14:05:21 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-5df61d87-7d36-4566-86d0-5d8e78fda849 tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] Selected osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 14:05:21 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-5df61d87-7d36-4566-86d0-5d8e78fda849 tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] casted to osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 Jul 13 14:05:21 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-5df61d87-7d36-4566-86d0-5d8e78fda849 tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-094b9914-584b-481f-9218-bddb49e0aa75 1073741824 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:05:21 devstack sudo[104505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-094b9914-584b-481f-9218-bddb49e0aa75 1073741824 Jul 13 14:05:21 devstack sudo[104505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:05:21 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-5b9bf4dd-d0aa-4973-91b8-3e55cdc725d3 tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f62fe795-2c68-480e-804f-34411f2b5c77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1ca97dda-8158-4574-86d3-1e1b556f6b1a', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:05:21 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-5b9bf4dd-d0aa-4973-91b8-3e55cdc725d3 tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6521b94-f4ac-4f7b-a763-6365bcda0605) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:05:21 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-f3f77ad0-2bed-4bb3-9b10-937efb50666d tempest-CreateVolumesFromImageTest-2023936333 None] Acquiring lock "cinder-quobyte-4d7b9d30-7299-4a2c-83dc-9e9dcd2cf61a" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 14:05:21 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-5b9bf4dd-d0aa-4973-91b8-3e55cdc725d3 tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] Volume volume-1ca97dda-8158-4574-86d3-1e1b556f6b1a (1ca97dda-8158-4574-86d3-1e1b556f6b1a): created successfully Jul 13 14:05:21 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-5b9bf4dd-d0aa-4973-91b8-3e55cdc725d3 tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6521b94-f4ac-4f7b-a763-6365bcda0605) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:05:21 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-5b9bf4dd-d0aa-4973-91b8-3e55cdc725d3 tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] Flow 'volume_create_manager' (0eda7882-a75b-43f9-8755-7a9100e35ded) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 14:05:21 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-f3f77ad0-2bed-4bb3-9b10-937efb50666d tempest-CreateVolumesFromImageTest-2023936333 None] Lock "cinder-quobyte-4d7b9d30-7299-4a2c-83dc-9e9dcd2cf61a" acquired by "delete_volume" :: waited 0.028s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 14:05:21 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-5b9bf4dd-d0aa-4973-91b8-3e55cdc725d3 tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] Created volume successfully. Jul 13 14:05:21 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf4896fd-3d46-4bbf-a4ec-19e2bce85fcb]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 14:05:21 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-f3f77ad0-2bed-4bb3-9b10-937efb50666d tempest-CreateVolumesFromImageTest-2023936333 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-4d7b9d30-7299-4a2c-83dc-9e9dcd2cf61a {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:05:22 devstack sudo[104507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-4d7b9d30-7299-4a2c-83dc-9e9dcd2cf61a Jul 13 14:05:22 devstack sudo[104507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:05:22 devstack sudo[104505]: pam_unix(sudo:session): session closed for user root Jul 13 14:05:22 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-5df61d87-7d36-4566-86d0-5d8e78fda849 tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-094b9914-584b-481f-9218-bddb49e0aa75 1073741824" returned: 0 in 0.441s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:05:22 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-5df61d87-7d36-4566-86d0-5d8e78fda849 tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-094b9914-584b-481f-9218-bddb49e0aa75 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:05:22 devstack sudo[104507]: pam_unix(sudo:session): session closed for user root Jul 13 14:05:22 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-f3f77ad0-2bed-4bb3-9b10-937efb50666d tempest-CreateVolumesFromImageTest-2023936333 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-4d7b9d30-7299-4a2c-83dc-9e9dcd2cf61a" returned: 0 in 0.382s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:05:22 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-f3f77ad0-2bed-4bb3-9b10-937efb50666d tempest-CreateVolumesFromImageTest-2023936333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-4d7b9d30-7299-4a2c-83dc-9e9dcd2cf61a {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:05:22 devstack sudo[104515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-094b9914-584b-481f-9218-bddb49e0aa75 Jul 13 14:05:22 devstack sudo[104515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:05:22 devstack sudo[104516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-4d7b9d30-7299-4a2c-83dc-9e9dcd2cf61a Jul 13 14:05:22 devstack sudo[104516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:05:22 devstack sudo[104516]: pam_unix(sudo:session): session closed for user root Jul 13 14:05:22 devstack sudo[104515]: pam_unix(sudo:session): session closed for user root Jul 13 14:05:22 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-5df61d87-7d36-4566-86d0-5d8e78fda849 tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-094b9914-584b-481f-9218-bddb49e0aa75" returned: 0 in 0.261s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:05:22 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-5df61d87-7d36-4566-86d0-5d8e78fda849 tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] <== create_volume: return (744ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'} {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 13 14:05:22 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-5df61d87-7d36-4566-86d0-5d8e78fda849 tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.748s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 14:05:22 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-f47b92a6-7eee-4666-8ebd-d80ba5562046 tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.682s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 14:05:22 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-f47b92a6-7eee-4666-8ebd-d80ba5562046 tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T12:05:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-273983385',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23f43f57-77c9-4a9c-a0c1-1917e27b248e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce428363f37447a983feb0713c40c3fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T12:05:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T12:05:19Z,use_quota=True,user_id='ff04b5282f6b4624ad35bd88c7edcc0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1147de8b-623b-426c-a13d-7fc824a80f67),volume_type_id=1147de8b-623b-426c-a13d-7fc824a80f67)}" {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 13 14:05:22 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-f47b92a6-7eee-4666-8ebd-d80ba5562046 tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] Creating volume 23f43f57-77c9-4a9c-a0c1-1917e27b248e {{(pid=87098) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 13 14:05:22 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-f47b92a6-7eee-4666-8ebd-d80ba5562046 tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 14:05:22 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-f47b92a6-7eee-4666-8ebd-d80ba5562046 tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 14:05:22 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-f47b92a6-7eee-4666-8ebd-d80ba5562046 tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 14:05:22 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-f47b92a6-7eee-4666-8ebd-d80ba5562046 tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 14:05:22 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-f47b92a6-7eee-4666-8ebd-d80ba5562046 tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 14:05:22 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-f47b92a6-7eee-4666-8ebd-d80ba5562046 tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] Selected osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 14:05:22 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-f47b92a6-7eee-4666-8ebd-d80ba5562046 tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] casted to osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 Jul 13 14:05:22 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-f47b92a6-7eee-4666-8ebd-d80ba5562046 tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-23f43f57-77c9-4a9c-a0c1-1917e27b248e 1073741824 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:05:22 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-f3f77ad0-2bed-4bb3-9b10-937efb50666d tempest-CreateVolumesFromImageTest-2023936333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-4d7b9d30-7299-4a2c-83dc-9e9dcd2cf61a" returned: 0 in 0.275s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:05:22 devstack sudo[104521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-23f43f57-77c9-4a9c-a0c1-1917e27b248e 1073741824 Jul 13 14:05:22 devstack sudo[104521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:05:22 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-5df61d87-7d36-4566-86d0-5d8e78fda849 tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (edc6dab8-f0de-40ab-a971-94ee13d88061) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-094b9914-584b-481f-9218-bddb49e0aa75', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:05:22 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-5df61d87-7d36-4566-86d0-5d8e78fda849 tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01212e42-a7be-40f6-9793-830e9d1ffddd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:05:22 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-f3f77ad0-2bed-4bb3-9b10-937efb50666d tempest-CreateVolumesFromImageTest-2023936333 None] Lock "cinder-quobyte-4d7b9d30-7299-4a2c-83dc-9e9dcd2cf61a" released by "delete_volume" :: held 0.723s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 14:05:22 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-5df61d87-7d36-4566-86d0-5d8e78fda849 tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] Volume volume-094b9914-584b-481f-9218-bddb49e0aa75 (094b9914-584b-481f-9218-bddb49e0aa75): created successfully Jul 13 14:05:22 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-5df61d87-7d36-4566-86d0-5d8e78fda849 tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01212e42-a7be-40f6-9793-830e9d1ffddd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:05:22 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-5df61d87-7d36-4566-86d0-5d8e78fda849 tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] Flow 'volume_create_manager' (be4400c4-6aa5-452a-9f15-b34956bf7beb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 14:05:22 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-5df61d87-7d36-4566-86d0-5d8e78fda849 tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] Created volume successfully. Jul 13 14:05:22 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-f3f77ad0-2bed-4bb3-9b10-937efb50666d tempest-CreateVolumesFromImageTest-2023936333 None] Created reservations ['d36f84b5-12f1-4441-9a47-a7ee51246a89', 'd6cadde7-0627-4db8-827b-7cb73b61ae67', '34638fc5-02cf-447b-83dc-5fa48be29d26', '754aa5a1-8630-4f71-acb8-0ca19ad05bbd'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 14:05:22 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-f3f77ad0-2bed-4bb3-9b10-937efb50666d tempest-CreateVolumesFromImageTest-2023936333 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 14:05:22 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-f3f77ad0-2bed-4bb3-9b10-937efb50666d tempest-CreateVolumesFromImageTest-2023936333 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 14:05:22 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-f3f77ad0-2bed-4bb3-9b10-937efb50666d tempest-CreateVolumesFromImageTest-2023936333 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 14:05:22 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-f3f77ad0-2bed-4bb3-9b10-937efb50666d tempest-CreateVolumesFromImageTest-2023936333 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 14:05:22 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-f3f77ad0-2bed-4bb3-9b10-937efb50666d tempest-CreateVolumesFromImageTest-2023936333 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 14:05:22 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-f3f77ad0-2bed-4bb3-9b10-937efb50666d tempest-CreateVolumesFromImageTest-2023936333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:05:22 devstack sudo[104523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 Jul 13 14:05:22 devstack sudo[104523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:05:22 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-7e3882a2-8e25-44f2-8236-16a96b5c83b4 tempest-CreateVolumesFromImageTest-2023936333 None] Acquiring lock "cinder-cd5e6b83-8d85-4b89-b0cf-5a1df3139a18-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 14:05:22 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-7e3882a2-8e25-44f2-8236-16a96b5c83b4 tempest-CreateVolumesFromImageTest-2023936333 None] Lock "cinder-cd5e6b83-8d85-4b89-b0cf-5a1df3139a18-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 14:05:23 devstack sudo[104523]: pam_unix(sudo:session): session closed for user root Jul 13 14:05:23 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-f3f77ad0-2bed-4bb3-9b10-937efb50666d tempest-CreateVolumesFromImageTest-2023936333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78" returned: 0 in 0.324s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:05:23 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-f3f77ad0-2bed-4bb3-9b10-937efb50666d tempest-CreateVolumesFromImageTest-2023936333 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 14:05:23 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-7e3882a2-8e25-44f2-8236-16a96b5c83b4 tempest-CreateVolumesFromImageTest-2023936333 None] Acquiring lock "cinder-quobyte-cd5e6b83-8d85-4b89-b0cf-5a1df3139a18" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 14:05:23 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-f3f77ad0-2bed-4bb3-9b10-937efb50666d tempest-CreateVolumesFromImageTest-2023936333 None] Deleted volume successfully. Jul 13 14:05:23 devstack sudo[104521]: pam_unix(sudo:session): session closed for user root Jul 13 14:05:23 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-7e3882a2-8e25-44f2-8236-16a96b5c83b4 tempest-CreateVolumesFromImageTest-2023936333 None] Lock "cinder-quobyte-cd5e6b83-8d85-4b89-b0cf-5a1df3139a18" acquired by "delete_volume" :: waited 0.031s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 14:05:23 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-f3f77ad0-2bed-4bb3-9b10-937efb50666d tempest-CreateVolumesFromImageTest-2023936333 None] Lock "cinder-4d7b9d30-7299-4a2c-83dc-9e9dcd2cf61a-delete_volume" released by "delete_volume" :: held 1.344s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 14:05:23 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-f47b92a6-7eee-4666-8ebd-d80ba5562046 tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-23f43f57-77c9-4a9c-a0c1-1917e27b248e 1073741824" returned: 0 in 0.557s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:05:23 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b4f5ec6-a3d6-4ec5-aeac-6848a3b9245e]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 14:05:23 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-7e3882a2-8e25-44f2-8236-16a96b5c83b4 tempest-CreateVolumesFromImageTest-2023936333 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-cd5e6b83-8d85-4b89-b0cf-5a1df3139a18 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:05:23 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-f47b92a6-7eee-4666-8ebd-d80ba5562046 tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-23f43f57-77c9-4a9c-a0c1-1917e27b248e {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:05:23 devstack sudo[104530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-23f43f57-77c9-4a9c-a0c1-1917e27b248e Jul 13 14:05:23 devstack sudo[104530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:05:23 devstack sudo[104529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-cd5e6b83-8d85-4b89-b0cf-5a1df3139a18 Jul 13 14:05:23 devstack sudo[104529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:05:23 devstack sudo[104530]: pam_unix(sudo:session): session closed for user root Jul 13 14:05:23 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-f47b92a6-7eee-4666-8ebd-d80ba5562046 tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-23f43f57-77c9-4a9c-a0c1-1917e27b248e" returned: 0 in 0.253s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:05:23 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-f47b92a6-7eee-4666-8ebd-d80ba5562046 tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] <== create_volume: return (866ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'} {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 13 14:05:23 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-f47b92a6-7eee-4666-8ebd-d80ba5562046 tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.869s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 14:05:23 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-38268e11-d422-4e7e-8b0f-86df8956a930 tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.399s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 14:05:23 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-38268e11-d422-4e7e-8b0f-86df8956a930 tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T12:05:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-554825025',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=765d95bf-d33b-47c1-82e9-720767f8d76b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce428363f37447a983feb0713c40c3fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T12:05:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T12:05:19Z,use_quota=True,user_id='ff04b5282f6b4624ad35bd88c7edcc0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1147de8b-623b-426c-a13d-7fc824a80f67),volume_type_id=1147de8b-623b-426c-a13d-7fc824a80f67)}" {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 13 14:05:23 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-38268e11-d422-4e7e-8b0f-86df8956a930 tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] Creating volume 765d95bf-d33b-47c1-82e9-720767f8d76b {{(pid=87098) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 13 14:05:23 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-38268e11-d422-4e7e-8b0f-86df8956a930 tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 14:05:23 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-38268e11-d422-4e7e-8b0f-86df8956a930 tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 14:05:23 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-38268e11-d422-4e7e-8b0f-86df8956a930 tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 14:05:23 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-38268e11-d422-4e7e-8b0f-86df8956a930 tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 14:05:23 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-38268e11-d422-4e7e-8b0f-86df8956a930 tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 14:05:23 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-38268e11-d422-4e7e-8b0f-86df8956a930 tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] Selected osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 14:05:23 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-38268e11-d422-4e7e-8b0f-86df8956a930 tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] casted to osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 Jul 13 14:05:23 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-38268e11-d422-4e7e-8b0f-86df8956a930 tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-765d95bf-d33b-47c1-82e9-720767f8d76b 1073741824 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:05:23 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-f47b92a6-7eee-4666-8ebd-d80ba5562046 tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48233625-a361-4213-9126-1ce07037c435) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-23f43f57-77c9-4a9c-a0c1-1917e27b248e', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:05:23 devstack sudo[104536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-765d95bf-d33b-47c1-82e9-720767f8d76b 1073741824 Jul 13 14:05:23 devstack sudo[104536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:05:23 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-f47b92a6-7eee-4666-8ebd-d80ba5562046 tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (850ac7d2-bf80-41dd-9bcd-5aa3a85dd364) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:05:23 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-f47b92a6-7eee-4666-8ebd-d80ba5562046 tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] Volume volume-23f43f57-77c9-4a9c-a0c1-1917e27b248e (23f43f57-77c9-4a9c-a0c1-1917e27b248e): created successfully Jul 13 14:05:23 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-f47b92a6-7eee-4666-8ebd-d80ba5562046 tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (850ac7d2-bf80-41dd-9bcd-5aa3a85dd364) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:05:23 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-f47b92a6-7eee-4666-8ebd-d80ba5562046 tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] Flow 'volume_create_manager' (590372af-f28e-4718-b149-e4ca6cb5ab89) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 14:05:23 devstack sudo[104529]: pam_unix(sudo:session): session closed for user root Jul 13 14:05:23 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-7e3882a2-8e25-44f2-8236-16a96b5c83b4 tempest-CreateVolumesFromImageTest-2023936333 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-cd5e6b83-8d85-4b89-b0cf-5a1df3139a18" returned: 0 in 0.387s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:05:23 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-7e3882a2-8e25-44f2-8236-16a96b5c83b4 tempest-CreateVolumesFromImageTest-2023936333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-cd5e6b83-8d85-4b89-b0cf-5a1df3139a18 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:05:23 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-f47b92a6-7eee-4666-8ebd-d80ba5562046 tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] Created volume successfully. Jul 13 14:05:23 devstack sudo[104540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-cd5e6b83-8d85-4b89-b0cf-5a1df3139a18 Jul 13 14:05:23 devstack sudo[104540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:05:23 devstack sudo[104540]: pam_unix(sudo:session): session closed for user root Jul 13 14:05:23 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-7e3882a2-8e25-44f2-8236-16a96b5c83b4 tempest-CreateVolumesFromImageTest-2023936333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-cd5e6b83-8d85-4b89-b0cf-5a1df3139a18" returned: 0 in 0.287s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:05:23 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-7e3882a2-8e25-44f2-8236-16a96b5c83b4 tempest-CreateVolumesFromImageTest-2023936333 None] Lock "cinder-quobyte-cd5e6b83-8d85-4b89-b0cf-5a1df3139a18" released by "delete_volume" :: held 0.712s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 14:05:23 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-7e3882a2-8e25-44f2-8236-16a96b5c83b4 tempest-CreateVolumesFromImageTest-2023936333 None] Created reservations ['3591311b-7e68-4205-b812-faaaecf5c3f9', '17156226-4dd4-44c9-8b84-0d83ecb38902', '00e2aa25-5805-438c-8013-ce3a4431b038', '46d3c781-1fdd-42bc-9dbe-f7398dea529c'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 14:05:23 devstack sudo[104536]: pam_unix(sudo:session): session closed for user root Jul 13 14:05:23 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-38268e11-d422-4e7e-8b0f-86df8956a930 tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-765d95bf-d33b-47c1-82e9-720767f8d76b 1073741824" returned: 0 in 0.477s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:05:23 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-7e3882a2-8e25-44f2-8236-16a96b5c83b4 tempest-CreateVolumesFromImageTest-2023936333 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 14:05:23 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-7e3882a2-8e25-44f2-8236-16a96b5c83b4 tempest-CreateVolumesFromImageTest-2023936333 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 14:05:23 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-7e3882a2-8e25-44f2-8236-16a96b5c83b4 tempest-CreateVolumesFromImageTest-2023936333 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 14:05:23 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-7e3882a2-8e25-44f2-8236-16a96b5c83b4 tempest-CreateVolumesFromImageTest-2023936333 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 14:05:23 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-7e3882a2-8e25-44f2-8236-16a96b5c83b4 tempest-CreateVolumesFromImageTest-2023936333 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 14:05:23 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-7e3882a2-8e25-44f2-8236-16a96b5c83b4 tempest-CreateVolumesFromImageTest-2023936333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:05:23 devstack sudo[104547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 Jul 13 14:05:23 devstack sudo[104547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:05:23 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-38268e11-d422-4e7e-8b0f-86df8956a930 tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-765d95bf-d33b-47c1-82e9-720767f8d76b {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:05:23 devstack sudo[104549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-765d95bf-d33b-47c1-82e9-720767f8d76b Jul 13 14:05:23 devstack sudo[104549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:05:24 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-5407a278-f336-4987-97ef-f501bb4d2414 tempest-CreateVolumesFromImageTest-2023936333 None] Acquiring lock "cinder-52ed089e-51f8-4a31-94ad-916b18b90d5b-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 14:05:24 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-5407a278-f336-4987-97ef-f501bb4d2414 tempest-CreateVolumesFromImageTest-2023936333 None] Lock "cinder-52ed089e-51f8-4a31-94ad-916b18b90d5b-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 14:05:24 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-5407a278-f336-4987-97ef-f501bb4d2414 tempest-CreateVolumesFromImageTest-2023936333 None] Acquiring lock "cinder-quobyte-52ed089e-51f8-4a31-94ad-916b18b90d5b" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 14:05:24 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-5407a278-f336-4987-97ef-f501bb4d2414 tempest-CreateVolumesFromImageTest-2023936333 None] Lock "cinder-quobyte-52ed089e-51f8-4a31-94ad-916b18b90d5b" acquired by "delete_volume" :: waited 0.015s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 14:05:24 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[af675b0e-ae92-4a63-b50b-0ebc098aab58]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 14:05:24 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-5407a278-f336-4987-97ef-f501bb4d2414 tempest-CreateVolumesFromImageTest-2023936333 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-52ed089e-51f8-4a31-94ad-916b18b90d5b {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:05:24 devstack sudo[104547]: pam_unix(sudo:session): session closed for user root Jul 13 14:05:24 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-7e3882a2-8e25-44f2-8236-16a96b5c83b4 tempest-CreateVolumesFromImageTest-2023936333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78" returned: 0 in 0.300s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:05:24 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-7e3882a2-8e25-44f2-8236-16a96b5c83b4 tempest-CreateVolumesFromImageTest-2023936333 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 14:05:24 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-7e3882a2-8e25-44f2-8236-16a96b5c83b4 tempest-CreateVolumesFromImageTest-2023936333 None] Deleted volume successfully. Jul 13 14:05:24 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-7e3882a2-8e25-44f2-8236-16a96b5c83b4 tempest-CreateVolumesFromImageTest-2023936333 None] Lock "cinder-cd5e6b83-8d85-4b89-b0cf-5a1df3139a18-delete_volume" released by "delete_volume" :: held 1.312s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 14:05:24 devstack sudo[104549]: pam_unix(sudo:session): session closed for user root Jul 13 14:05:24 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-38268e11-d422-4e7e-8b0f-86df8956a930 tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-765d95bf-d33b-47c1-82e9-720767f8d76b" returned: 0 in 0.308s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:05:24 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-38268e11-d422-4e7e-8b0f-86df8956a930 tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] <== create_volume: return (849ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'} {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 13 14:05:24 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-38268e11-d422-4e7e-8b0f-86df8956a930 tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.851s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 14:05:24 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-7122a7d7-2616-4c8d-9e74-fba008f8a5e5 tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.884s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 14:05:24 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-7122a7d7-2616-4c8d-9e74-fba008f8a5e5 tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T12:05:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1198966441',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=178da845-c43e-45d4-95a0-050b7f646f4e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce428363f37447a983feb0713c40c3fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T12:05:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T12:05:19Z,use_quota=True,user_id='ff04b5282f6b4624ad35bd88c7edcc0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1147de8b-623b-426c-a13d-7fc824a80f67),volume_type_id=1147de8b-623b-426c-a13d-7fc824a80f67)}" {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 13 14:05:24 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-7122a7d7-2616-4c8d-9e74-fba008f8a5e5 tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] Creating volume 178da845-c43e-45d4-95a0-050b7f646f4e {{(pid=87098) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 13 14:05:24 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-7122a7d7-2616-4c8d-9e74-fba008f8a5e5 tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 14:05:24 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-7122a7d7-2616-4c8d-9e74-fba008f8a5e5 tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 14:05:24 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-7122a7d7-2616-4c8d-9e74-fba008f8a5e5 tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 14:05:24 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-7122a7d7-2616-4c8d-9e74-fba008f8a5e5 tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 14:05:24 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-7122a7d7-2616-4c8d-9e74-fba008f8a5e5 tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 14:05:24 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-7122a7d7-2616-4c8d-9e74-fba008f8a5e5 tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] Selected osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 14:05:24 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-7122a7d7-2616-4c8d-9e74-fba008f8a5e5 tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] casted to osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 Jul 13 14:05:24 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-7122a7d7-2616-4c8d-9e74-fba008f8a5e5 tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-178da845-c43e-45d4-95a0-050b7f646f4e 1073741824 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:05:24 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-38268e11-d422-4e7e-8b0f-86df8956a930 tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b2269ac-24a7-4577-a6dd-e932feafccac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-765d95bf-d33b-47c1-82e9-720767f8d76b', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:05:24 devstack sudo[104554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-178da845-c43e-45d4-95a0-050b7f646f4e 1073741824 Jul 13 14:05:24 devstack sudo[104554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:05:24 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-38268e11-d422-4e7e-8b0f-86df8956a930 tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (294b190a-e606-4693-a7f8-de5aee80c970) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:05:24 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-38268e11-d422-4e7e-8b0f-86df8956a930 tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] Volume volume-765d95bf-d33b-47c1-82e9-720767f8d76b (765d95bf-d33b-47c1-82e9-720767f8d76b): created successfully Jul 13 14:05:24 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-38268e11-d422-4e7e-8b0f-86df8956a930 tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (294b190a-e606-4693-a7f8-de5aee80c970) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:05:24 devstack sudo[104553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-52ed089e-51f8-4a31-94ad-916b18b90d5b Jul 13 14:05:24 devstack sudo[104553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:05:24 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-38268e11-d422-4e7e-8b0f-86df8956a930 tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] Flow 'volume_create_manager' (4dd06e24-7b7f-4310-9bbd-a6d945562c82) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 14:05:24 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-38268e11-d422-4e7e-8b0f-86df8956a930 tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] Created volume successfully. Jul 13 14:05:24 devstack sudo[104553]: pam_unix(sudo:session): session closed for user root Jul 13 14:05:24 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-5407a278-f336-4987-97ef-f501bb4d2414 tempest-CreateVolumesFromImageTest-2023936333 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-52ed089e-51f8-4a31-94ad-916b18b90d5b" returned: 0 in 0.403s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:05:24 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-5407a278-f336-4987-97ef-f501bb4d2414 tempest-CreateVolumesFromImageTest-2023936333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-52ed089e-51f8-4a31-94ad-916b18b90d5b {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:05:24 devstack sudo[104564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-52ed089e-51f8-4a31-94ad-916b18b90d5b Jul 13 14:05:24 devstack sudo[104564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:05:24 devstack sudo[104554]: pam_unix(sudo:session): session closed for user root Jul 13 14:05:24 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-7122a7d7-2616-4c8d-9e74-fba008f8a5e5 tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-178da845-c43e-45d4-95a0-050b7f646f4e 1073741824" returned: 0 in 0.484s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:05:24 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-7122a7d7-2616-4c8d-9e74-fba008f8a5e5 tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-178da845-c43e-45d4-95a0-050b7f646f4e {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:05:24 devstack sudo[104566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-178da845-c43e-45d4-95a0-050b7f646f4e Jul 13 14:05:24 devstack sudo[104566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:05:24 devstack sudo[104564]: pam_unix(sudo:session): session closed for user root Jul 13 14:05:24 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-5407a278-f336-4987-97ef-f501bb4d2414 tempest-CreateVolumesFromImageTest-2023936333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-52ed089e-51f8-4a31-94ad-916b18b90d5b" returned: 0 in 0.285s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:05:24 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-5407a278-f336-4987-97ef-f501bb4d2414 tempest-CreateVolumesFromImageTest-2023936333 None] Lock "cinder-quobyte-52ed089e-51f8-4a31-94ad-916b18b90d5b" released by "delete_volume" :: held 0.735s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 14:05:24 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-5407a278-f336-4987-97ef-f501bb4d2414 tempest-CreateVolumesFromImageTest-2023936333 None] Created reservations ['1c5fd5a2-cfe8-4cff-bb3b-8d863af200d3', 'f8ff10d0-7a40-4dab-9f6c-0832bf83cc01', 'c9540d4e-a041-49a6-af1f-28738d6721a5', 'b9f4f11b-86fb-46f4-bf92-70d8fbe55e89'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 14:05:25 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-5407a278-f336-4987-97ef-f501bb4d2414 tempest-CreateVolumesFromImageTest-2023936333 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 14:05:25 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-5407a278-f336-4987-97ef-f501bb4d2414 tempest-CreateVolumesFromImageTest-2023936333 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 14:05:25 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-5407a278-f336-4987-97ef-f501bb4d2414 tempest-CreateVolumesFromImageTest-2023936333 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 14:05:25 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-5407a278-f336-4987-97ef-f501bb4d2414 tempest-CreateVolumesFromImageTest-2023936333 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 14:05:25 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-5407a278-f336-4987-97ef-f501bb4d2414 tempest-CreateVolumesFromImageTest-2023936333 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 14:05:25 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-5407a278-f336-4987-97ef-f501bb4d2414 tempest-CreateVolumesFromImageTest-2023936333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:05:25 devstack sudo[104566]: pam_unix(sudo:session): session closed for user root Jul 13 14:05:25 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-7122a7d7-2616-4c8d-9e74-fba008f8a5e5 tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-178da845-c43e-45d4-95a0-050b7f646f4e" returned: 0 in 0.261s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:05:25 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-7122a7d7-2616-4c8d-9e74-fba008f8a5e5 tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] <== create_volume: return (795ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'} {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 13 14:05:25 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-7122a7d7-2616-4c8d-9e74-fba008f8a5e5 tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.799s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 14:05:25 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-810dbbe7-17b6-4d92-afa6-9aaa29594547 tempest-CreateVolumesFromSnapshotTest-61948078 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.687s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 14:05:25 devstack sudo[104570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 Jul 13 14:05:25 devstack sudo[104570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:05:25 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-7122a7d7-2616-4c8d-9e74-fba008f8a5e5 tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2133bfbb-4784-435b-98f6-44da8cb20df8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-178da845-c43e-45d4-95a0-050b7f646f4e', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:05:25 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-7122a7d7-2616-4c8d-9e74-fba008f8a5e5 tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d549f05c-112f-4102-95a5-b288f98af7b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:05:25 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-810dbbe7-17b6-4d92-afa6-9aaa29594547 tempest-CreateVolumesFromSnapshotTest-61948078 None] Creating offline snapshot e4b1d12d-e475-4ef5-9018-cf24fed038ec of volume 47619ab5-bc64-413d-bb7d-e74c118fdb97 {{(pid=87098) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 13 14:05:25 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-7122a7d7-2616-4c8d-9e74-fba008f8a5e5 tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] Volume volume-178da845-c43e-45d4-95a0-050b7f646f4e (178da845-c43e-45d4-95a0-050b7f646f4e): created successfully Jul 13 14:05:25 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-7122a7d7-2616-4c8d-9e74-fba008f8a5e5 tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d549f05c-112f-4102-95a5-b288f98af7b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:05:25 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-7122a7d7-2616-4c8d-9e74-fba008f8a5e5 tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] Flow 'volume_create_manager' (428f9a79-39c0-40a5-9e22-f582383dc279) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 14:05:25 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfec33ea-6e6d-4373-aeed-bd38abb42657]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 14:05:25 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-810dbbe7-17b6-4d92-afa6-9aaa29594547 tempest-CreateVolumesFromSnapshotTest-61948078 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-47619ab5-bc64-413d-bb7d-e74c118fdb97 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:05:25 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-7122a7d7-2616-4c8d-9e74-fba008f8a5e5 tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] Created volume successfully. Jul 13 14:05:25 devstack sudo[104572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-47619ab5-bc64-413d-bb7d-e74c118fdb97 Jul 13 14:05:25 devstack sudo[104572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:05:25 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-3ae3d80f-ce13-46c2-bd14-ed0b63c19a65 tempest-CreateVolumesFromImageTest-2023936333 None] Acquiring lock "cinder-c535624d-d908-4fc0-a974-a77a0ffed6d3-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 14:05:25 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-3ae3d80f-ce13-46c2-bd14-ed0b63c19a65 tempest-CreateVolumesFromImageTest-2023936333 None] Lock "cinder-c535624d-d908-4fc0-a974-a77a0ffed6d3-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 14:05:25 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-3ae3d80f-ce13-46c2-bd14-ed0b63c19a65 tempest-CreateVolumesFromImageTest-2023936333 None] Acquiring lock "cinder-quobyte-c535624d-d908-4fc0-a974-a77a0ffed6d3" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 14:05:25 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-3ae3d80f-ce13-46c2-bd14-ed0b63c19a65 tempest-CreateVolumesFromImageTest-2023936333 None] Lock "cinder-quobyte-c535624d-d908-4fc0-a974-a77a0ffed6d3" acquired by "delete_volume" :: waited 0.019s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 14:05:25 devstack sudo[104570]: pam_unix(sudo:session): session closed for user root Jul 13 14:05:25 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-5407a278-f336-4987-97ef-f501bb4d2414 tempest-CreateVolumesFromImageTest-2023936333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78" returned: 0 in 0.321s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:05:25 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-5407a278-f336-4987-97ef-f501bb4d2414 tempest-CreateVolumesFromImageTest-2023936333 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 14:05:25 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0800ca3-fc5e-40c1-bd04-2e9b86ae4df0]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 14:05:25 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-5407a278-f336-4987-97ef-f501bb4d2414 tempest-CreateVolumesFromImageTest-2023936333 None] Deleted volume successfully. Jul 13 14:05:25 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-3ae3d80f-ce13-46c2-bd14-ed0b63c19a65 tempest-CreateVolumesFromImageTest-2023936333 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-c535624d-d908-4fc0-a974-a77a0ffed6d3 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:05:25 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-5407a278-f336-4987-97ef-f501bb4d2414 tempest-CreateVolumesFromImageTest-2023936333 None] Lock "cinder-52ed089e-51f8-4a31-94ad-916b18b90d5b-delete_volume" released by "delete_volume" :: held 1.293s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 14:05:25 devstack sudo[104575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-c535624d-d908-4fc0-a974-a77a0ffed6d3 Jul 13 14:05:25 devstack sudo[104575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:05:25 devstack sudo[104572]: pam_unix(sudo:session): session closed for user root Jul 13 14:05:25 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-810dbbe7-17b6-4d92-afa6-9aaa29594547 tempest-CreateVolumesFromSnapshotTest-61948078 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-47619ab5-bc64-413d-bb7d-e74c118fdb97" returned: 0 in 0.404s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:05:25 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-810dbbe7-17b6-4d92-afa6-9aaa29594547 tempest-CreateVolumesFromSnapshotTest-61948078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-47619ab5-bc64-413d-bb7d-e74c118fdb97,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-47619ab5-bc64-413d-bb7d-e74c118fdb97.e4b1d12d-e475-4ef5-9018-cf24fed038ec 1G {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:05:25 devstack sudo[104580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-47619ab5-bc64-413d-bb7d-e74c118fdb97,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-47619ab5-bc64-413d-bb7d-e74c118fdb97.e4b1d12d-e475-4ef5-9018-cf24fed038ec 1G Jul 13 14:05:25 devstack sudo[104580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:05:25 devstack sudo[104575]: pam_unix(sudo:session): session closed for user root Jul 13 14:05:25 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-3ae3d80f-ce13-46c2-bd14-ed0b63c19a65 tempest-CreateVolumesFromImageTest-2023936333 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-c535624d-d908-4fc0-a974-a77a0ffed6d3" returned: 0 in 0.385s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:05:25 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-3ae3d80f-ce13-46c2-bd14-ed0b63c19a65 tempest-CreateVolumesFromImageTest-2023936333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-c535624d-d908-4fc0-a974-a77a0ffed6d3 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:05:25 devstack sudo[104587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-c535624d-d908-4fc0-a974-a77a0ffed6d3 Jul 13 14:05:25 devstack sudo[104587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:05:25 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-03a535ee-c195-4089-b6e4-52bb15913646 tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] Acquiring lock "cinder-178da845-c43e-45d4-95a0-050b7f646f4e-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 14:05:25 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-03a535ee-c195-4089-b6e4-52bb15913646 tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] Lock "cinder-178da845-c43e-45d4-95a0-050b7f646f4e-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 14:05:26 devstack sudo[104580]: pam_unix(sudo:session): session closed for user root Jul 13 14:05:26 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-03a535ee-c195-4089-b6e4-52bb15913646 tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] Acquiring lock "cinder-quobyte-178da845-c43e-45d4-95a0-050b7f646f4e" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 14:05:26 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-810dbbe7-17b6-4d92-afa6-9aaa29594547 tempest-CreateVolumesFromSnapshotTest-61948078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-47619ab5-bc64-413d-bb7d-e74c118fdb97,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-47619ab5-bc64-413d-bb7d-e74c118fdb97.e4b1d12d-e475-4ef5-9018-cf24fed038ec 1G" returned: 0 in 0.513s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:05:26 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-810dbbe7-17b6-4d92-afa6-9aaa29594547 tempest-CreateVolumesFromSnapshotTest-61948078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-47619ab5-bc64-413d-bb7d-e74c118fdb97 -F qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-47619ab5-bc64-413d-bb7d-e74c118fdb97.e4b1d12d-e475-4ef5-9018-cf24fed038ec {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:05:26 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-03a535ee-c195-4089-b6e4-52bb15913646 tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] Lock "cinder-quobyte-178da845-c43e-45d4-95a0-050b7f646f4e" acquired by "delete_volume" :: waited 0.035s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 14:05:26 devstack sudo[104587]: pam_unix(sudo:session): session closed for user root Jul 13 14:05:26 devstack sudo[104592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-47619ab5-bc64-413d-bb7d-e74c118fdb97 -F qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-47619ab5-bc64-413d-bb7d-e74c118fdb97.e4b1d12d-e475-4ef5-9018-cf24fed038ec Jul 13 14:05:26 devstack sudo[104592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:05:26 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-3ae3d80f-ce13-46c2-bd14-ed0b63c19a65 tempest-CreateVolumesFromImageTest-2023936333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-c535624d-d908-4fc0-a974-a77a0ffed6d3" returned: 0 in 0.342s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:05:26 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a4f8234-d792-4b77-8807-7d79979e5575]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 14:05:26 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-03a535ee-c195-4089-b6e4-52bb15913646 tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-178da845-c43e-45d4-95a0-050b7f646f4e {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:05:26 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-3ae3d80f-ce13-46c2-bd14-ed0b63c19a65 tempest-CreateVolumesFromImageTest-2023936333 None] Lock "cinder-quobyte-c535624d-d908-4fc0-a974-a77a0ffed6d3" released by "delete_volume" :: held 0.792s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 14:05:26 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-3ae3d80f-ce13-46c2-bd14-ed0b63c19a65 tempest-CreateVolumesFromImageTest-2023936333 None] Created reservations ['d2e04323-5890-422c-8182-08a88983230f', 'e23661c9-d8ea-48c0-9d0b-0063c147831b', '9231d266-4b0c-49a0-9345-5310e208807c', '0e5e2ec8-f0df-4f37-8cc5-d0d27bff9a69'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 14:05:26 devstack sudo[104594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-178da845-c43e-45d4-95a0-050b7f646f4e Jul 13 14:05:26 devstack sudo[104594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:05:26 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-3ae3d80f-ce13-46c2-bd14-ed0b63c19a65 tempest-CreateVolumesFromImageTest-2023936333 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 14:05:26 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-3ae3d80f-ce13-46c2-bd14-ed0b63c19a65 tempest-CreateVolumesFromImageTest-2023936333 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 14:05:26 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-3ae3d80f-ce13-46c2-bd14-ed0b63c19a65 tempest-CreateVolumesFromImageTest-2023936333 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 14:05:26 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-3ae3d80f-ce13-46c2-bd14-ed0b63c19a65 tempest-CreateVolumesFromImageTest-2023936333 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 14:05:26 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-3ae3d80f-ce13-46c2-bd14-ed0b63c19a65 tempest-CreateVolumesFromImageTest-2023936333 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 14:05:26 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-3ae3d80f-ce13-46c2-bd14-ed0b63c19a65 tempest-CreateVolumesFromImageTest-2023936333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:05:26 devstack sudo[104598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 Jul 13 14:05:26 devstack sudo[104598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:05:26 devstack sudo[104592]: pam_unix(sudo:session): session closed for user root Jul 13 14:05:26 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-810dbbe7-17b6-4d92-afa6-9aaa29594547 tempest-CreateVolumesFromSnapshotTest-61948078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-47619ab5-bc64-413d-bb7d-e74c118fdb97 -F qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-47619ab5-bc64-413d-bb7d-e74c118fdb97.e4b1d12d-e475-4ef5-9018-cf24fed038ec" returned: 0 in 0.373s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:05:26 devstack cinder-volume[87098]: WARNING cinder.volume.drivers.remotefs [None req-810dbbe7-17b6-4d92-afa6-9aaa29594547 tempest-CreateVolumesFromSnapshotTest-61948078 None] /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-47619ab5-bc64-413d-bb7d-e74c118fdb97.e4b1d12d-e475-4ef5-9018-cf24fed038ec is being set with open permissions: ugo+rw Jul 13 14:05:26 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-810dbbe7-17b6-4d92-afa6-9aaa29594547 tempest-CreateVolumesFromSnapshotTest-61948078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-47619ab5-bc64-413d-bb7d-e74c118fdb97.e4b1d12d-e475-4ef5-9018-cf24fed038ec {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:05:26 devstack sudo[104602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-47619ab5-bc64-413d-bb7d-e74c118fdb97.e4b1d12d-e475-4ef5-9018-cf24fed038ec Jul 13 14:05:26 devstack sudo[104602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:05:26 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-160850bf-24a9-4495-8946-094f3f5f4cb3 tempest-CreateVolumesFromImageTest-2023936333 None] Acquiring lock "cinder-0492cad4-2b54-476d-a2b1-49689cc4e80a-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 14:05:26 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-160850bf-24a9-4495-8946-094f3f5f4cb3 tempest-CreateVolumesFromImageTest-2023936333 None] Lock "cinder-0492cad4-2b54-476d-a2b1-49689cc4e80a-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 14:05:26 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-160850bf-24a9-4495-8946-094f3f5f4cb3 tempest-CreateVolumesFromImageTest-2023936333 None] Acquiring lock "cinder-quobyte-0492cad4-2b54-476d-a2b1-49689cc4e80a" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 14:05:26 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-160850bf-24a9-4495-8946-094f3f5f4cb3 tempest-CreateVolumesFromImageTest-2023936333 None] Lock "cinder-quobyte-0492cad4-2b54-476d-a2b1-49689cc4e80a" acquired by "delete_volume" :: waited 0.015s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 14:05:26 devstack sudo[104594]: pam_unix(sudo:session): session closed for user root Jul 13 14:05:26 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-03a535ee-c195-4089-b6e4-52bb15913646 tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-178da845-c43e-45d4-95a0-050b7f646f4e" returned: 0 in 0.488s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:05:26 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-03a535ee-c195-4089-b6e4-52bb15913646 tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-178da845-c43e-45d4-95a0-050b7f646f4e {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:05:26 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f9f056c-6d42-44b0-95ef-6b6cff0841dc]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 14:05:26 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-160850bf-24a9-4495-8946-094f3f5f4cb3 tempest-CreateVolumesFromImageTest-2023936333 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-0492cad4-2b54-476d-a2b1-49689cc4e80a {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:05:26 devstack sudo[104608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-178da845-c43e-45d4-95a0-050b7f646f4e Jul 13 14:05:26 devstack sudo[104608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:05:26 devstack sudo[104598]: pam_unix(sudo:session): session closed for user root Jul 13 14:05:26 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-3ae3d80f-ce13-46c2-bd14-ed0b63c19a65 tempest-CreateVolumesFromImageTest-2023936333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78" returned: 0 in 0.375s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:05:26 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-3ae3d80f-ce13-46c2-bd14-ed0b63c19a65 tempest-CreateVolumesFromImageTest-2023936333 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 14:05:26 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-3ae3d80f-ce13-46c2-bd14-ed0b63c19a65 tempest-CreateVolumesFromImageTest-2023936333 None] Deleted volume successfully. Jul 13 14:05:26 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-3ae3d80f-ce13-46c2-bd14-ed0b63c19a65 tempest-CreateVolumesFromImageTest-2023936333 None] Lock "cinder-c535624d-d908-4fc0-a974-a77a0ffed6d3-delete_volume" released by "delete_volume" :: held 1.464s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 14:05:26 devstack sudo[104602]: pam_unix(sudo:session): session closed for user root Jul 13 14:05:26 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-810dbbe7-17b6-4d92-afa6-9aaa29594547 tempest-CreateVolumesFromSnapshotTest-61948078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-47619ab5-bc64-413d-bb7d-e74c118fdb97.e4b1d12d-e475-4ef5-9018-cf24fed038ec" returned: 0 in 0.338s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:05:26 devstack sudo[104610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-0492cad4-2b54-476d-a2b1-49689cc4e80a Jul 13 14:05:26 devstack sudo[104610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:05:26 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-810dbbe7-17b6-4d92-afa6-9aaa29594547 tempest-CreateVolumesFromSnapshotTest-61948078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-47619ab5-bc64-413d-bb7d-e74c118fdb97.info {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:05:26 devstack sudo[104613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-47619ab5-bc64-413d-bb7d-e74c118fdb97.info Jul 13 14:05:26 devstack sudo[104613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:05:26 devstack sudo[104608]: pam_unix(sudo:session): session closed for user root Jul 13 14:05:26 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-03a535ee-c195-4089-b6e4-52bb15913646 tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-178da845-c43e-45d4-95a0-050b7f646f4e" returned: 0 in 0.306s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:05:26 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-03a535ee-c195-4089-b6e4-52bb15913646 tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] Lock "cinder-quobyte-178da845-c43e-45d4-95a0-050b7f646f4e" released by "delete_volume" :: held 0.859s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 14:05:26 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-03a535ee-c195-4089-b6e4-52bb15913646 tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] Created reservations ['1990d3b6-67d9-4d7e-b3d6-4e07ad65c77d', '0c1ed4cc-b363-497f-9268-1a9b01890245', 'f8006c8a-d285-4fba-a779-7a8eebc18c6b', '6a1ba36e-d704-4129-b0ba-6c5a376e59c3'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 14:05:27 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-03a535ee-c195-4089-b6e4-52bb15913646 tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 14:05:27 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-03a535ee-c195-4089-b6e4-52bb15913646 tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 14:05:27 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-03a535ee-c195-4089-b6e4-52bb15913646 tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 14:05:27 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-03a535ee-c195-4089-b6e4-52bb15913646 tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 14:05:27 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-03a535ee-c195-4089-b6e4-52bb15913646 tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 14:05:27 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-03a535ee-c195-4089-b6e4-52bb15913646 tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:05:27 devstack sudo[104613]: pam_unix(sudo:session): session closed for user root Jul 13 14:05:27 devstack sudo[104610]: pam_unix(sudo:session): session closed for user root Jul 13 14:05:27 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-810dbbe7-17b6-4d92-afa6-9aaa29594547 tempest-CreateVolumesFromSnapshotTest-61948078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-47619ab5-bc64-413d-bb7d-e74c118fdb97.info" returned: 0 in 0.290s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:05:27 devstack cinder-volume[87098]: WARNING cinder.volume.drivers.remotefs [None req-810dbbe7-17b6-4d92-afa6-9aaa29594547 tempest-CreateVolumesFromSnapshotTest-61948078 None] /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-47619ab5-bc64-413d-bb7d-e74c118fdb97.info is being set with open permissions: ugo+rw Jul 13 14:05:27 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-810dbbe7-17b6-4d92-afa6-9aaa29594547 tempest-CreateVolumesFromSnapshotTest-61948078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-47619ab5-bc64-413d-bb7d-e74c118fdb97.info {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:05:27 devstack sudo[104622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 Jul 13 14:05:27 devstack sudo[104622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:05:27 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-160850bf-24a9-4495-8946-094f3f5f4cb3 tempest-CreateVolumesFromImageTest-2023936333 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-0492cad4-2b54-476d-a2b1-49689cc4e80a" returned: 0 in 0.465s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:05:27 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-160850bf-24a9-4495-8946-094f3f5f4cb3 tempest-CreateVolumesFromImageTest-2023936333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-0492cad4-2b54-476d-a2b1-49689cc4e80a {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:05:27 devstack sudo[104623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-47619ab5-bc64-413d-bb7d-e74c118fdb97.info Jul 13 14:05:27 devstack sudo[104623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:05:27 devstack sudo[104626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-0492cad4-2b54-476d-a2b1-49689cc4e80a Jul 13 14:05:27 devstack sudo[104626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:05:27 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-25c195aa-cbf9-4b4b-97bc-27a32e1160e6 tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] Acquiring lock "cinder-765d95bf-d33b-47c1-82e9-720767f8d76b-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 14:05:27 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-25c195aa-cbf9-4b4b-97bc-27a32e1160e6 tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] Lock "cinder-765d95bf-d33b-47c1-82e9-720767f8d76b-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 14:05:27 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-25c195aa-cbf9-4b4b-97bc-27a32e1160e6 tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] Acquiring lock "cinder-quobyte-765d95bf-d33b-47c1-82e9-720767f8d76b" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 14:05:27 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-25c195aa-cbf9-4b4b-97bc-27a32e1160e6 tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] Lock "cinder-quobyte-765d95bf-d33b-47c1-82e9-720767f8d76b" acquired by "delete_volume" :: waited 0.024s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 14:05:27 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[da6114c3-875e-45a4-b3bc-24fc186e25fd]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 14:05:27 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-25c195aa-cbf9-4b4b-97bc-27a32e1160e6 tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-765d95bf-d33b-47c1-82e9-720767f8d76b {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:05:27 devstack sudo[104622]: pam_unix(sudo:session): session closed for user root Jul 13 14:05:27 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-03a535ee-c195-4089-b6e4-52bb15913646 tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78" returned: 0 in 0.318s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:05:27 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-03a535ee-c195-4089-b6e4-52bb15913646 tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 14:05:27 devstack sudo[104623]: pam_unix(sudo:session): session closed for user root Jul 13 14:05:27 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-810dbbe7-17b6-4d92-afa6-9aaa29594547 tempest-CreateVolumesFromSnapshotTest-61948078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-47619ab5-bc64-413d-bb7d-e74c118fdb97.info" returned: 0 in 0.300s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:05:27 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-810dbbe7-17b6-4d92-afa6-9aaa29594547 tempest-CreateVolumesFromSnapshotTest-61948078 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.350s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 14:05:27 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-d181d778-ab8c-4c5d-ad95-7ce7bb3af05c tempest-VolumeAndVolumeTypeFromImageTest-1673490618 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.497s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 14:05:27 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-d181d778-ab8c-4c5d-ad95-7ce7bb3af05c tempest-VolumeAndVolumeTypeFromImageTest-1673490618 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T12:05:18Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5e90e7d-df2e-43bb-a085-9e92d1b8cc13,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a7117fae06a426bade2b7c96cff132a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T12:05:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T12:05:18Z,use_quota=True,user_id='21537734620d49f2a57d390cd897ccc5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cc0678a5-f28e-4e6f-a202-9685a57e54fc),volume_type_id=cc0678a5-f28e-4e6f-a202-9685a57e54fc)}" {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 13 14:05:27 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-d181d778-ab8c-4c5d-ad95-7ce7bb3af05c tempest-VolumeAndVolumeTypeFromImageTest-1673490618 None] Creating volume d5e90e7d-df2e-43bb-a085-9e92d1b8cc13 {{(pid=87098) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 13 14:05:27 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-d181d778-ab8c-4c5d-ad95-7ce7bb3af05c tempest-VolumeAndVolumeTypeFromImageTest-1673490618 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 14:05:27 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-d181d778-ab8c-4c5d-ad95-7ce7bb3af05c tempest-VolumeAndVolumeTypeFromImageTest-1673490618 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 14:05:27 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-d181d778-ab8c-4c5d-ad95-7ce7bb3af05c tempest-VolumeAndVolumeTypeFromImageTest-1673490618 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 14:05:27 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-d181d778-ab8c-4c5d-ad95-7ce7bb3af05c tempest-VolumeAndVolumeTypeFromImageTest-1673490618 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 14:05:27 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-d181d778-ab8c-4c5d-ad95-7ce7bb3af05c tempest-VolumeAndVolumeTypeFromImageTest-1673490618 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 14:05:27 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-d181d778-ab8c-4c5d-ad95-7ce7bb3af05c tempest-VolumeAndVolumeTypeFromImageTest-1673490618 None] Selected osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 14:05:27 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-d181d778-ab8c-4c5d-ad95-7ce7bb3af05c tempest-VolumeAndVolumeTypeFromImageTest-1673490618 None] casted to osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 Jul 13 14:05:27 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-d181d778-ab8c-4c5d-ad95-7ce7bb3af05c tempest-VolumeAndVolumeTypeFromImageTest-1673490618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-d5e90e7d-df2e-43bb-a085-9e92d1b8cc13 1073741824 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:05:27 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-03a535ee-c195-4089-b6e4-52bb15913646 tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] Deleted volume successfully. Jul 13 14:05:27 devstack sudo[104630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-765d95bf-d33b-47c1-82e9-720767f8d76b Jul 13 14:05:27 devstack sudo[104630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:05:27 devstack sudo[104626]: pam_unix(sudo:session): session closed for user root Jul 13 14:05:27 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-160850bf-24a9-4495-8946-094f3f5f4cb3 tempest-CreateVolumesFromImageTest-2023936333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-0492cad4-2b54-476d-a2b1-49689cc4e80a" returned: 0 in 0.366s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:05:27 devstack sudo[104633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-d5e90e7d-df2e-43bb-a085-9e92d1b8cc13 1073741824 Jul 13 14:05:27 devstack sudo[104633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:05:27 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-160850bf-24a9-4495-8946-094f3f5f4cb3 tempest-CreateVolumesFromImageTest-2023936333 None] Lock "cinder-quobyte-0492cad4-2b54-476d-a2b1-49689cc4e80a" released by "delete_volume" :: held 0.913s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 14:05:27 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-03a535ee-c195-4089-b6e4-52bb15913646 tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] Lock "cinder-178da845-c43e-45d4-95a0-050b7f646f4e-delete_volume" released by "delete_volume" :: held 1.530s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 14:05:27 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-810dbbe7-17b6-4d92-afa6-9aaa29594547 tempest-CreateVolumesFromSnapshotTest-61948078 None] Create snapshot completed successfully Jul 13 14:05:27 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-160850bf-24a9-4495-8946-094f3f5f4cb3 tempest-CreateVolumesFromImageTest-2023936333 None] Created reservations ['7e7cd1aa-f6bb-41ce-a9ed-a263f0569fea', 'f7028cd4-e4b8-4980-96c3-39dd26b32fde', 'eff8d8b9-fa0c-47fc-ba15-818075c79f8a', '16c5ec4d-2400-4e77-88da-41b4b2f9b0d3'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 14:05:27 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-160850bf-24a9-4495-8946-094f3f5f4cb3 tempest-CreateVolumesFromImageTest-2023936333 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 14:05:27 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-160850bf-24a9-4495-8946-094f3f5f4cb3 tempest-CreateVolumesFromImageTest-2023936333 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 14:05:27 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-160850bf-24a9-4495-8946-094f3f5f4cb3 tempest-CreateVolumesFromImageTest-2023936333 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 14:05:27 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-160850bf-24a9-4495-8946-094f3f5f4cb3 tempest-CreateVolumesFromImageTest-2023936333 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 14:05:27 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-160850bf-24a9-4495-8946-094f3f5f4cb3 tempest-CreateVolumesFromImageTest-2023936333 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 14:05:27 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-160850bf-24a9-4495-8946-094f3f5f4cb3 tempest-CreateVolumesFromImageTest-2023936333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:05:27 devstack sudo[104636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 Jul 13 14:05:27 devstack sudo[104636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:05:27 devstack sudo[104630]: pam_unix(sudo:session): session closed for user root Jul 13 14:05:27 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-25c195aa-cbf9-4b4b-97bc-27a32e1160e6 tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-765d95bf-d33b-47c1-82e9-720767f8d76b" returned: 0 in 0.475s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:05:27 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-25c195aa-cbf9-4b4b-97bc-27a32e1160e6 tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-765d95bf-d33b-47c1-82e9-720767f8d76b {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:05:27 devstack sudo[104644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-765d95bf-d33b-47c1-82e9-720767f8d76b Jul 13 14:05:27 devstack sudo[104644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:05:27 devstack sudo[104636]: pam_unix(sudo:session): session closed for user root Jul 13 14:05:27 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-160850bf-24a9-4495-8946-094f3f5f4cb3 tempest-CreateVolumesFromImageTest-2023936333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78" returned: 0 in 0.322s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:05:27 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-160850bf-24a9-4495-8946-094f3f5f4cb3 tempest-CreateVolumesFromImageTest-2023936333 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 14:05:27 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-160850bf-24a9-4495-8946-094f3f5f4cb3 tempest-CreateVolumesFromImageTest-2023936333 None] Deleted volume successfully. Jul 13 14:05:28 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-160850bf-24a9-4495-8946-094f3f5f4cb3 tempest-CreateVolumesFromImageTest-2023936333 None] Lock "cinder-0492cad4-2b54-476d-a2b1-49689cc4e80a-delete_volume" released by "delete_volume" :: held 1.505s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 14:05:28 devstack sudo[104644]: pam_unix(sudo:session): session closed for user root Jul 13 14:05:28 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-25c195aa-cbf9-4b4b-97bc-27a32e1160e6 tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-765d95bf-d33b-47c1-82e9-720767f8d76b" returned: 0 in 0.352s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:05:28 devstack sudo[104633]: pam_unix(sudo:session): session closed for user root Jul 13 14:05:28 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-d181d778-ab8c-4c5d-ad95-7ce7bb3af05c tempest-VolumeAndVolumeTypeFromImageTest-1673490618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-d5e90e7d-df2e-43bb-a085-9e92d1b8cc13 1073741824" returned: 0 in 0.738s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:05:28 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-25c195aa-cbf9-4b4b-97bc-27a32e1160e6 tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] Lock "cinder-quobyte-765d95bf-d33b-47c1-82e9-720767f8d76b" released by "delete_volume" :: held 0.881s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 14:05:28 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-d181d778-ab8c-4c5d-ad95-7ce7bb3af05c tempest-VolumeAndVolumeTypeFromImageTest-1673490618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-d5e90e7d-df2e-43bb-a085-9e92d1b8cc13 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:05:28 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-25c195aa-cbf9-4b4b-97bc-27a32e1160e6 tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] Created reservations ['6a923eef-9aa6-47c3-8c0c-e86a68bd2387', '3d5105ef-00ef-4526-9d3d-e5f76d81f34f', '1cd763f3-b8e4-475f-9de3-dc5b663f8014', '9512525e-e212-4736-b71e-0a75410d0f73'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 14:05:28 devstack sudo[104650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-d5e90e7d-df2e-43bb-a085-9e92d1b8cc13 Jul 13 14:05:28 devstack sudo[104650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:05:28 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-a2c628d7-c39c-4a19-9dc2-88f244a4dd64 tempest-CreateVolumesFromSnapshotTest-61948078 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 14:05:28 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-a2c628d7-c39c-4a19-9dc2-88f244a4dd64 tempest-CreateVolumesFromSnapshotTest-61948078 None] Flow 'volume_create_manager' (3aa03d64-9abb-4d5e-aac2-90c4dbbaa0d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 14:05:28 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-a2c628d7-c39c-4a19-9dc2-88f244a4dd64 tempest-CreateVolumesFromSnapshotTest-61948078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (edc262d7-fd75-4e53-a623-a356d959612d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:05:28 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-a2c628d7-c39c-4a19-9dc2-88f244a4dd64 tempest-CreateVolumesFromSnapshotTest-61948078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (edc262d7-fd75-4e53-a623-a356d959612d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T12:05:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1192737971',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8af43fe5-e744-48c2-b431-20c25c2f9c40,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f84a0aabc104f4da5cc693a0132f06c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T12:05:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T12:05:28Z,use_quota=True,user_id='1955b577a12b4d9daf79921a01a6e1d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1147de8b-623b-426c-a13d-7fc824a80f67),volume_type_id=1147de8b-623b-426c-a13d-7fc824a80f67)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:05:28 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-a2c628d7-c39c-4a19-9dc2-88f244a4dd64 tempest-CreateVolumesFromSnapshotTest-61948078 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea6ee738-bc5c-4502-9a61-108173453146) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:05:28 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-a2c628d7-c39c-4a19-9dc2-88f244a4dd64 tempest-CreateVolumesFromSnapshotTest-61948078 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea6ee738-bc5c-4502-9a61-108173453146) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:05:28 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-a2c628d7-c39c-4a19-9dc2-88f244a4dd64 tempest-CreateVolumesFromSnapshotTest-61948078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32b17719-67d9-44a1-b7ab-4a24e5f4d746) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:05:28 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-a2c628d7-c39c-4a19-9dc2-88f244a4dd64 tempest-CreateVolumesFromSnapshotTest-61948078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32b17719-67d9-44a1-b7ab-4a24e5f4d746) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8af43fe5-e744-48c2-b431-20c25c2f9c40', 'volume_name': 'volume-8af43fe5-e744-48c2-b431-20c25c2f9c40', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:05:28 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-a2c628d7-c39c-4a19-9dc2-88f244a4dd64 tempest-CreateVolumesFromSnapshotTest-61948078 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7606a90b-27e5-4259-8b43-e9fa51c89a70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:05:28 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-a2c628d7-c39c-4a19-9dc2-88f244a4dd64 tempest-CreateVolumesFromSnapshotTest-61948078 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7606a90b-27e5-4259-8b43-e9fa51c89a70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:05:28 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-a2c628d7-c39c-4a19-9dc2-88f244a4dd64 tempest-CreateVolumesFromSnapshotTest-61948078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48891629-a2eb-496c-aa1f-568591edb20c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:05:28 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-a2c628d7-c39c-4a19-9dc2-88f244a4dd64 tempest-CreateVolumesFromSnapshotTest-61948078 None] Volume 8af43fe5-e744-48c2-b431-20c25c2f9c40: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8af43fe5-e744-48c2-b431-20c25c2f9c40', 'volume_size': 1} Jul 13 14:05:28 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-a2c628d7-c39c-4a19-9dc2-88f244a4dd64 tempest-CreateVolumesFromSnapshotTest-61948078 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 14:05:28 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-a0a60cac-e607-4b3a-8be8-f048695c0969 tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] Acquiring lock "cinder-23f43f57-77c9-4a9c-a0c1-1917e27b248e-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 14:05:28 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-a0a60cac-e607-4b3a-8be8-f048695c0969 tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] Lock "cinder-23f43f57-77c9-4a9c-a0c1-1917e27b248e-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 14:05:28 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-25c195aa-cbf9-4b4b-97bc-27a32e1160e6 tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 14:05:28 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-25c195aa-cbf9-4b4b-97bc-27a32e1160e6 tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 14:05:28 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-25c195aa-cbf9-4b4b-97bc-27a32e1160e6 tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 14:05:28 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-25c195aa-cbf9-4b4b-97bc-27a32e1160e6 tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 14:05:28 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-25c195aa-cbf9-4b4b-97bc-27a32e1160e6 tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 14:05:28 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-25c195aa-cbf9-4b4b-97bc-27a32e1160e6 tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:05:28 devstack sudo[104652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 Jul 13 14:05:28 devstack sudo[104652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:05:28 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-a0a60cac-e607-4b3a-8be8-f048695c0969 tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] Acquiring lock "cinder-quobyte-23f43f57-77c9-4a9c-a0c1-1917e27b248e" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 14:05:28 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-a0a60cac-e607-4b3a-8be8-f048695c0969 tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] Lock "cinder-quobyte-23f43f57-77c9-4a9c-a0c1-1917e27b248e" acquired by "delete_volume" :: waited 0.025s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 14:05:28 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec665c16-933b-4eb4-b32c-dc6982d95cb3]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 14:05:28 devstack sudo[104650]: pam_unix(sudo:session): session closed for user root Jul 13 14:05:28 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-a0a60cac-e607-4b3a-8be8-f048695c0969 tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-23f43f57-77c9-4a9c-a0c1-1917e27b248e {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:05:28 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-d181d778-ab8c-4c5d-ad95-7ce7bb3af05c tempest-VolumeAndVolumeTypeFromImageTest-1673490618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-d5e90e7d-df2e-43bb-a085-9e92d1b8cc13" returned: 0 in 0.517s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:05:28 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-d181d778-ab8c-4c5d-ad95-7ce7bb3af05c tempest-VolumeAndVolumeTypeFromImageTest-1673490618 None] <== create_volume: return (1337ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'} {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 13 14:05:28 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-d181d778-ab8c-4c5d-ad95-7ce7bb3af05c tempest-VolumeAndVolumeTypeFromImageTest-1673490618 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.341s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 14:05:28 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-a2c628d7-c39c-4a19-9dc2-88f244a4dd64 tempest-CreateVolumesFromSnapshotTest-61948078 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.297s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 14:05:28 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-a2c628d7-c39c-4a19-9dc2-88f244a4dd64 tempest-CreateVolumesFromSnapshotTest-61948078 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T12:05:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1192737971',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8af43fe5-e744-48c2-b431-20c25c2f9c40,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f84a0aabc104f4da5cc693a0132f06c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T12:05:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T12:05:28Z,use_quota=True,user_id='1955b577a12b4d9daf79921a01a6e1d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1147de8b-623b-426c-a13d-7fc824a80f67),volume_type_id=1147de8b-623b-426c-a13d-7fc824a80f67)}" {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 13 14:05:28 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-a2c628d7-c39c-4a19-9dc2-88f244a4dd64 tempest-CreateVolumesFromSnapshotTest-61948078 None] Creating volume 8af43fe5-e744-48c2-b431-20c25c2f9c40 {{(pid=87098) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 13 14:05:28 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-a2c628d7-c39c-4a19-9dc2-88f244a4dd64 tempest-CreateVolumesFromSnapshotTest-61948078 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 14:05:28 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-a2c628d7-c39c-4a19-9dc2-88f244a4dd64 tempest-CreateVolumesFromSnapshotTest-61948078 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 14:05:28 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-a2c628d7-c39c-4a19-9dc2-88f244a4dd64 tempest-CreateVolumesFromSnapshotTest-61948078 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 14:05:28 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-a2c628d7-c39c-4a19-9dc2-88f244a4dd64 tempest-CreateVolumesFromSnapshotTest-61948078 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 14:05:28 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-a2c628d7-c39c-4a19-9dc2-88f244a4dd64 tempest-CreateVolumesFromSnapshotTest-61948078 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 14:05:28 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-a2c628d7-c39c-4a19-9dc2-88f244a4dd64 tempest-CreateVolumesFromSnapshotTest-61948078 None] Selected osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 14:05:28 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-a2c628d7-c39c-4a19-9dc2-88f244a4dd64 tempest-CreateVolumesFromSnapshotTest-61948078 None] casted to osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 Jul 13 14:05:28 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-a2c628d7-c39c-4a19-9dc2-88f244a4dd64 tempest-CreateVolumesFromSnapshotTest-61948078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-8af43fe5-e744-48c2-b431-20c25c2f9c40 1073741824 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:05:28 devstack sudo[104656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-8af43fe5-e744-48c2-b431-20c25c2f9c40 1073741824 Jul 13 14:05:28 devstack sudo[104656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:05:28 devstack sudo[104655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-23f43f57-77c9-4a9c-a0c1-1917e27b248e Jul 13 14:05:28 devstack sudo[104655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:05:28 devstack cinder-volume[87098]: DEBUG cinder.volume.volume_utils [None req-d181d778-ab8c-4c5d-ad95-7ce7bb3af05c tempest-VolumeAndVolumeTypeFromImageTest-1673490618 None] Attempting download of c863dcc3-ec31-44d0-b4fd-21cc18530275 ((None, [{'url': 'file:///opt/stack/data/glance/images/c863dcc3-ec31-44d0-b4fd-21cc18530275', 'metadata': {}}])) to volume d5e90e7d-df2e-43bb-a085-9e92d1b8cc13. {{(pid=87098) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 13 14:05:28 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-d5af9fec-e12b-43ce-b8df-f93569aee244 tempest-CreateVolumesFromSnapshotTest-61948078 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 14:05:29 devstack sudo[104652]: pam_unix(sudo:session): session closed for user root Jul 13 14:05:29 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-d5af9fec-e12b-43ce-b8df-f93569aee244 tempest-CreateVolumesFromSnapshotTest-61948078 None] Flow 'volume_create_manager' (916f7ba3-3576-45a8-8b23-8897340adfb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 14:05:29 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-d5af9fec-e12b-43ce-b8df-f93569aee244 tempest-CreateVolumesFromSnapshotTest-61948078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a721d8a8-866e-486b-9c00-1011fef16ecb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:05:29 devstack cinder-volume[87098]: DEBUG oslo_service.periodic_task [None req-727a1692-ea28-4a77-b327-0d94e8f01efb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87098) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 13 14:05:29 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-727a1692-ea28-4a77-b327-0d94e8f01efb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 14:05:29 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-727a1692-ea28-4a77-b327-0d94e8f01efb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 14:05:29 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-727a1692-ea28-4a77-b327-0d94e8f01efb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 14:05:29 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-727a1692-ea28-4a77-b327-0d94e8f01efb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 14:05:29 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-727a1692-ea28-4a77-b327-0d94e8f01efb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 14:05:29 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-727a1692-ea28-4a77-b327-0d94e8f01efb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:05:29 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-25c195aa-cbf9-4b4b-97bc-27a32e1160e6 tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78" returned: 0 in 0.547s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:05:29 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-25c195aa-cbf9-4b4b-97bc-27a32e1160e6 tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 14:05:29 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-d5af9fec-e12b-43ce-b8df-f93569aee244 tempest-CreateVolumesFromSnapshotTest-61948078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a721d8a8-866e-486b-9c00-1011fef16ecb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T12:05:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1772979089',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82931003-2183-4d42-a2f4-76c1c2501bf7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f84a0aabc104f4da5cc693a0132f06c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T12:05:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T12:05:29Z,use_quota=True,user_id='1955b577a12b4d9daf79921a01a6e1d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1147de8b-623b-426c-a13d-7fc824a80f67),volume_type_id=1147de8b-623b-426c-a13d-7fc824a80f67)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:05:29 devstack sudo[104660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 Jul 13 14:05:29 devstack sudo[104660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:05:29 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-d5af9fec-e12b-43ce-b8df-f93569aee244 tempest-CreateVolumesFromSnapshotTest-61948078 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55e0e526-fbea-4dbd-99a7-6df5965f6cb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:05:29 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-d5af9fec-e12b-43ce-b8df-f93569aee244 tempest-CreateVolumesFromSnapshotTest-61948078 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55e0e526-fbea-4dbd-99a7-6df5965f6cb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:05:29 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-d5af9fec-e12b-43ce-b8df-f93569aee244 tempest-CreateVolumesFromSnapshotTest-61948078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (023e0d72-66cc-4b7a-b4fc-59427d1f1cae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:05:29 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-d5af9fec-e12b-43ce-b8df-f93569aee244 tempest-CreateVolumesFromSnapshotTest-61948078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (023e0d72-66cc-4b7a-b4fc-59427d1f1cae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '82931003-2183-4d42-a2f4-76c1c2501bf7', 'volume_name': 'volume-82931003-2183-4d42-a2f4-76c1c2501bf7', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:05:29 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-d5af9fec-e12b-43ce-b8df-f93569aee244 tempest-CreateVolumesFromSnapshotTest-61948078 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4100434a-fdaa-49ec-b02d-10fb0fbbbd57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:05:29 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-d5af9fec-e12b-43ce-b8df-f93569aee244 tempest-CreateVolumesFromSnapshotTest-61948078 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4100434a-fdaa-49ec-b02d-10fb0fbbbd57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:05:29 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-d5af9fec-e12b-43ce-b8df-f93569aee244 tempest-CreateVolumesFromSnapshotTest-61948078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa3c8aa3-cd0c-4b33-b02b-19c59be16fa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:05:29 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-d5af9fec-e12b-43ce-b8df-f93569aee244 tempest-CreateVolumesFromSnapshotTest-61948078 None] Volume 82931003-2183-4d42-a2f4-76c1c2501bf7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-82931003-2183-4d42-a2f4-76c1c2501bf7', 'volume_size': 1} Jul 13 14:05:29 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-d5af9fec-e12b-43ce-b8df-f93569aee244 tempest-CreateVolumesFromSnapshotTest-61948078 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 14:05:29 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-25c195aa-cbf9-4b4b-97bc-27a32e1160e6 tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] Deleted volume successfully. Jul 13 14:05:29 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-25c195aa-cbf9-4b4b-97bc-27a32e1160e6 tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] Lock "cinder-765d95bf-d33b-47c1-82e9-720767f8d76b-delete_volume" released by "delete_volume" :: held 2.043s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 14:05:29 devstack sudo[104655]: pam_unix(sudo:session): session closed for user root Jul 13 14:05:29 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-a0a60cac-e607-4b3a-8be8-f048695c0969 tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-23f43f57-77c9-4a9c-a0c1-1917e27b248e" returned: 0 in 0.745s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:05:29 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-a0a60cac-e607-4b3a-8be8-f048695c0969 tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-23f43f57-77c9-4a9c-a0c1-1917e27b248e {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:05:29 devstack sudo[104670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-23f43f57-77c9-4a9c-a0c1-1917e27b248e Jul 13 14:05:29 devstack sudo[104670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:05:29 devstack sudo[104660]: pam_unix(sudo:session): session closed for user root Jul 13 14:05:29 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-727a1692-ea28-4a77-b327-0d94e8f01efb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78" returned: 0 in 0.532s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:05:29 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-727a1692-ea28-4a77-b327-0d94e8f01efb None None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 14:05:29 devstack cinder-volume[87098]: DEBUG oslo_service.periodic_task [None req-727a1692-ea28-4a77-b327-0d94e8f01efb None None] Running periodic task VolumeManager._thread_info {{(pid=87098) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 13 14:05:29 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-727a1692-ea28-4a77-b327-0d94e8f01efb None None] thread count: 28 {{(pid=87098) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 13 14:05:29 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-727a1692-ea28-4a77-b327-0d94e8f01efb None None] thread info: [<_MainThread(MainThread, started 127988054597760)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87098) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 13 14:05:29 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-adb7b359-360d-496f-af21-9518607fddec tempest-CreateVolumesFromSnapshotTest-61948078 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 14:05:29 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-adb7b359-360d-496f-af21-9518607fddec tempest-CreateVolumesFromSnapshotTest-61948078 None] Flow 'volume_create_manager' (f4cd2455-93c8-4493-bd84-28183b8c5f8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 14:05:29 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-adb7b359-360d-496f-af21-9518607fddec tempest-CreateVolumesFromSnapshotTest-61948078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9de90b50-c93a-4190-b6d5-da7e62b70a4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:05:29 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-adb7b359-360d-496f-af21-9518607fddec tempest-CreateVolumesFromSnapshotTest-61948078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9de90b50-c93a-4190-b6d5-da7e62b70a4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T12:05:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-124200358',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85c7e60a-d7d9-44a1-a4ee-25065916fae4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f84a0aabc104f4da5cc693a0132f06c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T12:05:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T12:05:30Z,use_quota=True,user_id='1955b577a12b4d9daf79921a01a6e1d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1147de8b-623b-426c-a13d-7fc824a80f67),volume_type_id=1147de8b-623b-426c-a13d-7fc824a80f67)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:05:29 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-adb7b359-360d-496f-af21-9518607fddec tempest-CreateVolumesFromSnapshotTest-61948078 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5494f62e-edc8-413a-91c0-dae823758750) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:05:29 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-adb7b359-360d-496f-af21-9518607fddec tempest-CreateVolumesFromSnapshotTest-61948078 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5494f62e-edc8-413a-91c0-dae823758750) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:05:29 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-adb7b359-360d-496f-af21-9518607fddec tempest-CreateVolumesFromSnapshotTest-61948078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b285704a-8c4c-4f41-a916-20a54adf3ccc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:05:29 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-adb7b359-360d-496f-af21-9518607fddec tempest-CreateVolumesFromSnapshotTest-61948078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b285704a-8c4c-4f41-a916-20a54adf3ccc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '85c7e60a-d7d9-44a1-a4ee-25065916fae4', 'volume_name': 'volume-85c7e60a-d7d9-44a1-a4ee-25065916fae4', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:05:29 devstack sudo[104656]: pam_unix(sudo:session): session closed for user root Jul 13 14:05:29 devstack sudo[104670]: pam_unix(sudo:session): session closed for user root Jul 13 14:05:29 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-adb7b359-360d-496f-af21-9518607fddec tempest-CreateVolumesFromSnapshotTest-61948078 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06deab3d-2760-4e1a-82a1-d4f629b14f36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:05:29 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-adb7b359-360d-496f-af21-9518607fddec tempest-CreateVolumesFromSnapshotTest-61948078 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06deab3d-2760-4e1a-82a1-d4f629b14f36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:05:29 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-adb7b359-360d-496f-af21-9518607fddec tempest-CreateVolumesFromSnapshotTest-61948078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8942a9dd-3092-4573-894a-907f5585d91b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:05:29 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-adb7b359-360d-496f-af21-9518607fddec tempest-CreateVolumesFromSnapshotTest-61948078 None] Volume 85c7e60a-d7d9-44a1-a4ee-25065916fae4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-85c7e60a-d7d9-44a1-a4ee-25065916fae4', 'volume_size': 1} Jul 13 14:05:29 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-adb7b359-360d-496f-af21-9518607fddec tempest-CreateVolumesFromSnapshotTest-61948078 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 14:05:29 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b10795f-1711-4ef3-9bc1-f8a86081435e]: (4, 'raw') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 14:05:29 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-d181d778-ab8c-4c5d-ad95-7ce7bb3af05c tempest-VolumeAndVolumeTypeFromImageTest-1673490618 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c863dcc3-ec31-44d0-b4fd-21cc18530275_3tz0p02_ {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:05:29 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-a0a60cac-e607-4b3a-8be8-f048695c0969 tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-23f43f57-77c9-4a9c-a0c1-1917e27b248e" returned: 0 in 0.420s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:05:29 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-a2c628d7-c39c-4a19-9dc2-88f244a4dd64 tempest-CreateVolumesFromSnapshotTest-61948078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-8af43fe5-e744-48c2-b431-20c25c2f9c40 1073741824" returned: 0 in 1.119s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:05:29 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-a0a60cac-e607-4b3a-8be8-f048695c0969 tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] Lock "cinder-quobyte-23f43f57-77c9-4a9c-a0c1-1917e27b248e" released by "delete_volume" :: held 1.284s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 14:05:30 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-a2c628d7-c39c-4a19-9dc2-88f244a4dd64 tempest-CreateVolumesFromSnapshotTest-61948078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-8af43fe5-e744-48c2-b431-20c25c2f9c40 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:05:30 devstack sudo[104675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-8af43fe5-e744-48c2-b431-20c25c2f9c40 Jul 13 14:05:30 devstack sudo[104675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:05:30 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-a0a60cac-e607-4b3a-8be8-f048695c0969 tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] Created reservations ['cd550937-dbed-48a2-82a1-f88e140cd293', 'bc2ba642-803a-4655-be4a-fd8b9036bc03', '48e8d7c0-0695-47db-b50e-dd20a0b4c594', 'feb0014d-885c-4187-a351-48afe677944e'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 14:05:30 devstack sudo[104674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c863dcc3-ec31-44d0-b4fd-21cc18530275_3tz0p02_ Jul 13 14:05:30 devstack sudo[104674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:05:30 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa646bc2-48c2-4bb0-93e7-b80b9065167c tempest-CreateVolumesFromSnapshotTest-61948078 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 14:05:30 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-aa646bc2-48c2-4bb0-93e7-b80b9065167c tempest-CreateVolumesFromSnapshotTest-61948078 None] Flow 'volume_create_manager' (1bc3d24a-501b-446e-8446-251c8bc9e3f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 14:05:30 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-aa646bc2-48c2-4bb0-93e7-b80b9065167c tempest-CreateVolumesFromSnapshotTest-61948078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a229ecda-51af-48ec-9079-aa554a4b8e70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:05:30 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-aa646bc2-48c2-4bb0-93e7-b80b9065167c tempest-CreateVolumesFromSnapshotTest-61948078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a229ecda-51af-48ec-9079-aa554a4b8e70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T12:05:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1773875997',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5425ad8-fe2b-4a49-91cd-b9fae58b6991,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f84a0aabc104f4da5cc693a0132f06c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T12:05:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T12:05:30Z,use_quota=True,user_id='1955b577a12b4d9daf79921a01a6e1d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1147de8b-623b-426c-a13d-7fc824a80f67),volume_type_id=1147de8b-623b-426c-a13d-7fc824a80f67)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:05:30 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-aa646bc2-48c2-4bb0-93e7-b80b9065167c tempest-CreateVolumesFromSnapshotTest-61948078 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20f57d16-c26c-4bff-a536-b6d164d99681) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:05:30 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-aa646bc2-48c2-4bb0-93e7-b80b9065167c tempest-CreateVolumesFromSnapshotTest-61948078 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20f57d16-c26c-4bff-a536-b6d164d99681) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:05:30 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-aa646bc2-48c2-4bb0-93e7-b80b9065167c tempest-CreateVolumesFromSnapshotTest-61948078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3101418c-f67e-471f-a984-ef18d8a287c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:05:30 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-aa646bc2-48c2-4bb0-93e7-b80b9065167c tempest-CreateVolumesFromSnapshotTest-61948078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3101418c-f67e-471f-a984-ef18d8a287c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c5425ad8-fe2b-4a49-91cd-b9fae58b6991', 'volume_name': 'volume-c5425ad8-fe2b-4a49-91cd-b9fae58b6991', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:05:30 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-aa646bc2-48c2-4bb0-93e7-b80b9065167c tempest-CreateVolumesFromSnapshotTest-61948078 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f37988a2-fcd6-4e7e-beab-1a67f600198a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:05:30 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-aa646bc2-48c2-4bb0-93e7-b80b9065167c tempest-CreateVolumesFromSnapshotTest-61948078 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f37988a2-fcd6-4e7e-beab-1a67f600198a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:05:30 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-aa646bc2-48c2-4bb0-93e7-b80b9065167c tempest-CreateVolumesFromSnapshotTest-61948078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e25979f-c37d-408a-b3fa-0d55e8b6fb76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:05:30 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-aa646bc2-48c2-4bb0-93e7-b80b9065167c tempest-CreateVolumesFromSnapshotTest-61948078 None] Volume c5425ad8-fe2b-4a49-91cd-b9fae58b6991: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c5425ad8-fe2b-4a49-91cd-b9fae58b6991', 'volume_size': 1} Jul 13 14:05:30 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-aa646bc2-48c2-4bb0-93e7-b80b9065167c tempest-CreateVolumesFromSnapshotTest-61948078 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 14:05:30 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-a0a60cac-e607-4b3a-8be8-f048695c0969 tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 14:05:30 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-a0a60cac-e607-4b3a-8be8-f048695c0969 tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 14:05:30 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-a0a60cac-e607-4b3a-8be8-f048695c0969 tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 14:05:30 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-a0a60cac-e607-4b3a-8be8-f048695c0969 tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 14:05:30 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-a0a60cac-e607-4b3a-8be8-f048695c0969 tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 14:05:30 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-a0a60cac-e607-4b3a-8be8-f048695c0969 tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:05:30 devstack sudo[104675]: pam_unix(sudo:session): session closed for user root Jul 13 14:05:30 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-a2c628d7-c39c-4a19-9dc2-88f244a4dd64 tempest-CreateVolumesFromSnapshotTest-61948078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-8af43fe5-e744-48c2-b431-20c25c2f9c40" returned: 0 in 0.426s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:05:30 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-a2c628d7-c39c-4a19-9dc2-88f244a4dd64 tempest-CreateVolumesFromSnapshotTest-61948078 None] <== create_volume: return (1648ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'} {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 13 14:05:30 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-a2c628d7-c39c-4a19-9dc2-88f244a4dd64 tempest-CreateVolumesFromSnapshotTest-61948078 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.653s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 14:05:30 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-d5af9fec-e12b-43ce-b8df-f93569aee244 tempest-CreateVolumesFromSnapshotTest-61948078 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.232s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 14:05:30 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-d5af9fec-e12b-43ce-b8df-f93569aee244 tempest-CreateVolumesFromSnapshotTest-61948078 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T12:05:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1772979089',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82931003-2183-4d42-a2f4-76c1c2501bf7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f84a0aabc104f4da5cc693a0132f06c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T12:05:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T12:05:29Z,use_quota=True,user_id='1955b577a12b4d9daf79921a01a6e1d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1147de8b-623b-426c-a13d-7fc824a80f67),volume_type_id=1147de8b-623b-426c-a13d-7fc824a80f67)}" {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 13 14:05:30 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-d5af9fec-e12b-43ce-b8df-f93569aee244 tempest-CreateVolumesFromSnapshotTest-61948078 None] Creating volume 82931003-2183-4d42-a2f4-76c1c2501bf7 {{(pid=87098) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 13 14:05:30 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-d5af9fec-e12b-43ce-b8df-f93569aee244 tempest-CreateVolumesFromSnapshotTest-61948078 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 14:05:30 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-d5af9fec-e12b-43ce-b8df-f93569aee244 tempest-CreateVolumesFromSnapshotTest-61948078 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 14:05:30 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-d5af9fec-e12b-43ce-b8df-f93569aee244 tempest-CreateVolumesFromSnapshotTest-61948078 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 14:05:30 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-d5af9fec-e12b-43ce-b8df-f93569aee244 tempest-CreateVolumesFromSnapshotTest-61948078 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 14:05:30 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-d5af9fec-e12b-43ce-b8df-f93569aee244 tempest-CreateVolumesFromSnapshotTest-61948078 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 14:05:30 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-d5af9fec-e12b-43ce-b8df-f93569aee244 tempest-CreateVolumesFromSnapshotTest-61948078 None] Selected osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 14:05:30 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-d5af9fec-e12b-43ce-b8df-f93569aee244 tempest-CreateVolumesFromSnapshotTest-61948078 None] casted to osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 Jul 13 14:05:30 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-d5af9fec-e12b-43ce-b8df-f93569aee244 tempest-CreateVolumesFromSnapshotTest-61948078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-82931003-2183-4d42-a2f4-76c1c2501bf7 1073741824 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:05:30 devstack sudo[104679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 Jul 13 14:05:30 devstack sudo[104679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:05:30 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-a2c628d7-c39c-4a19-9dc2-88f244a4dd64 tempest-CreateVolumesFromSnapshotTest-61948078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48891629-a2eb-496c-aa1f-568591edb20c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8af43fe5-e744-48c2-b431-20c25c2f9c40', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:05:30 devstack sudo[104680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-82931003-2183-4d42-a2f4-76c1c2501bf7 1073741824 Jul 13 14:05:30 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-a2c628d7-c39c-4a19-9dc2-88f244a4dd64 tempest-CreateVolumesFromSnapshotTest-61948078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e17f45a-4d84-44c1-99f3-5e3dc34defc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:05:30 devstack sudo[104680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:05:30 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-a2c628d7-c39c-4a19-9dc2-88f244a4dd64 tempest-CreateVolumesFromSnapshotTest-61948078 None] Volume volume-8af43fe5-e744-48c2-b431-20c25c2f9c40 (8af43fe5-e744-48c2-b431-20c25c2f9c40): created successfully Jul 13 14:05:30 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-a2c628d7-c39c-4a19-9dc2-88f244a4dd64 tempest-CreateVolumesFromSnapshotTest-61948078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e17f45a-4d84-44c1-99f3-5e3dc34defc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:05:30 devstack sudo[104674]: pam_unix(sudo:session): session closed for user root Jul 13 14:05:30 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-a2c628d7-c39c-4a19-9dc2-88f244a4dd64 tempest-CreateVolumesFromSnapshotTest-61948078 None] Flow 'volume_create_manager' (3aa03d64-9abb-4d5e-aac2-90c4dbbaa0d7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 14:05:30 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-d181d778-ab8c-4c5d-ad95-7ce7bb3af05c tempest-VolumeAndVolumeTypeFromImageTest-1673490618 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c863dcc3-ec31-44d0-b4fd-21cc18530275_3tz0p02_" returned: 0 in 0.691s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:05:30 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-d181d778-ab8c-4c5d-ad95-7ce7bb3af05c tempest-VolumeAndVolumeTypeFromImageTest-1673490618 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c863dcc3-ec31-44d0-b4fd-21cc18530275_3tz0p02_ {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:05:30 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-a2c628d7-c39c-4a19-9dc2-88f244a4dd64 tempest-CreateVolumesFromSnapshotTest-61948078 None] Created volume successfully. Jul 13 14:05:30 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b24b4d0-edd2-46e6-a70b-874098434abf tempest-CreateVolumesFromSnapshotTest-61948078 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 14:05:30 devstack sudo[104685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c863dcc3-ec31-44d0-b4fd-21cc18530275_3tz0p02_ Jul 13 14:05:30 devstack sudo[104685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:05:30 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-1b24b4d0-edd2-46e6-a70b-874098434abf tempest-CreateVolumesFromSnapshotTest-61948078 None] Flow 'volume_create_manager' (5023f876-6d41-468a-a629-5a3c043ce571) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 14:05:30 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-1b24b4d0-edd2-46e6-a70b-874098434abf tempest-CreateVolumesFromSnapshotTest-61948078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c200237-29a5-4cdf-9ac8-c205615ef912) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:05:30 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-b7fc0989-bfed-43c5-8820-c12cfc157862 tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] Acquiring lock "cinder-094b9914-584b-481f-9218-bddb49e0aa75-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 14:05:30 devstack sudo[104679]: pam_unix(sudo:session): session closed for user root Jul 13 14:05:30 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-a0a60cac-e607-4b3a-8be8-f048695c0969 tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78" returned: 0 in 0.494s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:05:30 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-a0a60cac-e607-4b3a-8be8-f048695c0969 tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 14:05:30 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-a0a60cac-e607-4b3a-8be8-f048695c0969 tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] Deleted volume successfully. Jul 13 14:05:30 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-1b24b4d0-edd2-46e6-a70b-874098434abf tempest-CreateVolumesFromSnapshotTest-61948078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c200237-29a5-4cdf-9ac8-c205615ef912) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T12:05:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-440401819',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96b7b4cf-4961-4137-ae27-9284bb6155b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f84a0aabc104f4da5cc693a0132f06c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T12:05:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T12:05:31Z,use_quota=True,user_id='1955b577a12b4d9daf79921a01a6e1d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1147de8b-623b-426c-a13d-7fc824a80f67),volume_type_id=1147de8b-623b-426c-a13d-7fc824a80f67)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:05:30 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-1b24b4d0-edd2-46e6-a70b-874098434abf tempest-CreateVolumesFromSnapshotTest-61948078 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62dbf461-21f5-4186-ba0d-a79814f0b6dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:05:30 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-1b24b4d0-edd2-46e6-a70b-874098434abf tempest-CreateVolumesFromSnapshotTest-61948078 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62dbf461-21f5-4186-ba0d-a79814f0b6dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:05:30 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-1b24b4d0-edd2-46e6-a70b-874098434abf tempest-CreateVolumesFromSnapshotTest-61948078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a300fa6-264a-4ec5-872e-ff9d650faee8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:05:30 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-1b24b4d0-edd2-46e6-a70b-874098434abf tempest-CreateVolumesFromSnapshotTest-61948078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a300fa6-264a-4ec5-872e-ff9d650faee8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '96b7b4cf-4961-4137-ae27-9284bb6155b0', 'volume_name': 'volume-96b7b4cf-4961-4137-ae27-9284bb6155b0', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:05:30 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-1b24b4d0-edd2-46e6-a70b-874098434abf tempest-CreateVolumesFromSnapshotTest-61948078 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f462dd0-5c45-4c3e-9696-d1187f4b24d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:05:30 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-1b24b4d0-edd2-46e6-a70b-874098434abf tempest-CreateVolumesFromSnapshotTest-61948078 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f462dd0-5c45-4c3e-9696-d1187f4b24d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:05:30 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-1b24b4d0-edd2-46e6-a70b-874098434abf tempest-CreateVolumesFromSnapshotTest-61948078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ccb1dd03-a708-4fea-8972-007624498bb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:05:30 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-1b24b4d0-edd2-46e6-a70b-874098434abf tempest-CreateVolumesFromSnapshotTest-61948078 None] Volume 96b7b4cf-4961-4137-ae27-9284bb6155b0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-96b7b4cf-4961-4137-ae27-9284bb6155b0', 'volume_size': 1} Jul 13 14:05:30 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-1b24b4d0-edd2-46e6-a70b-874098434abf tempest-CreateVolumesFromSnapshotTest-61948078 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 14:05:30 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-b7fc0989-bfed-43c5-8820-c12cfc157862 tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] Lock "cinder-094b9914-584b-481f-9218-bddb49e0aa75-delete_volume" acquired by "delete_volume" :: waited 0.087s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 14:05:31 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-a0a60cac-e607-4b3a-8be8-f048695c0969 tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] Lock "cinder-23f43f57-77c9-4a9c-a0c1-1917e27b248e-delete_volume" released by "delete_volume" :: held 2.493s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 14:05:31 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-b7fc0989-bfed-43c5-8820-c12cfc157862 tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] Acquiring lock "cinder-quobyte-094b9914-584b-481f-9218-bddb49e0aa75" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 14:05:31 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-b7fc0989-bfed-43c5-8820-c12cfc157862 tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] Lock "cinder-quobyte-094b9914-584b-481f-9218-bddb49e0aa75" acquired by "delete_volume" :: waited 0.025s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 14:05:31 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f21cddd-87b6-4969-9d05-8e71bf90e4fc]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 14:05:31 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-b7fc0989-bfed-43c5-8820-c12cfc157862 tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-094b9914-584b-481f-9218-bddb49e0aa75 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:05:31 devstack sudo[104680]: pam_unix(sudo:session): session closed for user root Jul 13 14:05:31 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-d5af9fec-e12b-43ce-b8df-f93569aee244 tempest-CreateVolumesFromSnapshotTest-61948078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-82931003-2183-4d42-a2f4-76c1c2501bf7 1073741824" returned: 0 in 0.660s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:05:31 devstack sudo[104685]: pam_unix(sudo:session): session closed for user root Jul 13 14:05:31 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-d181d778-ab8c-4c5d-ad95-7ce7bb3af05c tempest-VolumeAndVolumeTypeFromImageTest-1673490618 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c863dcc3-ec31-44d0-b4fd-21cc18530275_3tz0p02_" returned: 1 in 0.558s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:05:31 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-d181d778-ab8c-4c5d-ad95-7ce7bb3af05c tempest-VolumeAndVolumeTypeFromImageTest-1673490618 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c863dcc3-ec31-44d0-b4fd-21cc18530275_3tz0p02_' failed. Not Retrying. {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 13 14:05:31 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[68929d9e-e024-4032-a02a-ba296e7919db]: (4, 'raw') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 14:05:31 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-d181d778-ab8c-4c5d-ad95-7ce7bb3af05c tempest-VolumeAndVolumeTypeFromImageTest-1673490618 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c863dcc3-ec31-44d0-b4fd-21cc18530275_wm4fhypqdevstack@QuobyteHD {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:05:31 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-d5af9fec-e12b-43ce-b8df-f93569aee244 tempest-CreateVolumesFromSnapshotTest-61948078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-82931003-2183-4d42-a2f4-76c1c2501bf7 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:05:31 devstack sudo[104696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-82931003-2183-4d42-a2f4-76c1c2501bf7 Jul 13 14:05:31 devstack sudo[104692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-094b9914-584b-481f-9218-bddb49e0aa75 Jul 13 14:05:31 devstack sudo[104696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:05:31 devstack sudo[104692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:05:31 devstack sudo[104695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c863dcc3-ec31-44d0-b4fd-21cc18530275_wm4fhypqdevstack@QuobyteHD Jul 13 14:05:31 devstack sudo[104695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:05:31 devstack sudo[104696]: pam_unix(sudo:session): session closed for user root Jul 13 14:05:31 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-d5af9fec-e12b-43ce-b8df-f93569aee244 tempest-CreateVolumesFromSnapshotTest-61948078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-82931003-2183-4d42-a2f4-76c1c2501bf7" returned: 0 in 0.324s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:05:31 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-d5af9fec-e12b-43ce-b8df-f93569aee244 tempest-CreateVolumesFromSnapshotTest-61948078 None] <== create_volume: return (1082ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'} {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 13 14:05:31 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-d5af9fec-e12b-43ce-b8df-f93569aee244 tempest-CreateVolumesFromSnapshotTest-61948078 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.085s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 14:05:31 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-adb7b359-360d-496f-af21-9518607fddec tempest-CreateVolumesFromSnapshotTest-61948078 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.641s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 14:05:31 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-adb7b359-360d-496f-af21-9518607fddec tempest-CreateVolumesFromSnapshotTest-61948078 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T12:05:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-124200358',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85c7e60a-d7d9-44a1-a4ee-25065916fae4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f84a0aabc104f4da5cc693a0132f06c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T12:05:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T12:05:30Z,use_quota=True,user_id='1955b577a12b4d9daf79921a01a6e1d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1147de8b-623b-426c-a13d-7fc824a80f67),volume_type_id=1147de8b-623b-426c-a13d-7fc824a80f67)}" {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 13 14:05:31 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-adb7b359-360d-496f-af21-9518607fddec tempest-CreateVolumesFromSnapshotTest-61948078 None] Creating volume 85c7e60a-d7d9-44a1-a4ee-25065916fae4 {{(pid=87098) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 13 14:05:31 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-adb7b359-360d-496f-af21-9518607fddec tempest-CreateVolumesFromSnapshotTest-61948078 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 14:05:31 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-adb7b359-360d-496f-af21-9518607fddec tempest-CreateVolumesFromSnapshotTest-61948078 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 14:05:31 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-adb7b359-360d-496f-af21-9518607fddec tempest-CreateVolumesFromSnapshotTest-61948078 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 14:05:31 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-adb7b359-360d-496f-af21-9518607fddec tempest-CreateVolumesFromSnapshotTest-61948078 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 14:05:31 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-adb7b359-360d-496f-af21-9518607fddec tempest-CreateVolumesFromSnapshotTest-61948078 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 14:05:31 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-adb7b359-360d-496f-af21-9518607fddec tempest-CreateVolumesFromSnapshotTest-61948078 None] Selected osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 14:05:31 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-adb7b359-360d-496f-af21-9518607fddec tempest-CreateVolumesFromSnapshotTest-61948078 None] casted to osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 Jul 13 14:05:31 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-adb7b359-360d-496f-af21-9518607fddec tempest-CreateVolumesFromSnapshotTest-61948078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-85c7e60a-d7d9-44a1-a4ee-25065916fae4 1073741824 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:05:31 devstack sudo[104692]: pam_unix(sudo:session): session closed for user root Jul 13 14:05:31 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-b7fc0989-bfed-43c5-8820-c12cfc157862 tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-094b9914-584b-481f-9218-bddb49e0aa75" returned: 0 in 0.473s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:05:31 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-b7fc0989-bfed-43c5-8820-c12cfc157862 tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-094b9914-584b-481f-9218-bddb49e0aa75 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:05:31 devstack sudo[104695]: pam_unix(sudo:session): session closed for user root Jul 13 14:05:31 devstack sudo[104707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-85c7e60a-d7d9-44a1-a4ee-25065916fae4 1073741824 Jul 13 14:05:31 devstack sudo[104707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:05:31 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-d181d778-ab8c-4c5d-ad95-7ce7bb3af05c tempest-VolumeAndVolumeTypeFromImageTest-1673490618 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c863dcc3-ec31-44d0-b4fd-21cc18530275_wm4fhypqdevstack@QuobyteHD" returned: 0 in 0.425s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:05:31 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-d181d778-ab8c-4c5d-ad95-7ce7bb3af05c tempest-VolumeAndVolumeTypeFromImageTest-1673490618 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c863dcc3-ec31-44d0-b4fd-21cc18530275_wm4fhypqdevstack@QuobyteHD {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:05:31 devstack sudo[104708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-094b9914-584b-481f-9218-bddb49e0aa75 Jul 13 14:05:31 devstack sudo[104708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:05:31 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-d5af9fec-e12b-43ce-b8df-f93569aee244 tempest-CreateVolumesFromSnapshotTest-61948078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa3c8aa3-cd0c-4b33-b02b-19c59be16fa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-82931003-2183-4d42-a2f4-76c1c2501bf7', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:05:31 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-d5af9fec-e12b-43ce-b8df-f93569aee244 tempest-CreateVolumesFromSnapshotTest-61948078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39527401-655e-4633-80dd-5c034d3f0e48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:05:31 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-d5af9fec-e12b-43ce-b8df-f93569aee244 tempest-CreateVolumesFromSnapshotTest-61948078 None] Volume volume-82931003-2183-4d42-a2f4-76c1c2501bf7 (82931003-2183-4d42-a2f4-76c1c2501bf7): created successfully Jul 13 14:05:31 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-d5af9fec-e12b-43ce-b8df-f93569aee244 tempest-CreateVolumesFromSnapshotTest-61948078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39527401-655e-4633-80dd-5c034d3f0e48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:05:31 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-d5af9fec-e12b-43ce-b8df-f93569aee244 tempest-CreateVolumesFromSnapshotTest-61948078 None] Flow 'volume_create_manager' (916f7ba3-3576-45a8-8b23-8897340adfb1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 14:05:31 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-d5af9fec-e12b-43ce-b8df-f93569aee244 tempest-CreateVolumesFromSnapshotTest-61948078 None] Created volume successfully. Jul 13 14:05:31 devstack sudo[104710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c863dcc3-ec31-44d0-b4fd-21cc18530275_wm4fhypqdevstack@QuobyteHD Jul 13 14:05:31 devstack sudo[104710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:05:32 devstack sudo[104708]: pam_unix(sudo:session): session closed for user root Jul 13 14:05:32 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-b7fc0989-bfed-43c5-8820-c12cfc157862 tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-094b9914-584b-481f-9218-bddb49e0aa75" returned: 0 in 0.460s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:05:32 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-b7fc0989-bfed-43c5-8820-c12cfc157862 tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] Lock "cinder-quobyte-094b9914-584b-481f-9218-bddb49e0aa75" released by "delete_volume" :: held 0.994s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 14:05:32 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-b7fc0989-bfed-43c5-8820-c12cfc157862 tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] Created reservations ['82b605d9-bf59-4b63-89c5-8bd549a8ca19', '66691f9a-25c3-4eaa-a970-26bfe24d6b10', 'd4d808e0-9e26-4ffd-9b62-cae49c7028a0', '2229f203-3aec-403b-b293-97909b8224a7'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 14:05:32 devstack sudo[104707]: pam_unix(sudo:session): session closed for user root Jul 13 14:05:32 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-adb7b359-360d-496f-af21-9518607fddec tempest-CreateVolumesFromSnapshotTest-61948078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-85c7e60a-d7d9-44a1-a4ee-25065916fae4 1073741824" returned: 0 in 0.644s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:05:32 devstack sudo[104710]: pam_unix(sudo:session): session closed for user root Jul 13 14:05:32 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-d181d778-ab8c-4c5d-ad95-7ce7bb3af05c tempest-VolumeAndVolumeTypeFromImageTest-1673490618 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c863dcc3-ec31-44d0-b4fd-21cc18530275_wm4fhypqdevstack@QuobyteHD" returned: 1 in 0.610s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:05:32 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-d181d778-ab8c-4c5d-ad95-7ce7bb3af05c tempest-VolumeAndVolumeTypeFromImageTest-1673490618 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c863dcc3-ec31-44d0-b4fd-21cc18530275_wm4fhypqdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 13 14:05:32 devstack cinder-volume[87098]: DEBUG cinder.image.image_utils [None req-d181d778-ab8c-4c5d-ad95-7ce7bb3af05c tempest-VolumeAndVolumeTypeFromImageTest-1673490618 None] c863dcc3-ec31-44d0-b4fd-21cc18530275 was raw, converting to raw {{(pid=87098) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 13 14:05:32 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-d181d778-ab8c-4c5d-ad95-7ce7bb3af05c tempest-VolumeAndVolumeTypeFromImageTest-1673490618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_c863dcc3-ec31-44d0-b4fd-21cc18530275_wm4fhypqdevstack@QuobyteHD /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-d5e90e7d-df2e-43bb-a085-9e92d1b8cc13 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:05:32 devstack sudo[104721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_c863dcc3-ec31-44d0-b4fd-21cc18530275_wm4fhypqdevstack@QuobyteHD /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-d5e90e7d-df2e-43bb-a085-9e92d1b8cc13 Jul 13 14:05:32 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-b7fc0989-bfed-43c5-8820-c12cfc157862 tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 14:05:32 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-b7fc0989-bfed-43c5-8820-c12cfc157862 tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 14:05:32 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-b7fc0989-bfed-43c5-8820-c12cfc157862 tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 14:05:32 devstack sudo[104721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:05:32 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-b7fc0989-bfed-43c5-8820-c12cfc157862 tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 14:05:32 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-b7fc0989-bfed-43c5-8820-c12cfc157862 tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 14:05:32 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-b7fc0989-bfed-43c5-8820-c12cfc157862 tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:05:32 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-adb7b359-360d-496f-af21-9518607fddec tempest-CreateVolumesFromSnapshotTest-61948078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-85c7e60a-d7d9-44a1-a4ee-25065916fae4 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:05:32 devstack sudo[104723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 Jul 13 14:05:32 devstack sudo[104723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:05:32 devstack sudo[104724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-85c7e60a-d7d9-44a1-a4ee-25065916fae4 Jul 13 14:05:32 devstack sudo[104724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:05:32 devstack sudo[104723]: pam_unix(sudo:session): session closed for user root Jul 13 14:05:32 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-b7fc0989-bfed-43c5-8820-c12cfc157862 tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78" returned: 0 in 0.281s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:05:32 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-b7fc0989-bfed-43c5-8820-c12cfc157862 tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 14:05:32 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-b7fc0989-bfed-43c5-8820-c12cfc157862 tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] Deleted volume successfully. Jul 13 14:05:32 devstack sudo[104724]: pam_unix(sudo:session): session closed for user root Jul 13 14:05:32 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-adb7b359-360d-496f-af21-9518607fddec tempest-CreateVolumesFromSnapshotTest-61948078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-85c7e60a-d7d9-44a1-a4ee-25065916fae4" returned: 0 in 0.287s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:05:32 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-adb7b359-360d-496f-af21-9518607fddec tempest-CreateVolumesFromSnapshotTest-61948078 None] <== create_volume: return (1027ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'} {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 13 14:05:32 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-adb7b359-360d-496f-af21-9518607fddec tempest-CreateVolumesFromSnapshotTest-61948078 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.030s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 14:05:32 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-aa646bc2-48c2-4bb0-93e7-b80b9065167c tempest-CreateVolumesFromSnapshotTest-61948078 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.167s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 14:05:32 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-aa646bc2-48c2-4bb0-93e7-b80b9065167c tempest-CreateVolumesFromSnapshotTest-61948078 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T12:05:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1773875997',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5425ad8-fe2b-4a49-91cd-b9fae58b6991,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f84a0aabc104f4da5cc693a0132f06c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T12:05:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T12:05:30Z,use_quota=True,user_id='1955b577a12b4d9daf79921a01a6e1d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1147de8b-623b-426c-a13d-7fc824a80f67),volume_type_id=1147de8b-623b-426c-a13d-7fc824a80f67)}" {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 13 14:05:32 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-aa646bc2-48c2-4bb0-93e7-b80b9065167c tempest-CreateVolumesFromSnapshotTest-61948078 None] Creating volume c5425ad8-fe2b-4a49-91cd-b9fae58b6991 {{(pid=87098) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 13 14:05:32 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-aa646bc2-48c2-4bb0-93e7-b80b9065167c tempest-CreateVolumesFromSnapshotTest-61948078 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 14:05:32 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-aa646bc2-48c2-4bb0-93e7-b80b9065167c tempest-CreateVolumesFromSnapshotTest-61948078 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 14:05:32 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-aa646bc2-48c2-4bb0-93e7-b80b9065167c tempest-CreateVolumesFromSnapshotTest-61948078 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 14:05:32 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-aa646bc2-48c2-4bb0-93e7-b80b9065167c tempest-CreateVolumesFromSnapshotTest-61948078 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 14:05:32 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-aa646bc2-48c2-4bb0-93e7-b80b9065167c tempest-CreateVolumesFromSnapshotTest-61948078 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 14:05:32 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-aa646bc2-48c2-4bb0-93e7-b80b9065167c tempest-CreateVolumesFromSnapshotTest-61948078 None] Selected osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 14:05:32 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-aa646bc2-48c2-4bb0-93e7-b80b9065167c tempest-CreateVolumesFromSnapshotTest-61948078 None] casted to osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 Jul 13 14:05:32 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-aa646bc2-48c2-4bb0-93e7-b80b9065167c tempest-CreateVolumesFromSnapshotTest-61948078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-c5425ad8-fe2b-4a49-91cd-b9fae58b6991 1073741824 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:05:32 devstack sudo[104732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-c5425ad8-fe2b-4a49-91cd-b9fae58b6991 1073741824 Jul 13 14:05:32 devstack sudo[104732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:05:32 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-adb7b359-360d-496f-af21-9518607fddec tempest-CreateVolumesFromSnapshotTest-61948078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8942a9dd-3092-4573-894a-907f5585d91b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-85c7e60a-d7d9-44a1-a4ee-25065916fae4', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:05:32 devstack sudo[104721]: pam_unix(sudo:session): session closed for user root Jul 13 14:05:32 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-adb7b359-360d-496f-af21-9518607fddec tempest-CreateVolumesFromSnapshotTest-61948078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a84a0dc1-fa07-46e4-8f94-0106b9a4b4c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:05:32 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-b7fc0989-bfed-43c5-8820-c12cfc157862 tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] Lock "cinder-094b9914-584b-481f-9218-bddb49e0aa75-delete_volume" released by "delete_volume" :: held 1.646s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 14:05:32 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-d181d778-ab8c-4c5d-ad95-7ce7bb3af05c tempest-VolumeAndVolumeTypeFromImageTest-1673490618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_c863dcc3-ec31-44d0-b4fd-21cc18530275_wm4fhypqdevstack@QuobyteHD /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-d5e90e7d-df2e-43bb-a085-9e92d1b8cc13" returned: 0 in 0.422s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:05:32 devstack cinder-volume[87098]: DEBUG cinder.image.image_utils [None req-d181d778-ab8c-4c5d-ad95-7ce7bb3af05c tempest-VolumeAndVolumeTypeFromImageTest-1673490618 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_c863dcc3-ec31-44d0-b4fd-21cc18530275_wm4fhypqdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-d5e90e7d-df2e-43bb-a085-9e92d1b8cc13 {{(pid=87098) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 13 14:05:32 devstack cinder-volume[87098]: INFO cinder.image.image_utils [None req-d181d778-ab8c-4c5d-ad95-7ce7bb3af05c tempest-VolumeAndVolumeTypeFromImageTest-1673490618 None] Converted 0.00 MB image at 0.00 MB/s Jul 13 14:05:32 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-d181d778-ab8c-4c5d-ad95-7ce7bb3af05c tempest-VolumeAndVolumeTypeFromImageTest-1673490618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-d5e90e7d-df2e-43bb-a085-9e92d1b8cc13 1G {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:05:32 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-adb7b359-360d-496f-af21-9518607fddec tempest-CreateVolumesFromSnapshotTest-61948078 None] Volume volume-85c7e60a-d7d9-44a1-a4ee-25065916fae4 (85c7e60a-d7d9-44a1-a4ee-25065916fae4): created successfully Jul 13 14:05:32 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-adb7b359-360d-496f-af21-9518607fddec tempest-CreateVolumesFromSnapshotTest-61948078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a84a0dc1-fa07-46e4-8f94-0106b9a4b4c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:05:32 devstack sudo[104734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-d5e90e7d-df2e-43bb-a085-9e92d1b8cc13 1G Jul 13 14:05:32 devstack sudo[104734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:05:32 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-adb7b359-360d-496f-af21-9518607fddec tempest-CreateVolumesFromSnapshotTest-61948078 None] Flow 'volume_create_manager' (f4cd2455-93c8-4493-bd84-28183b8c5f8f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 14:05:32 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-adb7b359-360d-496f-af21-9518607fddec tempest-CreateVolumesFromSnapshotTest-61948078 None] Created volume successfully. Jul 13 14:05:32 devstack sudo[104734]: pam_unix(sudo:session): session closed for user root Jul 13 14:05:32 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-d181d778-ab8c-4c5d-ad95-7ce7bb3af05c tempest-VolumeAndVolumeTypeFromImageTest-1673490618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-d5e90e7d-df2e-43bb-a085-9e92d1b8cc13 1G" returned: 0 in 0.334s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:05:33 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[c21dd600-28af-4f44-8d7a-520882d836fd]: (4, 'raw') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 14:05:33 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-d181d778-ab8c-4c5d-ad95-7ce7bb3af05c tempest-VolumeAndVolumeTypeFromImageTest-1673490618 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-d5e90e7d-df2e-43bb-a085-9e92d1b8cc13 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:05:33 devstack sudo[104732]: pam_unix(sudo:session): session closed for user root Jul 13 14:05:33 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-aa646bc2-48c2-4bb0-93e7-b80b9065167c tempest-CreateVolumesFromSnapshotTest-61948078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-c5425ad8-fe2b-4a49-91cd-b9fae58b6991 1073741824" returned: 0 in 0.506s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:05:33 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-aa646bc2-48c2-4bb0-93e7-b80b9065167c tempest-CreateVolumesFromSnapshotTest-61948078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-c5425ad8-fe2b-4a49-91cd-b9fae58b6991 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:05:33 devstack sudo[104744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-c5425ad8-fe2b-4a49-91cd-b9fae58b6991 Jul 13 14:05:33 devstack sudo[104743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-d5e90e7d-df2e-43bb-a085-9e92d1b8cc13 Jul 13 14:05:33 devstack sudo[104743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:05:33 devstack sudo[104744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:05:33 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-a5523f76-1291-44fd-9a81-be3787e4e77e tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] Acquiring lock "cinder-1ca97dda-8158-4574-86d3-1e1b556f6b1a-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 14:05:33 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-a5523f76-1291-44fd-9a81-be3787e4e77e tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] Lock "cinder-1ca97dda-8158-4574-86d3-1e1b556f6b1a-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 14:05:33 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-a5523f76-1291-44fd-9a81-be3787e4e77e tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] Acquiring lock "cinder-quobyte-1ca97dda-8158-4574-86d3-1e1b556f6b1a" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 14:05:33 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-a5523f76-1291-44fd-9a81-be3787e4e77e tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] Lock "cinder-quobyte-1ca97dda-8158-4574-86d3-1e1b556f6b1a" acquired by "delete_volume" :: waited 0.019s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 14:05:33 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[8916afb8-e598-44be-b9a4-42820766b897]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 14:05:33 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-a5523f76-1291-44fd-9a81-be3787e4e77e tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-1ca97dda-8158-4574-86d3-1e1b556f6b1a {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:05:33 devstack sudo[104743]: pam_unix(sudo:session): session closed for user root Jul 13 14:05:33 devstack sudo[104744]: pam_unix(sudo:session): session closed for user root Jul 13 14:05:33 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-d181d778-ab8c-4c5d-ad95-7ce7bb3af05c tempest-VolumeAndVolumeTypeFromImageTest-1673490618 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-d5e90e7d-df2e-43bb-a085-9e92d1b8cc13" returned: 0 in 0.449s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:05:33 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-d181d778-ab8c-4c5d-ad95-7ce7bb3af05c tempest-VolumeAndVolumeTypeFromImageTest-1673490618 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-d5e90e7d-df2e-43bb-a085-9e92d1b8cc13 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:05:33 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-aa646bc2-48c2-4bb0-93e7-b80b9065167c tempest-CreateVolumesFromSnapshotTest-61948078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-c5425ad8-fe2b-4a49-91cd-b9fae58b6991" returned: 0 in 0.334s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:05:33 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-aa646bc2-48c2-4bb0-93e7-b80b9065167c tempest-CreateVolumesFromSnapshotTest-61948078 None] <== create_volume: return (904ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'} {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 13 14:05:33 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-aa646bc2-48c2-4bb0-93e7-b80b9065167c tempest-CreateVolumesFromSnapshotTest-61948078 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.907s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 14:05:33 devstack sudo[104747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-1ca97dda-8158-4574-86d3-1e1b556f6b1a Jul 13 14:05:33 devstack sudo[104747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:05:33 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-1b24b4d0-edd2-46e6-a70b-874098434abf tempest-CreateVolumesFromSnapshotTest-61948078 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.504s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 14:05:33 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-1b24b4d0-edd2-46e6-a70b-874098434abf tempest-CreateVolumesFromSnapshotTest-61948078 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T12:05:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-440401819',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96b7b4cf-4961-4137-ae27-9284bb6155b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f84a0aabc104f4da5cc693a0132f06c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T12:05:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T12:05:31Z,use_quota=True,user_id='1955b577a12b4d9daf79921a01a6e1d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1147de8b-623b-426c-a13d-7fc824a80f67),volume_type_id=1147de8b-623b-426c-a13d-7fc824a80f67)}" {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 13 14:05:33 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-1b24b4d0-edd2-46e6-a70b-874098434abf tempest-CreateVolumesFromSnapshotTest-61948078 None] Creating volume 96b7b4cf-4961-4137-ae27-9284bb6155b0 {{(pid=87098) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 13 14:05:33 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-1b24b4d0-edd2-46e6-a70b-874098434abf tempest-CreateVolumesFromSnapshotTest-61948078 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 14:05:33 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-1b24b4d0-edd2-46e6-a70b-874098434abf tempest-CreateVolumesFromSnapshotTest-61948078 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 14:05:33 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-1b24b4d0-edd2-46e6-a70b-874098434abf tempest-CreateVolumesFromSnapshotTest-61948078 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 14:05:33 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-1b24b4d0-edd2-46e6-a70b-874098434abf tempest-CreateVolumesFromSnapshotTest-61948078 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 14:05:33 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-1b24b4d0-edd2-46e6-a70b-874098434abf tempest-CreateVolumesFromSnapshotTest-61948078 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 14:05:33 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-1b24b4d0-edd2-46e6-a70b-874098434abf tempest-CreateVolumesFromSnapshotTest-61948078 None] Selected osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 14:05:33 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-1b24b4d0-edd2-46e6-a70b-874098434abf tempest-CreateVolumesFromSnapshotTest-61948078 None] casted to osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 Jul 13 14:05:33 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-1b24b4d0-edd2-46e6-a70b-874098434abf tempest-CreateVolumesFromSnapshotTest-61948078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-96b7b4cf-4961-4137-ae27-9284bb6155b0 1073741824 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:05:33 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-aa646bc2-48c2-4bb0-93e7-b80b9065167c tempest-CreateVolumesFromSnapshotTest-61948078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e25979f-c37d-408a-b3fa-0d55e8b6fb76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c5425ad8-fe2b-4a49-91cd-b9fae58b6991', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:05:33 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-aa646bc2-48c2-4bb0-93e7-b80b9065167c tempest-CreateVolumesFromSnapshotTest-61948078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (344cfb06-4d4c-4ebf-83a9-f307b48975f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:05:33 devstack sudo[104753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-96b7b4cf-4961-4137-ae27-9284bb6155b0 1073741824 Jul 13 14:05:33 devstack sudo[104753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:05:33 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-aa646bc2-48c2-4bb0-93e7-b80b9065167c tempest-CreateVolumesFromSnapshotTest-61948078 None] Volume volume-c5425ad8-fe2b-4a49-91cd-b9fae58b6991 (c5425ad8-fe2b-4a49-91cd-b9fae58b6991): created successfully Jul 13 14:05:33 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-aa646bc2-48c2-4bb0-93e7-b80b9065167c tempest-CreateVolumesFromSnapshotTest-61948078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (344cfb06-4d4c-4ebf-83a9-f307b48975f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:05:33 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-aa646bc2-48c2-4bb0-93e7-b80b9065167c tempest-CreateVolumesFromSnapshotTest-61948078 None] Flow 'volume_create_manager' (1bc3d24a-501b-446e-8446-251c8bc9e3f4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 14:05:33 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-aa646bc2-48c2-4bb0-93e7-b80b9065167c tempest-CreateVolumesFromSnapshotTest-61948078 None] Created volume successfully. Jul 13 14:05:33 devstack sudo[104751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-d5e90e7d-df2e-43bb-a085-9e92d1b8cc13 Jul 13 14:05:33 devstack sudo[104751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:05:33 devstack sudo[104747]: pam_unix(sudo:session): session closed for user root Jul 13 14:05:33 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-a5523f76-1291-44fd-9a81-be3787e4e77e tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-1ca97dda-8158-4574-86d3-1e1b556f6b1a" returned: 0 in 0.413s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:05:33 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-a5523f76-1291-44fd-9a81-be3787e4e77e tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-1ca97dda-8158-4574-86d3-1e1b556f6b1a {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:05:33 devstack sudo[104760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-1ca97dda-8158-4574-86d3-1e1b556f6b1a Jul 13 14:05:33 devstack sudo[104760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:05:33 devstack sudo[104751]: pam_unix(sudo:session): session closed for user root Jul 13 14:05:33 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-d181d778-ab8c-4c5d-ad95-7ce7bb3af05c tempest-VolumeAndVolumeTypeFromImageTest-1673490618 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-d5e90e7d-df2e-43bb-a085-9e92d1b8cc13" returned: 1 in 0.501s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:05:33 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-d181d778-ab8c-4c5d-ad95-7ce7bb3af05c tempest-VolumeAndVolumeTypeFromImageTest-1673490618 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-d5e90e7d-df2e-43bb-a085-9e92d1b8cc13' failed. Not Retrying. {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 13 14:05:33 devstack cinder-volume[87098]: DEBUG cinder.volume.volume_utils [None req-d181d778-ab8c-4c5d-ad95-7ce7bb3af05c tempest-VolumeAndVolumeTypeFromImageTest-1673490618 None] Downloaded image c863dcc3-ec31-44d0-b4fd-21cc18530275 ((None, [{'url': 'file:///opt/stack/data/glance/images/c863dcc3-ec31-44d0-b4fd-21cc18530275', 'metadata': {}}])) to volume d5e90e7d-df2e-43bb-a085-9e92d1b8cc13 successfully. {{(pid=87098) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 13 14:05:33 devstack cinder-volume[87098]: DEBUG cinder.image.image_utils [None req-d181d778-ab8c-4c5d-ad95-7ce7bb3af05c tempest-VolumeAndVolumeTypeFromImageTest-1673490618 None] Temporary image c863dcc3-ec31-44d0-b4fd-21cc18530275 for user 21537734620d49f2a57d390cd897ccc5 is deleted. {{(pid=87098) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 13 14:05:33 devstack cinder-volume[87098]: DEBUG cinder.volume.volume_utils [None req-d181d778-ab8c-4c5d-ad95-7ce7bb3af05c tempest-VolumeAndVolumeTypeFromImageTest-1673490618 None] Marking volume d5e90e7d-df2e-43bb-a085-9e92d1b8cc13 as bootable. {{(pid=87098) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 13 14:05:33 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-d181d778-ab8c-4c5d-ad95-7ce7bb3af05c tempest-VolumeAndVolumeTypeFromImageTest-1673490618 None] Copying metadata from image c863dcc3-ec31-44d0-b4fd-21cc18530275 to d5e90e7d-df2e-43bb-a085-9e92d1b8cc13. {{(pid=87098) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 13 14:05:33 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-d181d778-ab8c-4c5d-ad95-7ce7bb3af05c tempest-VolumeAndVolumeTypeFromImageTest-1673490618 None] Creating volume glance metadata for volume d5e90e7d-df2e-43bb-a085-9e92d1b8cc13 backed by image c863dcc3-ec31-44d0-b4fd-21cc18530275 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'c863dcc3-ec31-44d0-b4fd-21cc18530275', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '204ffc83de30b7cb0457658abb845cf5', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87098) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 13 14:05:34 devstack sudo[104760]: pam_unix(sudo:session): session closed for user root Jul 13 14:05:34 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-d181d778-ab8c-4c5d-ad95-7ce7bb3af05c tempest-VolumeAndVolumeTypeFromImageTest-1673490618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00c86e4e-1554-4379-b16b-3d4ee4cbe439) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d5e90e7d-df2e-43bb-a085-9e92d1b8cc13', 'volume_size': 1, 'image_id': 'c863dcc3-ec31-44d0-b4fd-21cc18530275', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c863dcc3-ec31-44d0-b4fd-21cc18530275', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '204ffc83de30b7cb0457658abb845cf5', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '1a7117fae06a426bade2b7c96cff132a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'da24bc72f4429b1e99514033de51b3344189a41c5391b94acac233c78cdab795424a41c27cdcb6444c0e20b5213a85981a61d8b2842f10542cff78ca126242f2', 'id': 'c863dcc3-ec31-44d0-b4fd-21cc18530275', 'created_at': datetime.datetime(2026, 7, 13, 12, 5, 16, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 13, 12, 5, 17, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c863dcc3-ec31-44d0-b4fd-21cc18530275/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:05:34 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-d181d778-ab8c-4c5d-ad95-7ce7bb3af05c tempest-VolumeAndVolumeTypeFromImageTest-1673490618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06740437-a4e4-4434-9155-a3ffd32e2a8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:05:34 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-a5523f76-1291-44fd-9a81-be3787e4e77e tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-1ca97dda-8158-4574-86d3-1e1b556f6b1a" returned: 0 in 0.334s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:05:34 devstack sudo[104753]: pam_unix(sudo:session): session closed for user root Jul 13 14:05:34 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-1b24b4d0-edd2-46e6-a70b-874098434abf tempest-CreateVolumesFromSnapshotTest-61948078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-96b7b4cf-4961-4137-ae27-9284bb6155b0 1073741824" returned: 0 in 0.623s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:05:34 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-a5523f76-1291-44fd-9a81-be3787e4e77e tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] Lock "cinder-quobyte-1ca97dda-8158-4574-86d3-1e1b556f6b1a" released by "delete_volume" :: held 0.809s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 14:05:34 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-d181d778-ab8c-4c5d-ad95-7ce7bb3af05c tempest-VolumeAndVolumeTypeFromImageTest-1673490618 None] Volume volume-d5e90e7d-df2e-43bb-a085-9e92d1b8cc13 (d5e90e7d-df2e-43bb-a085-9e92d1b8cc13): created successfully Jul 13 14:05:34 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-d181d778-ab8c-4c5d-ad95-7ce7bb3af05c tempest-VolumeAndVolumeTypeFromImageTest-1673490618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06740437-a4e4-4434-9155-a3ffd32e2a8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:05:34 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-d181d778-ab8c-4c5d-ad95-7ce7bb3af05c tempest-VolumeAndVolumeTypeFromImageTest-1673490618 None] Flow 'volume_create_manager' (8a9e3889-5565-49e7-a60a-4e38d2a8b334) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 14:05:34 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-d181d778-ab8c-4c5d-ad95-7ce7bb3af05c tempest-VolumeAndVolumeTypeFromImageTest-1673490618 None] Created volume successfully. Jul 13 14:05:34 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-1b24b4d0-edd2-46e6-a70b-874098434abf tempest-CreateVolumesFromSnapshotTest-61948078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-96b7b4cf-4961-4137-ae27-9284bb6155b0 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:05:34 devstack sudo[104769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-96b7b4cf-4961-4137-ae27-9284bb6155b0 Jul 13 14:05:34 devstack sudo[104769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:05:34 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-a5523f76-1291-44fd-9a81-be3787e4e77e tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] Created reservations ['68ee5619-962f-4ba3-81fe-d33435d52a90', 'b55ae0ac-e5d3-43f0-8bec-fb55262a45d7', '4200b50d-aad6-4624-86fe-afab69d1a004', 'e7f2a037-93ca-4753-aff1-1ed838d83f16'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 14:05:34 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-a5523f76-1291-44fd-9a81-be3787e4e77e tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 14:05:34 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-a5523f76-1291-44fd-9a81-be3787e4e77e tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 14:05:34 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-a5523f76-1291-44fd-9a81-be3787e4e77e tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 14:05:34 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-a5523f76-1291-44fd-9a81-be3787e4e77e tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 14:05:34 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-a5523f76-1291-44fd-9a81-be3787e4e77e tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 14:05:34 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-a5523f76-1291-44fd-9a81-be3787e4e77e tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:05:34 devstack sudo[104771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 Jul 13 14:05:34 devstack sudo[104771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:05:34 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-f0b3b285-5c6a-45f1-81a4-c24e8db30379 tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] Acquiring lock "cinder-4d070bd2-2d07-479c-af1c-755e25180abc-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 14:05:34 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-f0b3b285-5c6a-45f1-81a4-c24e8db30379 tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] Lock "cinder-4d070bd2-2d07-479c-af1c-755e25180abc-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 14:05:34 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-f0b3b285-5c6a-45f1-81a4-c24e8db30379 tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] Acquiring lock "cinder-quobyte-4d070bd2-2d07-479c-af1c-755e25180abc" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 14:05:34 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-f0b3b285-5c6a-45f1-81a4-c24e8db30379 tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] Lock "cinder-quobyte-4d070bd2-2d07-479c-af1c-755e25180abc" acquired by "delete_volume" :: waited 0.024s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 14:05:34 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[29ebdc40-4203-434b-8cba-06fe193e251e]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 14:05:34 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-f0b3b285-5c6a-45f1-81a4-c24e8db30379 tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-4d070bd2-2d07-479c-af1c-755e25180abc {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:05:34 devstack sudo[104769]: pam_unix(sudo:session): session closed for user root Jul 13 14:05:34 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-1b24b4d0-edd2-46e6-a70b-874098434abf tempest-CreateVolumesFromSnapshotTest-61948078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-96b7b4cf-4961-4137-ae27-9284bb6155b0" returned: 0 in 0.371s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:05:34 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-1b24b4d0-edd2-46e6-a70b-874098434abf tempest-CreateVolumesFromSnapshotTest-61948078 None] <== create_volume: return (1078ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'} {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 13 14:05:34 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-1b24b4d0-edd2-46e6-a70b-874098434abf tempest-CreateVolumesFromSnapshotTest-61948078 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.082s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 14:05:34 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-1b24b4d0-edd2-46e6-a70b-874098434abf tempest-CreateVolumesFromSnapshotTest-61948078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ccb1dd03-a708-4fea-8972-007624498bb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-96b7b4cf-4961-4137-ae27-9284bb6155b0', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:05:34 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-1b24b4d0-edd2-46e6-a70b-874098434abf tempest-CreateVolumesFromSnapshotTest-61948078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7dda0924-019b-4e08-9a25-284d0878e03f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:05:34 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-1b24b4d0-edd2-46e6-a70b-874098434abf tempest-CreateVolumesFromSnapshotTest-61948078 None] Volume volume-96b7b4cf-4961-4137-ae27-9284bb6155b0 (96b7b4cf-4961-4137-ae27-9284bb6155b0): created successfully Jul 13 14:05:34 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-1b24b4d0-edd2-46e6-a70b-874098434abf tempest-CreateVolumesFromSnapshotTest-61948078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7dda0924-019b-4e08-9a25-284d0878e03f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:05:34 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-1b24b4d0-edd2-46e6-a70b-874098434abf tempest-CreateVolumesFromSnapshotTest-61948078 None] Flow 'volume_create_manager' (5023f876-6d41-468a-a629-5a3c043ce571) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 14:05:34 devstack sudo[104771]: pam_unix(sudo:session): session closed for user root Jul 13 14:05:34 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-a5523f76-1291-44fd-9a81-be3787e4e77e tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78" returned: 0 in 0.301s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:05:34 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-a5523f76-1291-44fd-9a81-be3787e4e77e tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 14:05:34 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-1b24b4d0-edd2-46e6-a70b-874098434abf tempest-CreateVolumesFromSnapshotTest-61948078 None] Created volume successfully. Jul 13 14:05:34 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-a5523f76-1291-44fd-9a81-be3787e4e77e tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] Deleted volume successfully. Jul 13 14:05:34 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-a5523f76-1291-44fd-9a81-be3787e4e77e tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] Lock "cinder-1ca97dda-8158-4574-86d3-1e1b556f6b1a-delete_volume" released by "delete_volume" :: held 1.447s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 14:05:34 devstack sudo[104774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-4d070bd2-2d07-479c-af1c-755e25180abc Jul 13 14:05:34 devstack sudo[104774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:05:34 devstack sudo[104774]: pam_unix(sudo:session): session closed for user root Jul 13 14:05:34 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-f0b3b285-5c6a-45f1-81a4-c24e8db30379 tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-4d070bd2-2d07-479c-af1c-755e25180abc" returned: 0 in 0.407s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:05:34 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-f0b3b285-5c6a-45f1-81a4-c24e8db30379 tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-4d070bd2-2d07-479c-af1c-755e25180abc {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:05:34 devstack sudo[104780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-4d070bd2-2d07-479c-af1c-755e25180abc Jul 13 14:05:34 devstack sudo[104780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:05:35 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-05217a5f-9c9e-4fe4-81fd-be50a1010f3e tempest-VolumeAndVolumeTypeFromImageTest-1673490618 None] Acquiring lock "cinder-d5e90e7d-df2e-43bb-a085-9e92d1b8cc13-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 14:05:35 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-05217a5f-9c9e-4fe4-81fd-be50a1010f3e tempest-VolumeAndVolumeTypeFromImageTest-1673490618 None] Lock "cinder-d5e90e7d-df2e-43bb-a085-9e92d1b8cc13-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 14:05:35 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-05217a5f-9c9e-4fe4-81fd-be50a1010f3e tempest-VolumeAndVolumeTypeFromImageTest-1673490618 None] Acquiring lock "cinder-quobyte-d5e90e7d-df2e-43bb-a085-9e92d1b8cc13" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 14:05:35 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-05217a5f-9c9e-4fe4-81fd-be50a1010f3e tempest-VolumeAndVolumeTypeFromImageTest-1673490618 None] Lock "cinder-quobyte-d5e90e7d-df2e-43bb-a085-9e92d1b8cc13" acquired by "delete_volume" :: waited 0.015s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 14:05:35 devstack sudo[104780]: pam_unix(sudo:session): session closed for user root Jul 13 14:05:35 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-f0b3b285-5c6a-45f1-81a4-c24e8db30379 tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-4d070bd2-2d07-479c-af1c-755e25180abc" returned: 0 in 0.290s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:05:35 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[52f059e6-9819-4247-9e57-aaa4793dd906]: (4, 'raw') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 14:05:35 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-05217a5f-9c9e-4fe4-81fd-be50a1010f3e tempest-VolumeAndVolumeTypeFromImageTest-1673490618 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-d5e90e7d-df2e-43bb-a085-9e92d1b8cc13 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:05:35 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-f0b3b285-5c6a-45f1-81a4-c24e8db30379 tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] Lock "cinder-quobyte-4d070bd2-2d07-479c-af1c-755e25180abc" released by "delete_volume" :: held 0.777s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 14:05:35 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-f0b3b285-5c6a-45f1-81a4-c24e8db30379 tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] Created reservations ['d5103981-ca2e-4db8-b520-d059dd6769ed', 'bbf6207b-f5fd-4941-933f-ade5370c9cee', '57b2f45c-2abd-4b2d-88d0-9b8a1af82819', '94bbda10-fbb9-4546-92ce-526fe405ca41'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 14:05:35 devstack sudo[104783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-d5e90e7d-df2e-43bb-a085-9e92d1b8cc13 Jul 13 14:05:35 devstack sudo[104783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:05:35 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-41c1718c-e746-4662-a1e8-e0c6b2806d1d tempest-CreateVolumesFromSnapshotTest-61948078 None] Acquiring lock "cinder-96b7b4cf-4961-4137-ae27-9284bb6155b0-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 14:05:35 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-f0b3b285-5c6a-45f1-81a4-c24e8db30379 tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 14:05:35 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-f0b3b285-5c6a-45f1-81a4-c24e8db30379 tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 14:05:35 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-f0b3b285-5c6a-45f1-81a4-c24e8db30379 tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 14:05:35 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-f0b3b285-5c6a-45f1-81a4-c24e8db30379 tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 14:05:35 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-f0b3b285-5c6a-45f1-81a4-c24e8db30379 tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 14:05:35 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-f0b3b285-5c6a-45f1-81a4-c24e8db30379 tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:05:35 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-79fca9f9-9b84-4484-9608-5b45124b0275 tempest-VolumeImageDependencyTests-984528418 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 14:05:35 devstack sudo[104785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 Jul 13 14:05:35 devstack sudo[104785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:05:35 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-79fca9f9-9b84-4484-9608-5b45124b0275 tempest-VolumeImageDependencyTests-984528418 None] Flow 'volume_create_manager' (4db332e1-d840-4060-bf81-9a9c5a9dd568) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 14:05:35 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-79fca9f9-9b84-4484-9608-5b45124b0275 tempest-VolumeImageDependencyTests-984528418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1673bb10-41ca-4373-a78f-a9b7a7558f8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:05:35 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-41c1718c-e746-4662-a1e8-e0c6b2806d1d tempest-CreateVolumesFromSnapshotTest-61948078 None] Lock "cinder-96b7b4cf-4961-4137-ae27-9284bb6155b0-delete_volume" acquired by "delete_volume" :: waited 0.087s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 14:05:35 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-79fca9f9-9b84-4484-9608-5b45124b0275 tempest-VolumeImageDependencyTests-984528418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1673bb10-41ca-4373-a78f-a9b7a7558f8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T12:05:35Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92c64345-7d55-4ea6-af85-0956b9abcf07,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d2cf39a3e3e4c6a91e0f38ce467513d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T12:05:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T12:05:35Z,use_quota=True,user_id='38c995afd80a4eef8964cb36a000a42b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1147de8b-623b-426c-a13d-7fc824a80f67),volume_type_id=1147de8b-623b-426c-a13d-7fc824a80f67)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:05:35 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-79fca9f9-9b84-4484-9608-5b45124b0275 tempest-VolumeImageDependencyTests-984528418 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c20aa53e-3d2e-4734-9cf0-e1ae4ba17790) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:05:35 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-79fca9f9-9b84-4484-9608-5b45124b0275 tempest-VolumeImageDependencyTests-984528418 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c20aa53e-3d2e-4734-9cf0-e1ae4ba17790) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:05:35 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-79fca9f9-9b84-4484-9608-5b45124b0275 tempest-VolumeImageDependencyTests-984528418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d9076ac-c335-4608-ac15-9a9b0e83fffe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:05:35 devstack cinder-volume[87098]: DEBUG cinder.image.glance [None req-79fca9f9-9b84-4484-9608-5b45124b0275 tempest-VolumeImageDependencyTests-984528418 None] Creating Keystone auth plugin from conf {{(pid=87098) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 13 14:05:35 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-41c1718c-e746-4662-a1e8-e0c6b2806d1d tempest-CreateVolumesFromSnapshotTest-61948078 None] Acquiring lock "cinder-quobyte-96b7b4cf-4961-4137-ae27-9284bb6155b0" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 14:05:35 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-41c1718c-e746-4662-a1e8-e0c6b2806d1d tempest-CreateVolumesFromSnapshotTest-61948078 None] Lock "cinder-quobyte-96b7b4cf-4961-4137-ae27-9284bb6155b0" acquired by "delete_volume" :: waited 0.021s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 14:05:35 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdfb036f-ab2d-49ee-bf7e-9866b689e62d]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 14:05:35 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-41c1718c-e746-4662-a1e8-e0c6b2806d1d tempest-CreateVolumesFromSnapshotTest-61948078 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-96b7b4cf-4961-4137-ae27-9284bb6155b0 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:05:35 devstack sudo[104785]: pam_unix(sudo:session): session closed for user root Jul 13 14:05:35 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-f0b3b285-5c6a-45f1-81a4-c24e8db30379 tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78" returned: 0 in 0.343s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:05:35 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-f0b3b285-5c6a-45f1-81a4-c24e8db30379 tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 14:05:35 devstack sudo[104787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-96b7b4cf-4961-4137-ae27-9284bb6155b0 Jul 13 14:05:35 devstack sudo[104787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:05:35 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-f0b3b285-5c6a-45f1-81a4-c24e8db30379 tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] Deleted volume successfully. Jul 13 14:05:35 devstack sudo[104783]: pam_unix(sudo:session): session closed for user root Jul 13 14:05:35 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-05217a5f-9c9e-4fe4-81fd-be50a1010f3e tempest-VolumeAndVolumeTypeFromImageTest-1673490618 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-d5e90e7d-df2e-43bb-a085-9e92d1b8cc13" returned: 0 in 0.599s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:05:35 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-05217a5f-9c9e-4fe4-81fd-be50a1010f3e tempest-VolumeAndVolumeTypeFromImageTest-1673490618 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-d5e90e7d-df2e-43bb-a085-9e92d1b8cc13 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:05:35 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-f0b3b285-5c6a-45f1-81a4-c24e8db30379 tempest-CreateVolumesFromSourceVolumeTest-1762418787 None] Lock "cinder-4d070bd2-2d07-479c-af1c-755e25180abc-delete_volume" released by "delete_volume" :: held 1.456s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 14:05:35 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-79fca9f9-9b84-4484-9608-5b45124b0275 tempest-VolumeImageDependencyTests-984528418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d9076ac-c335-4608-ac15-9a9b0e83fffe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '92c64345-7d55-4ea6-af85-0956b9abcf07', 'volume_name': 'volume-92c64345-7d55-4ea6-af85-0956b9abcf07', 'volume_size': 1, 'image_id': '69cb8e9a-2e32-43ab-b120-21f08cf055c1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/69cb8e9a-2e32-43ab-b120-21f08cf055c1', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'da2038e02185a25d15e8b7cb6c6bac93', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '5d2cf39a3e3e4c6a91e0f38ce467513d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '69ebcdb5930ee8c8321b833ddbcf0c2408a6668080221e94b0edd8897e1336a22346892aef7f0f45797d1781c3b827705d182c69541273b74f7ed65b85dc5f57', 'id': '69cb8e9a-2e32-43ab-b120-21f08cf055c1', 'created_at': datetime.datetime(2026, 7, 13, 12, 5, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 13, 12, 5, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/69cb8e9a-2e32-43ab-b120-21f08cf055c1/file', 'properties': {}}, 'image_service': }' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:05:35 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-79fca9f9-9b84-4484-9608-5b45124b0275 tempest-VolumeImageDependencyTests-984528418 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37d2775e-083c-448a-a0dd-1edf57e7a885) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:05:35 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-79fca9f9-9b84-4484-9608-5b45124b0275 tempest-VolumeImageDependencyTests-984528418 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37d2775e-083c-448a-a0dd-1edf57e7a885) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:05:35 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-79fca9f9-9b84-4484-9608-5b45124b0275 tempest-VolumeImageDependencyTests-984528418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b5c1633-d23f-495b-982f-fb444e55aa97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:05:35 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-79fca9f9-9b84-4484-9608-5b45124b0275 tempest-VolumeImageDependencyTests-984528418 None] Volume 92c64345-7d55-4ea6-af85-0956b9abcf07: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-92c64345-7d55-4ea6-af85-0956b9abcf07', 'volume_size': 1, 'image_id': '69cb8e9a-2e32-43ab-b120-21f08cf055c1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/69cb8e9a-2e32-43ab-b120-21f08cf055c1', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'da2038e02185a25d15e8b7cb6c6bac93', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '5d2cf39a3e3e4c6a91e0f38ce467513d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '69ebcdb5930ee8c8321b833ddbcf0c2408a6668080221e94b0edd8897e1336a22346892aef7f0f45797d1781c3b827705d182c69541273b74f7ed65b85dc5f57', 'id': '69cb8e9a-2e32-43ab-b120-21f08cf055c1', 'created_at': datetime.datetime(2026, 7, 13, 12, 5, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 13, 12, 5, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/69cb8e9a-2e32-43ab-b120-21f08cf055c1/file', 'properties': {}}, 'image_service': } Jul 13 14:05:35 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-79fca9f9-9b84-4484-9608-5b45124b0275 tempest-VolumeImageDependencyTests-984528418 None] Trying to clone 92c64345-7d55-4ea6-af85-0956b9abcf07 from image 69cb8e9a-2e32-43ab-b120-21f08cf055c1 at location (None, [{'url': 'file:///opt/stack/data/glance/images/69cb8e9a-2e32-43ab-b120-21f08cf055c1', 'metadata': {}}]). {{(pid=87098) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 13 14:05:36 devstack sudo[104792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-d5e90e7d-df2e-43bb-a085-9e92d1b8cc13 Jul 13 14:05:36 devstack sudo[104792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:05:36 devstack cinder-volume[87098]: DEBUG cinder.image.image_utils [None req-79fca9f9-9b84-4484-9608-5b45124b0275 tempest-VolumeImageDependencyTests-984528418 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_69cb8e9a-2e32-43ab-b120-21f08cf055c1_hz2s1dvpdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87098) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 13 14:05:36 devstack cinder-volume[87098]: INFO cinder.image.image_utils [None req-79fca9f9-9b84-4484-9608-5b45124b0275 tempest-VolumeImageDependencyTests-984528418 None] Image download 0.00 MB at 0.00 MB/s Jul 13 14:05:36 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2f062b2-db61-47c1-ac1f-45eb8206a4ce]: (4, 'raw') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 14:05:36 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-79fca9f9-9b84-4484-9608-5b45124b0275 tempest-VolumeImageDependencyTests-984528418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_69cb8e9a-2e32-43ab-b120-21f08cf055c1_hz2s1dvpdevstack@QuobyteHD {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:05:36 devstack sudo[104787]: pam_unix(sudo:session): session closed for user root Jul 13 14:05:36 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-41c1718c-e746-4662-a1e8-e0c6b2806d1d tempest-CreateVolumesFromSnapshotTest-61948078 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-96b7b4cf-4961-4137-ae27-9284bb6155b0" returned: 0 in 0.518s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:05:36 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-41c1718c-e746-4662-a1e8-e0c6b2806d1d tempest-CreateVolumesFromSnapshotTest-61948078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-96b7b4cf-4961-4137-ae27-9284bb6155b0 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:05:36 devstack sudo[104798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-96b7b4cf-4961-4137-ae27-9284bb6155b0 Jul 13 14:05:36 devstack sudo[104798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:05:36 devstack sudo[104796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_69cb8e9a-2e32-43ab-b120-21f08cf055c1_hz2s1dvpdevstack@QuobyteHD Jul 13 14:05:36 devstack sudo[104796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:05:36 devstack sudo[104792]: pam_unix(sudo:session): session closed for user root Jul 13 14:05:36 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-05217a5f-9c9e-4fe4-81fd-be50a1010f3e tempest-VolumeAndVolumeTypeFromImageTest-1673490618 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-d5e90e7d-df2e-43bb-a085-9e92d1b8cc13" returned: 1 in 0.574s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:05:36 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-05217a5f-9c9e-4fe4-81fd-be50a1010f3e tempest-VolumeAndVolumeTypeFromImageTest-1673490618 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-d5e90e7d-df2e-43bb-a085-9e92d1b8cc13' failed. Not Retrying. {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 13 14:05:36 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-05217a5f-9c9e-4fe4-81fd-be50a1010f3e tempest-VolumeAndVolumeTypeFromImageTest-1673490618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-d5e90e7d-df2e-43bb-a085-9e92d1b8cc13 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:05:36 devstack sudo[104804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-d5e90e7d-df2e-43bb-a085-9e92d1b8cc13 Jul 13 14:05:36 devstack sudo[104804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:05:36 devstack sudo[104798]: pam_unix(sudo:session): session closed for user root Jul 13 14:05:36 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-41c1718c-e746-4662-a1e8-e0c6b2806d1d tempest-CreateVolumesFromSnapshotTest-61948078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-96b7b4cf-4961-4137-ae27-9284bb6155b0" returned: 0 in 0.328s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:05:36 devstack sudo[104796]: pam_unix(sudo:session): session closed for user root Jul 13 14:05:36 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-79fca9f9-9b84-4484-9608-5b45124b0275 tempest-VolumeImageDependencyTests-984528418 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_69cb8e9a-2e32-43ab-b120-21f08cf055c1_hz2s1dvpdevstack@QuobyteHD" returned: 0 in 0.426s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:05:36 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-79fca9f9-9b84-4484-9608-5b45124b0275 tempest-VolumeImageDependencyTests-984528418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_69cb8e9a-2e32-43ab-b120-21f08cf055c1_hz2s1dvpdevstack@QuobyteHD {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:05:36 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-41c1718c-e746-4662-a1e8-e0c6b2806d1d tempest-CreateVolumesFromSnapshotTest-61948078 None] Lock "cinder-quobyte-96b7b4cf-4961-4137-ae27-9284bb6155b0" released by "delete_volume" :: held 0.913s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 14:05:36 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-41c1718c-e746-4662-a1e8-e0c6b2806d1d tempest-CreateVolumesFromSnapshotTest-61948078 None] Created reservations ['57062c63-ddcf-4cb9-b90a-0eed18f9151e', 'd4a8cab2-7b47-4a73-bead-8d53772232be', '12bbc4e8-a339-4394-a454-04dd9542d15e', 'eaef8882-178f-4976-bab0-aa7d86bf496a'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 14:05:36 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-41c1718c-e746-4662-a1e8-e0c6b2806d1d tempest-CreateVolumesFromSnapshotTest-61948078 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 14:05:36 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-41c1718c-e746-4662-a1e8-e0c6b2806d1d tempest-CreateVolumesFromSnapshotTest-61948078 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 14:05:36 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-41c1718c-e746-4662-a1e8-e0c6b2806d1d tempest-CreateVolumesFromSnapshotTest-61948078 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 14:05:36 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-41c1718c-e746-4662-a1e8-e0c6b2806d1d tempest-CreateVolumesFromSnapshotTest-61948078 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 14:05:36 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-41c1718c-e746-4662-a1e8-e0c6b2806d1d tempest-CreateVolumesFromSnapshotTest-61948078 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 14:05:36 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-41c1718c-e746-4662-a1e8-e0c6b2806d1d tempest-CreateVolumesFromSnapshotTest-61948078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:05:36 devstack sudo[104809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_69cb8e9a-2e32-43ab-b120-21f08cf055c1_hz2s1dvpdevstack@QuobyteHD Jul 13 14:05:36 devstack sudo[104809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:05:36 devstack sudo[104804]: pam_unix(sudo:session): session closed for user root Jul 13 14:05:36 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-05217a5f-9c9e-4fe4-81fd-be50a1010f3e tempest-VolumeAndVolumeTypeFromImageTest-1673490618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-d5e90e7d-df2e-43bb-a085-9e92d1b8cc13" returned: 0 in 0.350s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:05:36 devstack sudo[104812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 Jul 13 14:05:36 devstack sudo[104812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:05:36 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-05217a5f-9c9e-4fe4-81fd-be50a1010f3e tempest-VolumeAndVolumeTypeFromImageTest-1673490618 None] Lock "cinder-quobyte-d5e90e7d-df2e-43bb-a085-9e92d1b8cc13" released by "delete_volume" :: held 1.616s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 14:05:36 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-05217a5f-9c9e-4fe4-81fd-be50a1010f3e tempest-VolumeAndVolumeTypeFromImageTest-1673490618 None] Created reservations ['ba853d63-9465-4d6a-aa99-31c5f5814292', 'a6d7c367-0020-4bbb-9d6b-7d3d503c5cf9', 'bd00420e-ac18-447c-9b64-4ed7423ee844', '3cfda64a-b025-465d-9912-ba0aeee0db2f'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 14:05:36 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-05217a5f-9c9e-4fe4-81fd-be50a1010f3e tempest-VolumeAndVolumeTypeFromImageTest-1673490618 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 14:05:36 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-05217a5f-9c9e-4fe4-81fd-be50a1010f3e tempest-VolumeAndVolumeTypeFromImageTest-1673490618 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 14:05:36 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-05217a5f-9c9e-4fe4-81fd-be50a1010f3e tempest-VolumeAndVolumeTypeFromImageTest-1673490618 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 14:05:36 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-05217a5f-9c9e-4fe4-81fd-be50a1010f3e tempest-VolumeAndVolumeTypeFromImageTest-1673490618 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 14:05:36 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-05217a5f-9c9e-4fe4-81fd-be50a1010f3e tempest-VolumeAndVolumeTypeFromImageTest-1673490618 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 14:05:36 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-05217a5f-9c9e-4fe4-81fd-be50a1010f3e tempest-VolumeAndVolumeTypeFromImageTest-1673490618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:05:37 devstack sudo[104814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 Jul 13 14:05:37 devstack sudo[104814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:05:37 devstack sudo[104809]: pam_unix(sudo:session): session closed for user root Jul 13 14:05:37 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-79fca9f9-9b84-4484-9608-5b45124b0275 tempest-VolumeImageDependencyTests-984528418 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_69cb8e9a-2e32-43ab-b120-21f08cf055c1_hz2s1dvpdevstack@QuobyteHD" returned: 1 in 0.511s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:05:37 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-79fca9f9-9b84-4484-9608-5b45124b0275 tempest-VolumeImageDependencyTests-984528418 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_69cb8e9a-2e32-43ab-b120-21f08cf055c1_hz2s1dvpdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 13 14:05:37 devstack cinder-volume[87098]: DEBUG cinder.image.image_utils [None req-79fca9f9-9b84-4484-9608-5b45124b0275 tempest-VolumeImageDependencyTests-984528418 None] Temporary image 69cb8e9a-2e32-43ab-b120-21f08cf055c1 is fetched for user 38c995afd80a4eef8964cb36a000a42b. {{(pid=87098) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 13 14:05:37 devstack sudo[104812]: pam_unix(sudo:session): session closed for user root Jul 13 14:05:37 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-41c1718c-e746-4662-a1e8-e0c6b2806d1d tempest-CreateVolumesFromSnapshotTest-61948078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78" returned: 0 in 0.310s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:05:37 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-41c1718c-e746-4662-a1e8-e0c6b2806d1d tempest-CreateVolumesFromSnapshotTest-61948078 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 14:05:37 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-41c1718c-e746-4662-a1e8-e0c6b2806d1d tempest-CreateVolumesFromSnapshotTest-61948078 None] Deleted volume successfully. Jul 13 14:05:37 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-41c1718c-e746-4662-a1e8-e0c6b2806d1d tempest-CreateVolumesFromSnapshotTest-61948078 None] Lock "cinder-96b7b4cf-4961-4137-ae27-9284bb6155b0-delete_volume" released by "delete_volume" :: held 1.561s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 14:05:37 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[e612a336-e373-45ca-b2c9-ba4669435eea]: (4, 'raw') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 14:05:37 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-79fca9f9-9b84-4484-9608-5b45124b0275 tempest-VolumeImageDependencyTests-984528418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_69cb8e9a-2e32-43ab-b120-21f08cf055c1_hz2s1dvpdevstack@QuobyteHD {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:05:37 devstack sudo[104814]: pam_unix(sudo:session): session closed for user root Jul 13 14:05:37 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-05217a5f-9c9e-4fe4-81fd-be50a1010f3e tempest-VolumeAndVolumeTypeFromImageTest-1673490618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78" returned: 0 in 0.280s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:05:37 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-05217a5f-9c9e-4fe4-81fd-be50a1010f3e tempest-VolumeAndVolumeTypeFromImageTest-1673490618 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 14:05:37 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-05217a5f-9c9e-4fe4-81fd-be50a1010f3e tempest-VolumeAndVolumeTypeFromImageTest-1673490618 None] Deleted volume successfully. Jul 13 14:05:37 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-05217a5f-9c9e-4fe4-81fd-be50a1010f3e tempest-VolumeAndVolumeTypeFromImageTest-1673490618 None] Lock "cinder-d5e90e7d-df2e-43bb-a085-9e92d1b8cc13-delete_volume" released by "delete_volume" :: held 2.158s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 14:05:37 devstack sudo[104821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_69cb8e9a-2e32-43ab-b120-21f08cf055c1_hz2s1dvpdevstack@QuobyteHD Jul 13 14:05:37 devstack sudo[104821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:05:37 devstack sudo[104821]: pam_unix(sudo:session): session closed for user root Jul 13 14:05:37 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-79fca9f9-9b84-4484-9608-5b45124b0275 tempest-VolumeImageDependencyTests-984528418 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_69cb8e9a-2e32-43ab-b120-21f08cf055c1_hz2s1dvpdevstack@QuobyteHD" returned: 0 in 0.390s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:05:37 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-79fca9f9-9b84-4484-9608-5b45124b0275 tempest-VolumeImageDependencyTests-984528418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_69cb8e9a-2e32-43ab-b120-21f08cf055c1_hz2s1dvpdevstack@QuobyteHD {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:05:37 devstack sudo[104826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_69cb8e9a-2e32-43ab-b120-21f08cf055c1_hz2s1dvpdevstack@QuobyteHD Jul 13 14:05:37 devstack sudo[104826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:05:37 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-32e7faf1-1219-4853-a66d-ac891bbc5fc7 tempest-CreateVolumesFromSnapshotTest-61948078 None] Acquiring lock "cinder-c5425ad8-fe2b-4a49-91cd-b9fae58b6991-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 14:05:37 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-32e7faf1-1219-4853-a66d-ac891bbc5fc7 tempest-CreateVolumesFromSnapshotTest-61948078 None] Lock "cinder-c5425ad8-fe2b-4a49-91cd-b9fae58b6991-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 14:05:37 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-32e7faf1-1219-4853-a66d-ac891bbc5fc7 tempest-CreateVolumesFromSnapshotTest-61948078 None] Acquiring lock "cinder-quobyte-c5425ad8-fe2b-4a49-91cd-b9fae58b6991" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 14:05:37 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-32e7faf1-1219-4853-a66d-ac891bbc5fc7 tempest-CreateVolumesFromSnapshotTest-61948078 None] Lock "cinder-quobyte-c5425ad8-fe2b-4a49-91cd-b9fae58b6991" acquired by "delete_volume" :: waited 0.017s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 14:05:37 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8eb9b5f-c9f1-4c59-b004-f443cfc47547]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 14:05:37 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-32e7faf1-1219-4853-a66d-ac891bbc5fc7 tempest-CreateVolumesFromSnapshotTest-61948078 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-c5425ad8-fe2b-4a49-91cd-b9fae58b6991 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:05:37 devstack sudo[104826]: pam_unix(sudo:session): session closed for user root Jul 13 14:05:37 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-79fca9f9-9b84-4484-9608-5b45124b0275 tempest-VolumeImageDependencyTests-984528418 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_69cb8e9a-2e32-43ab-b120-21f08cf055c1_hz2s1dvpdevstack@QuobyteHD" returned: 1 in 0.449s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:05:37 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-79fca9f9-9b84-4484-9608-5b45124b0275 tempest-VolumeImageDependencyTests-984528418 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_69cb8e9a-2e32-43ab-b120-21f08cf055c1_hz2s1dvpdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 13 14:05:38 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-79fca9f9-9b84-4484-9608-5b45124b0275 tempest-VolumeImageDependencyTests-984528418 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 14:05:38 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-79fca9f9-9b84-4484-9608-5b45124b0275 tempest-VolumeImageDependencyTests-984528418 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 14:05:38 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-79fca9f9-9b84-4484-9608-5b45124b0275 tempest-VolumeImageDependencyTests-984528418 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T12:05:35Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92c64345-7d55-4ea6-af85-0956b9abcf07,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d2cf39a3e3e4c6a91e0f38ce467513d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T12:05:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T12:05:35Z,use_quota=True,user_id='38c995afd80a4eef8964cb36a000a42b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1147de8b-623b-426c-a13d-7fc824a80f67),volume_type_id=1147de8b-623b-426c-a13d-7fc824a80f67)}" {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 13 14:05:38 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-79fca9f9-9b84-4484-9608-5b45124b0275 tempest-VolumeImageDependencyTests-984528418 None] Creating volume 92c64345-7d55-4ea6-af85-0956b9abcf07 {{(pid=87098) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 13 14:05:38 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-79fca9f9-9b84-4484-9608-5b45124b0275 tempest-VolumeImageDependencyTests-984528418 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 14:05:38 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-79fca9f9-9b84-4484-9608-5b45124b0275 tempest-VolumeImageDependencyTests-984528418 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 14:05:38 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-79fca9f9-9b84-4484-9608-5b45124b0275 tempest-VolumeImageDependencyTests-984528418 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 14:05:38 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-79fca9f9-9b84-4484-9608-5b45124b0275 tempest-VolumeImageDependencyTests-984528418 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 14:05:38 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-79fca9f9-9b84-4484-9608-5b45124b0275 tempest-VolumeImageDependencyTests-984528418 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 14:05:38 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-79fca9f9-9b84-4484-9608-5b45124b0275 tempest-VolumeImageDependencyTests-984528418 None] Selected osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 14:05:38 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-79fca9f9-9b84-4484-9608-5b45124b0275 tempest-VolumeImageDependencyTests-984528418 None] casted to osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 Jul 13 14:05:38 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-79fca9f9-9b84-4484-9608-5b45124b0275 tempest-VolumeImageDependencyTests-984528418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-92c64345-7d55-4ea6-af85-0956b9abcf07 1073741824 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:05:38 devstack sudo[104828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-c5425ad8-fe2b-4a49-91cd-b9fae58b6991 Jul 13 14:05:38 devstack sudo[104828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:05:38 devstack sudo[104832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-92c64345-7d55-4ea6-af85-0956b9abcf07 1073741824 Jul 13 14:05:38 devstack sudo[104832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:05:38 devstack sudo[104828]: pam_unix(sudo:session): session closed for user root Jul 13 14:05:38 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-32e7faf1-1219-4853-a66d-ac891bbc5fc7 tempest-CreateVolumesFromSnapshotTest-61948078 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-c5425ad8-fe2b-4a49-91cd-b9fae58b6991" returned: 0 in 0.439s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:05:38 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-32e7faf1-1219-4853-a66d-ac891bbc5fc7 tempest-CreateVolumesFromSnapshotTest-61948078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-c5425ad8-fe2b-4a49-91cd-b9fae58b6991 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:05:38 devstack sudo[104841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-c5425ad8-fe2b-4a49-91cd-b9fae58b6991 Jul 13 14:05:38 devstack sudo[104841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:05:38 devstack sudo[104832]: pam_unix(sudo:session): session closed for user root Jul 13 14:05:38 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-79fca9f9-9b84-4484-9608-5b45124b0275 tempest-VolumeImageDependencyTests-984528418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-92c64345-7d55-4ea6-af85-0956b9abcf07 1073741824" returned: 0 in 0.608s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:05:38 devstack sudo[104841]: pam_unix(sudo:session): session closed for user root Jul 13 14:05:38 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-32e7faf1-1219-4853-a66d-ac891bbc5fc7 tempest-CreateVolumesFromSnapshotTest-61948078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-c5425ad8-fe2b-4a49-91cd-b9fae58b6991" returned: 0 in 0.308s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:05:38 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-79fca9f9-9b84-4484-9608-5b45124b0275 tempest-VolumeImageDependencyTests-984528418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-92c64345-7d55-4ea6-af85-0956b9abcf07 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:05:38 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-32e7faf1-1219-4853-a66d-ac891bbc5fc7 tempest-CreateVolumesFromSnapshotTest-61948078 None] Lock "cinder-quobyte-c5425ad8-fe2b-4a49-91cd-b9fae58b6991" released by "delete_volume" :: held 0.819s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 14:05:38 devstack sudo[104845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-92c64345-7d55-4ea6-af85-0956b9abcf07 Jul 13 14:05:38 devstack sudo[104845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:05:38 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-32e7faf1-1219-4853-a66d-ac891bbc5fc7 tempest-CreateVolumesFromSnapshotTest-61948078 None] Created reservations ['2f2c66eb-625d-4e87-8705-a6524a419d30', '3f72d8a7-bce1-45ca-88e3-6b023a3ac462', '527dba96-719f-4556-849a-0b6719bca324', '70e86741-386a-47f7-ae25-e58a43872880'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 14:05:38 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-32e7faf1-1219-4853-a66d-ac891bbc5fc7 tempest-CreateVolumesFromSnapshotTest-61948078 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 14:05:38 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-32e7faf1-1219-4853-a66d-ac891bbc5fc7 tempest-CreateVolumesFromSnapshotTest-61948078 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 14:05:38 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-32e7faf1-1219-4853-a66d-ac891bbc5fc7 tempest-CreateVolumesFromSnapshotTest-61948078 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 14:05:38 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-32e7faf1-1219-4853-a66d-ac891bbc5fc7 tempest-CreateVolumesFromSnapshotTest-61948078 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 14:05:38 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-32e7faf1-1219-4853-a66d-ac891bbc5fc7 tempest-CreateVolumesFromSnapshotTest-61948078 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 14:05:38 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-32e7faf1-1219-4853-a66d-ac891bbc5fc7 tempest-CreateVolumesFromSnapshotTest-61948078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:05:38 devstack sudo[104847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 Jul 13 14:05:38 devstack sudo[104847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:05:39 devstack sudo[104845]: pam_unix(sudo:session): session closed for user root Jul 13 14:05:39 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-79fca9f9-9b84-4484-9608-5b45124b0275 tempest-VolumeImageDependencyTests-984528418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-92c64345-7d55-4ea6-af85-0956b9abcf07" returned: 0 in 0.331s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:05:39 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-79fca9f9-9b84-4484-9608-5b45124b0275 tempest-VolumeImageDependencyTests-984528418 None] <== create_volume: return (1006ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'} {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 13 14:05:39 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-79fca9f9-9b84-4484-9608-5b45124b0275 tempest-VolumeImageDependencyTests-984528418 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.010s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 14:05:39 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-7ff7e30f-7597-4777-b671-e17b4182a02d tempest-CreateVolumesFromSnapshotTest-61948078 None] Acquiring lock "cinder-85c7e60a-d7d9-44a1-a4ee-25065916fae4-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 14:05:39 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-7ff7e30f-7597-4777-b671-e17b4182a02d tempest-CreateVolumesFromSnapshotTest-61948078 None] Lock "cinder-85c7e60a-d7d9-44a1-a4ee-25065916fae4-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 14:05:39 devstack cinder-volume[87098]: DEBUG cinder.volume.volume_utils [None req-79fca9f9-9b84-4484-9608-5b45124b0275 tempest-VolumeImageDependencyTests-984528418 None] Attempting download of 69cb8e9a-2e32-43ab-b120-21f08cf055c1 ((None, [{'url': 'file:///opt/stack/data/glance/images/69cb8e9a-2e32-43ab-b120-21f08cf055c1', 'metadata': {}}])) to volume 92c64345-7d55-4ea6-af85-0956b9abcf07. {{(pid=87098) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 13 14:05:39 devstack sudo[104847]: pam_unix(sudo:session): session closed for user root Jul 13 14:05:39 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-32e7faf1-1219-4853-a66d-ac891bbc5fc7 tempest-CreateVolumesFromSnapshotTest-61948078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78" returned: 0 in 0.333s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:05:39 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-32e7faf1-1219-4853-a66d-ac891bbc5fc7 tempest-CreateVolumesFromSnapshotTest-61948078 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 14:05:39 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-32e7faf1-1219-4853-a66d-ac891bbc5fc7 tempest-CreateVolumesFromSnapshotTest-61948078 None] Deleted volume successfully. Jul 13 14:05:39 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-7ff7e30f-7597-4777-b671-e17b4182a02d tempest-CreateVolumesFromSnapshotTest-61948078 None] Acquiring lock "cinder-quobyte-85c7e60a-d7d9-44a1-a4ee-25065916fae4" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 14:05:39 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[c36e3420-d94c-49be-8e72-74e176a797a2]: (4, 'raw') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 14:05:39 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-79fca9f9-9b84-4484-9608-5b45124b0275 tempest-VolumeImageDependencyTests-984528418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_69cb8e9a-2e32-43ab-b120-21f08cf055c1_q4_azila {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:05:39 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-7ff7e30f-7597-4777-b671-e17b4182a02d tempest-CreateVolumesFromSnapshotTest-61948078 None] Lock "cinder-quobyte-85c7e60a-d7d9-44a1-a4ee-25065916fae4" acquired by "delete_volume" :: waited 0.038s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 14:05:39 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-32e7faf1-1219-4853-a66d-ac891bbc5fc7 tempest-CreateVolumesFromSnapshotTest-61948078 None] Lock "cinder-c5425ad8-fe2b-4a49-91cd-b9fae58b6991-delete_volume" released by "delete_volume" :: held 1.431s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 14:05:39 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fed9568-b9ce-45f2-9163-11071f70d91e]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 14:05:39 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-7ff7e30f-7597-4777-b671-e17b4182a02d tempest-CreateVolumesFromSnapshotTest-61948078 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-85c7e60a-d7d9-44a1-a4ee-25065916fae4 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:05:39 devstack sudo[104851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_69cb8e9a-2e32-43ab-b120-21f08cf055c1_q4_azila Jul 13 14:05:39 devstack sudo[104851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:05:39 devstack sudo[104852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-85c7e60a-d7d9-44a1-a4ee-25065916fae4 Jul 13 14:05:39 devstack sudo[104852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:05:39 devstack sudo[104851]: pam_unix(sudo:session): session closed for user root Jul 13 14:05:39 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-79fca9f9-9b84-4484-9608-5b45124b0275 tempest-VolumeImageDependencyTests-984528418 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_69cb8e9a-2e32-43ab-b120-21f08cf055c1_q4_azila" returned: 0 in 0.457s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:05:39 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-79fca9f9-9b84-4484-9608-5b45124b0275 tempest-VolumeImageDependencyTests-984528418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_69cb8e9a-2e32-43ab-b120-21f08cf055c1_q4_azila {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:05:39 devstack sudo[104852]: pam_unix(sudo:session): session closed for user root Jul 13 14:05:39 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-7ff7e30f-7597-4777-b671-e17b4182a02d tempest-CreateVolumesFromSnapshotTest-61948078 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-85c7e60a-d7d9-44a1-a4ee-25065916fae4" returned: 0 in 0.485s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:05:39 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-7ff7e30f-7597-4777-b671-e17b4182a02d tempest-CreateVolumesFromSnapshotTest-61948078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-85c7e60a-d7d9-44a1-a4ee-25065916fae4 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:05:39 devstack sudo[104859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_69cb8e9a-2e32-43ab-b120-21f08cf055c1_q4_azila Jul 13 14:05:39 devstack sudo[104859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:05:39 devstack sudo[104862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-85c7e60a-d7d9-44a1-a4ee-25065916fae4 Jul 13 14:05:39 devstack sudo[104862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:05:39 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-afabf0ca-fba8-471d-a1c4-8d913a827517 tempest-VolumeDependencyTests-691513090 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 14:05:39 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-afabf0ca-fba8-471d-a1c4-8d913a827517 tempest-VolumeDependencyTests-691513090 None] Flow 'volume_create_manager' (698b78c4-5b36-4602-aaea-b40c335e4639) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 14:05:39 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-afabf0ca-fba8-471d-a1c4-8d913a827517 tempest-VolumeDependencyTests-691513090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (130dcd6a-9a23-4c45-83e5-0018c420509a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:05:39 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-afabf0ca-fba8-471d-a1c4-8d913a827517 tempest-VolumeDependencyTests-691513090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (130dcd6a-9a23-4c45-83e5-0018c420509a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T12:05:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2039837122',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae62b240-08a3-4ccb-90ee-ef7c56f32cd6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da25d3dbcf4042759d5569dd1827f9f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T12:05:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T12:05:40Z,use_quota=True,user_id='76380cc9b80841cc901dda15af0c5c54',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1147de8b-623b-426c-a13d-7fc824a80f67),volume_type_id=1147de8b-623b-426c-a13d-7fc824a80f67)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:05:39 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-afabf0ca-fba8-471d-a1c4-8d913a827517 tempest-VolumeDependencyTests-691513090 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c96b8e4a-a367-4e3a-8c80-1dd88b08f79a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:05:39 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-afabf0ca-fba8-471d-a1c4-8d913a827517 tempest-VolumeDependencyTests-691513090 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c96b8e4a-a367-4e3a-8c80-1dd88b08f79a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:05:39 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-afabf0ca-fba8-471d-a1c4-8d913a827517 tempest-VolumeDependencyTests-691513090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bef65bd3-d8c4-400b-bb83-ed2905b5c588) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:05:39 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-afabf0ca-fba8-471d-a1c4-8d913a827517 tempest-VolumeDependencyTests-691513090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bef65bd3-d8c4-400b-bb83-ed2905b5c588) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ae62b240-08a3-4ccb-90ee-ef7c56f32cd6', 'volume_name': 'volume-ae62b240-08a3-4ccb-90ee-ef7c56f32cd6', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:05:39 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-afabf0ca-fba8-471d-a1c4-8d913a827517 tempest-VolumeDependencyTests-691513090 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04df8c23-02ef-4b2d-adb2-3d87f91e3af9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:05:39 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-afabf0ca-fba8-471d-a1c4-8d913a827517 tempest-VolumeDependencyTests-691513090 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04df8c23-02ef-4b2d-adb2-3d87f91e3af9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:05:39 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-afabf0ca-fba8-471d-a1c4-8d913a827517 tempest-VolumeDependencyTests-691513090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc396581-aae2-4116-b9d5-fbf348c2e92b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:05:39 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-afabf0ca-fba8-471d-a1c4-8d913a827517 tempest-VolumeDependencyTests-691513090 None] Volume ae62b240-08a3-4ccb-90ee-ef7c56f32cd6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ae62b240-08a3-4ccb-90ee-ef7c56f32cd6', 'volume_size': 1} Jul 13 14:05:39 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-afabf0ca-fba8-471d-a1c4-8d913a827517 tempest-VolumeDependencyTests-691513090 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 14:05:39 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-afabf0ca-fba8-471d-a1c4-8d913a827517 tempest-VolumeDependencyTests-691513090 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 14:05:39 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-afabf0ca-fba8-471d-a1c4-8d913a827517 tempest-VolumeDependencyTests-691513090 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T12:05:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2039837122',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae62b240-08a3-4ccb-90ee-ef7c56f32cd6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da25d3dbcf4042759d5569dd1827f9f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T12:05:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T12:05:40Z,use_quota=True,user_id='76380cc9b80841cc901dda15af0c5c54',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1147de8b-623b-426c-a13d-7fc824a80f67),volume_type_id=1147de8b-623b-426c-a13d-7fc824a80f67)}" {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 13 14:05:39 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-afabf0ca-fba8-471d-a1c4-8d913a827517 tempest-VolumeDependencyTests-691513090 None] Creating volume ae62b240-08a3-4ccb-90ee-ef7c56f32cd6 {{(pid=87098) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 13 14:05:39 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-afabf0ca-fba8-471d-a1c4-8d913a827517 tempest-VolumeDependencyTests-691513090 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 14:05:39 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-afabf0ca-fba8-471d-a1c4-8d913a827517 tempest-VolumeDependencyTests-691513090 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 14:05:39 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-afabf0ca-fba8-471d-a1c4-8d913a827517 tempest-VolumeDependencyTests-691513090 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 14:05:39 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-afabf0ca-fba8-471d-a1c4-8d913a827517 tempest-VolumeDependencyTests-691513090 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 14:05:39 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-afabf0ca-fba8-471d-a1c4-8d913a827517 tempest-VolumeDependencyTests-691513090 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 14:05:39 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-afabf0ca-fba8-471d-a1c4-8d913a827517 tempest-VolumeDependencyTests-691513090 None] Selected osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 14:05:39 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-afabf0ca-fba8-471d-a1c4-8d913a827517 tempest-VolumeDependencyTests-691513090 None] casted to osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 Jul 13 14:05:39 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-afabf0ca-fba8-471d-a1c4-8d913a827517 tempest-VolumeDependencyTests-691513090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-ae62b240-08a3-4ccb-90ee-ef7c56f32cd6 1073741824 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:05:40 devstack sudo[104859]: pam_unix(sudo:session): session closed for user root Jul 13 14:05:40 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-79fca9f9-9b84-4484-9608-5b45124b0275 tempest-VolumeImageDependencyTests-984528418 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_69cb8e9a-2e32-43ab-b120-21f08cf055c1_q4_azila" returned: 1 in 0.387s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:05:40 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-79fca9f9-9b84-4484-9608-5b45124b0275 tempest-VolumeImageDependencyTests-984528418 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_69cb8e9a-2e32-43ab-b120-21f08cf055c1_q4_azila' failed. Not Retrying. {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 13 14:05:40 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc32f0aa-85b0-4864-85a6-1406a1a5afc5]: (4, 'raw') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 14:05:40 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-79fca9f9-9b84-4484-9608-5b45124b0275 tempest-VolumeImageDependencyTests-984528418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_69cb8e9a-2e32-43ab-b120-21f08cf055c1_hz2s1dvpdevstack@QuobyteHD {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:05:40 devstack sudo[104867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-ae62b240-08a3-4ccb-90ee-ef7c56f32cd6 1073741824 Jul 13 14:05:40 devstack sudo[104867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:05:40 devstack sudo[104862]: pam_unix(sudo:session): session closed for user root Jul 13 14:05:40 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-7ff7e30f-7597-4777-b671-e17b4182a02d tempest-CreateVolumesFromSnapshotTest-61948078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-85c7e60a-d7d9-44a1-a4ee-25065916fae4" returned: 0 in 0.354s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:05:40 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-7ff7e30f-7597-4777-b671-e17b4182a02d tempest-CreateVolumesFromSnapshotTest-61948078 None] Lock "cinder-quobyte-85c7e60a-d7d9-44a1-a4ee-25065916fae4" released by "delete_volume" :: held 0.911s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 14:05:40 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-7ff7e30f-7597-4777-b671-e17b4182a02d tempest-CreateVolumesFromSnapshotTest-61948078 None] Created reservations ['0eeb4355-d318-4962-9ee0-9c048d5a5a41', 'e099fe1d-5eb3-4fd4-8f5b-6d335d5bbe65', '2062f5ed-64a1-407a-955f-72b4d7389e24', '93d4fbc5-fece-40c9-a6df-b4a4c31a8764'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 14:05:40 devstack sudo[104870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_69cb8e9a-2e32-43ab-b120-21f08cf055c1_hz2s1dvpdevstack@QuobyteHD Jul 13 14:05:40 devstack sudo[104870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:05:40 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-7ff7e30f-7597-4777-b671-e17b4182a02d tempest-CreateVolumesFromSnapshotTest-61948078 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 14:05:40 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-7ff7e30f-7597-4777-b671-e17b4182a02d tempest-CreateVolumesFromSnapshotTest-61948078 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 14:05:40 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-7ff7e30f-7597-4777-b671-e17b4182a02d tempest-CreateVolumesFromSnapshotTest-61948078 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 14:05:40 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-7ff7e30f-7597-4777-b671-e17b4182a02d tempest-CreateVolumesFromSnapshotTest-61948078 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 14:05:40 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-7ff7e30f-7597-4777-b671-e17b4182a02d tempest-CreateVolumesFromSnapshotTest-61948078 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 14:05:40 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-7ff7e30f-7597-4777-b671-e17b4182a02d tempest-CreateVolumesFromSnapshotTest-61948078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:05:40 devstack sudo[104872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 Jul 13 14:05:40 devstack sudo[104872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:05:40 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-f85d8c74-27be-432c-b0f4-828e55aa1fa6 tempest-CreateVolumesFromSnapshotTest-61948078 None] Acquiring lock "cinder-82931003-2183-4d42-a2f4-76c1c2501bf7-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 14:05:40 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-f85d8c74-27be-432c-b0f4-828e55aa1fa6 tempest-CreateVolumesFromSnapshotTest-61948078 None] Lock "cinder-82931003-2183-4d42-a2f4-76c1c2501bf7-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 14:05:40 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-f85d8c74-27be-432c-b0f4-828e55aa1fa6 tempest-CreateVolumesFromSnapshotTest-61948078 None] Acquiring lock "cinder-quobyte-82931003-2183-4d42-a2f4-76c1c2501bf7" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 14:05:40 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-f85d8c74-27be-432c-b0f4-828e55aa1fa6 tempest-CreateVolumesFromSnapshotTest-61948078 None] Lock "cinder-quobyte-82931003-2183-4d42-a2f4-76c1c2501bf7" acquired by "delete_volume" :: waited 0.029s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 14:05:40 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[c45f93ee-a222-430e-a478-86c7c8d16033]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 14:05:40 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-f85d8c74-27be-432c-b0f4-828e55aa1fa6 tempest-CreateVolumesFromSnapshotTest-61948078 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-82931003-2183-4d42-a2f4-76c1c2501bf7 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:05:40 devstack sudo[104870]: pam_unix(sudo:session): session closed for user root Jul 13 14:05:40 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-79fca9f9-9b84-4484-9608-5b45124b0275 tempest-VolumeImageDependencyTests-984528418 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_69cb8e9a-2e32-43ab-b120-21f08cf055c1_hz2s1dvpdevstack@QuobyteHD" returned: 0 in 0.523s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:05:40 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-79fca9f9-9b84-4484-9608-5b45124b0275 tempest-VolumeImageDependencyTests-984528418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_69cb8e9a-2e32-43ab-b120-21f08cf055c1_hz2s1dvpdevstack@QuobyteHD {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:05:40 devstack sudo[104867]: pam_unix(sudo:session): session closed for user root Jul 13 14:05:40 devstack sudo[104872]: pam_unix(sudo:session): session closed for user root Jul 13 14:05:40 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-afabf0ca-fba8-471d-a1c4-8d913a827517 tempest-VolumeDependencyTests-691513090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-ae62b240-08a3-4ccb-90ee-ef7c56f32cd6 1073741824" returned: 0 in 0.643s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:05:40 devstack sudo[104878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-82931003-2183-4d42-a2f4-76c1c2501bf7 Jul 13 14:05:40 devstack sudo[104878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:05:40 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-7ff7e30f-7597-4777-b671-e17b4182a02d tempest-CreateVolumesFromSnapshotTest-61948078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78" returned: 0 in 0.399s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:05:40 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-7ff7e30f-7597-4777-b671-e17b4182a02d tempest-CreateVolumesFromSnapshotTest-61948078 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 14:05:40 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-7ff7e30f-7597-4777-b671-e17b4182a02d tempest-CreateVolumesFromSnapshotTest-61948078 None] Deleted volume successfully. Jul 13 14:05:40 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-7ff7e30f-7597-4777-b671-e17b4182a02d tempest-CreateVolumesFromSnapshotTest-61948078 None] Lock "cinder-85c7e60a-d7d9-44a1-a4ee-25065916fae4-delete_volume" released by "delete_volume" :: held 1.668s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 14:05:40 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-afabf0ca-fba8-471d-a1c4-8d913a827517 tempest-VolumeDependencyTests-691513090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-ae62b240-08a3-4ccb-90ee-ef7c56f32cd6 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:05:40 devstack sudo[104881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_69cb8e9a-2e32-43ab-b120-21f08cf055c1_hz2s1dvpdevstack@QuobyteHD Jul 13 14:05:40 devstack sudo[104881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:05:40 devstack sudo[104884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-ae62b240-08a3-4ccb-90ee-ef7c56f32cd6 Jul 13 14:05:40 devstack sudo[104884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:05:40 devstack sudo[104878]: pam_unix(sudo:session): session closed for user root Jul 13 14:05:41 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-f85d8c74-27be-432c-b0f4-828e55aa1fa6 tempest-CreateVolumesFromSnapshotTest-61948078 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-82931003-2183-4d42-a2f4-76c1c2501bf7" returned: 0 in 0.512s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:05:41 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-f85d8c74-27be-432c-b0f4-828e55aa1fa6 tempest-CreateVolumesFromSnapshotTest-61948078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-82931003-2183-4d42-a2f4-76c1c2501bf7 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:05:41 devstack sudo[104891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-82931003-2183-4d42-a2f4-76c1c2501bf7 Jul 13 14:05:41 devstack sudo[104891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:05:41 devstack sudo[104881]: pam_unix(sudo:session): session closed for user root Jul 13 14:05:41 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-79fca9f9-9b84-4484-9608-5b45124b0275 tempest-VolumeImageDependencyTests-984528418 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_69cb8e9a-2e32-43ab-b120-21f08cf055c1_hz2s1dvpdevstack@QuobyteHD" returned: 1 in 0.520s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:05:41 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-79fca9f9-9b84-4484-9608-5b45124b0275 tempest-VolumeImageDependencyTests-984528418 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_69cb8e9a-2e32-43ab-b120-21f08cf055c1_hz2s1dvpdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 13 14:05:41 devstack cinder-volume[87098]: DEBUG cinder.image.image_utils [None req-79fca9f9-9b84-4484-9608-5b45124b0275 tempest-VolumeImageDependencyTests-984528418 None] 69cb8e9a-2e32-43ab-b120-21f08cf055c1 was raw, converting to raw {{(pid=87098) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 13 14:05:41 devstack sudo[104884]: pam_unix(sudo:session): session closed for user root Jul 13 14:05:41 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-79fca9f9-9b84-4484-9608-5b45124b0275 tempest-VolumeImageDependencyTests-984528418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_69cb8e9a-2e32-43ab-b120-21f08cf055c1_hz2s1dvpdevstack@QuobyteHD /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-92c64345-7d55-4ea6-af85-0956b9abcf07 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:05:41 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-afabf0ca-fba8-471d-a1c4-8d913a827517 tempest-VolumeDependencyTests-691513090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-ae62b240-08a3-4ccb-90ee-ef7c56f32cd6" returned: 0 in 0.358s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:05:41 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-afabf0ca-fba8-471d-a1c4-8d913a827517 tempest-VolumeDependencyTests-691513090 None] <== create_volume: return (1135ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'} {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 13 14:05:41 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-afabf0ca-fba8-471d-a1c4-8d913a827517 tempest-VolumeDependencyTests-691513090 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.137s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 14:05:41 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-afabf0ca-fba8-471d-a1c4-8d913a827517 tempest-VolumeDependencyTests-691513090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc396581-aae2-4116-b9d5-fbf348c2e92b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ae62b240-08a3-4ccb-90ee-ef7c56f32cd6', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:05:41 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-afabf0ca-fba8-471d-a1c4-8d913a827517 tempest-VolumeDependencyTests-691513090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55f362a4-450e-476e-8aca-7485e6f73543) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:05:41 devstack sudo[104897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_69cb8e9a-2e32-43ab-b120-21f08cf055c1_hz2s1dvpdevstack@QuobyteHD /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-92c64345-7d55-4ea6-af85-0956b9abcf07 Jul 13 14:05:41 devstack sudo[104897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:05:41 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-afabf0ca-fba8-471d-a1c4-8d913a827517 tempest-VolumeDependencyTests-691513090 None] Volume volume-ae62b240-08a3-4ccb-90ee-ef7c56f32cd6 (ae62b240-08a3-4ccb-90ee-ef7c56f32cd6): created successfully Jul 13 14:05:41 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-afabf0ca-fba8-471d-a1c4-8d913a827517 tempest-VolumeDependencyTests-691513090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55f362a4-450e-476e-8aca-7485e6f73543) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:05:41 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-afabf0ca-fba8-471d-a1c4-8d913a827517 tempest-VolumeDependencyTests-691513090 None] Flow 'volume_create_manager' (698b78c4-5b36-4602-aaea-b40c335e4639) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 14:05:41 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-afabf0ca-fba8-471d-a1c4-8d913a827517 tempest-VolumeDependencyTests-691513090 None] Created volume successfully. Jul 13 14:05:41 devstack sudo[104891]: pam_unix(sudo:session): session closed for user root Jul 13 14:05:41 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-f85d8c74-27be-432c-b0f4-828e55aa1fa6 tempest-CreateVolumesFromSnapshotTest-61948078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-82931003-2183-4d42-a2f4-76c1c2501bf7" returned: 0 in 0.301s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:05:41 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-f85d8c74-27be-432c-b0f4-828e55aa1fa6 tempest-CreateVolumesFromSnapshotTest-61948078 None] Lock "cinder-quobyte-82931003-2183-4d42-a2f4-76c1c2501bf7" released by "delete_volume" :: held 0.869s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 14:05:41 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-f85d8c74-27be-432c-b0f4-828e55aa1fa6 tempest-CreateVolumesFromSnapshotTest-61948078 None] Created reservations ['56a0ee4a-5f19-4e4e-91cd-ba6691155039', '85556948-88d1-4f27-92bd-a9af637ddc3e', '6ba2b82d-e3aa-4f24-892c-a3214f4d1a8b', '4f3817d2-ddc5-443d-8c64-734738fb0aea'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 14:05:41 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-f85d8c74-27be-432c-b0f4-828e55aa1fa6 tempest-CreateVolumesFromSnapshotTest-61948078 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 14:05:41 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-f85d8c74-27be-432c-b0f4-828e55aa1fa6 tempest-CreateVolumesFromSnapshotTest-61948078 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 14:05:41 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-f85d8c74-27be-432c-b0f4-828e55aa1fa6 tempest-CreateVolumesFromSnapshotTest-61948078 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 14:05:41 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-f85d8c74-27be-432c-b0f4-828e55aa1fa6 tempest-CreateVolumesFromSnapshotTest-61948078 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 14:05:41 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-f85d8c74-27be-432c-b0f4-828e55aa1fa6 tempest-CreateVolumesFromSnapshotTest-61948078 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 14:05:41 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-f85d8c74-27be-432c-b0f4-828e55aa1fa6 tempest-CreateVolumesFromSnapshotTest-61948078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:05:41 devstack sudo[104903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 Jul 13 14:05:41 devstack sudo[104903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:05:41 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-b224d90b-6e11-41ee-b00d-9ddbff429f1d tempest-CreateVolumesFromSnapshotTest-61948078 None] Acquiring lock "cinder-8af43fe5-e744-48c2-b431-20c25c2f9c40-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 14:05:41 devstack sudo[104897]: pam_unix(sudo:session): session closed for user root Jul 13 14:05:41 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-79fca9f9-9b84-4484-9608-5b45124b0275 tempest-VolumeImageDependencyTests-984528418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_69cb8e9a-2e32-43ab-b120-21f08cf055c1_hz2s1dvpdevstack@QuobyteHD /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-92c64345-7d55-4ea6-af85-0956b9abcf07" returned: 0 in 0.474s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:05:41 devstack cinder-volume[87098]: DEBUG cinder.image.image_utils [None req-79fca9f9-9b84-4484-9608-5b45124b0275 tempest-VolumeImageDependencyTests-984528418 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_69cb8e9a-2e32-43ab-b120-21f08cf055c1_hz2s1dvpdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-92c64345-7d55-4ea6-af85-0956b9abcf07 {{(pid=87098) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 13 14:05:41 devstack cinder-volume[87098]: INFO cinder.image.image_utils [None req-79fca9f9-9b84-4484-9608-5b45124b0275 tempest-VolumeImageDependencyTests-984528418 None] Converted 0.00 MB image at 0.00 MB/s Jul 13 14:05:41 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-79fca9f9-9b84-4484-9608-5b45124b0275 tempest-VolumeImageDependencyTests-984528418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-92c64345-7d55-4ea6-af85-0956b9abcf07 1G {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:05:41 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-b224d90b-6e11-41ee-b00d-9ddbff429f1d tempest-CreateVolumesFromSnapshotTest-61948078 None] Lock "cinder-8af43fe5-e744-48c2-b431-20c25c2f9c40-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 14:05:41 devstack sudo[104905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-92c64345-7d55-4ea6-af85-0956b9abcf07 1G Jul 13 14:05:41 devstack sudo[104905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:05:41 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-b224d90b-6e11-41ee-b00d-9ddbff429f1d tempest-CreateVolumesFromSnapshotTest-61948078 None] Acquiring lock "cinder-quobyte-8af43fe5-e744-48c2-b431-20c25c2f9c40" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 14:05:41 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-b224d90b-6e11-41ee-b00d-9ddbff429f1d tempest-CreateVolumesFromSnapshotTest-61948078 None] Lock "cinder-quobyte-8af43fe5-e744-48c2-b431-20c25c2f9c40" acquired by "delete_volume" :: waited 0.019s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 14:05:41 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd466588-f040-4871-827c-d2ebefc57c7e]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 14:05:41 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-b224d90b-6e11-41ee-b00d-9ddbff429f1d tempest-CreateVolumesFromSnapshotTest-61948078 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-8af43fe5-e744-48c2-b431-20c25c2f9c40 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:05:41 devstack sudo[104903]: pam_unix(sudo:session): session closed for user root Jul 13 14:05:41 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-f85d8c74-27be-432c-b0f4-828e55aa1fa6 tempest-CreateVolumesFromSnapshotTest-61948078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78" returned: 0 in 0.330s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:05:41 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-f85d8c74-27be-432c-b0f4-828e55aa1fa6 tempest-CreateVolumesFromSnapshotTest-61948078 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 14:05:41 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-f85d8c74-27be-432c-b0f4-828e55aa1fa6 tempest-CreateVolumesFromSnapshotTest-61948078 None] Deleted volume successfully. Jul 13 14:05:41 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-f85d8c74-27be-432c-b0f4-828e55aa1fa6 tempest-CreateVolumesFromSnapshotTest-61948078 None] Lock "cinder-82931003-2183-4d42-a2f4-76c1c2501bf7-delete_volume" released by "delete_volume" :: held 1.512s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 14:05:41 devstack sudo[104907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-8af43fe5-e744-48c2-b431-20c25c2f9c40 Jul 13 14:05:41 devstack sudo[104907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:05:42 devstack sudo[104905]: pam_unix(sudo:session): session closed for user root Jul 13 14:05:42 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-79fca9f9-9b84-4484-9608-5b45124b0275 tempest-VolumeImageDependencyTests-984528418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-92c64345-7d55-4ea6-af85-0956b9abcf07 1G" returned: 0 in 0.464s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:05:42 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[25aff3b8-6810-4827-b0a3-27ab38598954]: (4, 'raw') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 14:05:42 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-79fca9f9-9b84-4484-9608-5b45124b0275 tempest-VolumeImageDependencyTests-984528418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-92c64345-7d55-4ea6-af85-0956b9abcf07 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:05:42 devstack sudo[104907]: pam_unix(sudo:session): session closed for user root Jul 13 14:05:42 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-b224d90b-6e11-41ee-b00d-9ddbff429f1d tempest-CreateVolumesFromSnapshotTest-61948078 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-8af43fe5-e744-48c2-b431-20c25c2f9c40" returned: 0 in 0.529s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:05:42 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-b224d90b-6e11-41ee-b00d-9ddbff429f1d tempest-CreateVolumesFromSnapshotTest-61948078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-8af43fe5-e744-48c2-b431-20c25c2f9c40 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:05:42 devstack sudo[104915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-92c64345-7d55-4ea6-af85-0956b9abcf07 Jul 13 14:05:42 devstack sudo[104915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:05:42 devstack sudo[104917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-8af43fe5-e744-48c2-b431-20c25c2f9c40 Jul 13 14:05:42 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-04659f96-b70c-44f2-a4a3-336238b072df tempest-VolumeDependencyTests-691513090 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 14:05:42 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-04659f96-b70c-44f2-a4a3-336238b072df tempest-VolumeDependencyTests-691513090 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.004s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 14:05:42 devstack sudo[104917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:05:42 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-04659f96-b70c-44f2-a4a3-336238b072df tempest-VolumeDependencyTests-691513090 None] Creating offline snapshot 8d3708c6-04a7-4993-a301-21c6c81631a2 of volume ae62b240-08a3-4ccb-90ee-ef7c56f32cd6 {{(pid=87098) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 13 14:05:42 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[224059d2-28da-4b74-9739-a3ab7e0881aa]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 14:05:42 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-04659f96-b70c-44f2-a4a3-336238b072df tempest-VolumeDependencyTests-691513090 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-ae62b240-08a3-4ccb-90ee-ef7c56f32cd6 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:05:42 devstack sudo[104920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-ae62b240-08a3-4ccb-90ee-ef7c56f32cd6 Jul 13 14:05:42 devstack sudo[104920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:05:42 devstack sudo[104915]: pam_unix(sudo:session): session closed for user root Jul 13 14:05:42 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-79fca9f9-9b84-4484-9608-5b45124b0275 tempest-VolumeImageDependencyTests-984528418 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-92c64345-7d55-4ea6-af85-0956b9abcf07" returned: 0 in 0.422s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:05:42 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-79fca9f9-9b84-4484-9608-5b45124b0275 tempest-VolumeImageDependencyTests-984528418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-92c64345-7d55-4ea6-af85-0956b9abcf07 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:05:42 devstack sudo[104917]: pam_unix(sudo:session): session closed for user root Jul 13 14:05:42 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-b224d90b-6e11-41ee-b00d-9ddbff429f1d tempest-CreateVolumesFromSnapshotTest-61948078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-8af43fe5-e744-48c2-b431-20c25c2f9c40" returned: 0 in 0.295s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:05:42 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-b224d90b-6e11-41ee-b00d-9ddbff429f1d tempest-CreateVolumesFromSnapshotTest-61948078 None] Lock "cinder-quobyte-8af43fe5-e744-48c2-b431-20c25c2f9c40" released by "delete_volume" :: held 0.883s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 14:05:42 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-b224d90b-6e11-41ee-b00d-9ddbff429f1d tempest-CreateVolumesFromSnapshotTest-61948078 None] Created reservations ['8d0ef953-a0ee-471d-bf64-2bcd486c85ea', '6af9d60d-4634-4b83-9f7e-fe13a1d62fe0', '51af0b2a-1860-43e0-bfed-d90cd0d46f79', 'ef0b4438-4932-4d1b-8739-ba4c44978281'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 14:05:42 devstack sudo[104925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-92c64345-7d55-4ea6-af85-0956b9abcf07 Jul 13 14:05:42 devstack sudo[104925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:05:42 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-b224d90b-6e11-41ee-b00d-9ddbff429f1d tempest-CreateVolumesFromSnapshotTest-61948078 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 14:05:42 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-b224d90b-6e11-41ee-b00d-9ddbff429f1d tempest-CreateVolumesFromSnapshotTest-61948078 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 14:05:42 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-b224d90b-6e11-41ee-b00d-9ddbff429f1d tempest-CreateVolumesFromSnapshotTest-61948078 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 14:05:42 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-b224d90b-6e11-41ee-b00d-9ddbff429f1d tempest-CreateVolumesFromSnapshotTest-61948078 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 14:05:42 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-b224d90b-6e11-41ee-b00d-9ddbff429f1d tempest-CreateVolumesFromSnapshotTest-61948078 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 14:05:42 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-b224d90b-6e11-41ee-b00d-9ddbff429f1d tempest-CreateVolumesFromSnapshotTest-61948078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:05:42 devstack sudo[104929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 Jul 13 14:05:42 devstack sudo[104929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:05:42 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-543b8e26-5fa0-4841-b93f-70487ae292c5 tempest-CreateVolumesFromSnapshotTest-61948078 None] Acquiring lock "cinder-e4b1d12d-e475-4ef5-9018-cf24fed038ec-delete_snapshot" by "delete_snapshot" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 14:05:42 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-543b8e26-5fa0-4841-b93f-70487ae292c5 tempest-CreateVolumesFromSnapshotTest-61948078 None] Lock "cinder-e4b1d12d-e475-4ef5-9018-cf24fed038ec-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 14:05:42 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-543b8e26-5fa0-4841-b93f-70487ae292c5 tempest-CreateVolumesFromSnapshotTest-61948078 None] Acquiring lock "cinder-quobyte-47619ab5-bc64-413d-bb7d-e74c118fdb97" by "delete_snapshot" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 14:05:42 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-543b8e26-5fa0-4841-b93f-70487ae292c5 tempest-CreateVolumesFromSnapshotTest-61948078 None] Lock "cinder-quobyte-47619ab5-bc64-413d-bb7d-e74c118fdb97" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 14:05:42 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-543b8e26-5fa0-4841-b93f-70487ae292c5 tempest-CreateVolumesFromSnapshotTest-61948078 None] Acquiring lock "cinder-quobyte-e4b1d12d-e475-4ef5-9018-cf24fed038ec" by "_delete_snapshot" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 14:05:42 devstack sudo[104920]: pam_unix(sudo:session): session closed for user root Jul 13 14:05:42 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-04659f96-b70c-44f2-a4a3-336238b072df tempest-VolumeDependencyTests-691513090 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-ae62b240-08a3-4ccb-90ee-ef7c56f32cd6" returned: 0 in 0.500s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:05:42 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-04659f96-b70c-44f2-a4a3-336238b072df tempest-VolumeDependencyTests-691513090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-ae62b240-08a3-4ccb-90ee-ef7c56f32cd6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-ae62b240-08a3-4ccb-90ee-ef7c56f32cd6.8d3708c6-04a7-4993-a301-21c6c81631a2 1G {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:05:42 devstack sudo[104932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-ae62b240-08a3-4ccb-90ee-ef7c56f32cd6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-ae62b240-08a3-4ccb-90ee-ef7c56f32cd6.8d3708c6-04a7-4993-a301-21c6c81631a2 1G Jul 13 14:05:42 devstack sudo[104932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:05:42 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-543b8e26-5fa0-4841-b93f-70487ae292c5 tempest-CreateVolumesFromSnapshotTest-61948078 None] Lock "cinder-quobyte-e4b1d12d-e475-4ef5-9018-cf24fed038ec" acquired by "_delete_snapshot" :: waited 0.051s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 14:05:42 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-543b8e26-5fa0-4841-b93f-70487ae292c5 tempest-CreateVolumesFromSnapshotTest-61948078 None] Deleting offline snapshot e4b1d12d-e475-4ef5-9018-cf24fed038ec of volume 47619ab5-bc64-413d-bb7d-e74c118fdb97 {{(pid=87098) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 13 14:05:42 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-543b8e26-5fa0-4841-b93f-70487ae292c5 tempest-CreateVolumesFromSnapshotTest-61948078 None] snapshot_file for this snap is: volume-47619ab5-bc64-413d-bb7d-e74c118fdb97.e4b1d12d-e475-4ef5-9018-cf24fed038ec {{(pid=87098) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 13 14:05:42 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[5113080b-4705-4a13-923a-245c48e082ab]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 14:05:42 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-543b8e26-5fa0-4841-b93f-70487ae292c5 tempest-CreateVolumesFromSnapshotTest-61948078 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-47619ab5-bc64-413d-bb7d-e74c118fdb97.e4b1d12d-e475-4ef5-9018-cf24fed038ec {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:05:43 devstack sudo[104925]: pam_unix(sudo:session): session closed for user root Jul 13 14:05:43 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-79fca9f9-9b84-4484-9608-5b45124b0275 tempest-VolumeImageDependencyTests-984528418 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-92c64345-7d55-4ea6-af85-0956b9abcf07" returned: 1 in 0.539s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:05:43 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-79fca9f9-9b84-4484-9608-5b45124b0275 tempest-VolumeImageDependencyTests-984528418 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-92c64345-7d55-4ea6-af85-0956b9abcf07' failed. Not Retrying. {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 13 14:05:43 devstack cinder-volume[87098]: DEBUG cinder.volume.volume_utils [None req-79fca9f9-9b84-4484-9608-5b45124b0275 tempest-VolumeImageDependencyTests-984528418 None] Downloaded image 69cb8e9a-2e32-43ab-b120-21f08cf055c1 ((None, [{'url': 'file:///opt/stack/data/glance/images/69cb8e9a-2e32-43ab-b120-21f08cf055c1', 'metadata': {}}])) to volume 92c64345-7d55-4ea6-af85-0956b9abcf07 successfully. {{(pid=87098) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 13 14:05:43 devstack cinder-volume[87098]: DEBUG cinder.image.image_utils [None req-79fca9f9-9b84-4484-9608-5b45124b0275 tempest-VolumeImageDependencyTests-984528418 None] Temporary image 69cb8e9a-2e32-43ab-b120-21f08cf055c1 for user 38c995afd80a4eef8964cb36a000a42b is deleted. {{(pid=87098) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 13 14:05:43 devstack cinder-volume[87098]: DEBUG cinder.volume.volume_utils [None req-79fca9f9-9b84-4484-9608-5b45124b0275 tempest-VolumeImageDependencyTests-984528418 None] Marking volume 92c64345-7d55-4ea6-af85-0956b9abcf07 as bootable. {{(pid=87098) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 13 14:05:43 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-79fca9f9-9b84-4484-9608-5b45124b0275 tempest-VolumeImageDependencyTests-984528418 None] Copying metadata from image 69cb8e9a-2e32-43ab-b120-21f08cf055c1 to 92c64345-7d55-4ea6-af85-0956b9abcf07. {{(pid=87098) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 13 14:05:43 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-79fca9f9-9b84-4484-9608-5b45124b0275 tempest-VolumeImageDependencyTests-984528418 None] Creating volume glance metadata for volume 92c64345-7d55-4ea6-af85-0956b9abcf07 backed by image 69cb8e9a-2e32-43ab-b120-21f08cf055c1 with: {'image_id': '69cb8e9a-2e32-43ab-b120-21f08cf055c1', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'da2038e02185a25d15e8b7cb6c6bac93', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87098) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 13 14:05:43 devstack sudo[104929]: pam_unix(sudo:session): session closed for user root Jul 13 14:05:43 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-b224d90b-6e11-41ee-b00d-9ddbff429f1d tempest-CreateVolumesFromSnapshotTest-61948078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78" returned: 0 in 0.417s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:05:43 devstack sudo[104936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-47619ab5-bc64-413d-bb7d-e74c118fdb97.e4b1d12d-e475-4ef5-9018-cf24fed038ec Jul 13 14:05:43 devstack sudo[104936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:05:43 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-b224d90b-6e11-41ee-b00d-9ddbff429f1d tempest-CreateVolumesFromSnapshotTest-61948078 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 14:05:43 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-b224d90b-6e11-41ee-b00d-9ddbff429f1d tempest-CreateVolumesFromSnapshotTest-61948078 None] Deleted volume successfully. Jul 13 14:05:43 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-b224d90b-6e11-41ee-b00d-9ddbff429f1d tempest-CreateVolumesFromSnapshotTest-61948078 None] Lock "cinder-8af43fe5-e744-48c2-b431-20c25c2f9c40-delete_volume" released by "delete_volume" :: held 1.586s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 14:05:43 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-79fca9f9-9b84-4484-9608-5b45124b0275 tempest-VolumeImageDependencyTests-984528418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b5c1633-d23f-495b-982f-fb444e55aa97) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-92c64345-7d55-4ea6-af85-0956b9abcf07', 'volume_size': 1, 'image_id': '69cb8e9a-2e32-43ab-b120-21f08cf055c1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/69cb8e9a-2e32-43ab-b120-21f08cf055c1', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'da2038e02185a25d15e8b7cb6c6bac93', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '5d2cf39a3e3e4c6a91e0f38ce467513d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '69ebcdb5930ee8c8321b833ddbcf0c2408a6668080221e94b0edd8897e1336a22346892aef7f0f45797d1781c3b827705d182c69541273b74f7ed65b85dc5f57', 'id': '69cb8e9a-2e32-43ab-b120-21f08cf055c1', 'created_at': datetime.datetime(2026, 7, 13, 12, 5, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 13, 12, 5, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/69cb8e9a-2e32-43ab-b120-21f08cf055c1/file', 'properties': {}}, 'image_service': }' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:05:43 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-79fca9f9-9b84-4484-9608-5b45124b0275 tempest-VolumeImageDependencyTests-984528418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f78d82f-2ae0-43d0-a943-575f040951d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:05:43 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-79fca9f9-9b84-4484-9608-5b45124b0275 tempest-VolumeImageDependencyTests-984528418 None] Volume volume-92c64345-7d55-4ea6-af85-0956b9abcf07 (92c64345-7d55-4ea6-af85-0956b9abcf07): created successfully Jul 13 14:05:43 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-79fca9f9-9b84-4484-9608-5b45124b0275 tempest-VolumeImageDependencyTests-984528418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f78d82f-2ae0-43d0-a943-575f040951d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:05:43 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-79fca9f9-9b84-4484-9608-5b45124b0275 tempest-VolumeImageDependencyTests-984528418 None] Flow 'volume_create_manager' (4db332e1-d840-4060-bf81-9a9c5a9dd568) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 14:05:43 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-79fca9f9-9b84-4484-9608-5b45124b0275 tempest-VolumeImageDependencyTests-984528418 None] Created volume successfully. Jul 13 14:05:43 devstack sudo[104932]: pam_unix(sudo:session): session closed for user root Jul 13 14:05:43 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-04659f96-b70c-44f2-a4a3-336238b072df tempest-VolumeDependencyTests-691513090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-ae62b240-08a3-4ccb-90ee-ef7c56f32cd6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-ae62b240-08a3-4ccb-90ee-ef7c56f32cd6.8d3708c6-04a7-4993-a301-21c6c81631a2 1G" returned: 0 in 0.519s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:05:43 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-04659f96-b70c-44f2-a4a3-336238b072df tempest-VolumeDependencyTests-691513090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ae62b240-08a3-4ccb-90ee-ef7c56f32cd6 -F qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-ae62b240-08a3-4ccb-90ee-ef7c56f32cd6.8d3708c6-04a7-4993-a301-21c6c81631a2 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:05:43 devstack sudo[104945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ae62b240-08a3-4ccb-90ee-ef7c56f32cd6 -F qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-ae62b240-08a3-4ccb-90ee-ef7c56f32cd6.8d3708c6-04a7-4993-a301-21c6c81631a2 Jul 13 14:05:43 devstack sudo[104945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:05:43 devstack sudo[104936]: pam_unix(sudo:session): session closed for user root Jul 13 14:05:43 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-543b8e26-5fa0-4841-b93f-70487ae292c5 tempest-CreateVolumesFromSnapshotTest-61948078 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-47619ab5-bc64-413d-bb7d-e74c118fdb97.e4b1d12d-e475-4ef5-9018-cf24fed038ec" returned: 0 in 0.517s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:05:43 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-543b8e26-5fa0-4841-b93f-70487ae292c5 tempest-CreateVolumesFromSnapshotTest-61948078 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-47619ab5-bc64-413d-bb7d-e74c118fdb97(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87098) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 13 14:05:43 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdc1c388-802e-4444-9783-9a451198cb70]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 14:05:43 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-543b8e26-5fa0-4841-b93f-70487ae292c5 tempest-CreateVolumesFromSnapshotTest-61948078 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-47619ab5-bc64-413d-bb7d-e74c118fdb97 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:05:43 devstack sudo[104949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-47619ab5-bc64-413d-bb7d-e74c118fdb97 Jul 13 14:05:43 devstack sudo[104949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:05:43 devstack sudo[104945]: pam_unix(sudo:session): session closed for user root Jul 13 14:05:43 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-04659f96-b70c-44f2-a4a3-336238b072df tempest-VolumeDependencyTests-691513090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ae62b240-08a3-4ccb-90ee-ef7c56f32cd6 -F qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-ae62b240-08a3-4ccb-90ee-ef7c56f32cd6.8d3708c6-04a7-4993-a301-21c6c81631a2" returned: 0 in 0.349s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:05:43 devstack cinder-volume[87098]: WARNING cinder.volume.drivers.remotefs [None req-04659f96-b70c-44f2-a4a3-336238b072df tempest-VolumeDependencyTests-691513090 None] /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-ae62b240-08a3-4ccb-90ee-ef7c56f32cd6.8d3708c6-04a7-4993-a301-21c6c81631a2 is being set with open permissions: ugo+rw Jul 13 14:05:43 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-04659f96-b70c-44f2-a4a3-336238b072df tempest-VolumeDependencyTests-691513090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-ae62b240-08a3-4ccb-90ee-ef7c56f32cd6.8d3708c6-04a7-4993-a301-21c6c81631a2 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:05:43 devstack sudo[104954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-ae62b240-08a3-4ccb-90ee-ef7c56f32cd6.8d3708c6-04a7-4993-a301-21c6c81631a2 Jul 13 14:05:43 devstack sudo[104954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:05:43 devstack sudo[104949]: pam_unix(sudo:session): session closed for user root Jul 13 14:05:43 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-543b8e26-5fa0-4841-b93f-70487ae292c5 tempest-CreateVolumesFromSnapshotTest-61948078 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-47619ab5-bc64-413d-bb7d-e74c118fdb97" returned: 0 in 0.405s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:05:43 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-543b8e26-5fa0-4841-b93f-70487ae292c5 tempest-CreateVolumesFromSnapshotTest-61948078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-47619ab5-bc64-413d-bb7d-e74c118fdb97.e4b1d12d-e475-4ef5-9018-cf24fed038ec {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:05:43 devstack sudo[104959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-47619ab5-bc64-413d-bb7d-e74c118fdb97.e4b1d12d-e475-4ef5-9018-cf24fed038ec Jul 13 14:05:43 devstack sudo[104959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:05:43 devstack sudo[104954]: pam_unix(sudo:session): session closed for user root Jul 13 14:05:43 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-04659f96-b70c-44f2-a4a3-336238b072df tempest-VolumeDependencyTests-691513090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-ae62b240-08a3-4ccb-90ee-ef7c56f32cd6.8d3708c6-04a7-4993-a301-21c6c81631a2" returned: 0 in 0.268s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:05:44 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-04659f96-b70c-44f2-a4a3-336238b072df tempest-VolumeDependencyTests-691513090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-ae62b240-08a3-4ccb-90ee-ef7c56f32cd6.info {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:05:44 devstack sudo[104962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-ae62b240-08a3-4ccb-90ee-ef7c56f32cd6.info Jul 13 14:05:44 devstack sudo[104962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:05:44 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-70dd8c5f-62e9-4deb-a8c3-86ea1804f8ac tempest-VolumeImageDependencyTests-984528418 None] Acquiring lock "cinder-92c64345-7d55-4ea6-af85-0956b9abcf07-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 14:05:44 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-70dd8c5f-62e9-4deb-a8c3-86ea1804f8ac tempest-VolumeImageDependencyTests-984528418 None] Lock "cinder-92c64345-7d55-4ea6-af85-0956b9abcf07-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 14:05:44 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-70dd8c5f-62e9-4deb-a8c3-86ea1804f8ac tempest-VolumeImageDependencyTests-984528418 None] Acquiring lock "cinder-quobyte-92c64345-7d55-4ea6-af85-0956b9abcf07" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 14:05:44 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-70dd8c5f-62e9-4deb-a8c3-86ea1804f8ac tempest-VolumeImageDependencyTests-984528418 None] Lock "cinder-quobyte-92c64345-7d55-4ea6-af85-0956b9abcf07" acquired by "delete_volume" :: waited 0.024s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 14:05:44 devstack sudo[104962]: pam_unix(sudo:session): session closed for user root Jul 13 14:05:44 devstack sudo[104959]: pam_unix(sudo:session): session closed for user root Jul 13 14:05:44 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-04659f96-b70c-44f2-a4a3-336238b072df tempest-VolumeDependencyTests-691513090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-ae62b240-08a3-4ccb-90ee-ef7c56f32cd6.info" returned: 0 in 0.387s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:05:44 devstack cinder-volume[87098]: WARNING cinder.volume.drivers.remotefs [None req-04659f96-b70c-44f2-a4a3-336238b072df tempest-VolumeDependencyTests-691513090 None] /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-ae62b240-08a3-4ccb-90ee-ef7c56f32cd6.info is being set with open permissions: ugo+rw Jul 13 14:05:44 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-04659f96-b70c-44f2-a4a3-336238b072df tempest-VolumeDependencyTests-691513090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-ae62b240-08a3-4ccb-90ee-ef7c56f32cd6.info {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:05:44 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-543b8e26-5fa0-4841-b93f-70487ae292c5 tempest-CreateVolumesFromSnapshotTest-61948078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-47619ab5-bc64-413d-bb7d-e74c118fdb97.e4b1d12d-e475-4ef5-9018-cf24fed038ec" returned: 0 in 0.520s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:05:44 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-543b8e26-5fa0-4841-b93f-70487ae292c5 tempest-CreateVolumesFromSnapshotTest-61948078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-47619ab5-bc64-413d-bb7d-e74c118fdb97.e4b1d12d-e475-4ef5-9018-cf24fed038ec {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:05:44 devstack sudo[104969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-ae62b240-08a3-4ccb-90ee-ef7c56f32cd6.info Jul 13 14:05:44 devstack sudo[104969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:05:44 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddf96a06-156c-44f7-97b6-091f8de57d2a]: (4, 'raw') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 14:05:44 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-70dd8c5f-62e9-4deb-a8c3-86ea1804f8ac tempest-VolumeImageDependencyTests-984528418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-92c64345-7d55-4ea6-af85-0956b9abcf07 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:05:44 devstack sudo[104970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-47619ab5-bc64-413d-bb7d-e74c118fdb97.e4b1d12d-e475-4ef5-9018-cf24fed038ec Jul 13 14:05:44 devstack sudo[104970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:05:44 devstack sudo[104972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-92c64345-7d55-4ea6-af85-0956b9abcf07 Jul 13 14:05:44 devstack sudo[104972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:05:44 devstack sudo[104969]: pam_unix(sudo:session): session closed for user root Jul 13 14:05:44 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-04659f96-b70c-44f2-a4a3-336238b072df tempest-VolumeDependencyTests-691513090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-ae62b240-08a3-4ccb-90ee-ef7c56f32cd6.info" returned: 0 in 0.281s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:05:44 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-04659f96-b70c-44f2-a4a3-336238b072df tempest-VolumeDependencyTests-691513090 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.423s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 14:05:44 devstack sudo[104970]: pam_unix(sudo:session): session closed for user root Jul 13 14:05:44 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-543b8e26-5fa0-4841-b93f-70487ae292c5 tempest-CreateVolumesFromSnapshotTest-61948078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-47619ab5-bc64-413d-bb7d-e74c118fdb97.e4b1d12d-e475-4ef5-9018-cf24fed038ec" returned: 0 in 0.293s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:05:44 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-04659f96-b70c-44f2-a4a3-336238b072df tempest-VolumeDependencyTests-691513090 None] Create snapshot completed successfully Jul 13 14:05:44 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-543b8e26-5fa0-4841-b93f-70487ae292c5 tempest-CreateVolumesFromSnapshotTest-61948078 None] Lock "cinder-quobyte-e4b1d12d-e475-4ef5-9018-cf24fed038ec" released by "_delete_snapshot" :: held 1.889s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 14:05:44 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-543b8e26-5fa0-4841-b93f-70487ae292c5 tempest-CreateVolumesFromSnapshotTest-61948078 None] Lock "cinder-quobyte-47619ab5-bc64-413d-bb7d-e74c118fdb97" released by "delete_snapshot" :: held 1.949s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 14:05:44 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-543b8e26-5fa0-4841-b93f-70487ae292c5 tempest-CreateVolumesFromSnapshotTest-61948078 None] Created reservations ['2bbc983b-a8ae-4e59-a44b-124e6b10b9f7', '485d9e5a-3e53-4a4b-afdb-e031d94a76c1', 'd9fe4bf8-8415-4cf0-bfef-e28c2f74182b', 'ec505053-12dd-4ee8-9659-66a9e5525f1f'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 14:05:44 devstack sudo[104972]: pam_unix(sudo:session): session closed for user root Jul 13 14:05:44 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-70dd8c5f-62e9-4deb-a8c3-86ea1804f8ac tempest-VolumeImageDependencyTests-984528418 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-92c64345-7d55-4ea6-af85-0956b9abcf07" returned: 0 in 0.440s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:05:44 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-70dd8c5f-62e9-4deb-a8c3-86ea1804f8ac tempest-VolumeImageDependencyTests-984528418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-92c64345-7d55-4ea6-af85-0956b9abcf07 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:05:44 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-543b8e26-5fa0-4841-b93f-70487ae292c5 tempest-CreateVolumesFromSnapshotTest-61948078 None] Delete snapshot completed successfully. Jul 13 14:05:44 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-543b8e26-5fa0-4841-b93f-70487ae292c5 tempest-CreateVolumesFromSnapshotTest-61948078 None] Lock "cinder-e4b1d12d-e475-4ef5-9018-cf24fed038ec-delete_snapshot" released by "delete_snapshot" :: held 2.155s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 14:05:45 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-087c85a7-9d2d-4c65-a06d-0dfb95b08e01 tempest-CreateVolumesFromSnapshotTest-61948078 None] Acquiring lock "cinder-47619ab5-bc64-413d-bb7d-e74c118fdb97-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 14:05:45 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-087c85a7-9d2d-4c65-a06d-0dfb95b08e01 tempest-CreateVolumesFromSnapshotTest-61948078 None] Lock "cinder-47619ab5-bc64-413d-bb7d-e74c118fdb97-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 14:05:45 devstack sudo[104979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-92c64345-7d55-4ea6-af85-0956b9abcf07 Jul 13 14:05:45 devstack sudo[104979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:05:45 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-087c85a7-9d2d-4c65-a06d-0dfb95b08e01 tempest-CreateVolumesFromSnapshotTest-61948078 None] Acquiring lock "cinder-quobyte-47619ab5-bc64-413d-bb7d-e74c118fdb97" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 14:05:45 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-087c85a7-9d2d-4c65-a06d-0dfb95b08e01 tempest-CreateVolumesFromSnapshotTest-61948078 None] Lock "cinder-quobyte-47619ab5-bc64-413d-bb7d-e74c118fdb97" acquired by "delete_volume" :: waited 0.017s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 14:05:45 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dd3401f-1311-4a3b-a26a-111e5b09ae07]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 14:05:45 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-087c85a7-9d2d-4c65-a06d-0dfb95b08e01 tempest-CreateVolumesFromSnapshotTest-61948078 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-47619ab5-bc64-413d-bb7d-e74c118fdb97 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:05:45 devstack sudo[104982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-47619ab5-bc64-413d-bb7d-e74c118fdb97 Jul 13 14:05:45 devstack sudo[104982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:05:45 devstack sudo[104979]: pam_unix(sudo:session): session closed for user root Jul 13 14:05:45 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-70dd8c5f-62e9-4deb-a8c3-86ea1804f8ac tempest-VolumeImageDependencyTests-984528418 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-92c64345-7d55-4ea6-af85-0956b9abcf07" returned: 1 in 0.443s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:05:45 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-70dd8c5f-62e9-4deb-a8c3-86ea1804f8ac tempest-VolumeImageDependencyTests-984528418 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-92c64345-7d55-4ea6-af85-0956b9abcf07' failed. Not Retrying. {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 13 14:05:45 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-70dd8c5f-62e9-4deb-a8c3-86ea1804f8ac tempest-VolumeImageDependencyTests-984528418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-92c64345-7d55-4ea6-af85-0956b9abcf07 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:05:45 devstack sudo[104987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-92c64345-7d55-4ea6-af85-0956b9abcf07 Jul 13 14:05:45 devstack sudo[104987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:05:45 devstack sudo[104982]: pam_unix(sudo:session): session closed for user root Jul 13 14:05:45 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-087c85a7-9d2d-4c65-a06d-0dfb95b08e01 tempest-CreateVolumesFromSnapshotTest-61948078 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-47619ab5-bc64-413d-bb7d-e74c118fdb97" returned: 0 in 0.415s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:05:45 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-087c85a7-9d2d-4c65-a06d-0dfb95b08e01 tempest-CreateVolumesFromSnapshotTest-61948078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-47619ab5-bc64-413d-bb7d-e74c118fdb97 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:05:45 devstack sudo[104993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-47619ab5-bc64-413d-bb7d-e74c118fdb97 Jul 13 14:05:45 devstack sudo[104993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:05:45 devstack sudo[104987]: pam_unix(sudo:session): session closed for user root Jul 13 14:05:45 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-70dd8c5f-62e9-4deb-a8c3-86ea1804f8ac tempest-VolumeImageDependencyTests-984528418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-92c64345-7d55-4ea6-af85-0956b9abcf07" returned: 0 in 0.338s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:05:45 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-70dd8c5f-62e9-4deb-a8c3-86ea1804f8ac tempest-VolumeImageDependencyTests-984528418 None] Lock "cinder-quobyte-92c64345-7d55-4ea6-af85-0956b9abcf07" released by "delete_volume" :: held 1.297s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 14:05:45 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-70dd8c5f-62e9-4deb-a8c3-86ea1804f8ac tempest-VolumeImageDependencyTests-984528418 None] Created reservations ['42bc46d8-06af-451f-af6e-7c781d94edca', '1f11831b-c90e-4ac0-9964-13cb4c0e8a1d', 'f41f9e78-93df-41cd-89be-a3c869b3d5a6', '82dd3f8b-6fea-4d02-9c91-6b6fb2114406'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 14:05:45 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-70dd8c5f-62e9-4deb-a8c3-86ea1804f8ac tempest-VolumeImageDependencyTests-984528418 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 14:05:45 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-70dd8c5f-62e9-4deb-a8c3-86ea1804f8ac tempest-VolumeImageDependencyTests-984528418 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 14:05:45 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-70dd8c5f-62e9-4deb-a8c3-86ea1804f8ac tempest-VolumeImageDependencyTests-984528418 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 14:05:45 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-70dd8c5f-62e9-4deb-a8c3-86ea1804f8ac tempest-VolumeImageDependencyTests-984528418 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 14:05:45 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-70dd8c5f-62e9-4deb-a8c3-86ea1804f8ac tempest-VolumeImageDependencyTests-984528418 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 14:05:45 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-70dd8c5f-62e9-4deb-a8c3-86ea1804f8ac tempest-VolumeImageDependencyTests-984528418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:05:45 devstack sudo[104997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 Jul 13 14:05:45 devstack sudo[104997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:05:45 devstack sudo[104993]: pam_unix(sudo:session): session closed for user root Jul 13 14:05:45 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-087c85a7-9d2d-4c65-a06d-0dfb95b08e01 tempest-CreateVolumesFromSnapshotTest-61948078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-47619ab5-bc64-413d-bb7d-e74c118fdb97" returned: 0 in 0.344s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:05:45 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-087c85a7-9d2d-4c65-a06d-0dfb95b08e01 tempest-CreateVolumesFromSnapshotTest-61948078 None] Lock "cinder-quobyte-47619ab5-bc64-413d-bb7d-e74c118fdb97" released by "delete_volume" :: held 0.839s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 14:05:46 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-087c85a7-9d2d-4c65-a06d-0dfb95b08e01 tempest-CreateVolumesFromSnapshotTest-61948078 None] Created reservations ['5815b221-b5e7-43d0-b730-572d20a608fe', '2ada4ee8-f47d-4745-864d-bc7084793673', 'f1347c8c-7172-4a35-abe1-a16aed65966e', '3d1e90e3-67ff-463c-bfa7-34c56f622587'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 14:05:46 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-ace6d7b6-73af-43fc-af87-b16c4ce03064 tempest-VolumeDependencyTests-691513090 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 14:05:46 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-ace6d7b6-73af-43fc-af87-b16c4ce03064 tempest-VolumeDependencyTests-691513090 None] Flow 'volume_create_manager' (be9bdaa9-9449-4f85-b32d-e392c34b2a56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 14:05:46 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-ace6d7b6-73af-43fc-af87-b16c4ce03064 tempest-VolumeDependencyTests-691513090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22f67fef-a19f-4bfe-a1b7-a56db3a16f4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:05:46 devstack sudo[104997]: pam_unix(sudo:session): session closed for user root Jul 13 14:05:46 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-70dd8c5f-62e9-4deb-a8c3-86ea1804f8ac tempest-VolumeImageDependencyTests-984528418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78" returned: 0 in 0.390s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:05:46 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-70dd8c5f-62e9-4deb-a8c3-86ea1804f8ac tempest-VolumeImageDependencyTests-984528418 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 14:05:46 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-087c85a7-9d2d-4c65-a06d-0dfb95b08e01 tempest-CreateVolumesFromSnapshotTest-61948078 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 14:05:46 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-087c85a7-9d2d-4c65-a06d-0dfb95b08e01 tempest-CreateVolumesFromSnapshotTest-61948078 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 14:05:46 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-087c85a7-9d2d-4c65-a06d-0dfb95b08e01 tempest-CreateVolumesFromSnapshotTest-61948078 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 14:05:46 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-087c85a7-9d2d-4c65-a06d-0dfb95b08e01 tempest-CreateVolumesFromSnapshotTest-61948078 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 14:05:46 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-087c85a7-9d2d-4c65-a06d-0dfb95b08e01 tempest-CreateVolumesFromSnapshotTest-61948078 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 14:05:46 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-087c85a7-9d2d-4c65-a06d-0dfb95b08e01 tempest-CreateVolumesFromSnapshotTest-61948078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:05:46 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-70dd8c5f-62e9-4deb-a8c3-86ea1804f8ac tempest-VolumeImageDependencyTests-984528418 None] Deleted volume successfully. Jul 13 14:05:46 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-ace6d7b6-73af-43fc-af87-b16c4ce03064 tempest-VolumeDependencyTests-691513090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22f67fef-a19f-4bfe-a1b7-a56db3a16f4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T12:05:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1198883428',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2eafd09-2276-4341-afb6-12bd2938cbb2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da25d3dbcf4042759d5569dd1827f9f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T12:05:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=8d3708c6-04a7-4993-a301-21c6c81631a2,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T12:05:46Z,use_quota=True,user_id='76380cc9b80841cc901dda15af0c5c54',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1147de8b-623b-426c-a13d-7fc824a80f67),volume_type_id=1147de8b-623b-426c-a13d-7fc824a80f67)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:05:46 devstack sudo[105000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 Jul 13 14:05:46 devstack sudo[105000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:05:46 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-ace6d7b6-73af-43fc-af87-b16c4ce03064 tempest-VolumeDependencyTests-691513090 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16153bab-f344-4aa2-9b86-8f120ba69b0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:05:46 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-ace6d7b6-73af-43fc-af87-b16c4ce03064 tempest-VolumeDependencyTests-691513090 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16153bab-f344-4aa2-9b86-8f120ba69b0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:05:46 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-ace6d7b6-73af-43fc-af87-b16c4ce03064 tempest-VolumeDependencyTests-691513090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (557acf77-4e1e-4973-bb64-a0489a2c5123) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:05:46 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-ace6d7b6-73af-43fc-af87-b16c4ce03064 tempest-VolumeDependencyTests-691513090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (557acf77-4e1e-4973-bb64-a0489a2c5123) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'b2eafd09-2276-4341-afb6-12bd2938cbb2', 'volume_name': 'volume-b2eafd09-2276-4341-afb6-12bd2938cbb2', 'volume_size': 1, 'snapshot_id': '8d3708c6-04a7-4993-a301-21c6c81631a2'}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:05:46 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-ace6d7b6-73af-43fc-af87-b16c4ce03064 tempest-VolumeDependencyTests-691513090 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df7562cb-edb2-4966-910a-7492d371f7dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:05:46 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-ace6d7b6-73af-43fc-af87-b16c4ce03064 tempest-VolumeDependencyTests-691513090 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df7562cb-edb2-4966-910a-7492d371f7dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:05:46 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-ace6d7b6-73af-43fc-af87-b16c4ce03064 tempest-VolumeDependencyTests-691513090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc81b756-ca83-48e1-909e-618f5dcedcfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:05:46 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-ace6d7b6-73af-43fc-af87-b16c4ce03064 tempest-VolumeDependencyTests-691513090 None] Volume b2eafd09-2276-4341-afb6-12bd2938cbb2: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-b2eafd09-2276-4341-afb6-12bd2938cbb2', 'volume_size': 1, 'snapshot_id': '8d3708c6-04a7-4993-a301-21c6c81631a2'} Jul 13 14:05:46 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-ace6d7b6-73af-43fc-af87-b16c4ce03064 tempest-VolumeDependencyTests-691513090 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 14:05:46 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-ace6d7b6-73af-43fc-af87-b16c4ce03064 tempest-VolumeDependencyTests-691513090 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 14:05:46 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-ace6d7b6-73af-43fc-af87-b16c4ce03064 tempest-VolumeDependencyTests-691513090 None] Acquiring lock "cinder-quobyte-8d3708c6-04a7-4993-a301-21c6c81631a2-b2eafd09-2276-4341-afb6-12bd2938cbb2" by "_create_volume_from_snapshot" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 14:05:46 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-ace6d7b6-73af-43fc-af87-b16c4ce03064 tempest-VolumeDependencyTests-691513090 None] Lock "cinder-quobyte-8d3708c6-04a7-4993-a301-21c6c81631a2-b2eafd09-2276-4341-afb6-12bd2938cbb2" acquired by "_create_volume_from_snapshot" :: waited 0.020s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 14:05:46 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-ace6d7b6-73af-43fc-af87-b16c4ce03064 tempest-VolumeDependencyTests-691513090 None] Creating volume b2eafd09-2276-4341-afb6-12bd2938cbb2 from snapshot 8d3708c6-04a7-4993-a301-21c6c81631a2 {{(pid=87098) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 13 14:05:46 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-ace6d7b6-73af-43fc-af87-b16c4ce03064 tempest-VolumeDependencyTests-691513090 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 14:05:46 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-ace6d7b6-73af-43fc-af87-b16c4ce03064 tempest-VolumeDependencyTests-691513090 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 14:05:46 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-ace6d7b6-73af-43fc-af87-b16c4ce03064 tempest-VolumeDependencyTests-691513090 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 14:05:46 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-ace6d7b6-73af-43fc-af87-b16c4ce03064 tempest-VolumeDependencyTests-691513090 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 14:05:46 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-ace6d7b6-73af-43fc-af87-b16c4ce03064 tempest-VolumeDependencyTests-691513090 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 14:05:46 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-ace6d7b6-73af-43fc-af87-b16c4ce03064 tempest-VolumeDependencyTests-691513090 None] Selected osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 14:05:46 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-ace6d7b6-73af-43fc-af87-b16c4ce03064 tempest-VolumeDependencyTests-691513090 None] Acquiring lock "cinder-quobyte-b2eafd09-2276-4341-afb6-12bd2938cbb2" by "_copy_volume_from_snapshot" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 14:05:46 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-70dd8c5f-62e9-4deb-a8c3-86ea1804f8ac tempest-VolumeImageDependencyTests-984528418 None] Lock "cinder-92c64345-7d55-4ea6-af85-0956b9abcf07-delete_volume" released by "delete_volume" :: held 2.072s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 14:05:46 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-ace6d7b6-73af-43fc-af87-b16c4ce03064 tempest-VolumeDependencyTests-691513090 None] Lock "cinder-quobyte-b2eafd09-2276-4341-afb6-12bd2938cbb2" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 14:05:46 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-ace6d7b6-73af-43fc-af87-b16c4ce03064 tempest-VolumeDependencyTests-691513090 None] snapshot: 8d3708c6-04a7-4993-a301-21c6c81631a2, volume: b2eafd09-2276-4341-afb6-12bd2938cbb2, {{(pid=87098) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 13 14:05:46 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-ace6d7b6-73af-43fc-af87-b16c4ce03064 tempest-VolumeDependencyTests-691513090 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 14:05:46 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-ace6d7b6-73af-43fc-af87-b16c4ce03064 tempest-VolumeDependencyTests-691513090 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 14:05:46 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-ace6d7b6-73af-43fc-af87-b16c4ce03064 tempest-VolumeDependencyTests-691513090 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 14:05:46 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-ace6d7b6-73af-43fc-af87-b16c4ce03064 tempest-VolumeDependencyTests-691513090 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 14:05:46 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-ace6d7b6-73af-43fc-af87-b16c4ce03064 tempest-VolumeDependencyTests-691513090 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 14:05:46 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7cdc665-f46e-4a5d-9782-aa59683f8b21]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 14:05:46 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-ace6d7b6-73af-43fc-af87-b16c4ce03064 tempest-VolumeDependencyTests-691513090 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-ae62b240-08a3-4ccb-90ee-ef7c56f32cd6.8d3708c6-04a7-4993-a301-21c6c81631a2 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:05:46 devstack sudo[105000]: pam_unix(sudo:session): session closed for user root Jul 13 14:05:46 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-087c85a7-9d2d-4c65-a06d-0dfb95b08e01 tempest-CreateVolumesFromSnapshotTest-61948078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78" returned: 0 in 0.273s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:05:46 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-087c85a7-9d2d-4c65-a06d-0dfb95b08e01 tempest-CreateVolumesFromSnapshotTest-61948078 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 14:05:46 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-087c85a7-9d2d-4c65-a06d-0dfb95b08e01 tempest-CreateVolumesFromSnapshotTest-61948078 None] Deleted volume successfully. Jul 13 14:05:46 devstack sudo[105002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-ae62b240-08a3-4ccb-90ee-ef7c56f32cd6.8d3708c6-04a7-4993-a301-21c6c81631a2 Jul 13 14:05:46 devstack sudo[105002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:05:46 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-087c85a7-9d2d-4c65-a06d-0dfb95b08e01 tempest-CreateVolumesFromSnapshotTest-61948078 None] Lock "cinder-47619ab5-bc64-413d-bb7d-e74c118fdb97-delete_volume" released by "delete_volume" :: held 1.557s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 14:05:46 devstack sudo[105002]: pam_unix(sudo:session): session closed for user root Jul 13 14:05:46 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-ace6d7b6-73af-43fc-af87-b16c4ce03064 tempest-VolumeDependencyTests-691513090 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-ae62b240-08a3-4ccb-90ee-ef7c56f32cd6.8d3708c6-04a7-4993-a301-21c6c81631a2" returned: 0 in 0.420s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:05:46 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-ace6d7b6-73af-43fc-af87-b16c4ce03064 tempest-VolumeDependencyTests-691513090 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ae62b240-08a3-4ccb-90ee-ef7c56f32cd6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87098) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 13 14:05:46 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-ace6d7b6-73af-43fc-af87-b16c4ce03064 tempest-VolumeDependencyTests-691513090 None] will copy from snapshot at /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-ae62b240-08a3-4ccb-90ee-ef7c56f32cd6 {{(pid=87098) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 13 14:05:46 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-ace6d7b6-73af-43fc-af87-b16c4ce03064 tempest-VolumeDependencyTests-691513090 None] Creating direct copy from snapshot {{(pid=87098) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 13 14:05:46 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[48a25656-caf6-4c11-a603-5d844683049c]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 14:05:46 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-ace6d7b6-73af-43fc-af87-b16c4ce03064 tempest-VolumeDependencyTests-691513090 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-ae62b240-08a3-4ccb-90ee-ef7c56f32cd6 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:05:47 devstack sudo[105008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-ae62b240-08a3-4ccb-90ee-ef7c56f32cd6 Jul 13 14:05:47 devstack sudo[105008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:05:47 devstack sudo[105008]: pam_unix(sudo:session): session closed for user root Jul 13 14:05:47 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-ace6d7b6-73af-43fc-af87-b16c4ce03064 tempest-VolumeDependencyTests-691513090 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-ae62b240-08a3-4ccb-90ee-ef7c56f32cd6" returned: 0 in 0.455s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:05:47 devstack cinder-volume[87098]: DEBUG cinder.utils [None req-ace6d7b6-73af-43fc-af87-b16c4ce03064 tempest-VolumeDependencyTests-691513090 None] Path /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-b2eafd09-2276-4341-afb6-12bd2938cbb2 not found in is_blk_device check {{(pid=87098) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 13 14:05:47 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-ace6d7b6-73af-43fc-af87-b16c4ce03064 tempest-VolumeDependencyTests-691513090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-ae62b240-08a3-4ccb-90ee-ef7c56f32cd6 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-b2eafd09-2276-4341-afb6-12bd2938cbb2 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:05:47 devstack sudo[105014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-ae62b240-08a3-4ccb-90ee-ef7c56f32cd6 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-b2eafd09-2276-4341-afb6-12bd2938cbb2 Jul 13 14:05:47 devstack sudo[105014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:05:53 devstack sudo[105014]: pam_unix(sudo:session): session closed for user root Jul 13 14:05:53 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-ace6d7b6-73af-43fc-af87-b16c4ce03064 tempest-VolumeDependencyTests-691513090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-ae62b240-08a3-4ccb-90ee-ef7c56f32cd6 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-b2eafd09-2276-4341-afb6-12bd2938cbb2" returned: 0 in 6.024s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:05:53 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[002e1890-1786-4489-8a16-6be0dfefeb19]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 14:05:53 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-ace6d7b6-73af-43fc-af87-b16c4ce03064 tempest-VolumeDependencyTests-691513090 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-ae62b240-08a3-4ccb-90ee-ef7c56f32cd6 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:05:53 devstack sudo[105028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-ae62b240-08a3-4ccb-90ee-ef7c56f32cd6 Jul 13 14:05:53 devstack sudo[105028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:05:54 devstack sudo[105028]: pam_unix(sudo:session): session closed for user root Jul 13 14:05:54 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-ace6d7b6-73af-43fc-af87-b16c4ce03064 tempest-VolumeDependencyTests-691513090 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-ae62b240-08a3-4ccb-90ee-ef7c56f32cd6" returned: 0 in 0.664s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:05:54 devstack cinder-volume[87098]: DEBUG cinder.image.image_utils [None req-ace6d7b6-73af-43fc-af87-b16c4ce03064 tempest-VolumeDependencyTests-691513090 None] Image conversion details: src /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-ae62b240-08a3-4ccb-90ee-ef7c56f32cd6, size 1024.00 MB, duration 6.03 sec, destination /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-b2eafd09-2276-4341-afb6-12bd2938cbb2 {{(pid=87098) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 13 14:05:54 devstack cinder-volume[87098]: INFO cinder.image.image_utils [None req-ace6d7b6-73af-43fc-af87-b16c4ce03064 tempest-VolumeDependencyTests-691513090 None] Converted 1024.00 MB image at 169.93 MB/s Jul 13 14:05:54 devstack cinder-volume[87098]: WARNING cinder.volume.drivers.remotefs [None req-ace6d7b6-73af-43fc-af87-b16c4ce03064 tempest-VolumeDependencyTests-691513090 None] /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-b2eafd09-2276-4341-afb6-12bd2938cbb2 is being set with open permissions: ugo+rw Jul 13 14:05:54 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-ace6d7b6-73af-43fc-af87-b16c4ce03064 tempest-VolumeDependencyTests-691513090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-b2eafd09-2276-4341-afb6-12bd2938cbb2 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:05:54 devstack sudo[105034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-b2eafd09-2276-4341-afb6-12bd2938cbb2 Jul 13 14:05:54 devstack sudo[105034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:05:54 devstack sudo[105034]: pam_unix(sudo:session): session closed for user root Jul 13 14:05:54 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-ace6d7b6-73af-43fc-af87-b16c4ce03064 tempest-VolumeDependencyTests-691513090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-b2eafd09-2276-4341-afb6-12bd2938cbb2" returned: 0 in 0.441s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:05:54 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-ace6d7b6-73af-43fc-af87-b16c4ce03064 tempest-VolumeDependencyTests-691513090 None] Lock "cinder-quobyte-b2eafd09-2276-4341-afb6-12bd2938cbb2" released by "_copy_volume_from_snapshot" :: held 8.122s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 14:05:54 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-dceb9434-064f-438d-9661-97f4eb8a7af0 tempest-CinderUnicodeTest-1494774103 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 14:05:54 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-dceb9434-064f-438d-9661-97f4eb8a7af0 tempest-CinderUnicodeTest-1494774103 None] Flow 'volume_create_manager' (01c06934-120b-4684-961e-d8aa0d80ac7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 14:05:54 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-dceb9434-064f-438d-9661-97f4eb8a7af0 tempest-CinderUnicodeTest-1494774103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a31c167-5257-47c2-ad1e-13230921db90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:05:54 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-ace6d7b6-73af-43fc-af87-b16c4ce03064 tempest-VolumeDependencyTests-691513090 None] Lock "cinder-quobyte-8d3708c6-04a7-4993-a301-21c6c81631a2-b2eafd09-2276-4341-afb6-12bd2938cbb2" released by "_create_volume_from_snapshot" :: held 8.195s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 14:05:54 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-ace6d7b6-73af-43fc-af87-b16c4ce03064 tempest-VolumeDependencyTests-691513090 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.216s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 14:05:54 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-dceb9434-064f-438d-9661-97f4eb8a7af0 tempest-CinderUnicodeTest-1494774103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a31c167-5257-47c2-ad1e-13230921db90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T12:05:54Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1f435ab-e6a6-4888-ad38-fa0f3a94c2a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e6f259a04a64e588cf71ffdb6845fb3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T12:05:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T12:05:54Z,use_quota=True,user_id='f2eaa34b2f364f7294548ad3b1d1fc5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1147de8b-623b-426c-a13d-7fc824a80f67),volume_type_id=1147de8b-623b-426c-a13d-7fc824a80f67)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:05:54 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-dceb9434-064f-438d-9661-97f4eb8a7af0 tempest-CinderUnicodeTest-1494774103 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a5c8521-d9e4-455a-b75d-d98b808b34f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:05:54 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-dceb9434-064f-438d-9661-97f4eb8a7af0 tempest-CinderUnicodeTest-1494774103 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a5c8521-d9e4-455a-b75d-d98b808b34f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:05:54 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-dceb9434-064f-438d-9661-97f4eb8a7af0 tempest-CinderUnicodeTest-1494774103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6556091c-d202-4225-9cb1-78f5ae902cf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:05:54 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-dceb9434-064f-438d-9661-97f4eb8a7af0 tempest-CinderUnicodeTest-1494774103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6556091c-d202-4225-9cb1-78f5ae902cf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c1f435ab-e6a6-4888-ad38-fa0f3a94c2a9', 'volume_name': 'volume-c1f435ab-e6a6-4888-ad38-fa0f3a94c2a9', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:05:54 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-dceb9434-064f-438d-9661-97f4eb8a7af0 tempest-CinderUnicodeTest-1494774103 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c47a416e-05c5-45bc-94a5-358d953673da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:05:54 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-dceb9434-064f-438d-9661-97f4eb8a7af0 tempest-CinderUnicodeTest-1494774103 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c47a416e-05c5-45bc-94a5-358d953673da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:05:54 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-dceb9434-064f-438d-9661-97f4eb8a7af0 tempest-CinderUnicodeTest-1494774103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9970d11a-0461-45c2-9793-8320c0c12083) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:05:54 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-dceb9434-064f-438d-9661-97f4eb8a7af0 tempest-CinderUnicodeTest-1494774103 None] Volume c1f435ab-e6a6-4888-ad38-fa0f3a94c2a9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c1f435ab-e6a6-4888-ad38-fa0f3a94c2a9', 'volume_size': 1} Jul 13 14:05:54 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-dceb9434-064f-438d-9661-97f4eb8a7af0 tempest-CinderUnicodeTest-1494774103 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 14:05:54 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-dceb9434-064f-438d-9661-97f4eb8a7af0 tempest-CinderUnicodeTest-1494774103 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 14:05:54 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-dceb9434-064f-438d-9661-97f4eb8a7af0 tempest-CinderUnicodeTest-1494774103 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T12:05:54Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1f435ab-e6a6-4888-ad38-fa0f3a94c2a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e6f259a04a64e588cf71ffdb6845fb3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T12:05:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T12:05:54Z,use_quota=True,user_id='f2eaa34b2f364f7294548ad3b1d1fc5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1147de8b-623b-426c-a13d-7fc824a80f67),volume_type_id=1147de8b-623b-426c-a13d-7fc824a80f67)}" {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 13 14:05:54 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-dceb9434-064f-438d-9661-97f4eb8a7af0 tempest-CinderUnicodeTest-1494774103 None] Creating volume c1f435ab-e6a6-4888-ad38-fa0f3a94c2a9 {{(pid=87098) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 13 14:05:54 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-dceb9434-064f-438d-9661-97f4eb8a7af0 tempest-CinderUnicodeTest-1494774103 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 14:05:54 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-dceb9434-064f-438d-9661-97f4eb8a7af0 tempest-CinderUnicodeTest-1494774103 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 14:05:54 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-dceb9434-064f-438d-9661-97f4eb8a7af0 tempest-CinderUnicodeTest-1494774103 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 14:05:54 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-dceb9434-064f-438d-9661-97f4eb8a7af0 tempest-CinderUnicodeTest-1494774103 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 14:05:54 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-dceb9434-064f-438d-9661-97f4eb8a7af0 tempest-CinderUnicodeTest-1494774103 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 14:05:54 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-dceb9434-064f-438d-9661-97f4eb8a7af0 tempest-CinderUnicodeTest-1494774103 None] Selected osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 14:05:54 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-dceb9434-064f-438d-9661-97f4eb8a7af0 tempest-CinderUnicodeTest-1494774103 None] casted to osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 Jul 13 14:05:54 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-dceb9434-064f-438d-9661-97f4eb8a7af0 tempest-CinderUnicodeTest-1494774103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-c1f435ab-e6a6-4888-ad38-fa0f3a94c2a9 1073741824 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:05:54 devstack sudo[105037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-c1f435ab-e6a6-4888-ad38-fa0f3a94c2a9 1073741824 Jul 13 14:05:54 devstack sudo[105037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:05:54 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-ace6d7b6-73af-43fc-af87-b16c4ce03064 tempest-VolumeDependencyTests-691513090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc81b756-ca83-48e1-909e-618f5dcedcfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b2eafd09-2276-4341-afb6-12bd2938cbb2', 'volume_size': 1, 'snapshot_id': '8d3708c6-04a7-4993-a301-21c6c81631a2'}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:05:54 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-ace6d7b6-73af-43fc-af87-b16c4ce03064 tempest-VolumeDependencyTests-691513090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ea987d6-4595-4532-bac7-6c8e29cde75d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:05:54 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-ace6d7b6-73af-43fc-af87-b16c4ce03064 tempest-VolumeDependencyTests-691513090 None] Volume volume-b2eafd09-2276-4341-afb6-12bd2938cbb2 (b2eafd09-2276-4341-afb6-12bd2938cbb2): created successfully Jul 13 14:05:54 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-ace6d7b6-73af-43fc-af87-b16c4ce03064 tempest-VolumeDependencyTests-691513090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ea987d6-4595-4532-bac7-6c8e29cde75d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:05:54 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-ace6d7b6-73af-43fc-af87-b16c4ce03064 tempest-VolumeDependencyTests-691513090 None] Flow 'volume_create_manager' (be9bdaa9-9449-4f85-b32d-e392c34b2a56) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 14:05:54 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-2412c364-3001-4406-8709-31de0c8362e8 tempest-ProjectAdminTests-593219782 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7577095031738, 'free_capacity_gb': 1775.7577095031738, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87098) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 13 14:05:54 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-ace6d7b6-73af-43fc-af87-b16c4ce03064 tempest-VolumeDependencyTests-691513090 None] Created volume successfully. Jul 13 14:05:55 devstack sudo[105037]: pam_unix(sudo:session): session closed for user root Jul 13 14:05:55 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-dceb9434-064f-438d-9661-97f4eb8a7af0 tempest-CinderUnicodeTest-1494774103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-c1f435ab-e6a6-4888-ad38-fa0f3a94c2a9 1073741824" returned: 0 in 0.529s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:05:55 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-dceb9434-064f-438d-9661-97f4eb8a7af0 tempest-CinderUnicodeTest-1494774103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-c1f435ab-e6a6-4888-ad38-fa0f3a94c2a9 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:05:55 devstack sudo[105043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-c1f435ab-e6a6-4888-ad38-fa0f3a94c2a9 Jul 13 14:05:55 devstack sudo[105043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:05:55 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-87abe9bb-a885-4ee4-8b06-8afd6253285b tempest-VolumeDependencyTests-691513090 None] Acquiring lock "cinder-8d3708c6-04a7-4993-a301-21c6c81631a2-delete_snapshot" by "delete_snapshot" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 14:05:55 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-87abe9bb-a885-4ee4-8b06-8afd6253285b tempest-VolumeDependencyTests-691513090 None] Lock "cinder-8d3708c6-04a7-4993-a301-21c6c81631a2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 14:05:55 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-87abe9bb-a885-4ee4-8b06-8afd6253285b tempest-VolumeDependencyTests-691513090 None] Acquiring lock "cinder-quobyte-ae62b240-08a3-4ccb-90ee-ef7c56f32cd6" by "delete_snapshot" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 14:05:55 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-87abe9bb-a885-4ee4-8b06-8afd6253285b tempest-VolumeDependencyTests-691513090 None] Lock "cinder-quobyte-ae62b240-08a3-4ccb-90ee-ef7c56f32cd6" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 14:05:55 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-87abe9bb-a885-4ee4-8b06-8afd6253285b tempest-VolumeDependencyTests-691513090 None] Acquiring lock "cinder-quobyte-8d3708c6-04a7-4993-a301-21c6c81631a2" by "_delete_snapshot" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 14:05:55 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-87abe9bb-a885-4ee4-8b06-8afd6253285b tempest-VolumeDependencyTests-691513090 None] Lock "cinder-quobyte-8d3708c6-04a7-4993-a301-21c6c81631a2" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 14:05:55 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-87abe9bb-a885-4ee4-8b06-8afd6253285b tempest-VolumeDependencyTests-691513090 None] Deleting offline snapshot 8d3708c6-04a7-4993-a301-21c6c81631a2 of volume ae62b240-08a3-4ccb-90ee-ef7c56f32cd6 {{(pid=87098) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 13 14:05:55 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-87abe9bb-a885-4ee4-8b06-8afd6253285b tempest-VolumeDependencyTests-691513090 None] snapshot_file for this snap is: volume-ae62b240-08a3-4ccb-90ee-ef7c56f32cd6.8d3708c6-04a7-4993-a301-21c6c81631a2 {{(pid=87098) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 13 14:05:55 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5863e5f-d271-40a4-a2b1-df8801f2e76b]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 14:05:55 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-87abe9bb-a885-4ee4-8b06-8afd6253285b tempest-VolumeDependencyTests-691513090 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-ae62b240-08a3-4ccb-90ee-ef7c56f32cd6.8d3708c6-04a7-4993-a301-21c6c81631a2 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:05:55 devstack sudo[105043]: pam_unix(sudo:session): session closed for user root Jul 13 14:05:55 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-dceb9434-064f-438d-9661-97f4eb8a7af0 tempest-CinderUnicodeTest-1494774103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-c1f435ab-e6a6-4888-ad38-fa0f3a94c2a9" returned: 0 in 0.325s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:05:55 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-dceb9434-064f-438d-9661-97f4eb8a7af0 tempest-CinderUnicodeTest-1494774103 None] <== create_volume: return (900ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'} {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 13 14:05:55 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-dceb9434-064f-438d-9661-97f4eb8a7af0 tempest-CinderUnicodeTest-1494774103 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.903s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 14:05:55 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-dceb9434-064f-438d-9661-97f4eb8a7af0 tempest-CinderUnicodeTest-1494774103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9970d11a-0461-45c2-9793-8320c0c12083) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c1f435ab-e6a6-4888-ad38-fa0f3a94c2a9', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:05:55 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-dceb9434-064f-438d-9661-97f4eb8a7af0 tempest-CinderUnicodeTest-1494774103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ddf7566a-eda2-498e-826b-74d41cee46d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:05:55 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-dceb9434-064f-438d-9661-97f4eb8a7af0 tempest-CinderUnicodeTest-1494774103 None] Volume volume-c1f435ab-e6a6-4888-ad38-fa0f3a94c2a9 (c1f435ab-e6a6-4888-ad38-fa0f3a94c2a9): created successfully Jul 13 14:05:55 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-dceb9434-064f-438d-9661-97f4eb8a7af0 tempest-CinderUnicodeTest-1494774103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ddf7566a-eda2-498e-826b-74d41cee46d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:05:55 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-dceb9434-064f-438d-9661-97f4eb8a7af0 tempest-CinderUnicodeTest-1494774103 None] Flow 'volume_create_manager' (01c06934-120b-4684-961e-d8aa0d80ac7b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 14:05:55 devstack sudo[105046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-ae62b240-08a3-4ccb-90ee-ef7c56f32cd6.8d3708c6-04a7-4993-a301-21c6c81631a2 Jul 13 14:05:55 devstack sudo[105046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:05:55 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-dceb9434-064f-438d-9661-97f4eb8a7af0 tempest-CinderUnicodeTest-1494774103 None] Created volume successfully. Jul 13 14:05:55 devstack sudo[105046]: pam_unix(sudo:session): session closed for user root Jul 13 14:05:55 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-87abe9bb-a885-4ee4-8b06-8afd6253285b tempest-VolumeDependencyTests-691513090 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-ae62b240-08a3-4ccb-90ee-ef7c56f32cd6.8d3708c6-04a7-4993-a301-21c6c81631a2" returned: 0 in 0.422s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:05:55 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-87abe9bb-a885-4ee4-8b06-8afd6253285b tempest-VolumeDependencyTests-691513090 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ae62b240-08a3-4ccb-90ee-ef7c56f32cd6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87098) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 13 14:05:55 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[b44f4b5b-01e0-4b4b-a6a1-175a4505aef8]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 14:05:55 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-87abe9bb-a885-4ee4-8b06-8afd6253285b tempest-VolumeDependencyTests-691513090 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-ae62b240-08a3-4ccb-90ee-ef7c56f32cd6 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:05:56 devstack sudo[105051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-ae62b240-08a3-4ccb-90ee-ef7c56f32cd6 Jul 13 14:05:56 devstack sudo[105051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:05:56 devstack sudo[105051]: pam_unix(sudo:session): session closed for user root Jul 13 14:05:56 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-87abe9bb-a885-4ee4-8b06-8afd6253285b tempest-VolumeDependencyTests-691513090 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-ae62b240-08a3-4ccb-90ee-ef7c56f32cd6" returned: 0 in 0.456s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:05:56 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-87abe9bb-a885-4ee4-8b06-8afd6253285b tempest-VolumeDependencyTests-691513090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-ae62b240-08a3-4ccb-90ee-ef7c56f32cd6.8d3708c6-04a7-4993-a301-21c6c81631a2 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:05:56 devstack sudo[105056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-ae62b240-08a3-4ccb-90ee-ef7c56f32cd6.8d3708c6-04a7-4993-a301-21c6c81631a2 Jul 13 14:05:56 devstack sudo[105056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:05:56 devstack sudo[105056]: pam_unix(sudo:session): session closed for user root Jul 13 14:05:56 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-87abe9bb-a885-4ee4-8b06-8afd6253285b tempest-VolumeDependencyTests-691513090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-ae62b240-08a3-4ccb-90ee-ef7c56f32cd6.8d3708c6-04a7-4993-a301-21c6c81631a2" returned: 0 in 0.510s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:05:56 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-87abe9bb-a885-4ee4-8b06-8afd6253285b tempest-VolumeDependencyTests-691513090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-ae62b240-08a3-4ccb-90ee-ef7c56f32cd6.8d3708c6-04a7-4993-a301-21c6c81631a2 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:05:56 devstack sudo[105062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-ae62b240-08a3-4ccb-90ee-ef7c56f32cd6.8d3708c6-04a7-4993-a301-21c6c81631a2 Jul 13 14:05:56 devstack sudo[105062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:05:57 devstack sudo[105062]: pam_unix(sudo:session): session closed for user root Jul 13 14:05:57 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-87abe9bb-a885-4ee4-8b06-8afd6253285b tempest-VolumeDependencyTests-691513090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-ae62b240-08a3-4ccb-90ee-ef7c56f32cd6.8d3708c6-04a7-4993-a301-21c6c81631a2" returned: 0 in 0.346s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:05:57 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-87abe9bb-a885-4ee4-8b06-8afd6253285b tempest-VolumeDependencyTests-691513090 None] Lock "cinder-quobyte-8d3708c6-04a7-4993-a301-21c6c81631a2" released by "_delete_snapshot" :: held 1.906s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 14:05:57 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-87abe9bb-a885-4ee4-8b06-8afd6253285b tempest-VolumeDependencyTests-691513090 None] Lock "cinder-quobyte-ae62b240-08a3-4ccb-90ee-ef7c56f32cd6" released by "delete_snapshot" :: held 1.950s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 14:05:57 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-87abe9bb-a885-4ee4-8b06-8afd6253285b tempest-VolumeDependencyTests-691513090 None] Created reservations ['7158dc9a-9c07-4660-9ae0-b5efdafa0396', '8e7ec124-ade7-44fc-a209-b641bb69db26', 'd61fc296-75d6-4acf-9672-dfc43336ec3a', '765c4f1c-bf3e-4641-8020-305ccb878209'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 14:05:57 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-90f05610-c3e7-4ff0-8c5a-17974dbc7a5f tempest-CinderUnicodeTest-1494774103 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 14:05:57 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-90f05610-c3e7-4ff0-8c5a-17974dbc7a5f tempest-CinderUnicodeTest-1494774103 None] Flow 'volume_create_manager' (c715afa8-e351-4c6b-bce8-dfcb66060859) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 14:05:57 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-90f05610-c3e7-4ff0-8c5a-17974dbc7a5f tempest-CinderUnicodeTest-1494774103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3fb7eeee-f1fd-4471-bad7-24838a36b831) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:05:57 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-90f05610-c3e7-4ff0-8c5a-17974dbc7a5f tempest-CinderUnicodeTest-1494774103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3fb7eeee-f1fd-4471-bad7-24838a36b831) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T12:05:57Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-347598776',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=969f9aaf-f074-4eca-9037-13743895cadf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e6f259a04a64e588cf71ffdb6845fb3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T12:05:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T12:05:57Z,use_quota=True,user_id='f2eaa34b2f364f7294548ad3b1d1fc5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1147de8b-623b-426c-a13d-7fc824a80f67),volume_type_id=1147de8b-623b-426c-a13d-7fc824a80f67)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:05:57 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-90f05610-c3e7-4ff0-8c5a-17974dbc7a5f tempest-CinderUnicodeTest-1494774103 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cca75620-6f40-4b43-9114-07ad6847d74f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:05:57 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-90f05610-c3e7-4ff0-8c5a-17974dbc7a5f tempest-CinderUnicodeTest-1494774103 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cca75620-6f40-4b43-9114-07ad6847d74f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:05:57 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-90f05610-c3e7-4ff0-8c5a-17974dbc7a5f tempest-CinderUnicodeTest-1494774103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef823abe-9801-45be-b850-b22da05cd224) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:05:57 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-90f05610-c3e7-4ff0-8c5a-17974dbc7a5f tempest-CinderUnicodeTest-1494774103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef823abe-9801-45be-b850-b22da05cd224) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '969f9aaf-f074-4eca-9037-13743895cadf', 'volume_name': 'volume-969f9aaf-f074-4eca-9037-13743895cadf', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:05:57 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-90f05610-c3e7-4ff0-8c5a-17974dbc7a5f tempest-CinderUnicodeTest-1494774103 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32680198-b9c1-4697-b315-a4f73403265e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:05:57 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-90f05610-c3e7-4ff0-8c5a-17974dbc7a5f tempest-CinderUnicodeTest-1494774103 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32680198-b9c1-4697-b315-a4f73403265e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:05:57 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-90f05610-c3e7-4ff0-8c5a-17974dbc7a5f tempest-CinderUnicodeTest-1494774103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e50372c6-30b9-49f5-949a-ddb278a52e0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:05:57 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-90f05610-c3e7-4ff0-8c5a-17974dbc7a5f tempest-CinderUnicodeTest-1494774103 None] Volume 969f9aaf-f074-4eca-9037-13743895cadf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-969f9aaf-f074-4eca-9037-13743895cadf', 'volume_size': 1} Jul 13 14:05:57 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-90f05610-c3e7-4ff0-8c5a-17974dbc7a5f tempest-CinderUnicodeTest-1494774103 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 14:05:57 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-90f05610-c3e7-4ff0-8c5a-17974dbc7a5f tempest-CinderUnicodeTest-1494774103 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 14:05:57 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-90f05610-c3e7-4ff0-8c5a-17974dbc7a5f tempest-CinderUnicodeTest-1494774103 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T12:05:57Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-347598776',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=969f9aaf-f074-4eca-9037-13743895cadf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e6f259a04a64e588cf71ffdb6845fb3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T12:05:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T12:05:57Z,use_quota=True,user_id='f2eaa34b2f364f7294548ad3b1d1fc5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1147de8b-623b-426c-a13d-7fc824a80f67),volume_type_id=1147de8b-623b-426c-a13d-7fc824a80f67)}" {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 13 14:05:57 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-90f05610-c3e7-4ff0-8c5a-17974dbc7a5f tempest-CinderUnicodeTest-1494774103 None] Creating volume 969f9aaf-f074-4eca-9037-13743895cadf {{(pid=87098) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 13 14:05:57 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-90f05610-c3e7-4ff0-8c5a-17974dbc7a5f tempest-CinderUnicodeTest-1494774103 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 14:05:57 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-90f05610-c3e7-4ff0-8c5a-17974dbc7a5f tempest-CinderUnicodeTest-1494774103 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 14:05:57 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-90f05610-c3e7-4ff0-8c5a-17974dbc7a5f tempest-CinderUnicodeTest-1494774103 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 14:05:57 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-90f05610-c3e7-4ff0-8c5a-17974dbc7a5f tempest-CinderUnicodeTest-1494774103 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 14:05:57 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-90f05610-c3e7-4ff0-8c5a-17974dbc7a5f tempest-CinderUnicodeTest-1494774103 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 14:05:57 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-90f05610-c3e7-4ff0-8c5a-17974dbc7a5f tempest-CinderUnicodeTest-1494774103 None] Selected osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 14:05:57 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-90f05610-c3e7-4ff0-8c5a-17974dbc7a5f tempest-CinderUnicodeTest-1494774103 None] casted to osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 Jul 13 14:05:57 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-90f05610-c3e7-4ff0-8c5a-17974dbc7a5f tempest-CinderUnicodeTest-1494774103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-969f9aaf-f074-4eca-9037-13743895cadf 1073741824 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:05:57 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-e941be58-6cc2-42bd-b4d4-2c359f7e5a0e tempest-VolumeDependencyTests-691513090 None] Acquiring lock "cinder-ae62b240-08a3-4ccb-90ee-ef7c56f32cd6-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 14:05:57 devstack sudo[105066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-969f9aaf-f074-4eca-9037-13743895cadf 1073741824 Jul 13 14:05:57 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-e941be58-6cc2-42bd-b4d4-2c359f7e5a0e tempest-VolumeDependencyTests-691513090 None] Lock "cinder-ae62b240-08a3-4ccb-90ee-ef7c56f32cd6-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 14:05:57 devstack sudo[105066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:05:57 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-87abe9bb-a885-4ee4-8b06-8afd6253285b tempest-VolumeDependencyTests-691513090 None] Delete snapshot completed successfully. Jul 13 14:05:57 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-87abe9bb-a885-4ee4-8b06-8afd6253285b tempest-VolumeDependencyTests-691513090 None] Lock "cinder-8d3708c6-04a7-4993-a301-21c6c81631a2-delete_snapshot" released by "delete_snapshot" :: held 2.312s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 14:05:57 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-e941be58-6cc2-42bd-b4d4-2c359f7e5a0e tempest-VolumeDependencyTests-691513090 None] Acquiring lock "cinder-quobyte-ae62b240-08a3-4ccb-90ee-ef7c56f32cd6" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 14:05:57 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-e941be58-6cc2-42bd-b4d4-2c359f7e5a0e tempest-VolumeDependencyTests-691513090 None] Lock "cinder-quobyte-ae62b240-08a3-4ccb-90ee-ef7c56f32cd6" acquired by "delete_volume" :: waited 0.020s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 14:05:57 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f3b9a2f-eb69-4823-8dd4-d4132d81ac72]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 14:05:57 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-e941be58-6cc2-42bd-b4d4-2c359f7e5a0e tempest-VolumeDependencyTests-691513090 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-ae62b240-08a3-4ccb-90ee-ef7c56f32cd6 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:05:57 devstack sudo[105068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-ae62b240-08a3-4ccb-90ee-ef7c56f32cd6 Jul 13 14:05:57 devstack sudo[105068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:05:58 devstack sudo[105066]: pam_unix(sudo:session): session closed for user root Jul 13 14:05:58 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-90f05610-c3e7-4ff0-8c5a-17974dbc7a5f tempest-CinderUnicodeTest-1494774103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-969f9aaf-f074-4eca-9037-13743895cadf 1073741824" returned: 0 in 0.634s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:05:58 devstack sudo[105068]: pam_unix(sudo:session): session closed for user root Jul 13 14:05:58 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-e941be58-6cc2-42bd-b4d4-2c359f7e5a0e tempest-VolumeDependencyTests-691513090 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-ae62b240-08a3-4ccb-90ee-ef7c56f32cd6" returned: 0 in 0.497s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:05:58 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-e941be58-6cc2-42bd-b4d4-2c359f7e5a0e tempest-VolumeDependencyTests-691513090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-ae62b240-08a3-4ccb-90ee-ef7c56f32cd6 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:05:58 devstack sudo[105077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-ae62b240-08a3-4ccb-90ee-ef7c56f32cd6 Jul 13 14:05:58 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-90f05610-c3e7-4ff0-8c5a-17974dbc7a5f tempest-CinderUnicodeTest-1494774103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-969f9aaf-f074-4eca-9037-13743895cadf {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:05:58 devstack sudo[105077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:05:58 devstack sudo[105079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-969f9aaf-f074-4eca-9037-13743895cadf Jul 13 14:05:58 devstack sudo[105079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:05:58 devstack sudo[105079]: pam_unix(sudo:session): session closed for user root Jul 13 14:05:58 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-90f05610-c3e7-4ff0-8c5a-17974dbc7a5f tempest-CinderUnicodeTest-1494774103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-969f9aaf-f074-4eca-9037-13743895cadf" returned: 0 in 0.283s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:05:58 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-90f05610-c3e7-4ff0-8c5a-17974dbc7a5f tempest-CinderUnicodeTest-1494774103 None] <== create_volume: return (992ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'} {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 13 14:05:58 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-90f05610-c3e7-4ff0-8c5a-17974dbc7a5f tempest-CinderUnicodeTest-1494774103 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.996s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 14:05:58 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-90f05610-c3e7-4ff0-8c5a-17974dbc7a5f tempest-CinderUnicodeTest-1494774103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e50372c6-30b9-49f5-949a-ddb278a52e0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-969f9aaf-f074-4eca-9037-13743895cadf', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:05:58 devstack sudo[105077]: pam_unix(sudo:session): session closed for user root Jul 13 14:05:58 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-90f05610-c3e7-4ff0-8c5a-17974dbc7a5f tempest-CinderUnicodeTest-1494774103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4098386a-95f4-4549-8cb2-c90920a78e63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:05:58 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-e941be58-6cc2-42bd-b4d4-2c359f7e5a0e tempest-VolumeDependencyTests-691513090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-ae62b240-08a3-4ccb-90ee-ef7c56f32cd6" returned: 0 in 0.361s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:05:58 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-90f05610-c3e7-4ff0-8c5a-17974dbc7a5f tempest-CinderUnicodeTest-1494774103 None] Volume volume-969f9aaf-f074-4eca-9037-13743895cadf (969f9aaf-f074-4eca-9037-13743895cadf): created successfully Jul 13 14:05:58 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-90f05610-c3e7-4ff0-8c5a-17974dbc7a5f tempest-CinderUnicodeTest-1494774103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4098386a-95f4-4549-8cb2-c90920a78e63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:05:58 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-90f05610-c3e7-4ff0-8c5a-17974dbc7a5f tempest-CinderUnicodeTest-1494774103 None] Flow 'volume_create_manager' (c715afa8-e351-4c6b-bce8-dfcb66060859) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 14:05:58 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-e941be58-6cc2-42bd-b4d4-2c359f7e5a0e tempest-VolumeDependencyTests-691513090 None] Lock "cinder-quobyte-ae62b240-08a3-4ccb-90ee-ef7c56f32cd6" released by "delete_volume" :: held 0.939s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 14:05:58 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-90f05610-c3e7-4ff0-8c5a-17974dbc7a5f tempest-CinderUnicodeTest-1494774103 None] Created volume successfully. Jul 13 14:05:58 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-e941be58-6cc2-42bd-b4d4-2c359f7e5a0e tempest-VolumeDependencyTests-691513090 None] Created reservations ['a9f597af-2439-4e03-ab25-8cd9f447ecb4', '27e6a5ec-0a3d-45bb-9b23-8183650de870', '2a858d1e-4965-44c7-b477-f114b69e9fa4', '814fd0a0-b876-4cf7-a774-cbcd4b3c8650'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 14:05:58 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-e941be58-6cc2-42bd-b4d4-2c359f7e5a0e tempest-VolumeDependencyTests-691513090 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 14:05:58 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-e941be58-6cc2-42bd-b4d4-2c359f7e5a0e tempest-VolumeDependencyTests-691513090 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 14:05:58 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-e941be58-6cc2-42bd-b4d4-2c359f7e5a0e tempest-VolumeDependencyTests-691513090 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 14:05:58 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-e941be58-6cc2-42bd-b4d4-2c359f7e5a0e tempest-VolumeDependencyTests-691513090 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 14:05:58 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-e941be58-6cc2-42bd-b4d4-2c359f7e5a0e tempest-VolumeDependencyTests-691513090 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 14:05:58 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-e941be58-6cc2-42bd-b4d4-2c359f7e5a0e tempest-VolumeDependencyTests-691513090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:05:58 devstack sudo[105083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 Jul 13 14:05:58 devstack sudo[105083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:05:59 devstack sudo[105083]: pam_unix(sudo:session): session closed for user root Jul 13 14:05:59 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-e941be58-6cc2-42bd-b4d4-2c359f7e5a0e tempest-VolumeDependencyTests-691513090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78" returned: 0 in 0.281s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:05:59 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-e941be58-6cc2-42bd-b4d4-2c359f7e5a0e tempest-VolumeDependencyTests-691513090 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 14:05:59 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-e941be58-6cc2-42bd-b4d4-2c359f7e5a0e tempest-VolumeDependencyTests-691513090 None] Deleted volume successfully. Jul 13 14:05:59 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-e941be58-6cc2-42bd-b4d4-2c359f7e5a0e tempest-VolumeDependencyTests-691513090 None] Lock "cinder-ae62b240-08a3-4ccb-90ee-ef7c56f32cd6-delete_volume" released by "delete_volume" :: held 1.501s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 14:05:59 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-61fdb992-9df1-450b-aa42-2940a8d944d7 tempest-VolumeDependencyTests-691513090 None] Acquiring lock "cinder-b2eafd09-2276-4341-afb6-12bd2938cbb2-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 14:05:59 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-61fdb992-9df1-450b-aa42-2940a8d944d7 tempest-VolumeDependencyTests-691513090 None] Lock "cinder-b2eafd09-2276-4341-afb6-12bd2938cbb2-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 14:05:59 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-e8bb6ffc-b132-4920-b9fa-37320527425e tempest-CinderUnicodeTest-1494774103 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 14:05:59 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-e8bb6ffc-b132-4920-b9fa-37320527425e tempest-CinderUnicodeTest-1494774103 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 14:06:00 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-e8bb6ffc-b132-4920-b9fa-37320527425e tempest-CinderUnicodeTest-1494774103 None] Creating offline snapshot 97ae3c3c-711c-4cac-b29f-1f0aa7d3eb04 of volume 969f9aaf-f074-4eca-9037-13743895cadf {{(pid=87098) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 13 14:06:00 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-61fdb992-9df1-450b-aa42-2940a8d944d7 tempest-VolumeDependencyTests-691513090 None] Acquiring lock "cinder-quobyte-b2eafd09-2276-4341-afb6-12bd2938cbb2" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 14:06:00 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[3af34bf7-2f41-4464-b362-a490a9406271]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 14:06:00 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-e8bb6ffc-b132-4920-b9fa-37320527425e tempest-CinderUnicodeTest-1494774103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-969f9aaf-f074-4eca-9037-13743895cadf {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:06:00 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-61fdb992-9df1-450b-aa42-2940a8d944d7 tempest-VolumeDependencyTests-691513090 None] Lock "cinder-quobyte-b2eafd09-2276-4341-afb6-12bd2938cbb2" acquired by "delete_volume" :: waited 0.033s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 14:06:00 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[38e9cc5a-5eb2-4d02-b15d-fc6df70ff31b]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 14:06:00 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-61fdb992-9df1-450b-aa42-2940a8d944d7 tempest-VolumeDependencyTests-691513090 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-b2eafd09-2276-4341-afb6-12bd2938cbb2 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:06:00 devstack sudo[105086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-969f9aaf-f074-4eca-9037-13743895cadf Jul 13 14:06:00 devstack sudo[105086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:06:00 devstack sudo[105087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-b2eafd09-2276-4341-afb6-12bd2938cbb2 Jul 13 14:06:00 devstack sudo[105087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:06:00 devstack sudo[105087]: pam_unix(sudo:session): session closed for user root Jul 13 14:06:00 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-61fdb992-9df1-450b-aa42-2940a8d944d7 tempest-VolumeDependencyTests-691513090 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-b2eafd09-2276-4341-afb6-12bd2938cbb2" returned: 0 in 0.478s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:06:00 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-61fdb992-9df1-450b-aa42-2940a8d944d7 tempest-VolumeDependencyTests-691513090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-b2eafd09-2276-4341-afb6-12bd2938cbb2 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:06:00 devstack sudo[105086]: pam_unix(sudo:session): session closed for user root Jul 13 14:06:00 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-e8bb6ffc-b132-4920-b9fa-37320527425e tempest-CinderUnicodeTest-1494774103 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-969f9aaf-f074-4eca-9037-13743895cadf" returned: 0 in 0.545s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:06:00 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-e8bb6ffc-b132-4920-b9fa-37320527425e tempest-CinderUnicodeTest-1494774103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-969f9aaf-f074-4eca-9037-13743895cadf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-969f9aaf-f074-4eca-9037-13743895cadf.97ae3c3c-711c-4cac-b29f-1f0aa7d3eb04 1G {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:06:00 devstack sudo[105097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-b2eafd09-2276-4341-afb6-12bd2938cbb2 Jul 13 14:06:00 devstack sudo[105097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:06:00 devstack sudo[105098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-969f9aaf-f074-4eca-9037-13743895cadf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-969f9aaf-f074-4eca-9037-13743895cadf.97ae3c3c-711c-4cac-b29f-1f0aa7d3eb04 1G Jul 13 14:06:00 devstack sudo[105098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:06:00 devstack sudo[105097]: pam_unix(sudo:session): session closed for user root Jul 13 14:06:00 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-61fdb992-9df1-450b-aa42-2940a8d944d7 tempest-VolumeDependencyTests-691513090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-b2eafd09-2276-4341-afb6-12bd2938cbb2" returned: 0 in 0.308s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:06:00 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-61fdb992-9df1-450b-aa42-2940a8d944d7 tempest-VolumeDependencyTests-691513090 None] Lock "cinder-quobyte-b2eafd09-2276-4341-afb6-12bd2938cbb2" released by "delete_volume" :: held 0.834s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 14:06:00 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-61fdb992-9df1-450b-aa42-2940a8d944d7 tempest-VolumeDependencyTests-691513090 None] Created reservations ['6635bdd1-daf1-4a1e-ad21-64427188ff63', '79c4b427-5777-41d1-afe7-7f3a14056211', '35fcfe72-c8ec-472c-a286-eea4a2044d8f', '28ef448c-9e8c-4995-a28f-42744e43424a'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 14:06:01 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-61fdb992-9df1-450b-aa42-2940a8d944d7 tempest-VolumeDependencyTests-691513090 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 14:06:01 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-61fdb992-9df1-450b-aa42-2940a8d944d7 tempest-VolumeDependencyTests-691513090 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 14:06:01 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-61fdb992-9df1-450b-aa42-2940a8d944d7 tempest-VolumeDependencyTests-691513090 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 14:06:01 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-61fdb992-9df1-450b-aa42-2940a8d944d7 tempest-VolumeDependencyTests-691513090 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 14:06:01 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-61fdb992-9df1-450b-aa42-2940a8d944d7 tempest-VolumeDependencyTests-691513090 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 14:06:01 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-61fdb992-9df1-450b-aa42-2940a8d944d7 tempest-VolumeDependencyTests-691513090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:06:01 devstack sudo[105106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 Jul 13 14:06:01 devstack sudo[105106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:06:01 devstack sudo[105098]: pam_unix(sudo:session): session closed for user root Jul 13 14:06:01 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-e8bb6ffc-b132-4920-b9fa-37320527425e tempest-CinderUnicodeTest-1494774103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-969f9aaf-f074-4eca-9037-13743895cadf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-969f9aaf-f074-4eca-9037-13743895cadf.97ae3c3c-711c-4cac-b29f-1f0aa7d3eb04 1G" returned: 0 in 0.661s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:06:01 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-e8bb6ffc-b132-4920-b9fa-37320527425e tempest-CinderUnicodeTest-1494774103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-969f9aaf-f074-4eca-9037-13743895cadf -F qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-969f9aaf-f074-4eca-9037-13743895cadf.97ae3c3c-711c-4cac-b29f-1f0aa7d3eb04 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:06:01 devstack sudo[105108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-969f9aaf-f074-4eca-9037-13743895cadf -F qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-969f9aaf-f074-4eca-9037-13743895cadf.97ae3c3c-711c-4cac-b29f-1f0aa7d3eb04 Jul 13 14:06:01 devstack sudo[105108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:06:01 devstack sudo[105106]: pam_unix(sudo:session): session closed for user root Jul 13 14:06:01 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-61fdb992-9df1-450b-aa42-2940a8d944d7 tempest-VolumeDependencyTests-691513090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78" returned: 0 in 0.409s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:06:01 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-61fdb992-9df1-450b-aa42-2940a8d944d7 tempest-VolumeDependencyTests-691513090 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 14:06:01 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-61fdb992-9df1-450b-aa42-2940a8d944d7 tempest-VolumeDependencyTests-691513090 None] Deleted volume successfully. Jul 13 14:06:01 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-61fdb992-9df1-450b-aa42-2940a8d944d7 tempest-VolumeDependencyTests-691513090 None] Lock "cinder-b2eafd09-2276-4341-afb6-12bd2938cbb2-delete_volume" released by "delete_volume" :: held 1.621s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 14:06:01 devstack sudo[105108]: pam_unix(sudo:session): session closed for user root Jul 13 14:06:01 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-e8bb6ffc-b132-4920-b9fa-37320527425e tempest-CinderUnicodeTest-1494774103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-969f9aaf-f074-4eca-9037-13743895cadf -F qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-969f9aaf-f074-4eca-9037-13743895cadf.97ae3c3c-711c-4cac-b29f-1f0aa7d3eb04" returned: 0 in 0.433s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:06:01 devstack cinder-volume[87098]: WARNING cinder.volume.drivers.remotefs [None req-e8bb6ffc-b132-4920-b9fa-37320527425e tempest-CinderUnicodeTest-1494774103 None] /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-969f9aaf-f074-4eca-9037-13743895cadf.97ae3c3c-711c-4cac-b29f-1f0aa7d3eb04 is being set with open permissions: ugo+rw Jul 13 14:06:01 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-e8bb6ffc-b132-4920-b9fa-37320527425e tempest-CinderUnicodeTest-1494774103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-969f9aaf-f074-4eca-9037-13743895cadf.97ae3c3c-711c-4cac-b29f-1f0aa7d3eb04 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:06:01 devstack sudo[105115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-969f9aaf-f074-4eca-9037-13743895cadf.97ae3c3c-711c-4cac-b29f-1f0aa7d3eb04 Jul 13 14:06:01 devstack sudo[105115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:06:01 devstack sudo[105115]: pam_unix(sudo:session): session closed for user root Jul 13 14:06:01 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-e8bb6ffc-b132-4920-b9fa-37320527425e tempest-CinderUnicodeTest-1494774103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-969f9aaf-f074-4eca-9037-13743895cadf.97ae3c3c-711c-4cac-b29f-1f0aa7d3eb04" returned: 0 in 0.300s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:06:02 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-e8bb6ffc-b132-4920-b9fa-37320527425e tempest-CinderUnicodeTest-1494774103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-969f9aaf-f074-4eca-9037-13743895cadf.info {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:06:02 devstack sudo[105118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-969f9aaf-f074-4eca-9037-13743895cadf.info Jul 13 14:06:02 devstack sudo[105118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:06:02 devstack sudo[105118]: pam_unix(sudo:session): session closed for user root Jul 13 14:06:02 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-e8bb6ffc-b132-4920-b9fa-37320527425e tempest-CinderUnicodeTest-1494774103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-969f9aaf-f074-4eca-9037-13743895cadf.info" returned: 0 in 0.368s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:06:02 devstack cinder-volume[87098]: WARNING cinder.volume.drivers.remotefs [None req-e8bb6ffc-b132-4920-b9fa-37320527425e tempest-CinderUnicodeTest-1494774103 None] /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-969f9aaf-f074-4eca-9037-13743895cadf.info is being set with open permissions: ugo+rw Jul 13 14:06:02 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-e8bb6ffc-b132-4920-b9fa-37320527425e tempest-CinderUnicodeTest-1494774103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-969f9aaf-f074-4eca-9037-13743895cadf.info {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:06:02 devstack sudo[105121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-969f9aaf-f074-4eca-9037-13743895cadf.info Jul 13 14:06:02 devstack sudo[105121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:06:02 devstack sudo[105121]: pam_unix(sudo:session): session closed for user root Jul 13 14:06:02 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-e8bb6ffc-b132-4920-b9fa-37320527425e tempest-CinderUnicodeTest-1494774103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-969f9aaf-f074-4eca-9037-13743895cadf.info" returned: 0 in 0.290s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:06:02 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-e8bb6ffc-b132-4920-b9fa-37320527425e tempest-CinderUnicodeTest-1494774103 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.742s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 14:06:02 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-e8bb6ffc-b132-4920-b9fa-37320527425e tempest-CinderUnicodeTest-1494774103 None] Create snapshot completed successfully Jul 13 14:06:03 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-2790e633-66e5-4f76-81e0-7cf7404c1010 tempest-CinderUnicodeTest-1494774103 None] Acquiring lock "cinder-97ae3c3c-711c-4cac-b29f-1f0aa7d3eb04-delete_snapshot" by "delete_snapshot" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 14:06:03 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-2790e633-66e5-4f76-81e0-7cf7404c1010 tempest-CinderUnicodeTest-1494774103 None] Lock "cinder-97ae3c3c-711c-4cac-b29f-1f0aa7d3eb04-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 14:06:03 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-2790e633-66e5-4f76-81e0-7cf7404c1010 tempest-CinderUnicodeTest-1494774103 None] Acquiring lock "cinder-quobyte-969f9aaf-f074-4eca-9037-13743895cadf" by "delete_snapshot" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 14:06:03 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-2790e633-66e5-4f76-81e0-7cf7404c1010 tempest-CinderUnicodeTest-1494774103 None] Lock "cinder-quobyte-969f9aaf-f074-4eca-9037-13743895cadf" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 14:06:03 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-2790e633-66e5-4f76-81e0-7cf7404c1010 tempest-CinderUnicodeTest-1494774103 None] Acquiring lock "cinder-quobyte-97ae3c3c-711c-4cac-b29f-1f0aa7d3eb04" by "_delete_snapshot" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 14:06:03 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-2790e633-66e5-4f76-81e0-7cf7404c1010 tempest-CinderUnicodeTest-1494774103 None] Lock "cinder-quobyte-97ae3c3c-711c-4cac-b29f-1f0aa7d3eb04" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 14:06:03 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-2790e633-66e5-4f76-81e0-7cf7404c1010 tempest-CinderUnicodeTest-1494774103 None] Deleting offline snapshot 97ae3c3c-711c-4cac-b29f-1f0aa7d3eb04 of volume 969f9aaf-f074-4eca-9037-13743895cadf {{(pid=87098) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 13 14:06:03 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-2790e633-66e5-4f76-81e0-7cf7404c1010 tempest-CinderUnicodeTest-1494774103 None] snapshot_file for this snap is: volume-969f9aaf-f074-4eca-9037-13743895cadf.97ae3c3c-711c-4cac-b29f-1f0aa7d3eb04 {{(pid=87098) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 13 14:06:03 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[edd84b6c-bb46-4ec1-a9f7-994c31fc0acc]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 14:06:03 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-2790e633-66e5-4f76-81e0-7cf7404c1010 tempest-CinderUnicodeTest-1494774103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-969f9aaf-f074-4eca-9037-13743895cadf.97ae3c3c-711c-4cac-b29f-1f0aa7d3eb04 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:06:03 devstack sudo[105124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-969f9aaf-f074-4eca-9037-13743895cadf.97ae3c3c-711c-4cac-b29f-1f0aa7d3eb04 Jul 13 14:06:03 devstack sudo[105124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:06:03 devstack sudo[105124]: pam_unix(sudo:session): session closed for user root Jul 13 14:06:03 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-2790e633-66e5-4f76-81e0-7cf7404c1010 tempest-CinderUnicodeTest-1494774103 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-969f9aaf-f074-4eca-9037-13743895cadf.97ae3c3c-711c-4cac-b29f-1f0aa7d3eb04" returned: 0 in 0.433s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:06:03 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-2790e633-66e5-4f76-81e0-7cf7404c1010 tempest-CinderUnicodeTest-1494774103 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-969f9aaf-f074-4eca-9037-13743895cadf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87098) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 13 14:06:03 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc714b30-edb9-4fab-8630-5e4cf0edee4c]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 14:06:03 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-2790e633-66e5-4f76-81e0-7cf7404c1010 tempest-CinderUnicodeTest-1494774103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-969f9aaf-f074-4eca-9037-13743895cadf {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:06:03 devstack sudo[105129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-969f9aaf-f074-4eca-9037-13743895cadf Jul 13 14:06:03 devstack sudo[105129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:06:04 devstack sudo[105129]: pam_unix(sudo:session): session closed for user root Jul 13 14:06:04 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-2790e633-66e5-4f76-81e0-7cf7404c1010 tempest-CinderUnicodeTest-1494774103 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-969f9aaf-f074-4eca-9037-13743895cadf" returned: 0 in 0.426s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:06:04 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-2790e633-66e5-4f76-81e0-7cf7404c1010 tempest-CinderUnicodeTest-1494774103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-969f9aaf-f074-4eca-9037-13743895cadf.97ae3c3c-711c-4cac-b29f-1f0aa7d3eb04 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:06:04 devstack sudo[105135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-969f9aaf-f074-4eca-9037-13743895cadf.97ae3c3c-711c-4cac-b29f-1f0aa7d3eb04 Jul 13 14:06:04 devstack sudo[105135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:06:04 devstack sudo[105135]: pam_unix(sudo:session): session closed for user root Jul 13 14:06:04 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-2790e633-66e5-4f76-81e0-7cf7404c1010 tempest-CinderUnicodeTest-1494774103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-969f9aaf-f074-4eca-9037-13743895cadf.97ae3c3c-711c-4cac-b29f-1f0aa7d3eb04" returned: 0 in 0.434s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:06:04 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-2790e633-66e5-4f76-81e0-7cf7404c1010 tempest-CinderUnicodeTest-1494774103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-969f9aaf-f074-4eca-9037-13743895cadf.97ae3c3c-711c-4cac-b29f-1f0aa7d3eb04 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:06:04 devstack sudo[105140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-969f9aaf-f074-4eca-9037-13743895cadf.97ae3c3c-711c-4cac-b29f-1f0aa7d3eb04 Jul 13 14:06:04 devstack sudo[105140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:06:04 devstack sudo[105140]: pam_unix(sudo:session): session closed for user root Jul 13 14:06:04 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-2790e633-66e5-4f76-81e0-7cf7404c1010 tempest-CinderUnicodeTest-1494774103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-969f9aaf-f074-4eca-9037-13743895cadf.97ae3c3c-711c-4cac-b29f-1f0aa7d3eb04" returned: 0 in 0.290s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:06:05 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-2790e633-66e5-4f76-81e0-7cf7404c1010 tempest-CinderUnicodeTest-1494774103 None] Lock "cinder-quobyte-97ae3c3c-711c-4cac-b29f-1f0aa7d3eb04" released by "_delete_snapshot" :: held 1.735s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 14:06:05 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-2790e633-66e5-4f76-81e0-7cf7404c1010 tempest-CinderUnicodeTest-1494774103 None] Lock "cinder-quobyte-969f9aaf-f074-4eca-9037-13743895cadf" released by "delete_snapshot" :: held 1.776s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 14:06:05 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-2790e633-66e5-4f76-81e0-7cf7404c1010 tempest-CinderUnicodeTest-1494774103 None] Created reservations ['6ca46444-525d-4daa-99fc-9d1114c3a556', 'b12e9943-5788-496c-a344-2e70d9001a43', '28f96614-36f1-4d2f-9355-3ab910004bb2', '34ee783d-1571-47b6-a453-da920bd895f4'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 14:06:05 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-2790e633-66e5-4f76-81e0-7cf7404c1010 tempest-CinderUnicodeTest-1494774103 None] Delete snapshot completed successfully. Jul 13 14:06:05 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-2790e633-66e5-4f76-81e0-7cf7404c1010 tempest-CinderUnicodeTest-1494774103 None] Lock "cinder-97ae3c3c-711c-4cac-b29f-1f0aa7d3eb04-delete_snapshot" released by "delete_snapshot" :: held 2.006s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 14:06:05 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-88bb797d-f6c1-4546-9f53-222688d573a0 tempest-CinderUnicodeTest-1494774103 None] Acquiring lock "cinder-969f9aaf-f074-4eca-9037-13743895cadf-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 14:06:05 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-88bb797d-f6c1-4546-9f53-222688d573a0 tempest-CinderUnicodeTest-1494774103 None] Lock "cinder-969f9aaf-f074-4eca-9037-13743895cadf-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 14:06:05 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-88bb797d-f6c1-4546-9f53-222688d573a0 tempest-CinderUnicodeTest-1494774103 None] Acquiring lock "cinder-quobyte-969f9aaf-f074-4eca-9037-13743895cadf" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 14:06:05 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-88bb797d-f6c1-4546-9f53-222688d573a0 tempest-CinderUnicodeTest-1494774103 None] Lock "cinder-quobyte-969f9aaf-f074-4eca-9037-13743895cadf" acquired by "delete_volume" :: waited 0.024s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 14:06:05 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[05c7e75f-d7ac-46a7-9887-8e59c6ff8933]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 14:06:05 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-88bb797d-f6c1-4546-9f53-222688d573a0 tempest-CinderUnicodeTest-1494774103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-969f9aaf-f074-4eca-9037-13743895cadf {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:06:05 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d7cad61-d837-4c32-9ddf-7cacb798b7dc tempest-ProjectMemberTests-718446646 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 14:06:05 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-7d7cad61-d837-4c32-9ddf-7cacb798b7dc tempest-ProjectMemberTests-718446646 None] Flow 'volume_create_manager' (1c414a51-c8b5-4071-aed7-483e3e6b839f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 14:06:05 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-7d7cad61-d837-4c32-9ddf-7cacb798b7dc tempest-ProjectMemberTests-718446646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f89362e-9afc-43e6-8d7a-75f4eab64f47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:06:05 devstack sudo[105143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-969f9aaf-f074-4eca-9037-13743895cadf Jul 13 14:06:05 devstack sudo[105143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:06:05 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-7d7cad61-d837-4c32-9ddf-7cacb798b7dc tempest-ProjectMemberTests-718446646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f89362e-9afc-43e6-8d7a-75f4eab64f47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T12:06:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2134904064',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0379c954-2d67-4627-a680-8e5abfebacdc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2bb0e12a2763448b9d28151e1e814854',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T12:06:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T12:06:06Z,use_quota=True,user_id='2d16431e25f348deb700350f5b150c69',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1147de8b-623b-426c-a13d-7fc824a80f67),volume_type_id=1147de8b-623b-426c-a13d-7fc824a80f67)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:06:05 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-7d7cad61-d837-4c32-9ddf-7cacb798b7dc tempest-ProjectMemberTests-718446646 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2b747ee-73f2-41a4-bf81-ff986aead5b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:06:05 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-7d7cad61-d837-4c32-9ddf-7cacb798b7dc tempest-ProjectMemberTests-718446646 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2b747ee-73f2-41a4-bf81-ff986aead5b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:06:05 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-7d7cad61-d837-4c32-9ddf-7cacb798b7dc tempest-ProjectMemberTests-718446646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cadf1106-c465-40e2-b39a-4182385159d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:06:05 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-7d7cad61-d837-4c32-9ddf-7cacb798b7dc tempest-ProjectMemberTests-718446646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cadf1106-c465-40e2-b39a-4182385159d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0379c954-2d67-4627-a680-8e5abfebacdc', 'volume_name': 'volume-0379c954-2d67-4627-a680-8e5abfebacdc', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:06:05 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-7d7cad61-d837-4c32-9ddf-7cacb798b7dc tempest-ProjectMemberTests-718446646 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a084276-e272-4c2b-9070-a4f109ceba25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:06:05 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-7d7cad61-d837-4c32-9ddf-7cacb798b7dc tempest-ProjectMemberTests-718446646 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a084276-e272-4c2b-9070-a4f109ceba25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:06:05 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-7d7cad61-d837-4c32-9ddf-7cacb798b7dc tempest-ProjectMemberTests-718446646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a8fe5e2-1d70-4f55-841a-fbdad757f6c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:06:05 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-7d7cad61-d837-4c32-9ddf-7cacb798b7dc tempest-ProjectMemberTests-718446646 None] Volume 0379c954-2d67-4627-a680-8e5abfebacdc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0379c954-2d67-4627-a680-8e5abfebacdc', 'volume_size': 1} Jul 13 14:06:05 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-7d7cad61-d837-4c32-9ddf-7cacb798b7dc tempest-ProjectMemberTests-718446646 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 14:06:05 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-7d7cad61-d837-4c32-9ddf-7cacb798b7dc tempest-ProjectMemberTests-718446646 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 14:06:05 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-7d7cad61-d837-4c32-9ddf-7cacb798b7dc tempest-ProjectMemberTests-718446646 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T12:06:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2134904064',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0379c954-2d67-4627-a680-8e5abfebacdc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2bb0e12a2763448b9d28151e1e814854',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T12:06:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T12:06:06Z,use_quota=True,user_id='2d16431e25f348deb700350f5b150c69',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1147de8b-623b-426c-a13d-7fc824a80f67),volume_type_id=1147de8b-623b-426c-a13d-7fc824a80f67)}" {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 13 14:06:05 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-7d7cad61-d837-4c32-9ddf-7cacb798b7dc tempest-ProjectMemberTests-718446646 None] Creating volume 0379c954-2d67-4627-a680-8e5abfebacdc {{(pid=87098) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 13 14:06:05 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-7d7cad61-d837-4c32-9ddf-7cacb798b7dc tempest-ProjectMemberTests-718446646 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 14:06:05 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-7d7cad61-d837-4c32-9ddf-7cacb798b7dc tempest-ProjectMemberTests-718446646 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 14:06:05 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-7d7cad61-d837-4c32-9ddf-7cacb798b7dc tempest-ProjectMemberTests-718446646 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 14:06:05 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-7d7cad61-d837-4c32-9ddf-7cacb798b7dc tempest-ProjectMemberTests-718446646 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 14:06:05 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-7d7cad61-d837-4c32-9ddf-7cacb798b7dc tempest-ProjectMemberTests-718446646 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 14:06:05 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-7d7cad61-d837-4c32-9ddf-7cacb798b7dc tempest-ProjectMemberTests-718446646 None] Selected osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 14:06:05 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-7d7cad61-d837-4c32-9ddf-7cacb798b7dc tempest-ProjectMemberTests-718446646 None] casted to osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 Jul 13 14:06:05 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-7d7cad61-d837-4c32-9ddf-7cacb798b7dc tempest-ProjectMemberTests-718446646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-0379c954-2d67-4627-a680-8e5abfebacdc 1073741824 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:06:05 devstack sudo[105145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-0379c954-2d67-4627-a680-8e5abfebacdc 1073741824 Jul 13 14:06:05 devstack sudo[105145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:06:06 devstack sudo[105143]: pam_unix(sudo:session): session closed for user root Jul 13 14:06:06 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-88bb797d-f6c1-4546-9f53-222688d573a0 tempest-CinderUnicodeTest-1494774103 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-969f9aaf-f074-4eca-9037-13743895cadf" returned: 0 in 0.474s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:06:06 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-88bb797d-f6c1-4546-9f53-222688d573a0 tempest-CinderUnicodeTest-1494774103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-969f9aaf-f074-4eca-9037-13743895cadf {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:06:06 devstack sudo[105150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-969f9aaf-f074-4eca-9037-13743895cadf Jul 13 14:06:06 devstack sudo[105150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:06:06 devstack sudo[105145]: pam_unix(sudo:session): session closed for user root Jul 13 14:06:06 devstack sudo[105150]: pam_unix(sudo:session): session closed for user root Jul 13 14:06:06 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-7d7cad61-d837-4c32-9ddf-7cacb798b7dc tempest-ProjectMemberTests-718446646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-0379c954-2d67-4627-a680-8e5abfebacdc 1073741824" returned: 0 in 0.639s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:06:06 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-88bb797d-f6c1-4546-9f53-222688d573a0 tempest-CinderUnicodeTest-1494774103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-969f9aaf-f074-4eca-9037-13743895cadf" returned: 0 in 0.410s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:06:06 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-88bb797d-f6c1-4546-9f53-222688d573a0 tempest-CinderUnicodeTest-1494774103 None] Lock "cinder-quobyte-969f9aaf-f074-4eca-9037-13743895cadf" released by "delete_volume" :: held 0.982s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 14:06:06 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-7d7cad61-d837-4c32-9ddf-7cacb798b7dc tempest-ProjectMemberTests-718446646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-0379c954-2d67-4627-a680-8e5abfebacdc {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:06:06 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-88bb797d-f6c1-4546-9f53-222688d573a0 tempest-CinderUnicodeTest-1494774103 None] Created reservations ['009d0542-fb67-4e1b-ab77-ee522cdcee6a', '2a0ae102-6fac-48d7-ae0b-d0d39acbcee1', '9d90441d-15e9-4dda-baab-e4a6f6d62254', '82b495a4-d451-4c5e-9b20-dbec50bd66b8'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 14:06:06 devstack sudo[105156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-0379c954-2d67-4627-a680-8e5abfebacdc Jul 13 14:06:06 devstack sudo[105156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:06:06 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-88bb797d-f6c1-4546-9f53-222688d573a0 tempest-CinderUnicodeTest-1494774103 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 14:06:06 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-88bb797d-f6c1-4546-9f53-222688d573a0 tempest-CinderUnicodeTest-1494774103 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 14:06:06 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-88bb797d-f6c1-4546-9f53-222688d573a0 tempest-CinderUnicodeTest-1494774103 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 14:06:06 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-88bb797d-f6c1-4546-9f53-222688d573a0 tempest-CinderUnicodeTest-1494774103 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 14:06:06 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-88bb797d-f6c1-4546-9f53-222688d573a0 tempest-CinderUnicodeTest-1494774103 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 14:06:06 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-88bb797d-f6c1-4546-9f53-222688d573a0 tempest-CinderUnicodeTest-1494774103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:06:06 devstack sudo[105158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 Jul 13 14:06:06 devstack sudo[105158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:06:06 devstack sudo[105156]: pam_unix(sudo:session): session closed for user root Jul 13 14:06:06 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-7d7cad61-d837-4c32-9ddf-7cacb798b7dc tempest-ProjectMemberTests-718446646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-0379c954-2d67-4627-a680-8e5abfebacdc" returned: 0 in 0.325s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:06:06 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-7d7cad61-d837-4c32-9ddf-7cacb798b7dc tempest-ProjectMemberTests-718446646 None] <== create_volume: return (1070ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'} {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 13 14:06:06 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-7d7cad61-d837-4c32-9ddf-7cacb798b7dc tempest-ProjectMemberTests-718446646 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.072s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 14:06:06 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-7d7cad61-d837-4c32-9ddf-7cacb798b7dc tempest-ProjectMemberTests-718446646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a8fe5e2-1d70-4f55-841a-fbdad757f6c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0379c954-2d67-4627-a680-8e5abfebacdc', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:06:06 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-7d7cad61-d837-4c32-9ddf-7cacb798b7dc tempest-ProjectMemberTests-718446646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (969b7753-5306-41c8-9ffb-750042c656a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:06:06 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-7d7cad61-d837-4c32-9ddf-7cacb798b7dc tempest-ProjectMemberTests-718446646 None] Volume volume-0379c954-2d67-4627-a680-8e5abfebacdc (0379c954-2d67-4627-a680-8e5abfebacdc): created successfully Jul 13 14:06:06 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-7d7cad61-d837-4c32-9ddf-7cacb798b7dc tempest-ProjectMemberTests-718446646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (969b7753-5306-41c8-9ffb-750042c656a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:06:06 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-7d7cad61-d837-4c32-9ddf-7cacb798b7dc tempest-ProjectMemberTests-718446646 None] Flow 'volume_create_manager' (1c414a51-c8b5-4071-aed7-483e3e6b839f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 14:06:07 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-7d7cad61-d837-4c32-9ddf-7cacb798b7dc tempest-ProjectMemberTests-718446646 None] Created volume successfully. Jul 13 14:06:07 devstack sudo[105158]: pam_unix(sudo:session): session closed for user root Jul 13 14:06:07 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-88bb797d-f6c1-4546-9f53-222688d573a0 tempest-CinderUnicodeTest-1494774103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78" returned: 0 in 0.312s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:06:07 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-88bb797d-f6c1-4546-9f53-222688d573a0 tempest-CinderUnicodeTest-1494774103 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 14:06:07 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-88bb797d-f6c1-4546-9f53-222688d573a0 tempest-CinderUnicodeTest-1494774103 None] Deleted volume successfully. Jul 13 14:06:07 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-88bb797d-f6c1-4546-9f53-222688d573a0 tempest-CinderUnicodeTest-1494774103 None] Lock "cinder-969f9aaf-f074-4eca-9037-13743895cadf-delete_volume" released by "delete_volume" :: held 1.630s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 14:06:07 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-fbb96c9c-2b1f-4351-9fe9-496b8acdd40d tempest-CinderUnicodeTest-1494774103 None] Acquiring lock "cinder-c1f435ab-e6a6-4888-ad38-fa0f3a94c2a9-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 14:06:07 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-fbb96c9c-2b1f-4351-9fe9-496b8acdd40d tempest-CinderUnicodeTest-1494774103 None] Lock "cinder-c1f435ab-e6a6-4888-ad38-fa0f3a94c2a9-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 14:06:07 devstack cinder-volume[87098]: DEBUG dbcounter [-] [87098] Writing DB stats cinder:SELECT=190,cinder:UPDATE=301,cinder:INSERT=79,cinder:DELETE=19 {{(pid=87098) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 13 14:06:07 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-fbb96c9c-2b1f-4351-9fe9-496b8acdd40d tempest-CinderUnicodeTest-1494774103 None] Acquiring lock "cinder-quobyte-c1f435ab-e6a6-4888-ad38-fa0f3a94c2a9" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 14:06:07 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-fbb96c9c-2b1f-4351-9fe9-496b8acdd40d tempest-CinderUnicodeTest-1494774103 None] Lock "cinder-quobyte-c1f435ab-e6a6-4888-ad38-fa0f3a94c2a9" acquired by "delete_volume" :: waited 0.028s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 14:06:07 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[89aa50de-b6f1-4bb6-8f2b-203ff9302fa8]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 14:06:07 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-fbb96c9c-2b1f-4351-9fe9-496b8acdd40d tempest-CinderUnicodeTest-1494774103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-c1f435ab-e6a6-4888-ad38-fa0f3a94c2a9 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:06:08 devstack sudo[105163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-c1f435ab-e6a6-4888-ad38-fa0f3a94c2a9 Jul 13 14:06:08 devstack sudo[105163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:06:08 devstack cinder-volume[87098]: DEBUG dbcounter [-] [87098] Writing DB stats cinder:SELECT=208,cinder:UPDATE=243,cinder:DELETE=30,cinder:INSERT=66 {{(pid=87098) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 13 14:06:08 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-c83af498-ef11-498d-8368-74a95854ac66 tempest-ProjectMemberTests-718446646 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 14:06:08 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-c83af498-ef11-498d-8368-74a95854ac66 tempest-ProjectMemberTests-718446646 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 14:06:08 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-c83af498-ef11-498d-8368-74a95854ac66 tempest-ProjectMemberTests-718446646 None] Creating offline snapshot 08443452-5f83-490c-b216-20b8f2e81132 of volume 0379c954-2d67-4627-a680-8e5abfebacdc {{(pid=87098) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 13 14:06:08 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[95bf9c77-8d1e-4fd5-b7c5-c1588b9d0be6]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 14:06:08 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-c83af498-ef11-498d-8368-74a95854ac66 tempest-ProjectMemberTests-718446646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-0379c954-2d67-4627-a680-8e5abfebacdc {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:06:08 devstack sudo[105163]: pam_unix(sudo:session): session closed for user root Jul 13 14:06:08 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-fbb96c9c-2b1f-4351-9fe9-496b8acdd40d tempest-CinderUnicodeTest-1494774103 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-c1f435ab-e6a6-4888-ad38-fa0f3a94c2a9" returned: 0 in 0.552s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:06:08 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-fbb96c9c-2b1f-4351-9fe9-496b8acdd40d tempest-CinderUnicodeTest-1494774103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-c1f435ab-e6a6-4888-ad38-fa0f3a94c2a9 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:06:08 devstack sudo[105169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-c1f435ab-e6a6-4888-ad38-fa0f3a94c2a9 Jul 13 14:06:08 devstack sudo[105169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:06:08 devstack sudo[105168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-0379c954-2d67-4627-a680-8e5abfebacdc Jul 13 14:06:08 devstack sudo[105168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:06:08 devstack sudo[105169]: pam_unix(sudo:session): session closed for user root Jul 13 14:06:08 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-fbb96c9c-2b1f-4351-9fe9-496b8acdd40d tempest-CinderUnicodeTest-1494774103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-c1f435ab-e6a6-4888-ad38-fa0f3a94c2a9" returned: 0 in 0.316s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:06:08 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-fbb96c9c-2b1f-4351-9fe9-496b8acdd40d tempest-CinderUnicodeTest-1494774103 None] Lock "cinder-quobyte-c1f435ab-e6a6-4888-ad38-fa0f3a94c2a9" released by "delete_volume" :: held 0.926s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 14:06:08 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-fbb96c9c-2b1f-4351-9fe9-496b8acdd40d tempest-CinderUnicodeTest-1494774103 None] Created reservations ['f9d3af59-f9ae-4afc-a29f-81bb3d04fbb8', '30ed6a40-a8b4-4e77-ac13-61cecbba479b', 'a6564f0d-248a-4a30-b1ce-e105c5951544', 'ca9a3f95-390b-4a36-912d-fc6a9ba26aa8'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 14:06:08 devstack sudo[105168]: pam_unix(sudo:session): session closed for user root Jul 13 14:06:09 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-c83af498-ef11-498d-8368-74a95854ac66 tempest-ProjectMemberTests-718446646 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-0379c954-2d67-4627-a680-8e5abfebacdc" returned: 0 in 0.544s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:06:09 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-c83af498-ef11-498d-8368-74a95854ac66 tempest-ProjectMemberTests-718446646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-0379c954-2d67-4627-a680-8e5abfebacdc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-0379c954-2d67-4627-a680-8e5abfebacdc.08443452-5f83-490c-b216-20b8f2e81132 1G {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:06:09 devstack sudo[105176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-0379c954-2d67-4627-a680-8e5abfebacdc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-0379c954-2d67-4627-a680-8e5abfebacdc.08443452-5f83-490c-b216-20b8f2e81132 1G Jul 13 14:06:09 devstack sudo[105176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:06:09 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-fbb96c9c-2b1f-4351-9fe9-496b8acdd40d tempest-CinderUnicodeTest-1494774103 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 14:06:09 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-fbb96c9c-2b1f-4351-9fe9-496b8acdd40d tempest-CinderUnicodeTest-1494774103 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 14:06:09 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-fbb96c9c-2b1f-4351-9fe9-496b8acdd40d tempest-CinderUnicodeTest-1494774103 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 14:06:09 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-fbb96c9c-2b1f-4351-9fe9-496b8acdd40d tempest-CinderUnicodeTest-1494774103 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 14:06:09 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-fbb96c9c-2b1f-4351-9fe9-496b8acdd40d tempest-CinderUnicodeTest-1494774103 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 14:06:09 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-fbb96c9c-2b1f-4351-9fe9-496b8acdd40d tempest-CinderUnicodeTest-1494774103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:06:09 devstack sudo[105178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 Jul 13 14:06:09 devstack sudo[105178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:06:09 devstack sudo[105178]: pam_unix(sudo:session): session closed for user root Jul 13 14:06:09 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-fbb96c9c-2b1f-4351-9fe9-496b8acdd40d tempest-CinderUnicodeTest-1494774103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78" returned: 0 in 0.401s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:06:09 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-fbb96c9c-2b1f-4351-9fe9-496b8acdd40d tempest-CinderUnicodeTest-1494774103 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 14:06:09 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-fbb96c9c-2b1f-4351-9fe9-496b8acdd40d tempest-CinderUnicodeTest-1494774103 None] Deleted volume successfully. Jul 13 14:06:09 devstack sudo[105176]: pam_unix(sudo:session): session closed for user root Jul 13 14:06:09 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-fbb96c9c-2b1f-4351-9fe9-496b8acdd40d tempest-CinderUnicodeTest-1494774103 None] Lock "cinder-c1f435ab-e6a6-4888-ad38-fa0f3a94c2a9-delete_volume" released by "delete_volume" :: held 1.711s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 14:06:09 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-c83af498-ef11-498d-8368-74a95854ac66 tempest-ProjectMemberTests-718446646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-0379c954-2d67-4627-a680-8e5abfebacdc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-0379c954-2d67-4627-a680-8e5abfebacdc.08443452-5f83-490c-b216-20b8f2e81132 1G" returned: 0 in 0.540s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:06:09 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-c83af498-ef11-498d-8368-74a95854ac66 tempest-ProjectMemberTests-718446646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0379c954-2d67-4627-a680-8e5abfebacdc -F qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-0379c954-2d67-4627-a680-8e5abfebacdc.08443452-5f83-490c-b216-20b8f2e81132 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:06:09 devstack sudo[105188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0379c954-2d67-4627-a680-8e5abfebacdc -F qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-0379c954-2d67-4627-a680-8e5abfebacdc.08443452-5f83-490c-b216-20b8f2e81132 Jul 13 14:06:09 devstack sudo[105188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:06:09 devstack sudo[105188]: pam_unix(sudo:session): session closed for user root Jul 13 14:06:09 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-c83af498-ef11-498d-8368-74a95854ac66 tempest-ProjectMemberTests-718446646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0379c954-2d67-4627-a680-8e5abfebacdc -F qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-0379c954-2d67-4627-a680-8e5abfebacdc.08443452-5f83-490c-b216-20b8f2e81132" returned: 0 in 0.323s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:06:09 devstack cinder-volume[87098]: WARNING cinder.volume.drivers.remotefs [None req-c83af498-ef11-498d-8368-74a95854ac66 tempest-ProjectMemberTests-718446646 None] /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-0379c954-2d67-4627-a680-8e5abfebacdc.08443452-5f83-490c-b216-20b8f2e81132 is being set with open permissions: ugo+rw Jul 13 14:06:09 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-c83af498-ef11-498d-8368-74a95854ac66 tempest-ProjectMemberTests-718446646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-0379c954-2d67-4627-a680-8e5abfebacdc.08443452-5f83-490c-b216-20b8f2e81132 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:06:09 devstack sudo[105193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-0379c954-2d67-4627-a680-8e5abfebacdc.08443452-5f83-490c-b216-20b8f2e81132 Jul 13 14:06:09 devstack sudo[105193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:06:10 devstack sudo[105193]: pam_unix(sudo:session): session closed for user root Jul 13 14:06:10 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-c83af498-ef11-498d-8368-74a95854ac66 tempest-ProjectMemberTests-718446646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-0379c954-2d67-4627-a680-8e5abfebacdc.08443452-5f83-490c-b216-20b8f2e81132" returned: 0 in 0.308s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:06:10 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-c83af498-ef11-498d-8368-74a95854ac66 tempest-ProjectMemberTests-718446646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-0379c954-2d67-4627-a680-8e5abfebacdc.info {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:06:10 devstack sudo[105196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-0379c954-2d67-4627-a680-8e5abfebacdc.info Jul 13 14:06:10 devstack sudo[105196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:06:10 devstack sudo[105196]: pam_unix(sudo:session): session closed for user root Jul 13 14:06:10 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-c83af498-ef11-498d-8368-74a95854ac66 tempest-ProjectMemberTests-718446646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-0379c954-2d67-4627-a680-8e5abfebacdc.info" returned: 0 in 0.372s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:06:10 devstack cinder-volume[87098]: WARNING cinder.volume.drivers.remotefs [None req-c83af498-ef11-498d-8368-74a95854ac66 tempest-ProjectMemberTests-718446646 None] /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-0379c954-2d67-4627-a680-8e5abfebacdc.info is being set with open permissions: ugo+rw Jul 13 14:06:10 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-c83af498-ef11-498d-8368-74a95854ac66 tempest-ProjectMemberTests-718446646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-0379c954-2d67-4627-a680-8e5abfebacdc.info {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:06:10 devstack sudo[105199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-0379c954-2d67-4627-a680-8e5abfebacdc.info Jul 13 14:06:10 devstack sudo[105199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:06:10 devstack sudo[105199]: pam_unix(sudo:session): session closed for user root Jul 13 14:06:10 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-c83af498-ef11-498d-8368-74a95854ac66 tempest-ProjectMemberTests-718446646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-0379c954-2d67-4627-a680-8e5abfebacdc.info" returned: 0 in 0.344s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:06:10 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-c83af498-ef11-498d-8368-74a95854ac66 tempest-ProjectMemberTests-718446646 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.561s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 14:06:11 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-c83af498-ef11-498d-8368-74a95854ac66 tempest-ProjectMemberTests-718446646 None] Create snapshot completed successfully Jul 13 14:06:11 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-a7e1478a-9745-477e-9892-5f8ef2e846e4 tempest-ProjectMemberTests-718446646 None] Acquiring lock "cinder-08443452-5f83-490c-b216-20b8f2e81132-delete_snapshot" by "delete_snapshot" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 14:06:11 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-a7e1478a-9745-477e-9892-5f8ef2e846e4 tempest-ProjectMemberTests-718446646 None] Lock "cinder-08443452-5f83-490c-b216-20b8f2e81132-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 14:06:11 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-a7e1478a-9745-477e-9892-5f8ef2e846e4 tempest-ProjectMemberTests-718446646 None] Acquiring lock "cinder-quobyte-0379c954-2d67-4627-a680-8e5abfebacdc" by "delete_snapshot" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 14:06:11 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-a7e1478a-9745-477e-9892-5f8ef2e846e4 tempest-ProjectMemberTests-718446646 None] Lock "cinder-quobyte-0379c954-2d67-4627-a680-8e5abfebacdc" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 14:06:11 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-a7e1478a-9745-477e-9892-5f8ef2e846e4 tempest-ProjectMemberTests-718446646 None] Acquiring lock "cinder-quobyte-08443452-5f83-490c-b216-20b8f2e81132" by "_delete_snapshot" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 14:06:11 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-a7e1478a-9745-477e-9892-5f8ef2e846e4 tempest-ProjectMemberTests-718446646 None] Lock "cinder-quobyte-08443452-5f83-490c-b216-20b8f2e81132" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 14:06:11 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-a7e1478a-9745-477e-9892-5f8ef2e846e4 tempest-ProjectMemberTests-718446646 None] Deleting offline snapshot 08443452-5f83-490c-b216-20b8f2e81132 of volume 0379c954-2d67-4627-a680-8e5abfebacdc {{(pid=87098) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 13 14:06:11 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-a7e1478a-9745-477e-9892-5f8ef2e846e4 tempest-ProjectMemberTests-718446646 None] snapshot_file for this snap is: volume-0379c954-2d67-4627-a680-8e5abfebacdc.08443452-5f83-490c-b216-20b8f2e81132 {{(pid=87098) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 13 14:06:11 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ec28722-dc3d-4b5d-b388-61230ce69878]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 14:06:11 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-a7e1478a-9745-477e-9892-5f8ef2e846e4 tempest-ProjectMemberTests-718446646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-0379c954-2d67-4627-a680-8e5abfebacdc.08443452-5f83-490c-b216-20b8f2e81132 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:06:11 devstack sudo[105202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-0379c954-2d67-4627-a680-8e5abfebacdc.08443452-5f83-490c-b216-20b8f2e81132 Jul 13 14:06:11 devstack sudo[105202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:06:12 devstack sudo[105202]: pam_unix(sudo:session): session closed for user root Jul 13 14:06:12 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-a7e1478a-9745-477e-9892-5f8ef2e846e4 tempest-ProjectMemberTests-718446646 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-0379c954-2d67-4627-a680-8e5abfebacdc.08443452-5f83-490c-b216-20b8f2e81132" returned: 0 in 0.547s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:06:12 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-a7e1478a-9745-477e-9892-5f8ef2e846e4 tempest-ProjectMemberTests-718446646 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0379c954-2d67-4627-a680-8e5abfebacdc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87098) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 13 14:06:12 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c702c84-61a1-4c3c-8ab3-aa42bcd8201d]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 14:06:12 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-a7e1478a-9745-477e-9892-5f8ef2e846e4 tempest-ProjectMemberTests-718446646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-0379c954-2d67-4627-a680-8e5abfebacdc {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:06:12 devstack sudo[105208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-0379c954-2d67-4627-a680-8e5abfebacdc Jul 13 14:06:12 devstack sudo[105208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:06:12 devstack sudo[105208]: pam_unix(sudo:session): session closed for user root Jul 13 14:06:12 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-a7e1478a-9745-477e-9892-5f8ef2e846e4 tempest-ProjectMemberTests-718446646 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-0379c954-2d67-4627-a680-8e5abfebacdc" returned: 0 in 0.397s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:06:12 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-a7e1478a-9745-477e-9892-5f8ef2e846e4 tempest-ProjectMemberTests-718446646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-0379c954-2d67-4627-a680-8e5abfebacdc.08443452-5f83-490c-b216-20b8f2e81132 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:06:12 devstack sudo[105213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-0379c954-2d67-4627-a680-8e5abfebacdc.08443452-5f83-490c-b216-20b8f2e81132 Jul 13 14:06:12 devstack sudo[105213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:06:13 devstack sudo[105213]: pam_unix(sudo:session): session closed for user root Jul 13 14:06:13 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-a7e1478a-9745-477e-9892-5f8ef2e846e4 tempest-ProjectMemberTests-718446646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-0379c954-2d67-4627-a680-8e5abfebacdc.08443452-5f83-490c-b216-20b8f2e81132" returned: 0 in 0.397s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:06:13 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-a7e1478a-9745-477e-9892-5f8ef2e846e4 tempest-ProjectMemberTests-718446646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-0379c954-2d67-4627-a680-8e5abfebacdc.08443452-5f83-490c-b216-20b8f2e81132 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:06:13 devstack sudo[105218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-0379c954-2d67-4627-a680-8e5abfebacdc.08443452-5f83-490c-b216-20b8f2e81132 Jul 13 14:06:13 devstack sudo[105218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:06:13 devstack sudo[105218]: pam_unix(sudo:session): session closed for user root Jul 13 14:06:13 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-a7e1478a-9745-477e-9892-5f8ef2e846e4 tempest-ProjectMemberTests-718446646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-0379c954-2d67-4627-a680-8e5abfebacdc.08443452-5f83-490c-b216-20b8f2e81132" returned: 0 in 0.292s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:06:13 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-a7e1478a-9745-477e-9892-5f8ef2e846e4 tempest-ProjectMemberTests-718446646 None] Lock "cinder-quobyte-08443452-5f83-490c-b216-20b8f2e81132" released by "_delete_snapshot" :: held 1.792s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 14:06:13 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-a7e1478a-9745-477e-9892-5f8ef2e846e4 tempest-ProjectMemberTests-718446646 None] Lock "cinder-quobyte-0379c954-2d67-4627-a680-8e5abfebacdc" released by "delete_snapshot" :: held 1.836s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 14:06:13 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-a7e1478a-9745-477e-9892-5f8ef2e846e4 tempest-ProjectMemberTests-718446646 None] Created reservations ['78db1e1b-8963-4776-8fd4-236daa860940', '1c34a247-da5e-4c8f-8bc2-4dc099010c96', '5f80e8b7-d231-44c0-94e0-49d58bebb4ad', '3942f007-2350-4b84-b0c0-47475099c1e0'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 14:06:13 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-a7e1478a-9745-477e-9892-5f8ef2e846e4 tempest-ProjectMemberTests-718446646 None] Delete snapshot completed successfully. Jul 13 14:06:13 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-a7e1478a-9745-477e-9892-5f8ef2e846e4 tempest-ProjectMemberTests-718446646 None] Lock "cinder-08443452-5f83-490c-b216-20b8f2e81132-delete_snapshot" released by "delete_snapshot" :: held 2.025s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 14:06:13 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-f1a05806-c1aa-4679-966d-195e2ac56646 tempest-ProjectMemberTests-718446646 None] Acquiring lock "cinder-0379c954-2d67-4627-a680-8e5abfebacdc-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 14:06:13 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-f1a05806-c1aa-4679-966d-195e2ac56646 tempest-ProjectMemberTests-718446646 None] Lock "cinder-0379c954-2d67-4627-a680-8e5abfebacdc-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 14:06:13 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-f1a05806-c1aa-4679-966d-195e2ac56646 tempest-ProjectMemberTests-718446646 None] Acquiring lock "cinder-quobyte-0379c954-2d67-4627-a680-8e5abfebacdc" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 14:06:13 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-f1a05806-c1aa-4679-966d-195e2ac56646 tempest-ProjectMemberTests-718446646 None] Lock "cinder-quobyte-0379c954-2d67-4627-a680-8e5abfebacdc" acquired by "delete_volume" :: waited 0.019s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 14:06:14 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[7eedf530-29ce-4636-9d62-7272758ec7a6]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 14:06:14 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-f1a05806-c1aa-4679-966d-195e2ac56646 tempest-ProjectMemberTests-718446646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-0379c954-2d67-4627-a680-8e5abfebacdc {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:06:14 devstack sudo[105221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-0379c954-2d67-4627-a680-8e5abfebacdc Jul 13 14:06:14 devstack sudo[105221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:06:14 devstack sudo[105221]: pam_unix(sudo:session): session closed for user root Jul 13 14:06:14 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-f1a05806-c1aa-4679-966d-195e2ac56646 tempest-ProjectMemberTests-718446646 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-0379c954-2d67-4627-a680-8e5abfebacdc" returned: 0 in 0.490s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:06:14 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-f1a05806-c1aa-4679-966d-195e2ac56646 tempest-ProjectMemberTests-718446646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-0379c954-2d67-4627-a680-8e5abfebacdc {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:06:14 devstack sudo[105226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-0379c954-2d67-4627-a680-8e5abfebacdc Jul 13 14:06:14 devstack sudo[105226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:06:14 devstack sudo[105226]: pam_unix(sudo:session): session closed for user root Jul 13 14:06:14 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-f1a05806-c1aa-4679-966d-195e2ac56646 tempest-ProjectMemberTests-718446646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-0379c954-2d67-4627-a680-8e5abfebacdc" returned: 0 in 0.256s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:06:14 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-f1a05806-c1aa-4679-966d-195e2ac56646 tempest-ProjectMemberTests-718446646 None] Lock "cinder-quobyte-0379c954-2d67-4627-a680-8e5abfebacdc" released by "delete_volume" :: held 0.829s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 14:06:14 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-f1a05806-c1aa-4679-966d-195e2ac56646 tempest-ProjectMemberTests-718446646 None] Created reservations ['89330f59-2a45-4b72-8b53-6aff00df83cb', '4301a4a7-6492-497c-936f-fe02b93cd1fa', 'c96cabce-85b3-4d48-b286-1b45fd58e426', '04703610-e254-4bfa-b65a-d4a1b114e857'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 14:06:14 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-f1a05806-c1aa-4679-966d-195e2ac56646 tempest-ProjectMemberTests-718446646 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 14:06:14 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-f1a05806-c1aa-4679-966d-195e2ac56646 tempest-ProjectMemberTests-718446646 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 14:06:14 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-f1a05806-c1aa-4679-966d-195e2ac56646 tempest-ProjectMemberTests-718446646 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 14:06:14 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-f1a05806-c1aa-4679-966d-195e2ac56646 tempest-ProjectMemberTests-718446646 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 14:06:14 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-f1a05806-c1aa-4679-966d-195e2ac56646 tempest-ProjectMemberTests-718446646 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 14:06:14 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-f1a05806-c1aa-4679-966d-195e2ac56646 tempest-ProjectMemberTests-718446646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:06:14 devstack sudo[105229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 Jul 13 14:06:14 devstack sudo[105229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:06:15 devstack sudo[105229]: pam_unix(sudo:session): session closed for user root Jul 13 14:06:15 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-f1a05806-c1aa-4679-966d-195e2ac56646 tempest-ProjectMemberTests-718446646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78" returned: 0 in 0.285s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:06:15 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-f1a05806-c1aa-4679-966d-195e2ac56646 tempest-ProjectMemberTests-718446646 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 14:06:15 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-f1a05806-c1aa-4679-966d-195e2ac56646 tempest-ProjectMemberTests-718446646 None] Deleted volume successfully. Jul 13 14:06:15 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-f1a05806-c1aa-4679-966d-195e2ac56646 tempest-ProjectMemberTests-718446646 None] Lock "cinder-0379c954-2d67-4627-a680-8e5abfebacdc-delete_volume" released by "delete_volume" :: held 1.357s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 14:06:15 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-b3732e20-93e5-49dc-90a0-9f09567e46e4 tempest-ProjectMemberTests-718446646 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 14:06:15 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-b3732e20-93e5-49dc-90a0-9f09567e46e4 tempest-ProjectMemberTests-718446646 None] Flow 'volume_create_manager' (61bbaaa3-0e2c-4a82-bf4b-7e8734b35596) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 14:06:15 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-b3732e20-93e5-49dc-90a0-9f09567e46e4 tempest-ProjectMemberTests-718446646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ef8729b-5398-4345-bfc2-99ad99342b49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:06:15 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-b3732e20-93e5-49dc-90a0-9f09567e46e4 tempest-ProjectMemberTests-718446646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ef8729b-5398-4345-bfc2-99ad99342b49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T12:06:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-224847606',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a32eccbd-45c7-4b4c-8314-03d9a8ef31af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2bb0e12a2763448b9d28151e1e814854',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T12:06:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T12:06:16Z,use_quota=True,user_id='2d16431e25f348deb700350f5b150c69',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1147de8b-623b-426c-a13d-7fc824a80f67),volume_type_id=1147de8b-623b-426c-a13d-7fc824a80f67)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:06:15 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-b3732e20-93e5-49dc-90a0-9f09567e46e4 tempest-ProjectMemberTests-718446646 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32f30b40-bb05-4826-b9e2-2c5ac82e5884) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:06:15 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-b3732e20-93e5-49dc-90a0-9f09567e46e4 tempest-ProjectMemberTests-718446646 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32f30b40-bb05-4826-b9e2-2c5ac82e5884) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:06:15 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-b3732e20-93e5-49dc-90a0-9f09567e46e4 tempest-ProjectMemberTests-718446646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa11a0cd-f0b9-4f54-a779-966ca22b63a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:06:15 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-b3732e20-93e5-49dc-90a0-9f09567e46e4 tempest-ProjectMemberTests-718446646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa11a0cd-f0b9-4f54-a779-966ca22b63a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a32eccbd-45c7-4b4c-8314-03d9a8ef31af', 'volume_name': 'volume-a32eccbd-45c7-4b4c-8314-03d9a8ef31af', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:06:15 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-b3732e20-93e5-49dc-90a0-9f09567e46e4 tempest-ProjectMemberTests-718446646 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3886d8a-22a1-4380-9aa9-8a7018b93893) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:06:15 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-b3732e20-93e5-49dc-90a0-9f09567e46e4 tempest-ProjectMemberTests-718446646 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3886d8a-22a1-4380-9aa9-8a7018b93893) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:06:15 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-b3732e20-93e5-49dc-90a0-9f09567e46e4 tempest-ProjectMemberTests-718446646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b48c50d-c182-486e-aa61-788b08a22d73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:06:15 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-b3732e20-93e5-49dc-90a0-9f09567e46e4 tempest-ProjectMemberTests-718446646 None] Volume a32eccbd-45c7-4b4c-8314-03d9a8ef31af: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a32eccbd-45c7-4b4c-8314-03d9a8ef31af', 'volume_size': 1} Jul 13 14:06:15 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-b3732e20-93e5-49dc-90a0-9f09567e46e4 tempest-ProjectMemberTests-718446646 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 14:06:15 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-b3732e20-93e5-49dc-90a0-9f09567e46e4 tempest-ProjectMemberTests-718446646 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 14:06:15 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-b3732e20-93e5-49dc-90a0-9f09567e46e4 tempest-ProjectMemberTests-718446646 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T12:06:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-224847606',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a32eccbd-45c7-4b4c-8314-03d9a8ef31af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2bb0e12a2763448b9d28151e1e814854',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T12:06:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T12:06:16Z,use_quota=True,user_id='2d16431e25f348deb700350f5b150c69',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1147de8b-623b-426c-a13d-7fc824a80f67),volume_type_id=1147de8b-623b-426c-a13d-7fc824a80f67)}" {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 13 14:06:15 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-b3732e20-93e5-49dc-90a0-9f09567e46e4 tempest-ProjectMemberTests-718446646 None] Creating volume a32eccbd-45c7-4b4c-8314-03d9a8ef31af {{(pid=87098) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 13 14:06:15 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-b3732e20-93e5-49dc-90a0-9f09567e46e4 tempest-ProjectMemberTests-718446646 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 14:06:15 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-b3732e20-93e5-49dc-90a0-9f09567e46e4 tempest-ProjectMemberTests-718446646 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 14:06:15 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-b3732e20-93e5-49dc-90a0-9f09567e46e4 tempest-ProjectMemberTests-718446646 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 14:06:15 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-b3732e20-93e5-49dc-90a0-9f09567e46e4 tempest-ProjectMemberTests-718446646 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 14:06:15 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-b3732e20-93e5-49dc-90a0-9f09567e46e4 tempest-ProjectMemberTests-718446646 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 14:06:15 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-b3732e20-93e5-49dc-90a0-9f09567e46e4 tempest-ProjectMemberTests-718446646 None] Selected osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 14:06:15 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-b3732e20-93e5-49dc-90a0-9f09567e46e4 tempest-ProjectMemberTests-718446646 None] casted to osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 Jul 13 14:06:15 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-b3732e20-93e5-49dc-90a0-9f09567e46e4 tempest-ProjectMemberTests-718446646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-a32eccbd-45c7-4b4c-8314-03d9a8ef31af 1073741824 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:06:15 devstack sudo[105269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-a32eccbd-45c7-4b4c-8314-03d9a8ef31af 1073741824 Jul 13 14:06:15 devstack sudo[105269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:06:16 devstack sudo[105269]: pam_unix(sudo:session): session closed for user root Jul 13 14:06:16 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-b3732e20-93e5-49dc-90a0-9f09567e46e4 tempest-ProjectMemberTests-718446646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-a32eccbd-45c7-4b4c-8314-03d9a8ef31af 1073741824" returned: 0 in 0.751s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:06:16 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-b3732e20-93e5-49dc-90a0-9f09567e46e4 tempest-ProjectMemberTests-718446646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-a32eccbd-45c7-4b4c-8314-03d9a8ef31af {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:06:16 devstack sudo[105275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-a32eccbd-45c7-4b4c-8314-03d9a8ef31af Jul 13 14:06:16 devstack sudo[105275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:06:16 devstack sudo[105275]: pam_unix(sudo:session): session closed for user root Jul 13 14:06:16 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-b3732e20-93e5-49dc-90a0-9f09567e46e4 tempest-ProjectMemberTests-718446646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-a32eccbd-45c7-4b4c-8314-03d9a8ef31af" returned: 0 in 0.361s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:06:16 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-b3732e20-93e5-49dc-90a0-9f09567e46e4 tempest-ProjectMemberTests-718446646 None] <== create_volume: return (1176ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'} {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 13 14:06:16 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-b3732e20-93e5-49dc-90a0-9f09567e46e4 tempest-ProjectMemberTests-718446646 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.181s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 14:06:17 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-b3732e20-93e5-49dc-90a0-9f09567e46e4 tempest-ProjectMemberTests-718446646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b48c50d-c182-486e-aa61-788b08a22d73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a32eccbd-45c7-4b4c-8314-03d9a8ef31af', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:06:17 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-b3732e20-93e5-49dc-90a0-9f09567e46e4 tempest-ProjectMemberTests-718446646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d1712f2-3ea0-4701-97c4-ddf4991ad2e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:06:17 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-b3732e20-93e5-49dc-90a0-9f09567e46e4 tempest-ProjectMemberTests-718446646 None] Volume volume-a32eccbd-45c7-4b4c-8314-03d9a8ef31af (a32eccbd-45c7-4b4c-8314-03d9a8ef31af): created successfully Jul 13 14:06:17 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-b3732e20-93e5-49dc-90a0-9f09567e46e4 tempest-ProjectMemberTests-718446646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d1712f2-3ea0-4701-97c4-ddf4991ad2e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:06:17 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-b3732e20-93e5-49dc-90a0-9f09567e46e4 tempest-ProjectMemberTests-718446646 None] Flow 'volume_create_manager' (61bbaaa3-0e2c-4a82-bf4b-7e8734b35596) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 14:06:17 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-b3732e20-93e5-49dc-90a0-9f09567e46e4 tempest-ProjectMemberTests-718446646 None] Created volume successfully. Jul 13 14:06:17 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-cff6594b-f7aa-4c33-b7cd-0640d76e47f5 tempest-ProjectMemberTests-718446646 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 14:06:17 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-cff6594b-f7aa-4c33-b7cd-0640d76e47f5 tempest-ProjectMemberTests-718446646 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 14:06:17 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-cff6594b-f7aa-4c33-b7cd-0640d76e47f5 tempest-ProjectMemberTests-718446646 None] Creating offline snapshot 7e006246-6b5f-4696-946d-4ba00e407adf of volume a32eccbd-45c7-4b4c-8314-03d9a8ef31af {{(pid=87098) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 13 14:06:17 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[cff408c5-4db3-4fb1-93ba-c54f66facb00]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 14:06:17 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-cff6594b-f7aa-4c33-b7cd-0640d76e47f5 tempest-ProjectMemberTests-718446646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-a32eccbd-45c7-4b4c-8314-03d9a8ef31af {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:06:18 devstack sudo[105279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-a32eccbd-45c7-4b4c-8314-03d9a8ef31af Jul 13 14:06:18 devstack sudo[105279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:06:18 devstack sudo[105279]: pam_unix(sudo:session): session closed for user root Jul 13 14:06:18 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-cff6594b-f7aa-4c33-b7cd-0640d76e47f5 tempest-ProjectMemberTests-718446646 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-a32eccbd-45c7-4b4c-8314-03d9a8ef31af" returned: 0 in 0.462s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:06:18 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-cff6594b-f7aa-4c33-b7cd-0640d76e47f5 tempest-ProjectMemberTests-718446646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-a32eccbd-45c7-4b4c-8314-03d9a8ef31af,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-a32eccbd-45c7-4b4c-8314-03d9a8ef31af.7e006246-6b5f-4696-946d-4ba00e407adf 1G {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:06:18 devstack sudo[105286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-a32eccbd-45c7-4b4c-8314-03d9a8ef31af,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-a32eccbd-45c7-4b4c-8314-03d9a8ef31af.7e006246-6b5f-4696-946d-4ba00e407adf 1G Jul 13 14:06:18 devstack sudo[105286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:06:18 devstack sudo[105286]: pam_unix(sudo:session): session closed for user root Jul 13 14:06:18 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-cff6594b-f7aa-4c33-b7cd-0640d76e47f5 tempest-ProjectMemberTests-718446646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-a32eccbd-45c7-4b4c-8314-03d9a8ef31af,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-a32eccbd-45c7-4b4c-8314-03d9a8ef31af.7e006246-6b5f-4696-946d-4ba00e407adf 1G" returned: 0 in 0.471s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:06:18 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-cff6594b-f7aa-4c33-b7cd-0640d76e47f5 tempest-ProjectMemberTests-718446646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a32eccbd-45c7-4b4c-8314-03d9a8ef31af -F qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-a32eccbd-45c7-4b4c-8314-03d9a8ef31af.7e006246-6b5f-4696-946d-4ba00e407adf {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:06:18 devstack sudo[105292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a32eccbd-45c7-4b4c-8314-03d9a8ef31af -F qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-a32eccbd-45c7-4b4c-8314-03d9a8ef31af.7e006246-6b5f-4696-946d-4ba00e407adf Jul 13 14:06:18 devstack sudo[105292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:06:19 devstack sudo[105292]: pam_unix(sudo:session): session closed for user root Jul 13 14:06:19 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-cff6594b-f7aa-4c33-b7cd-0640d76e47f5 tempest-ProjectMemberTests-718446646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a32eccbd-45c7-4b4c-8314-03d9a8ef31af -F qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-a32eccbd-45c7-4b4c-8314-03d9a8ef31af.7e006246-6b5f-4696-946d-4ba00e407adf" returned: 0 in 0.393s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:06:19 devstack cinder-volume[87098]: WARNING cinder.volume.drivers.remotefs [None req-cff6594b-f7aa-4c33-b7cd-0640d76e47f5 tempest-ProjectMemberTests-718446646 None] /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-a32eccbd-45c7-4b4c-8314-03d9a8ef31af.7e006246-6b5f-4696-946d-4ba00e407adf is being set with open permissions: ugo+rw Jul 13 14:06:19 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-cff6594b-f7aa-4c33-b7cd-0640d76e47f5 tempest-ProjectMemberTests-718446646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-a32eccbd-45c7-4b4c-8314-03d9a8ef31af.7e006246-6b5f-4696-946d-4ba00e407adf {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:06:19 devstack sudo[105298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-a32eccbd-45c7-4b4c-8314-03d9a8ef31af.7e006246-6b5f-4696-946d-4ba00e407adf Jul 13 14:06:19 devstack sudo[105298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:06:19 devstack sudo[105298]: pam_unix(sudo:session): session closed for user root Jul 13 14:06:19 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-cff6594b-f7aa-4c33-b7cd-0640d76e47f5 tempest-ProjectMemberTests-718446646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-a32eccbd-45c7-4b4c-8314-03d9a8ef31af.7e006246-6b5f-4696-946d-4ba00e407adf" returned: 0 in 0.293s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:06:19 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-cff6594b-f7aa-4c33-b7cd-0640d76e47f5 tempest-ProjectMemberTests-718446646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-a32eccbd-45c7-4b4c-8314-03d9a8ef31af.info {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:06:19 devstack sudo[105307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-a32eccbd-45c7-4b4c-8314-03d9a8ef31af.info Jul 13 14:06:19 devstack sudo[105307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:06:19 devstack sudo[105307]: pam_unix(sudo:session): session closed for user root Jul 13 14:06:19 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-cff6594b-f7aa-4c33-b7cd-0640d76e47f5 tempest-ProjectMemberTests-718446646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-a32eccbd-45c7-4b4c-8314-03d9a8ef31af.info" returned: 0 in 0.271s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:06:19 devstack cinder-volume[87098]: WARNING cinder.volume.drivers.remotefs [None req-cff6594b-f7aa-4c33-b7cd-0640d76e47f5 tempest-ProjectMemberTests-718446646 None] /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-a32eccbd-45c7-4b4c-8314-03d9a8ef31af.info is being set with open permissions: ugo+rw Jul 13 14:06:19 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-cff6594b-f7aa-4c33-b7cd-0640d76e47f5 tempest-ProjectMemberTests-718446646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-a32eccbd-45c7-4b4c-8314-03d9a8ef31af.info {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:06:19 devstack sudo[105310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-a32eccbd-45c7-4b4c-8314-03d9a8ef31af.info Jul 13 14:06:19 devstack sudo[105310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:06:20 devstack sudo[105310]: pam_unix(sudo:session): session closed for user root Jul 13 14:06:20 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-cff6594b-f7aa-4c33-b7cd-0640d76e47f5 tempest-ProjectMemberTests-718446646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-a32eccbd-45c7-4b4c-8314-03d9a8ef31af.info" returned: 0 in 0.284s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:06:20 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-cff6594b-f7aa-4c33-b7cd-0640d76e47f5 tempest-ProjectMemberTests-718446646 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.309s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 14:06:20 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-cff6594b-f7aa-4c33-b7cd-0640d76e47f5 tempest-ProjectMemberTests-718446646 None] Create snapshot completed successfully Jul 13 14:06:21 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-e824b265-cdf7-4adf-a470-1eee2e971c36 tempest-ProjectMemberTests-718446646 None] Acquiring lock "cinder-7e006246-6b5f-4696-946d-4ba00e407adf-delete_snapshot" by "delete_snapshot" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 14:06:21 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-e824b265-cdf7-4adf-a470-1eee2e971c36 tempest-ProjectMemberTests-718446646 None] Lock "cinder-7e006246-6b5f-4696-946d-4ba00e407adf-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 14:06:21 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-e824b265-cdf7-4adf-a470-1eee2e971c36 tempest-ProjectMemberTests-718446646 None] Acquiring lock "cinder-quobyte-a32eccbd-45c7-4b4c-8314-03d9a8ef31af" by "delete_snapshot" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 14:06:21 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-e824b265-cdf7-4adf-a470-1eee2e971c36 tempest-ProjectMemberTests-718446646 None] Lock "cinder-quobyte-a32eccbd-45c7-4b4c-8314-03d9a8ef31af" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 14:06:21 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-e824b265-cdf7-4adf-a470-1eee2e971c36 tempest-ProjectMemberTests-718446646 None] Acquiring lock "cinder-quobyte-7e006246-6b5f-4696-946d-4ba00e407adf" by "_delete_snapshot" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 14:06:21 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-e824b265-cdf7-4adf-a470-1eee2e971c36 tempest-ProjectMemberTests-718446646 None] Lock "cinder-quobyte-7e006246-6b5f-4696-946d-4ba00e407adf" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 14:06:21 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-e824b265-cdf7-4adf-a470-1eee2e971c36 tempest-ProjectMemberTests-718446646 None] Deleting offline snapshot 7e006246-6b5f-4696-946d-4ba00e407adf of volume a32eccbd-45c7-4b4c-8314-03d9a8ef31af {{(pid=87098) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 13 14:06:21 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-e824b265-cdf7-4adf-a470-1eee2e971c36 tempest-ProjectMemberTests-718446646 None] snapshot_file for this snap is: volume-a32eccbd-45c7-4b4c-8314-03d9a8ef31af.7e006246-6b5f-4696-946d-4ba00e407adf {{(pid=87098) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 13 14:06:21 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[82dff9ba-ab8c-42bb-97c7-6c85857a5448]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 14:06:21 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-e824b265-cdf7-4adf-a470-1eee2e971c36 tempest-ProjectMemberTests-718446646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-a32eccbd-45c7-4b4c-8314-03d9a8ef31af.7e006246-6b5f-4696-946d-4ba00e407adf {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:06:21 devstack sudo[105313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-a32eccbd-45c7-4b4c-8314-03d9a8ef31af.7e006246-6b5f-4696-946d-4ba00e407adf Jul 13 14:06:21 devstack sudo[105313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:06:21 devstack sudo[105313]: pam_unix(sudo:session): session closed for user root Jul 13 14:06:21 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-e824b265-cdf7-4adf-a470-1eee2e971c36 tempest-ProjectMemberTests-718446646 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-a32eccbd-45c7-4b4c-8314-03d9a8ef31af.7e006246-6b5f-4696-946d-4ba00e407adf" returned: 0 in 0.429s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:06:21 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-e824b265-cdf7-4adf-a470-1eee2e971c36 tempest-ProjectMemberTests-718446646 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a32eccbd-45c7-4b4c-8314-03d9a8ef31af(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87098) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 13 14:06:21 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[cce8bab4-a20d-4315-a0c5-908769c322bb]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 14:06:21 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-e824b265-cdf7-4adf-a470-1eee2e971c36 tempest-ProjectMemberTests-718446646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-a32eccbd-45c7-4b4c-8314-03d9a8ef31af {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:06:21 devstack sudo[105318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-a32eccbd-45c7-4b4c-8314-03d9a8ef31af Jul 13 14:06:21 devstack sudo[105318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:06:22 devstack sudo[105318]: pam_unix(sudo:session): session closed for user root Jul 13 14:06:22 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-e824b265-cdf7-4adf-a470-1eee2e971c36 tempest-ProjectMemberTests-718446646 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-a32eccbd-45c7-4b4c-8314-03d9a8ef31af" returned: 0 in 0.479s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:06:22 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-e824b265-cdf7-4adf-a470-1eee2e971c36 tempest-ProjectMemberTests-718446646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-a32eccbd-45c7-4b4c-8314-03d9a8ef31af.7e006246-6b5f-4696-946d-4ba00e407adf {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:06:22 devstack sudo[105323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-a32eccbd-45c7-4b4c-8314-03d9a8ef31af.7e006246-6b5f-4696-946d-4ba00e407adf Jul 13 14:06:22 devstack sudo[105323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:06:22 devstack sudo[105323]: pam_unix(sudo:session): session closed for user root Jul 13 14:06:22 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-e824b265-cdf7-4adf-a470-1eee2e971c36 tempest-ProjectMemberTests-718446646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-a32eccbd-45c7-4b4c-8314-03d9a8ef31af.7e006246-6b5f-4696-946d-4ba00e407adf" returned: 0 in 0.357s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:06:22 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-e824b265-cdf7-4adf-a470-1eee2e971c36 tempest-ProjectMemberTests-718446646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-a32eccbd-45c7-4b4c-8314-03d9a8ef31af.7e006246-6b5f-4696-946d-4ba00e407adf {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:06:22 devstack sudo[105328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-a32eccbd-45c7-4b4c-8314-03d9a8ef31af.7e006246-6b5f-4696-946d-4ba00e407adf Jul 13 14:06:22 devstack sudo[105328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:06:22 devstack sudo[105328]: pam_unix(sudo:session): session closed for user root Jul 13 14:06:22 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-e824b265-cdf7-4adf-a470-1eee2e971c36 tempest-ProjectMemberTests-718446646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-a32eccbd-45c7-4b4c-8314-03d9a8ef31af.7e006246-6b5f-4696-946d-4ba00e407adf" returned: 0 in 0.263s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:06:22 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-e824b265-cdf7-4adf-a470-1eee2e971c36 tempest-ProjectMemberTests-718446646 None] Lock "cinder-quobyte-7e006246-6b5f-4696-946d-4ba00e407adf" released by "_delete_snapshot" :: held 1.644s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 14:06:22 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-e824b265-cdf7-4adf-a470-1eee2e971c36 tempest-ProjectMemberTests-718446646 None] Lock "cinder-quobyte-a32eccbd-45c7-4b4c-8314-03d9a8ef31af" released by "delete_snapshot" :: held 1.677s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 14:06:22 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-e824b265-cdf7-4adf-a470-1eee2e971c36 tempest-ProjectMemberTests-718446646 None] Created reservations ['42bf9bc7-79b1-4efb-adce-075d79440beb', '802c5204-3d69-4320-b50c-227d7dcdd3db', '3f4e3b5c-8dfe-4db3-a0d6-50fac152535e', '55147e78-fbd5-4dda-bb18-0999e1bdb360'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 14:06:22 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-e824b265-cdf7-4adf-a470-1eee2e971c36 tempest-ProjectMemberTests-718446646 None] Delete snapshot completed successfully. Jul 13 14:06:22 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-e824b265-cdf7-4adf-a470-1eee2e971c36 tempest-ProjectMemberTests-718446646 None] Lock "cinder-7e006246-6b5f-4696-946d-4ba00e407adf-delete_snapshot" released by "delete_snapshot" :: held 1.832s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 14:06:23 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-acf3bd38-eb95-483f-8588-2f0b2807b0af tempest-ProjectMemberTests-718446646 None] Acquiring lock "cinder-a32eccbd-45c7-4b4c-8314-03d9a8ef31af-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 14:06:23 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-acf3bd38-eb95-483f-8588-2f0b2807b0af tempest-ProjectMemberTests-718446646 None] Lock "cinder-a32eccbd-45c7-4b4c-8314-03d9a8ef31af-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 14:06:23 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-acf3bd38-eb95-483f-8588-2f0b2807b0af tempest-ProjectMemberTests-718446646 None] Acquiring lock "cinder-quobyte-a32eccbd-45c7-4b4c-8314-03d9a8ef31af" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 14:06:23 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-acf3bd38-eb95-483f-8588-2f0b2807b0af tempest-ProjectMemberTests-718446646 None] Lock "cinder-quobyte-a32eccbd-45c7-4b4c-8314-03d9a8ef31af" acquired by "delete_volume" :: waited 0.024s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 14:06:23 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec5fc39b-9252-43ed-b507-ba379252ee11]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 14:06:23 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-acf3bd38-eb95-483f-8588-2f0b2807b0af tempest-ProjectMemberTests-718446646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-a32eccbd-45c7-4b4c-8314-03d9a8ef31af {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:06:23 devstack sudo[105331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-a32eccbd-45c7-4b4c-8314-03d9a8ef31af Jul 13 14:06:23 devstack sudo[105331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:06:24 devstack sudo[105331]: pam_unix(sudo:session): session closed for user root Jul 13 14:06:24 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-acf3bd38-eb95-483f-8588-2f0b2807b0af tempest-ProjectMemberTests-718446646 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-a32eccbd-45c7-4b4c-8314-03d9a8ef31af" returned: 0 in 0.426s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:06:24 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-acf3bd38-eb95-483f-8588-2f0b2807b0af tempest-ProjectMemberTests-718446646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-a32eccbd-45c7-4b4c-8314-03d9a8ef31af {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:06:24 devstack sudo[105336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-a32eccbd-45c7-4b4c-8314-03d9a8ef31af Jul 13 14:06:24 devstack sudo[105336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:06:24 devstack sudo[105336]: pam_unix(sudo:session): session closed for user root Jul 13 14:06:24 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-acf3bd38-eb95-483f-8588-2f0b2807b0af tempest-ProjectMemberTests-718446646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-a32eccbd-45c7-4b4c-8314-03d9a8ef31af" returned: 0 in 0.351s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:06:24 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-acf3bd38-eb95-483f-8588-2f0b2807b0af tempest-ProjectMemberTests-718446646 None] Lock "cinder-quobyte-a32eccbd-45c7-4b4c-8314-03d9a8ef31af" released by "delete_volume" :: held 0.881s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 14:06:24 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-acf3bd38-eb95-483f-8588-2f0b2807b0af tempest-ProjectMemberTests-718446646 None] Created reservations ['bcc86d77-f69f-4811-be46-cc42df0196dc', '0f49cce4-c212-4886-8db3-a4d1e34d5e73', 'c7e467ee-e44e-4d55-a29c-8f4e7650c4eb', '1381aa39-8b53-40f8-a988-1f71c0ba53b3'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 14:06:24 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-acf3bd38-eb95-483f-8588-2f0b2807b0af tempest-ProjectMemberTests-718446646 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 14:06:24 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-acf3bd38-eb95-483f-8588-2f0b2807b0af tempest-ProjectMemberTests-718446646 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 14:06:24 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-acf3bd38-eb95-483f-8588-2f0b2807b0af tempest-ProjectMemberTests-718446646 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 14:06:24 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-acf3bd38-eb95-483f-8588-2f0b2807b0af tempest-ProjectMemberTests-718446646 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 14:06:24 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-acf3bd38-eb95-483f-8588-2f0b2807b0af tempest-ProjectMemberTests-718446646 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 14:06:24 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-acf3bd38-eb95-483f-8588-2f0b2807b0af tempest-ProjectMemberTests-718446646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:06:24 devstack sudo[105339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 Jul 13 14:06:24 devstack sudo[105339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:06:25 devstack sudo[105339]: pam_unix(sudo:session): session closed for user root Jul 13 14:06:25 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-acf3bd38-eb95-483f-8588-2f0b2807b0af tempest-ProjectMemberTests-718446646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78" returned: 0 in 0.403s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:06:25 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-acf3bd38-eb95-483f-8588-2f0b2807b0af tempest-ProjectMemberTests-718446646 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 14:06:25 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-acf3bd38-eb95-483f-8588-2f0b2807b0af tempest-ProjectMemberTests-718446646 None] Deleted volume successfully. Jul 13 14:06:25 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-acf3bd38-eb95-483f-8588-2f0b2807b0af tempest-ProjectMemberTests-718446646 None] Lock "cinder-a32eccbd-45c7-4b4c-8314-03d9a8ef31af-delete_volume" released by "delete_volume" :: held 1.593s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 14:06:25 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-ab07613b-ddd5-4160-a7c7-5a24a6952146 tempest-ProjectMemberTests-718446646 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 14:06:25 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-ab07613b-ddd5-4160-a7c7-5a24a6952146 tempest-ProjectMemberTests-718446646 None] Flow 'volume_create_manager' (52bdc0e5-d7cb-48eb-aec9-a5ad302c56b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 14:06:25 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-ab07613b-ddd5-4160-a7c7-5a24a6952146 tempest-ProjectMemberTests-718446646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f69bffaf-7f38-4453-bfc4-a1a4661e9b80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:06:25 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-ab07613b-ddd5-4160-a7c7-5a24a6952146 tempest-ProjectMemberTests-718446646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f69bffaf-7f38-4453-bfc4-a1a4661e9b80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T12:06:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1828402670',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f895f5b-2083-4556-bf02-23cd7f508d8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2bb0e12a2763448b9d28151e1e814854',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T12:06:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T12:06:25Z,use_quota=True,user_id='2d16431e25f348deb700350f5b150c69',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1147de8b-623b-426c-a13d-7fc824a80f67),volume_type_id=1147de8b-623b-426c-a13d-7fc824a80f67)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:06:25 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-ab07613b-ddd5-4160-a7c7-5a24a6952146 tempest-ProjectMemberTests-718446646 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95444af8-1d04-45aa-8eb6-5b715286cea7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:06:25 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-ab07613b-ddd5-4160-a7c7-5a24a6952146 tempest-ProjectMemberTests-718446646 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95444af8-1d04-45aa-8eb6-5b715286cea7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:06:25 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-ab07613b-ddd5-4160-a7c7-5a24a6952146 tempest-ProjectMemberTests-718446646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92dbeadf-597b-490e-b3a3-bcd57ae91e60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:06:25 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-ab07613b-ddd5-4160-a7c7-5a24a6952146 tempest-ProjectMemberTests-718446646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92dbeadf-597b-490e-b3a3-bcd57ae91e60) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3f895f5b-2083-4556-bf02-23cd7f508d8c', 'volume_name': 'volume-3f895f5b-2083-4556-bf02-23cd7f508d8c', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:06:25 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-ab07613b-ddd5-4160-a7c7-5a24a6952146 tempest-ProjectMemberTests-718446646 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0531f348-1291-4250-9eab-9bebc8ccd058) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:06:25 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-ab07613b-ddd5-4160-a7c7-5a24a6952146 tempest-ProjectMemberTests-718446646 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0531f348-1291-4250-9eab-9bebc8ccd058) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:06:25 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-ab07613b-ddd5-4160-a7c7-5a24a6952146 tempest-ProjectMemberTests-718446646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2aaf063-990f-45f0-aa4a-3debff741d19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:06:25 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-ab07613b-ddd5-4160-a7c7-5a24a6952146 tempest-ProjectMemberTests-718446646 None] Volume 3f895f5b-2083-4556-bf02-23cd7f508d8c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3f895f5b-2083-4556-bf02-23cd7f508d8c', 'volume_size': 1} Jul 13 14:06:25 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-ab07613b-ddd5-4160-a7c7-5a24a6952146 tempest-ProjectMemberTests-718446646 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 14:06:25 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-ab07613b-ddd5-4160-a7c7-5a24a6952146 tempest-ProjectMemberTests-718446646 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 14:06:25 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-ab07613b-ddd5-4160-a7c7-5a24a6952146 tempest-ProjectMemberTests-718446646 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T12:06:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1828402670',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f895f5b-2083-4556-bf02-23cd7f508d8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2bb0e12a2763448b9d28151e1e814854',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T12:06:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T12:06:25Z,use_quota=True,user_id='2d16431e25f348deb700350f5b150c69',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1147de8b-623b-426c-a13d-7fc824a80f67),volume_type_id=1147de8b-623b-426c-a13d-7fc824a80f67)}" {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 13 14:06:25 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-ab07613b-ddd5-4160-a7c7-5a24a6952146 tempest-ProjectMemberTests-718446646 None] Creating volume 3f895f5b-2083-4556-bf02-23cd7f508d8c {{(pid=87098) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 13 14:06:25 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-ab07613b-ddd5-4160-a7c7-5a24a6952146 tempest-ProjectMemberTests-718446646 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 14:06:25 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-ab07613b-ddd5-4160-a7c7-5a24a6952146 tempest-ProjectMemberTests-718446646 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 14:06:25 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-ab07613b-ddd5-4160-a7c7-5a24a6952146 tempest-ProjectMemberTests-718446646 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 14:06:25 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-ab07613b-ddd5-4160-a7c7-5a24a6952146 tempest-ProjectMemberTests-718446646 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 14:06:25 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-ab07613b-ddd5-4160-a7c7-5a24a6952146 tempest-ProjectMemberTests-718446646 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 14:06:25 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-ab07613b-ddd5-4160-a7c7-5a24a6952146 tempest-ProjectMemberTests-718446646 None] Selected osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 14:06:25 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-ab07613b-ddd5-4160-a7c7-5a24a6952146 tempest-ProjectMemberTests-718446646 None] casted to osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 Jul 13 14:06:25 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-ab07613b-ddd5-4160-a7c7-5a24a6952146 tempest-ProjectMemberTests-718446646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-3f895f5b-2083-4556-bf02-23cd7f508d8c 1073741824 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:06:25 devstack sudo[105342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-3f895f5b-2083-4556-bf02-23cd7f508d8c 1073741824 Jul 13 14:06:25 devstack sudo[105342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:06:25 devstack sudo[105342]: pam_unix(sudo:session): session closed for user root Jul 13 14:06:25 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-ab07613b-ddd5-4160-a7c7-5a24a6952146 tempest-ProjectMemberTests-718446646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-3f895f5b-2083-4556-bf02-23cd7f508d8c 1073741824" returned: 0 in 0.506s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:06:25 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-ab07613b-ddd5-4160-a7c7-5a24a6952146 tempest-ProjectMemberTests-718446646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-3f895f5b-2083-4556-bf02-23cd7f508d8c {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:06:25 devstack sudo[105348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-3f895f5b-2083-4556-bf02-23cd7f508d8c Jul 13 14:06:25 devstack sudo[105348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:06:26 devstack sudo[105348]: pam_unix(sudo:session): session closed for user root Jul 13 14:06:26 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-ab07613b-ddd5-4160-a7c7-5a24a6952146 tempest-ProjectMemberTests-718446646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-3f895f5b-2083-4556-bf02-23cd7f508d8c" returned: 0 in 0.346s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:06:26 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-ab07613b-ddd5-4160-a7c7-5a24a6952146 tempest-ProjectMemberTests-718446646 None] <== create_volume: return (916ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'} {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 13 14:06:26 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-ab07613b-ddd5-4160-a7c7-5a24a6952146 tempest-ProjectMemberTests-718446646 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.919s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 14:06:26 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-ab07613b-ddd5-4160-a7c7-5a24a6952146 tempest-ProjectMemberTests-718446646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2aaf063-990f-45f0-aa4a-3debff741d19) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3f895f5b-2083-4556-bf02-23cd7f508d8c', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:06:26 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-ab07613b-ddd5-4160-a7c7-5a24a6952146 tempest-ProjectMemberTests-718446646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df8ba5ec-10bb-42d4-84df-29eaa69b25de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:06:26 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-ab07613b-ddd5-4160-a7c7-5a24a6952146 tempest-ProjectMemberTests-718446646 None] Volume volume-3f895f5b-2083-4556-bf02-23cd7f508d8c (3f895f5b-2083-4556-bf02-23cd7f508d8c): created successfully Jul 13 14:06:26 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-ab07613b-ddd5-4160-a7c7-5a24a6952146 tempest-ProjectMemberTests-718446646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df8ba5ec-10bb-42d4-84df-29eaa69b25de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:06:26 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-ab07613b-ddd5-4160-a7c7-5a24a6952146 tempest-ProjectMemberTests-718446646 None] Flow 'volume_create_manager' (52bdc0e5-d7cb-48eb-aec9-a5ad302c56b5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 14:06:26 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-ab07613b-ddd5-4160-a7c7-5a24a6952146 tempest-ProjectMemberTests-718446646 None] Created volume successfully. Jul 13 14:06:27 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-814cae0e-9856-4fd5-8245-39d0ca03b6be tempest-ProjectMemberTests-718446646 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 14:06:27 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-814cae0e-9856-4fd5-8245-39d0ca03b6be tempest-ProjectMemberTests-718446646 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 14:06:27 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-814cae0e-9856-4fd5-8245-39d0ca03b6be tempest-ProjectMemberTests-718446646 None] Creating offline snapshot 3dfdf00b-8888-499e-a0d6-48d69781f4f5 of volume 3f895f5b-2083-4556-bf02-23cd7f508d8c {{(pid=87098) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 13 14:06:27 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[383f7879-5498-42c2-abf1-f6bc9cc21c33]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 14:06:27 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-814cae0e-9856-4fd5-8245-39d0ca03b6be tempest-ProjectMemberTests-718446646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-3f895f5b-2083-4556-bf02-23cd7f508d8c {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:06:27 devstack sudo[105352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-3f895f5b-2083-4556-bf02-23cd7f508d8c Jul 13 14:06:27 devstack sudo[105352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:06:28 devstack sudo[105352]: pam_unix(sudo:session): session closed for user root Jul 13 14:06:28 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-814cae0e-9856-4fd5-8245-39d0ca03b6be tempest-ProjectMemberTests-718446646 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-3f895f5b-2083-4556-bf02-23cd7f508d8c" returned: 0 in 0.462s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:06:28 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-814cae0e-9856-4fd5-8245-39d0ca03b6be tempest-ProjectMemberTests-718446646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-3f895f5b-2083-4556-bf02-23cd7f508d8c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-3f895f5b-2083-4556-bf02-23cd7f508d8c.3dfdf00b-8888-499e-a0d6-48d69781f4f5 1G {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:06:28 devstack sudo[105358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-3f895f5b-2083-4556-bf02-23cd7f508d8c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-3f895f5b-2083-4556-bf02-23cd7f508d8c.3dfdf00b-8888-499e-a0d6-48d69781f4f5 1G Jul 13 14:06:28 devstack sudo[105358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:06:28 devstack sudo[105358]: pam_unix(sudo:session): session closed for user root Jul 13 14:06:28 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-814cae0e-9856-4fd5-8245-39d0ca03b6be tempest-ProjectMemberTests-718446646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-3f895f5b-2083-4556-bf02-23cd7f508d8c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-3f895f5b-2083-4556-bf02-23cd7f508d8c.3dfdf00b-8888-499e-a0d6-48d69781f4f5 1G" returned: 0 in 0.547s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:06:28 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-814cae0e-9856-4fd5-8245-39d0ca03b6be tempest-ProjectMemberTests-718446646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3f895f5b-2083-4556-bf02-23cd7f508d8c -F qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-3f895f5b-2083-4556-bf02-23cd7f508d8c.3dfdf00b-8888-499e-a0d6-48d69781f4f5 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:06:28 devstack sudo[105364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3f895f5b-2083-4556-bf02-23cd7f508d8c -F qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-3f895f5b-2083-4556-bf02-23cd7f508d8c.3dfdf00b-8888-499e-a0d6-48d69781f4f5 Jul 13 14:06:28 devstack sudo[105364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:06:28 devstack sudo[105364]: pam_unix(sudo:session): session closed for user root Jul 13 14:06:28 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-814cae0e-9856-4fd5-8245-39d0ca03b6be tempest-ProjectMemberTests-718446646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3f895f5b-2083-4556-bf02-23cd7f508d8c -F qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-3f895f5b-2083-4556-bf02-23cd7f508d8c.3dfdf00b-8888-499e-a0d6-48d69781f4f5" returned: 0 in 0.347s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:06:28 devstack cinder-volume[87098]: WARNING cinder.volume.drivers.remotefs [None req-814cae0e-9856-4fd5-8245-39d0ca03b6be tempest-ProjectMemberTests-718446646 None] /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-3f895f5b-2083-4556-bf02-23cd7f508d8c.3dfdf00b-8888-499e-a0d6-48d69781f4f5 is being set with open permissions: ugo+rw Jul 13 14:06:28 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-814cae0e-9856-4fd5-8245-39d0ca03b6be tempest-ProjectMemberTests-718446646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-3f895f5b-2083-4556-bf02-23cd7f508d8c.3dfdf00b-8888-499e-a0d6-48d69781f4f5 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:06:29 devstack sudo[105370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-3f895f5b-2083-4556-bf02-23cd7f508d8c.3dfdf00b-8888-499e-a0d6-48d69781f4f5 Jul 13 14:06:29 devstack sudo[105370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:06:29 devstack cinder-volume[87098]: DEBUG oslo_service.periodic_task [None req-727a1692-ea28-4a77-b327-0d94e8f01efb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87098) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 13 14:06:29 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-727a1692-ea28-4a77-b327-0d94e8f01efb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 14:06:29 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-727a1692-ea28-4a77-b327-0d94e8f01efb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 14:06:29 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-727a1692-ea28-4a77-b327-0d94e8f01efb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 14:06:29 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-727a1692-ea28-4a77-b327-0d94e8f01efb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 14:06:29 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-727a1692-ea28-4a77-b327-0d94e8f01efb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 14:06:29 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-727a1692-ea28-4a77-b327-0d94e8f01efb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:06:29 devstack sudo[105372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 Jul 13 14:06:29 devstack sudo[105372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:06:29 devstack sudo[105370]: pam_unix(sudo:session): session closed for user root Jul 13 14:06:29 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-814cae0e-9856-4fd5-8245-39d0ca03b6be tempest-ProjectMemberTests-718446646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-3f895f5b-2083-4556-bf02-23cd7f508d8c.3dfdf00b-8888-499e-a0d6-48d69781f4f5" returned: 0 in 0.267s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:06:29 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-814cae0e-9856-4fd5-8245-39d0ca03b6be tempest-ProjectMemberTests-718446646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-3f895f5b-2083-4556-bf02-23cd7f508d8c.info {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:06:29 devstack sudo[105375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-3f895f5b-2083-4556-bf02-23cd7f508d8c.info Jul 13 14:06:29 devstack sudo[105375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:06:29 devstack sudo[105372]: pam_unix(sudo:session): session closed for user root Jul 13 14:06:29 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-727a1692-ea28-4a77-b327-0d94e8f01efb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78" returned: 0 in 0.366s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:06:29 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-727a1692-ea28-4a77-b327-0d94e8f01efb None None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 14:06:29 devstack cinder-volume[87098]: DEBUG oslo_service.periodic_task [None req-727a1692-ea28-4a77-b327-0d94e8f01efb None None] Running periodic task VolumeManager._thread_info {{(pid=87098) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 13 14:06:29 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-727a1692-ea28-4a77-b327-0d94e8f01efb None None] thread count: 28 {{(pid=87098) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 13 14:06:29 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-727a1692-ea28-4a77-b327-0d94e8f01efb None None] thread info: [<_MainThread(MainThread, started 127988054597760)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87098) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 13 14:06:29 devstack sudo[105375]: pam_unix(sudo:session): session closed for user root Jul 13 14:06:29 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-814cae0e-9856-4fd5-8245-39d0ca03b6be tempest-ProjectMemberTests-718446646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-3f895f5b-2083-4556-bf02-23cd7f508d8c.info" returned: 0 in 0.365s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:06:29 devstack cinder-volume[87098]: WARNING cinder.volume.drivers.remotefs [None req-814cae0e-9856-4fd5-8245-39d0ca03b6be tempest-ProjectMemberTests-718446646 None] /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-3f895f5b-2083-4556-bf02-23cd7f508d8c.info is being set with open permissions: ugo+rw Jul 13 14:06:29 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-814cae0e-9856-4fd5-8245-39d0ca03b6be tempest-ProjectMemberTests-718446646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-3f895f5b-2083-4556-bf02-23cd7f508d8c.info {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:06:29 devstack sudo[105379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-3f895f5b-2083-4556-bf02-23cd7f508d8c.info Jul 13 14:06:29 devstack sudo[105379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:06:29 devstack sudo[105379]: pam_unix(sudo:session): session closed for user root Jul 13 14:06:29 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-814cae0e-9856-4fd5-8245-39d0ca03b6be tempest-ProjectMemberTests-718446646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-3f895f5b-2083-4556-bf02-23cd7f508d8c.info" returned: 0 in 0.326s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:06:30 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-814cae0e-9856-4fd5-8245-39d0ca03b6be tempest-ProjectMemberTests-718446646 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.453s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 14:06:30 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-814cae0e-9856-4fd5-8245-39d0ca03b6be tempest-ProjectMemberTests-718446646 None] Create snapshot completed successfully Jul 13 14:06:30 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-ae1a2833-0000-4224-8544-7f08ed79145c tempest-ProjectMemberTests-718446646 None] Acquiring lock "cinder-3dfdf00b-8888-499e-a0d6-48d69781f4f5-delete_snapshot" by "delete_snapshot" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 14:06:30 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-ae1a2833-0000-4224-8544-7f08ed79145c tempest-ProjectMemberTests-718446646 None] Lock "cinder-3dfdf00b-8888-499e-a0d6-48d69781f4f5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 14:06:30 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-ae1a2833-0000-4224-8544-7f08ed79145c tempest-ProjectMemberTests-718446646 None] Acquiring lock "cinder-quobyte-3f895f5b-2083-4556-bf02-23cd7f508d8c" by "delete_snapshot" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 14:06:30 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-ae1a2833-0000-4224-8544-7f08ed79145c tempest-ProjectMemberTests-718446646 None] Lock "cinder-quobyte-3f895f5b-2083-4556-bf02-23cd7f508d8c" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 14:06:30 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-ae1a2833-0000-4224-8544-7f08ed79145c tempest-ProjectMemberTests-718446646 None] Acquiring lock "cinder-quobyte-3dfdf00b-8888-499e-a0d6-48d69781f4f5" by "_delete_snapshot" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 14:06:30 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-ae1a2833-0000-4224-8544-7f08ed79145c tempest-ProjectMemberTests-718446646 None] Lock "cinder-quobyte-3dfdf00b-8888-499e-a0d6-48d69781f4f5" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 14:06:30 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-ae1a2833-0000-4224-8544-7f08ed79145c tempest-ProjectMemberTests-718446646 None] Deleting offline snapshot 3dfdf00b-8888-499e-a0d6-48d69781f4f5 of volume 3f895f5b-2083-4556-bf02-23cd7f508d8c {{(pid=87098) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 13 14:06:30 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-ae1a2833-0000-4224-8544-7f08ed79145c tempest-ProjectMemberTests-718446646 None] snapshot_file for this snap is: volume-3f895f5b-2083-4556-bf02-23cd7f508d8c.3dfdf00b-8888-499e-a0d6-48d69781f4f5 {{(pid=87098) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 13 14:06:30 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-b4b2076b-e0b2-49cd-b503-0bd8201788fa tempest-ProjectReaderTests-123956539 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 14:06:30 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-b4b2076b-e0b2-49cd-b503-0bd8201788fa tempest-ProjectReaderTests-123956539 None] Flow 'volume_create_manager' (e006a03e-6733-43e1-a047-002fa210ec74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 14:06:30 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-b4b2076b-e0b2-49cd-b503-0bd8201788fa tempest-ProjectReaderTests-123956539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48d9fdd6-7f31-4476-a558-09a9b885d4fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:06:30 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[660859dc-ca59-4e28-a375-47b1f32ca76e]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 14:06:30 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-ae1a2833-0000-4224-8544-7f08ed79145c tempest-ProjectMemberTests-718446646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-3f895f5b-2083-4556-bf02-23cd7f508d8c.3dfdf00b-8888-499e-a0d6-48d69781f4f5 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:06:30 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-b4b2076b-e0b2-49cd-b503-0bd8201788fa tempest-ProjectReaderTests-123956539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48d9fdd6-7f31-4476-a558-09a9b885d4fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T12:06:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-994979784',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53c700b8-7578-4582-b638-d52e5812db83,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c98969346eb94e82918d048a6c20a942',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T12:06:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T12:06:31Z,use_quota=True,user_id='1e148007b3654e4080b71b8d0cbd3cb8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1147de8b-623b-426c-a13d-7fc824a80f67),volume_type_id=1147de8b-623b-426c-a13d-7fc824a80f67)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:06:30 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-b4b2076b-e0b2-49cd-b503-0bd8201788fa tempest-ProjectReaderTests-123956539 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ee75266-7077-458d-b5ac-a5caea70a0d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:06:30 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-b4b2076b-e0b2-49cd-b503-0bd8201788fa tempest-ProjectReaderTests-123956539 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ee75266-7077-458d-b5ac-a5caea70a0d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:06:30 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-b4b2076b-e0b2-49cd-b503-0bd8201788fa tempest-ProjectReaderTests-123956539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69a786bd-4652-4578-ac44-3abdf05bc0c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:06:30 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-b4b2076b-e0b2-49cd-b503-0bd8201788fa tempest-ProjectReaderTests-123956539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69a786bd-4652-4578-ac44-3abdf05bc0c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '53c700b8-7578-4582-b638-d52e5812db83', 'volume_name': 'volume-53c700b8-7578-4582-b638-d52e5812db83', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:06:30 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-b4b2076b-e0b2-49cd-b503-0bd8201788fa tempest-ProjectReaderTests-123956539 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0617f204-9c67-4f07-990b-17997e085b39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:06:30 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-b4b2076b-e0b2-49cd-b503-0bd8201788fa tempest-ProjectReaderTests-123956539 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0617f204-9c67-4f07-990b-17997e085b39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:06:30 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-b4b2076b-e0b2-49cd-b503-0bd8201788fa tempest-ProjectReaderTests-123956539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85185a18-acfa-4d5b-b5c3-9b40ad2f8770) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:06:30 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-b4b2076b-e0b2-49cd-b503-0bd8201788fa tempest-ProjectReaderTests-123956539 None] Volume 53c700b8-7578-4582-b638-d52e5812db83: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-53c700b8-7578-4582-b638-d52e5812db83', 'volume_size': 1} Jul 13 14:06:30 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-b4b2076b-e0b2-49cd-b503-0bd8201788fa tempest-ProjectReaderTests-123956539 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 14:06:30 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-b4b2076b-e0b2-49cd-b503-0bd8201788fa tempest-ProjectReaderTests-123956539 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 14:06:30 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-b4b2076b-e0b2-49cd-b503-0bd8201788fa tempest-ProjectReaderTests-123956539 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T12:06:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-994979784',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53c700b8-7578-4582-b638-d52e5812db83,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c98969346eb94e82918d048a6c20a942',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T12:06:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T12:06:31Z,use_quota=True,user_id='1e148007b3654e4080b71b8d0cbd3cb8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1147de8b-623b-426c-a13d-7fc824a80f67),volume_type_id=1147de8b-623b-426c-a13d-7fc824a80f67)}" {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 13 14:06:30 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-b4b2076b-e0b2-49cd-b503-0bd8201788fa tempest-ProjectReaderTests-123956539 None] Creating volume 53c700b8-7578-4582-b638-d52e5812db83 {{(pid=87098) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 13 14:06:30 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-b4b2076b-e0b2-49cd-b503-0bd8201788fa tempest-ProjectReaderTests-123956539 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 14:06:30 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-b4b2076b-e0b2-49cd-b503-0bd8201788fa tempest-ProjectReaderTests-123956539 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 14:06:30 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-b4b2076b-e0b2-49cd-b503-0bd8201788fa tempest-ProjectReaderTests-123956539 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 14:06:30 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-b4b2076b-e0b2-49cd-b503-0bd8201788fa tempest-ProjectReaderTests-123956539 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 14:06:30 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-b4b2076b-e0b2-49cd-b503-0bd8201788fa tempest-ProjectReaderTests-123956539 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 14:06:30 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-b4b2076b-e0b2-49cd-b503-0bd8201788fa tempest-ProjectReaderTests-123956539 None] Selected osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 14:06:30 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-b4b2076b-e0b2-49cd-b503-0bd8201788fa tempest-ProjectReaderTests-123956539 None] casted to osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 Jul 13 14:06:30 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-b4b2076b-e0b2-49cd-b503-0bd8201788fa tempest-ProjectReaderTests-123956539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-53c700b8-7578-4582-b638-d52e5812db83 1073741824 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:06:31 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-6b4921b1-216c-40fa-875e-8996958ef3c6 tempest-SnapshotDependencyTests-1674021511 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 14:06:31 devstack sudo[105384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-53c700b8-7578-4582-b638-d52e5812db83 1073741824 Jul 13 14:06:31 devstack sudo[105384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:06:31 devstack sudo[105383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-3f895f5b-2083-4556-bf02-23cd7f508d8c.3dfdf00b-8888-499e-a0d6-48d69781f4f5 Jul 13 14:06:31 devstack sudo[105383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:06:31 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-6b4921b1-216c-40fa-875e-8996958ef3c6 tempest-SnapshotDependencyTests-1674021511 None] Flow 'volume_create_manager' (de91bfda-eb2f-483a-91cc-a2ac1561128c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 14:06:31 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-6b4921b1-216c-40fa-875e-8996958ef3c6 tempest-SnapshotDependencyTests-1674021511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ce0a9f1-922e-44ed-9670-1d1d18d05f15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:06:31 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-6b4921b1-216c-40fa-875e-8996958ef3c6 tempest-SnapshotDependencyTests-1674021511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ce0a9f1-922e-44ed-9670-1d1d18d05f15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T12:06:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-461346162',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c995f44-a4f9-482e-8a4f-48e6860dfdbd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7d9b0e094c84fa587e57be9640bc8e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T12:06:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T12:06:31Z,use_quota=True,user_id='f7710644902a49fea7639af7ac0ed6c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1147de8b-623b-426c-a13d-7fc824a80f67),volume_type_id=1147de8b-623b-426c-a13d-7fc824a80f67)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:06:31 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-6b4921b1-216c-40fa-875e-8996958ef3c6 tempest-SnapshotDependencyTests-1674021511 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4da4e640-9340-425c-b9e0-9f885619f2af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:06:31 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-6b4921b1-216c-40fa-875e-8996958ef3c6 tempest-SnapshotDependencyTests-1674021511 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4da4e640-9340-425c-b9e0-9f885619f2af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:06:31 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-6b4921b1-216c-40fa-875e-8996958ef3c6 tempest-SnapshotDependencyTests-1674021511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77e02d09-eeea-411f-b556-7bc3d595dbf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:06:31 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-6b4921b1-216c-40fa-875e-8996958ef3c6 tempest-SnapshotDependencyTests-1674021511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77e02d09-eeea-411f-b556-7bc3d595dbf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6c995f44-a4f9-482e-8a4f-48e6860dfdbd', 'volume_name': 'volume-6c995f44-a4f9-482e-8a4f-48e6860dfdbd', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:06:31 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-6b4921b1-216c-40fa-875e-8996958ef3c6 tempest-SnapshotDependencyTests-1674021511 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb222c18-cae4-431f-ba41-9100d19d2288) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:06:31 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-6b4921b1-216c-40fa-875e-8996958ef3c6 tempest-SnapshotDependencyTests-1674021511 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb222c18-cae4-431f-ba41-9100d19d2288) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:06:31 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-6b4921b1-216c-40fa-875e-8996958ef3c6 tempest-SnapshotDependencyTests-1674021511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a0716aa-e121-40f5-800b-3f5dc4de1a9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:06:31 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-6b4921b1-216c-40fa-875e-8996958ef3c6 tempest-SnapshotDependencyTests-1674021511 None] Volume 6c995f44-a4f9-482e-8a4f-48e6860dfdbd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6c995f44-a4f9-482e-8a4f-48e6860dfdbd', 'volume_size': 1} Jul 13 14:06:31 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-6b4921b1-216c-40fa-875e-8996958ef3c6 tempest-SnapshotDependencyTests-1674021511 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 14:06:31 devstack sudo[105383]: pam_unix(sudo:session): session closed for user root Jul 13 14:06:31 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-ae1a2833-0000-4224-8544-7f08ed79145c tempest-ProjectMemberTests-718446646 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-3f895f5b-2083-4556-bf02-23cd7f508d8c.3dfdf00b-8888-499e-a0d6-48d69781f4f5" returned: 0 in 0.412s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:06:31 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-ae1a2833-0000-4224-8544-7f08ed79145c tempest-ProjectMemberTests-718446646 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3f895f5b-2083-4556-bf02-23cd7f508d8c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87098) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 13 14:06:31 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e881005-0aca-4660-b964-f94876b092cb]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 14:06:31 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-ae1a2833-0000-4224-8544-7f08ed79145c tempest-ProjectMemberTests-718446646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-3f895f5b-2083-4556-bf02-23cd7f508d8c {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:06:31 devstack sudo[105384]: pam_unix(sudo:session): session closed for user root Jul 13 14:06:31 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-b4b2076b-e0b2-49cd-b503-0bd8201788fa tempest-ProjectReaderTests-123956539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-53c700b8-7578-4582-b638-d52e5812db83 1073741824" returned: 0 in 0.469s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:06:31 devstack sudo[105393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-3f895f5b-2083-4556-bf02-23cd7f508d8c Jul 13 14:06:31 devstack sudo[105393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:06:31 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-b4b2076b-e0b2-49cd-b503-0bd8201788fa tempest-ProjectReaderTests-123956539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-53c700b8-7578-4582-b638-d52e5812db83 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:06:31 devstack sudo[105395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-53c700b8-7578-4582-b638-d52e5812db83 Jul 13 14:06:31 devstack sudo[105395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:06:31 devstack sudo[105393]: pam_unix(sudo:session): session closed for user root Jul 13 14:06:31 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-ae1a2833-0000-4224-8544-7f08ed79145c tempest-ProjectMemberTests-718446646 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-3f895f5b-2083-4556-bf02-23cd7f508d8c" returned: 0 in 0.390s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:06:31 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-ae1a2833-0000-4224-8544-7f08ed79145c tempest-ProjectMemberTests-718446646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-3f895f5b-2083-4556-bf02-23cd7f508d8c.3dfdf00b-8888-499e-a0d6-48d69781f4f5 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:06:31 devstack sudo[105395]: pam_unix(sudo:session): session closed for user root Jul 13 14:06:31 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-b4b2076b-e0b2-49cd-b503-0bd8201788fa tempest-ProjectReaderTests-123956539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-53c700b8-7578-4582-b638-d52e5812db83" returned: 0 in 0.258s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:06:31 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-b4b2076b-e0b2-49cd-b503-0bd8201788fa tempest-ProjectReaderTests-123956539 None] <== create_volume: return (771ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'} {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 13 14:06:31 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-b4b2076b-e0b2-49cd-b503-0bd8201788fa tempest-ProjectReaderTests-123956539 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.774s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 14:06:31 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-6b4921b1-216c-40fa-875e-8996958ef3c6 tempest-SnapshotDependencyTests-1674021511 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.675s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 14:06:31 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-6b4921b1-216c-40fa-875e-8996958ef3c6 tempest-SnapshotDependencyTests-1674021511 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T12:06:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-461346162',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c995f44-a4f9-482e-8a4f-48e6860dfdbd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7d9b0e094c84fa587e57be9640bc8e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T12:06:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T12:06:31Z,use_quota=True,user_id='f7710644902a49fea7639af7ac0ed6c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1147de8b-623b-426c-a13d-7fc824a80f67),volume_type_id=1147de8b-623b-426c-a13d-7fc824a80f67)}" {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 13 14:06:31 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-6b4921b1-216c-40fa-875e-8996958ef3c6 tempest-SnapshotDependencyTests-1674021511 None] Creating volume 6c995f44-a4f9-482e-8a4f-48e6860dfdbd {{(pid=87098) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 13 14:06:31 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-6b4921b1-216c-40fa-875e-8996958ef3c6 tempest-SnapshotDependencyTests-1674021511 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 14:06:31 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-6b4921b1-216c-40fa-875e-8996958ef3c6 tempest-SnapshotDependencyTests-1674021511 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 14:06:31 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-6b4921b1-216c-40fa-875e-8996958ef3c6 tempest-SnapshotDependencyTests-1674021511 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 14:06:31 devstack sudo[105401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-3f895f5b-2083-4556-bf02-23cd7f508d8c.3dfdf00b-8888-499e-a0d6-48d69781f4f5 Jul 13 14:06:31 devstack sudo[105401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:06:31 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-6b4921b1-216c-40fa-875e-8996958ef3c6 tempest-SnapshotDependencyTests-1674021511 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 14:06:31 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-6b4921b1-216c-40fa-875e-8996958ef3c6 tempest-SnapshotDependencyTests-1674021511 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 14:06:31 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-6b4921b1-216c-40fa-875e-8996958ef3c6 tempest-SnapshotDependencyTests-1674021511 None] Selected osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 14:06:31 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-6b4921b1-216c-40fa-875e-8996958ef3c6 tempest-SnapshotDependencyTests-1674021511 None] casted to osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 Jul 13 14:06:31 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-6b4921b1-216c-40fa-875e-8996958ef3c6 tempest-SnapshotDependencyTests-1674021511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-6c995f44-a4f9-482e-8a4f-48e6860dfdbd 1073741824 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:06:31 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-b4b2076b-e0b2-49cd-b503-0bd8201788fa tempest-ProjectReaderTests-123956539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85185a18-acfa-4d5b-b5c3-9b40ad2f8770) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-53c700b8-7578-4582-b638-d52e5812db83', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:06:31 devstack sudo[105403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-6c995f44-a4f9-482e-8a4f-48e6860dfdbd 1073741824 Jul 13 14:06:31 devstack sudo[105403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:06:31 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-b4b2076b-e0b2-49cd-b503-0bd8201788fa tempest-ProjectReaderTests-123956539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf6a79fb-a623-48b5-be8d-1c4e4129e75e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:06:31 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-b4b2076b-e0b2-49cd-b503-0bd8201788fa tempest-ProjectReaderTests-123956539 None] Volume volume-53c700b8-7578-4582-b638-d52e5812db83 (53c700b8-7578-4582-b638-d52e5812db83): created successfully Jul 13 14:06:31 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-b4b2076b-e0b2-49cd-b503-0bd8201788fa tempest-ProjectReaderTests-123956539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf6a79fb-a623-48b5-be8d-1c4e4129e75e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:06:31 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-b4b2076b-e0b2-49cd-b503-0bd8201788fa tempest-ProjectReaderTests-123956539 None] Flow 'volume_create_manager' (e006a03e-6733-43e1-a047-002fa210ec74) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 14:06:31 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-b4b2076b-e0b2-49cd-b503-0bd8201788fa tempest-ProjectReaderTests-123956539 None] Created volume successfully. Jul 13 14:06:32 devstack sudo[105401]: pam_unix(sudo:session): session closed for user root Jul 13 14:06:32 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-ae1a2833-0000-4224-8544-7f08ed79145c tempest-ProjectMemberTests-718446646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-3f895f5b-2083-4556-bf02-23cd7f508d8c.3dfdf00b-8888-499e-a0d6-48d69781f4f5" returned: 0 in 0.366s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:06:32 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-ae1a2833-0000-4224-8544-7f08ed79145c tempest-ProjectMemberTests-718446646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-3f895f5b-2083-4556-bf02-23cd7f508d8c.3dfdf00b-8888-499e-a0d6-48d69781f4f5 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:06:32 devstack sudo[105412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-3f895f5b-2083-4556-bf02-23cd7f508d8c.3dfdf00b-8888-499e-a0d6-48d69781f4f5 Jul 13 14:06:32 devstack sudo[105412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:06:32 devstack sudo[105403]: pam_unix(sudo:session): session closed for user root Jul 13 14:06:32 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-6b4921b1-216c-40fa-875e-8996958ef3c6 tempest-SnapshotDependencyTests-1674021511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-6c995f44-a4f9-482e-8a4f-48e6860dfdbd 1073741824" returned: 0 in 0.446s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:06:32 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-6b4921b1-216c-40fa-875e-8996958ef3c6 tempest-SnapshotDependencyTests-1674021511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-6c995f44-a4f9-482e-8a4f-48e6860dfdbd {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:06:32 devstack sudo[105414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-6c995f44-a4f9-482e-8a4f-48e6860dfdbd Jul 13 14:06:32 devstack sudo[105414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:06:32 devstack sudo[105412]: pam_unix(sudo:session): session closed for user root Jul 13 14:06:32 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-ae1a2833-0000-4224-8544-7f08ed79145c tempest-ProjectMemberTests-718446646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-3f895f5b-2083-4556-bf02-23cd7f508d8c.3dfdf00b-8888-499e-a0d6-48d69781f4f5" returned: 0 in 0.247s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:06:32 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-ae1a2833-0000-4224-8544-7f08ed79145c tempest-ProjectMemberTests-718446646 None] Lock "cinder-quobyte-3dfdf00b-8888-499e-a0d6-48d69781f4f5" released by "_delete_snapshot" :: held 1.553s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 14:06:32 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-ae1a2833-0000-4224-8544-7f08ed79145c tempest-ProjectMemberTests-718446646 None] Lock "cinder-quobyte-3f895f5b-2083-4556-bf02-23cd7f508d8c" released by "delete_snapshot" :: held 1.578s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 14:06:32 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-ae1a2833-0000-4224-8544-7f08ed79145c tempest-ProjectMemberTests-718446646 None] Created reservations ['9e29e19d-e739-49cb-b58c-e79ec01e7d2e', 'dacec078-bde4-4e0a-afe7-e0bfe59ccef4', 'cd4286ba-7ed6-4c16-bcff-22c9d3ef96df', '1353d8fb-7c13-4bcd-a0f2-b55ceea32473'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 14:06:32 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-ae1a2833-0000-4224-8544-7f08ed79145c tempest-ProjectMemberTests-718446646 None] Delete snapshot completed successfully. Jul 13 14:06:32 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-ae1a2833-0000-4224-8544-7f08ed79145c tempest-ProjectMemberTests-718446646 None] Lock "cinder-3dfdf00b-8888-499e-a0d6-48d69781f4f5-delete_snapshot" released by "delete_snapshot" :: held 1.728s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 14:06:32 devstack sudo[105414]: pam_unix(sudo:session): session closed for user root Jul 13 14:06:32 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-6b4921b1-216c-40fa-875e-8996958ef3c6 tempest-SnapshotDependencyTests-1674021511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-6c995f44-a4f9-482e-8a4f-48e6860dfdbd" returned: 0 in 0.274s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:06:32 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-6b4921b1-216c-40fa-875e-8996958ef3c6 tempest-SnapshotDependencyTests-1674021511 None] <== create_volume: return (762ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'} {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 13 14:06:32 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-6b4921b1-216c-40fa-875e-8996958ef3c6 tempest-SnapshotDependencyTests-1674021511 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.767s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 14:06:32 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-6b4921b1-216c-40fa-875e-8996958ef3c6 tempest-SnapshotDependencyTests-1674021511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a0716aa-e121-40f5-800b-3f5dc4de1a9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6c995f44-a4f9-482e-8a4f-48e6860dfdbd', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:06:32 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-6b4921b1-216c-40fa-875e-8996958ef3c6 tempest-SnapshotDependencyTests-1674021511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f2faf26-2e82-44f5-b66a-c875874748e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:06:32 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-6b4921b1-216c-40fa-875e-8996958ef3c6 tempest-SnapshotDependencyTests-1674021511 None] Volume volume-6c995f44-a4f9-482e-8a4f-48e6860dfdbd (6c995f44-a4f9-482e-8a4f-48e6860dfdbd): created successfully Jul 13 14:06:32 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-6b4921b1-216c-40fa-875e-8996958ef3c6 tempest-SnapshotDependencyTests-1674021511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f2faf26-2e82-44f5-b66a-c875874748e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:06:32 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-6b4921b1-216c-40fa-875e-8996958ef3c6 tempest-SnapshotDependencyTests-1674021511 None] Flow 'volume_create_manager' (de91bfda-eb2f-483a-91cc-a2ac1561128c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 14:06:32 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-6b4921b1-216c-40fa-875e-8996958ef3c6 tempest-SnapshotDependencyTests-1674021511 None] Created volume successfully. Jul 13 14:06:32 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-3ffeb509-ee43-43c4-854a-5e6edf04370e tempest-ProjectReaderTests-123956539 None] Acquiring lock "cinder-53c700b8-7578-4582-b638-d52e5812db83-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 14:06:32 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-3ffeb509-ee43-43c4-854a-5e6edf04370e tempest-ProjectReaderTests-123956539 None] Lock "cinder-53c700b8-7578-4582-b638-d52e5812db83-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 14:06:32 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-3ffeb509-ee43-43c4-854a-5e6edf04370e tempest-ProjectReaderTests-123956539 None] Acquiring lock "cinder-quobyte-53c700b8-7578-4582-b638-d52e5812db83" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 14:06:32 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-3ffeb509-ee43-43c4-854a-5e6edf04370e tempest-ProjectReaderTests-123956539 None] Lock "cinder-quobyte-53c700b8-7578-4582-b638-d52e5812db83" acquired by "delete_volume" :: waited 0.018s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 14:06:33 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0edbb22-0c57-4439-8c4f-b2a9450ebca6]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 14:06:33 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-3ffeb509-ee43-43c4-854a-5e6edf04370e tempest-ProjectReaderTests-123956539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-53c700b8-7578-4582-b638-d52e5812db83 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:06:33 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-5f6479e1-879b-4e94-87b5-7d9e249e4a4c tempest-ProjectMemberTests-718446646 None] Acquiring lock "cinder-3f895f5b-2083-4556-bf02-23cd7f508d8c-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 14:06:33 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-5f6479e1-879b-4e94-87b5-7d9e249e4a4c tempest-ProjectMemberTests-718446646 None] Lock "cinder-3f895f5b-2083-4556-bf02-23cd7f508d8c-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 14:06:33 devstack sudo[105418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-53c700b8-7578-4582-b638-d52e5812db83 Jul 13 14:06:33 devstack sudo[105418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:06:33 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-5f6479e1-879b-4e94-87b5-7d9e249e4a4c tempest-ProjectMemberTests-718446646 None] Acquiring lock "cinder-quobyte-3f895f5b-2083-4556-bf02-23cd7f508d8c" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 14:06:33 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-5f6479e1-879b-4e94-87b5-7d9e249e4a4c tempest-ProjectMemberTests-718446646 None] Lock "cinder-quobyte-3f895f5b-2083-4556-bf02-23cd7f508d8c" acquired by "delete_volume" :: waited 0.020s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 14:06:33 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-a3086521-13c6-4705-9f9c-247d2c6a7c78 tempest-SnapshotDependencyTests-1674021511 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 14:06:33 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-a3086521-13c6-4705-9f9c-247d2c6a7c78 tempest-SnapshotDependencyTests-1674021511 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 14:06:33 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b0361ec-4ad1-405b-9a48-52323225615b]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 14:06:33 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-5f6479e1-879b-4e94-87b5-7d9e249e4a4c tempest-ProjectMemberTests-718446646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-3f895f5b-2083-4556-bf02-23cd7f508d8c {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:06:33 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-a3086521-13c6-4705-9f9c-247d2c6a7c78 tempest-SnapshotDependencyTests-1674021511 None] Creating offline snapshot 7eb2aea2-dc27-458c-8885-95b3cb578000 of volume 6c995f44-a4f9-482e-8a4f-48e6860dfdbd {{(pid=87098) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 13 14:06:33 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[a55ce1bf-28ea-47e6-b79d-b848eed8eb92]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 14:06:33 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-a3086521-13c6-4705-9f9c-247d2c6a7c78 tempest-SnapshotDependencyTests-1674021511 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-6c995f44-a4f9-482e-8a4f-48e6860dfdbd {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:06:33 devstack sudo[105420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-3f895f5b-2083-4556-bf02-23cd7f508d8c Jul 13 14:06:33 devstack sudo[105420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:06:33 devstack sudo[105421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-6c995f44-a4f9-482e-8a4f-48e6860dfdbd Jul 13 14:06:33 devstack sudo[105421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:06:33 devstack sudo[105418]: pam_unix(sudo:session): session closed for user root Jul 13 14:06:33 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-3ffeb509-ee43-43c4-854a-5e6edf04370e tempest-ProjectReaderTests-123956539 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-53c700b8-7578-4582-b638-d52e5812db83" returned: 0 in 0.429s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:06:33 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-3ffeb509-ee43-43c4-854a-5e6edf04370e tempest-ProjectReaderTests-123956539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-53c700b8-7578-4582-b638-d52e5812db83 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:06:33 devstack sudo[105427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-53c700b8-7578-4582-b638-d52e5812db83 Jul 13 14:06:33 devstack sudo[105427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:06:33 devstack sudo[105420]: pam_unix(sudo:session): session closed for user root Jul 13 14:06:33 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-5f6479e1-879b-4e94-87b5-7d9e249e4a4c tempest-ProjectMemberTests-718446646 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-3f895f5b-2083-4556-bf02-23cd7f508d8c" returned: 0 in 0.413s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:06:33 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-5f6479e1-879b-4e94-87b5-7d9e249e4a4c tempest-ProjectMemberTests-718446646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-3f895f5b-2083-4556-bf02-23cd7f508d8c {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:06:33 devstack sudo[105421]: pam_unix(sudo:session): session closed for user root Jul 13 14:06:33 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-a3086521-13c6-4705-9f9c-247d2c6a7c78 tempest-SnapshotDependencyTests-1674021511 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-6c995f44-a4f9-482e-8a4f-48e6860dfdbd" returned: 0 in 0.403s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:06:33 devstack sudo[105437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-3f895f5b-2083-4556-bf02-23cd7f508d8c Jul 13 14:06:33 devstack sudo[105437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:06:33 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-a3086521-13c6-4705-9f9c-247d2c6a7c78 tempest-SnapshotDependencyTests-1674021511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-6c995f44-a4f9-482e-8a4f-48e6860dfdbd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-6c995f44-a4f9-482e-8a4f-48e6860dfdbd.7eb2aea2-dc27-458c-8885-95b3cb578000 1G {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:06:33 devstack sudo[105427]: pam_unix(sudo:session): session closed for user root Jul 13 14:06:33 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-3ffeb509-ee43-43c4-854a-5e6edf04370e tempest-ProjectReaderTests-123956539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-53c700b8-7578-4582-b638-d52e5812db83" returned: 0 in 0.272s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:06:33 devstack sudo[105439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-6c995f44-a4f9-482e-8a4f-48e6860dfdbd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-6c995f44-a4f9-482e-8a4f-48e6860dfdbd.7eb2aea2-dc27-458c-8885-95b3cb578000 1G Jul 13 14:06:33 devstack sudo[105439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:06:33 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-3ffeb509-ee43-43c4-854a-5e6edf04370e tempest-ProjectReaderTests-123956539 None] Lock "cinder-quobyte-53c700b8-7578-4582-b638-d52e5812db83" released by "delete_volume" :: held 0.752s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 14:06:33 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-3ffeb509-ee43-43c4-854a-5e6edf04370e tempest-ProjectReaderTests-123956539 None] Created reservations ['8e2d3da7-0d7e-47ca-b178-860fd9502951', '6d8a273a-4fd3-45da-b921-4955913edd7d', 'd6380e85-ca18-4a87-ae41-35cd70f3e11a', '8609cfb9-8234-4de3-b0fa-ebbf5ffdd5bb'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 14:06:33 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-3ffeb509-ee43-43c4-854a-5e6edf04370e tempest-ProjectReaderTests-123956539 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 14:06:33 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-3ffeb509-ee43-43c4-854a-5e6edf04370e tempest-ProjectReaderTests-123956539 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 14:06:33 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-3ffeb509-ee43-43c4-854a-5e6edf04370e tempest-ProjectReaderTests-123956539 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 14:06:33 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-3ffeb509-ee43-43c4-854a-5e6edf04370e tempest-ProjectReaderTests-123956539 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 14:06:33 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-3ffeb509-ee43-43c4-854a-5e6edf04370e tempest-ProjectReaderTests-123956539 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 14:06:33 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-3ffeb509-ee43-43c4-854a-5e6edf04370e tempest-ProjectReaderTests-123956539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:06:33 devstack sudo[105441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 Jul 13 14:06:33 devstack sudo[105441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:06:33 devstack sudo[105437]: pam_unix(sudo:session): session closed for user root Jul 13 14:06:33 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-5f6479e1-879b-4e94-87b5-7d9e249e4a4c tempest-ProjectMemberTests-718446646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-3f895f5b-2083-4556-bf02-23cd7f508d8c" returned: 0 in 0.261s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:06:33 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-5f6479e1-879b-4e94-87b5-7d9e249e4a4c tempest-ProjectMemberTests-718446646 None] Lock "cinder-quobyte-3f895f5b-2083-4556-bf02-23cd7f508d8c" released by "delete_volume" :: held 0.739s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 14:06:34 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-5f6479e1-879b-4e94-87b5-7d9e249e4a4c tempest-ProjectMemberTests-718446646 None] Created reservations ['0e4487bb-e079-432b-b328-115e96ceccfa', '46ce5823-427f-4402-925b-2846783e7663', 'c171c0ad-9924-4ca4-b3f1-acc65bf5d24b', '74555a39-8c8c-47bf-9a21-290b1b5b32d4'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 14:06:34 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-5f6479e1-879b-4e94-87b5-7d9e249e4a4c tempest-ProjectMemberTests-718446646 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 14:06:34 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-5f6479e1-879b-4e94-87b5-7d9e249e4a4c tempest-ProjectMemberTests-718446646 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 14:06:34 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-5f6479e1-879b-4e94-87b5-7d9e249e4a4c tempest-ProjectMemberTests-718446646 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 14:06:34 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-5f6479e1-879b-4e94-87b5-7d9e249e4a4c tempest-ProjectMemberTests-718446646 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 14:06:34 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-5f6479e1-879b-4e94-87b5-7d9e249e4a4c tempest-ProjectMemberTests-718446646 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 14:06:34 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-5f6479e1-879b-4e94-87b5-7d9e249e4a4c tempest-ProjectMemberTests-718446646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:06:34 devstack sudo[105441]: pam_unix(sudo:session): session closed for user root Jul 13 14:06:34 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-3ffeb509-ee43-43c4-854a-5e6edf04370e tempest-ProjectReaderTests-123956539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78" returned: 0 in 0.291s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:06:34 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-3ffeb509-ee43-43c4-854a-5e6edf04370e tempest-ProjectReaderTests-123956539 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 14:06:34 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-3ffeb509-ee43-43c4-854a-5e6edf04370e tempest-ProjectReaderTests-123956539 None] Deleted volume successfully. Jul 13 14:06:34 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-3ffeb509-ee43-43c4-854a-5e6edf04370e tempest-ProjectReaderTests-123956539 None] Lock "cinder-53c700b8-7578-4582-b638-d52e5812db83-delete_volume" released by "delete_volume" :: held 1.268s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 14:06:34 devstack sudo[105449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 Jul 13 14:06:34 devstack sudo[105449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:06:34 devstack sudo[105439]: pam_unix(sudo:session): session closed for user root Jul 13 14:06:34 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-a3086521-13c6-4705-9f9c-247d2c6a7c78 tempest-SnapshotDependencyTests-1674021511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-6c995f44-a4f9-482e-8a4f-48e6860dfdbd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-6c995f44-a4f9-482e-8a4f-48e6860dfdbd.7eb2aea2-dc27-458c-8885-95b3cb578000 1G" returned: 0 in 0.522s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:06:34 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-a3086521-13c6-4705-9f9c-247d2c6a7c78 tempest-SnapshotDependencyTests-1674021511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6c995f44-a4f9-482e-8a4f-48e6860dfdbd -F qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-6c995f44-a4f9-482e-8a4f-48e6860dfdbd.7eb2aea2-dc27-458c-8885-95b3cb578000 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:06:34 devstack sudo[105451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6c995f44-a4f9-482e-8a4f-48e6860dfdbd -F qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-6c995f44-a4f9-482e-8a4f-48e6860dfdbd.7eb2aea2-dc27-458c-8885-95b3cb578000 Jul 13 14:06:34 devstack sudo[105451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:06:34 devstack sudo[105449]: pam_unix(sudo:session): session closed for user root Jul 13 14:06:34 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-5f6479e1-879b-4e94-87b5-7d9e249e4a4c tempest-ProjectMemberTests-718446646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78" returned: 0 in 0.342s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:06:34 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-5f6479e1-879b-4e94-87b5-7d9e249e4a4c tempest-ProjectMemberTests-718446646 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 14:06:34 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-5f6479e1-879b-4e94-87b5-7d9e249e4a4c tempest-ProjectMemberTests-718446646 None] Deleted volume successfully. Jul 13 14:06:34 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-5f6479e1-879b-4e94-87b5-7d9e249e4a4c tempest-ProjectMemberTests-718446646 None] Lock "cinder-3f895f5b-2083-4556-bf02-23cd7f508d8c-delete_volume" released by "delete_volume" :: held 1.451s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 14:06:34 devstack sudo[105451]: pam_unix(sudo:session): session closed for user root Jul 13 14:06:34 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-a3086521-13c6-4705-9f9c-247d2c6a7c78 tempest-SnapshotDependencyTests-1674021511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6c995f44-a4f9-482e-8a4f-48e6860dfdbd -F qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-6c995f44-a4f9-482e-8a4f-48e6860dfdbd.7eb2aea2-dc27-458c-8885-95b3cb578000" returned: 0 in 0.394s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:06:34 devstack cinder-volume[87098]: WARNING cinder.volume.drivers.remotefs [None req-a3086521-13c6-4705-9f9c-247d2c6a7c78 tempest-SnapshotDependencyTests-1674021511 None] /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-6c995f44-a4f9-482e-8a4f-48e6860dfdbd.7eb2aea2-dc27-458c-8885-95b3cb578000 is being set with open permissions: ugo+rw Jul 13 14:06:34 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-a3086521-13c6-4705-9f9c-247d2c6a7c78 tempest-SnapshotDependencyTests-1674021511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-6c995f44-a4f9-482e-8a4f-48e6860dfdbd.7eb2aea2-dc27-458c-8885-95b3cb578000 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:06:34 devstack sudo[105458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-6c995f44-a4f9-482e-8a4f-48e6860dfdbd.7eb2aea2-dc27-458c-8885-95b3cb578000 Jul 13 14:06:34 devstack sudo[105458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:06:34 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-d99b2313-b1e6-4f60-8158-6c943a760ec7 tempest-ProjectReaderTests-123956539 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 14:06:34 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-d99b2313-b1e6-4f60-8158-6c943a760ec7 tempest-ProjectReaderTests-123956539 None] Flow 'volume_create_manager' (f5774ef9-71b0-4e8c-9980-90095b3ec9c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 14:06:34 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-d99b2313-b1e6-4f60-8158-6c943a760ec7 tempest-ProjectReaderTests-123956539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35bcc4fe-350e-4db9-8dbe-130e4665932a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:06:34 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-d99b2313-b1e6-4f60-8158-6c943a760ec7 tempest-ProjectReaderTests-123956539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35bcc4fe-350e-4db9-8dbe-130e4665932a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T12:06:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1000202341',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=491b0b6c-6cfb-4097-b73f-805f5ce1323c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c98969346eb94e82918d048a6c20a942',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T12:06:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T12:06:35Z,use_quota=True,user_id='1e148007b3654e4080b71b8d0cbd3cb8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1147de8b-623b-426c-a13d-7fc824a80f67),volume_type_id=1147de8b-623b-426c-a13d-7fc824a80f67)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:06:34 devstack sudo[105458]: pam_unix(sudo:session): session closed for user root Jul 13 14:06:34 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-d99b2313-b1e6-4f60-8158-6c943a760ec7 tempest-ProjectReaderTests-123956539 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eaf86a78-4986-42d6-938f-60770ffb3faa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:06:34 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-d99b2313-b1e6-4f60-8158-6c943a760ec7 tempest-ProjectReaderTests-123956539 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eaf86a78-4986-42d6-938f-60770ffb3faa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:06:34 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-d99b2313-b1e6-4f60-8158-6c943a760ec7 tempest-ProjectReaderTests-123956539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4df6b397-ea69-4e27-a35d-d3d49add49b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:06:34 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-d99b2313-b1e6-4f60-8158-6c943a760ec7 tempest-ProjectReaderTests-123956539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4df6b397-ea69-4e27-a35d-d3d49add49b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '491b0b6c-6cfb-4097-b73f-805f5ce1323c', 'volume_name': 'volume-491b0b6c-6cfb-4097-b73f-805f5ce1323c', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:06:34 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-d99b2313-b1e6-4f60-8158-6c943a760ec7 tempest-ProjectReaderTests-123956539 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (acce043c-d959-4802-8ba1-b19d4a210a7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:06:34 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-d99b2313-b1e6-4f60-8158-6c943a760ec7 tempest-ProjectReaderTests-123956539 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (acce043c-d959-4802-8ba1-b19d4a210a7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:06:34 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-d99b2313-b1e6-4f60-8158-6c943a760ec7 tempest-ProjectReaderTests-123956539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de2ceb0a-b202-49c8-b7d3-55f851d98379) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:06:34 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-d99b2313-b1e6-4f60-8158-6c943a760ec7 tempest-ProjectReaderTests-123956539 None] Volume 491b0b6c-6cfb-4097-b73f-805f5ce1323c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-491b0b6c-6cfb-4097-b73f-805f5ce1323c', 'volume_size': 1} Jul 13 14:06:34 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-d99b2313-b1e6-4f60-8158-6c943a760ec7 tempest-ProjectReaderTests-123956539 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 14:06:34 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-a3086521-13c6-4705-9f9c-247d2c6a7c78 tempest-SnapshotDependencyTests-1674021511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-6c995f44-a4f9-482e-8a4f-48e6860dfdbd.7eb2aea2-dc27-458c-8885-95b3cb578000" returned: 0 in 0.323s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:06:34 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-88c35bd9-db7a-40b6-8ede-e5598cf6463b tempest-ProjectMemberTests-718446646 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 14:06:34 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-88c35bd9-db7a-40b6-8ede-e5598cf6463b tempest-ProjectMemberTests-718446646 None] Flow 'volume_create_manager' (b8527261-66ab-4534-b3ea-035fdb6f935f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 14:06:34 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-88c35bd9-db7a-40b6-8ede-e5598cf6463b tempest-ProjectMemberTests-718446646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e029ebbb-bf57-4d1f-aa1a-2e68737c034e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:06:35 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-88c35bd9-db7a-40b6-8ede-e5598cf6463b tempest-ProjectMemberTests-718446646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e029ebbb-bf57-4d1f-aa1a-2e68737c034e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T12:06:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2138152127',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77b3539a-4e6f-4aae-876d-4cdb2ca57ecd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2bb0e12a2763448b9d28151e1e814854',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T12:06:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T12:06:35Z,use_quota=True,user_id='2d16431e25f348deb700350f5b150c69',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1147de8b-623b-426c-a13d-7fc824a80f67),volume_type_id=1147de8b-623b-426c-a13d-7fc824a80f67)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:06:35 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-88c35bd9-db7a-40b6-8ede-e5598cf6463b tempest-ProjectMemberTests-718446646 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98c74131-5d0a-447a-b234-93a7c80ca886) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:06:35 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-88c35bd9-db7a-40b6-8ede-e5598cf6463b tempest-ProjectMemberTests-718446646 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98c74131-5d0a-447a-b234-93a7c80ca886) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:06:35 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-88c35bd9-db7a-40b6-8ede-e5598cf6463b tempest-ProjectMemberTests-718446646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (104d9b51-5d6f-4b70-84c7-a06307b50b78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:06:35 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-88c35bd9-db7a-40b6-8ede-e5598cf6463b tempest-ProjectMemberTests-718446646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (104d9b51-5d6f-4b70-84c7-a06307b50b78) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '77b3539a-4e6f-4aae-876d-4cdb2ca57ecd', 'volume_name': 'volume-77b3539a-4e6f-4aae-876d-4cdb2ca57ecd', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:06:35 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-88c35bd9-db7a-40b6-8ede-e5598cf6463b tempest-ProjectMemberTests-718446646 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3923ff6b-6e98-4997-86ed-5c2c06930cb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:06:35 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-88c35bd9-db7a-40b6-8ede-e5598cf6463b tempest-ProjectMemberTests-718446646 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3923ff6b-6e98-4997-86ed-5c2c06930cb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:06:35 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-88c35bd9-db7a-40b6-8ede-e5598cf6463b tempest-ProjectMemberTests-718446646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42ee16cd-34fe-4125-9f4c-0865a7284f49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:06:35 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-88c35bd9-db7a-40b6-8ede-e5598cf6463b tempest-ProjectMemberTests-718446646 None] Volume 77b3539a-4e6f-4aae-876d-4cdb2ca57ecd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-77b3539a-4e6f-4aae-876d-4cdb2ca57ecd', 'volume_size': 1} Jul 13 14:06:35 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-88c35bd9-db7a-40b6-8ede-e5598cf6463b tempest-ProjectMemberTests-718446646 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 14:06:35 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-a3086521-13c6-4705-9f9c-247d2c6a7c78 tempest-SnapshotDependencyTests-1674021511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-6c995f44-a4f9-482e-8a4f-48e6860dfdbd.info {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:06:35 devstack sudo[105461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-6c995f44-a4f9-482e-8a4f-48e6860dfdbd.info Jul 13 14:06:35 devstack sudo[105461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:06:35 devstack sudo[105461]: pam_unix(sudo:session): session closed for user root Jul 13 14:06:35 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-a3086521-13c6-4705-9f9c-247d2c6a7c78 tempest-SnapshotDependencyTests-1674021511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-6c995f44-a4f9-482e-8a4f-48e6860dfdbd.info" returned: 0 in 0.248s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:06:35 devstack cinder-volume[87098]: WARNING cinder.volume.drivers.remotefs [None req-a3086521-13c6-4705-9f9c-247d2c6a7c78 tempest-SnapshotDependencyTests-1674021511 None] /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-6c995f44-a4f9-482e-8a4f-48e6860dfdbd.info is being set with open permissions: ugo+rw Jul 13 14:06:35 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-a3086521-13c6-4705-9f9c-247d2c6a7c78 tempest-SnapshotDependencyTests-1674021511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-6c995f44-a4f9-482e-8a4f-48e6860dfdbd.info {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:06:35 devstack sudo[105464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-6c995f44-a4f9-482e-8a4f-48e6860dfdbd.info Jul 13 14:06:35 devstack sudo[105464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:06:35 devstack sudo[105464]: pam_unix(sudo:session): session closed for user root Jul 13 14:06:35 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-a3086521-13c6-4705-9f9c-247d2c6a7c78 tempest-SnapshotDependencyTests-1674021511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-6c995f44-a4f9-482e-8a4f-48e6860dfdbd.info" returned: 0 in 0.238s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:06:35 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-a3086521-13c6-4705-9f9c-247d2c6a7c78 tempest-SnapshotDependencyTests-1674021511 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.307s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 14:06:35 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-d99b2313-b1e6-4f60-8158-6c943a760ec7 tempest-ProjectReaderTests-123956539 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.615s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 14:06:35 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-d99b2313-b1e6-4f60-8158-6c943a760ec7 tempest-ProjectReaderTests-123956539 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T12:06:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1000202341',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=491b0b6c-6cfb-4097-b73f-805f5ce1323c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c98969346eb94e82918d048a6c20a942',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T12:06:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T12:06:35Z,use_quota=True,user_id='1e148007b3654e4080b71b8d0cbd3cb8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1147de8b-623b-426c-a13d-7fc824a80f67),volume_type_id=1147de8b-623b-426c-a13d-7fc824a80f67)}" {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 13 14:06:35 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-d99b2313-b1e6-4f60-8158-6c943a760ec7 tempest-ProjectReaderTests-123956539 None] Creating volume 491b0b6c-6cfb-4097-b73f-805f5ce1323c {{(pid=87098) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 13 14:06:35 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-d99b2313-b1e6-4f60-8158-6c943a760ec7 tempest-ProjectReaderTests-123956539 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 14:06:35 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-d99b2313-b1e6-4f60-8158-6c943a760ec7 tempest-ProjectReaderTests-123956539 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 14:06:35 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-d99b2313-b1e6-4f60-8158-6c943a760ec7 tempest-ProjectReaderTests-123956539 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 14:06:35 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-d99b2313-b1e6-4f60-8158-6c943a760ec7 tempest-ProjectReaderTests-123956539 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 14:06:35 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-d99b2313-b1e6-4f60-8158-6c943a760ec7 tempest-ProjectReaderTests-123956539 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 14:06:35 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-d99b2313-b1e6-4f60-8158-6c943a760ec7 tempest-ProjectReaderTests-123956539 None] Selected osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 14:06:35 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-d99b2313-b1e6-4f60-8158-6c943a760ec7 tempest-ProjectReaderTests-123956539 None] casted to osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 Jul 13 14:06:35 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-d99b2313-b1e6-4f60-8158-6c943a760ec7 tempest-ProjectReaderTests-123956539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-491b0b6c-6cfb-4097-b73f-805f5ce1323c 1073741824 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:06:35 devstack sudo[105467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-491b0b6c-6cfb-4097-b73f-805f5ce1323c 1073741824 Jul 13 14:06:35 devstack sudo[105467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:06:35 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-a3086521-13c6-4705-9f9c-247d2c6a7c78 tempest-SnapshotDependencyTests-1674021511 None] Create snapshot completed successfully Jul 13 14:06:35 devstack sudo[105467]: pam_unix(sudo:session): session closed for user root Jul 13 14:06:35 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-d99b2313-b1e6-4f60-8158-6c943a760ec7 tempest-ProjectReaderTests-123956539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-491b0b6c-6cfb-4097-b73f-805f5ce1323c 1073741824" returned: 0 in 0.418s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:06:36 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-d99b2313-b1e6-4f60-8158-6c943a760ec7 tempest-ProjectReaderTests-123956539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-491b0b6c-6cfb-4097-b73f-805f5ce1323c {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:06:36 devstack sudo[105472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-491b0b6c-6cfb-4097-b73f-805f5ce1323c Jul 13 14:06:36 devstack sudo[105472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:06:36 devstack sudo[105472]: pam_unix(sudo:session): session closed for user root Jul 13 14:06:36 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-d99b2313-b1e6-4f60-8158-6c943a760ec7 tempest-ProjectReaderTests-123956539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-491b0b6c-6cfb-4097-b73f-805f5ce1323c" returned: 0 in 0.254s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:06:36 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-d99b2313-b1e6-4f60-8158-6c943a760ec7 tempest-ProjectReaderTests-123956539 None] <== create_volume: return (709ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'} {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 13 14:06:36 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-d99b2313-b1e6-4f60-8158-6c943a760ec7 tempest-ProjectReaderTests-123956539 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.713s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 14:06:36 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-88c35bd9-db7a-40b6-8ede-e5598cf6463b tempest-ProjectMemberTests-718446646 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.241s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 14:06:36 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-88c35bd9-db7a-40b6-8ede-e5598cf6463b tempest-ProjectMemberTests-718446646 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T12:06:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2138152127',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77b3539a-4e6f-4aae-876d-4cdb2ca57ecd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2bb0e12a2763448b9d28151e1e814854',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T12:06:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T12:06:35Z,use_quota=True,user_id='2d16431e25f348deb700350f5b150c69',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1147de8b-623b-426c-a13d-7fc824a80f67),volume_type_id=1147de8b-623b-426c-a13d-7fc824a80f67)}" {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 13 14:06:36 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-88c35bd9-db7a-40b6-8ede-e5598cf6463b tempest-ProjectMemberTests-718446646 None] Creating volume 77b3539a-4e6f-4aae-876d-4cdb2ca57ecd {{(pid=87098) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 13 14:06:36 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-88c35bd9-db7a-40b6-8ede-e5598cf6463b tempest-ProjectMemberTests-718446646 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 14:06:36 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-88c35bd9-db7a-40b6-8ede-e5598cf6463b tempest-ProjectMemberTests-718446646 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 14:06:36 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-88c35bd9-db7a-40b6-8ede-e5598cf6463b tempest-ProjectMemberTests-718446646 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 14:06:36 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-88c35bd9-db7a-40b6-8ede-e5598cf6463b tempest-ProjectMemberTests-718446646 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 14:06:36 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-88c35bd9-db7a-40b6-8ede-e5598cf6463b tempest-ProjectMemberTests-718446646 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 14:06:36 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-88c35bd9-db7a-40b6-8ede-e5598cf6463b tempest-ProjectMemberTests-718446646 None] Selected osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 14:06:36 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-88c35bd9-db7a-40b6-8ede-e5598cf6463b tempest-ProjectMemberTests-718446646 None] casted to osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 Jul 13 14:06:36 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-88c35bd9-db7a-40b6-8ede-e5598cf6463b tempest-ProjectMemberTests-718446646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-77b3539a-4e6f-4aae-876d-4cdb2ca57ecd 1073741824 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:06:36 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-d99b2313-b1e6-4f60-8158-6c943a760ec7 tempest-ProjectReaderTests-123956539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de2ceb0a-b202-49c8-b7d3-55f851d98379) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-491b0b6c-6cfb-4097-b73f-805f5ce1323c', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:06:36 devstack sudo[105475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-77b3539a-4e6f-4aae-876d-4cdb2ca57ecd 1073741824 Jul 13 14:06:36 devstack sudo[105475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:06:36 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-d99b2313-b1e6-4f60-8158-6c943a760ec7 tempest-ProjectReaderTests-123956539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6894a51-80ba-4058-a260-36beb078ae95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:06:36 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-d99b2313-b1e6-4f60-8158-6c943a760ec7 tempest-ProjectReaderTests-123956539 None] Volume volume-491b0b6c-6cfb-4097-b73f-805f5ce1323c (491b0b6c-6cfb-4097-b73f-805f5ce1323c): created successfully Jul 13 14:06:36 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-d99b2313-b1e6-4f60-8158-6c943a760ec7 tempest-ProjectReaderTests-123956539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6894a51-80ba-4058-a260-36beb078ae95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:06:36 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-d99b2313-b1e6-4f60-8158-6c943a760ec7 tempest-ProjectReaderTests-123956539 None] Flow 'volume_create_manager' (f5774ef9-71b0-4e8c-9980-90095b3ec9c3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 14:06:36 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-d99b2313-b1e6-4f60-8158-6c943a760ec7 tempest-ProjectReaderTests-123956539 None] Created volume successfully. Jul 13 14:06:36 devstack sudo[105475]: pam_unix(sudo:session): session closed for user root Jul 13 14:06:36 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-88c35bd9-db7a-40b6-8ede-e5598cf6463b tempest-ProjectMemberTests-718446646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-77b3539a-4e6f-4aae-876d-4cdb2ca57ecd 1073741824" returned: 0 in 0.501s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:06:36 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-f96364f5-bfea-4e37-a227-4e028b2dd9c9 tempest-ProjectReaderTests-123956539 None] Acquiring lock "cinder-491b0b6c-6cfb-4097-b73f-805f5ce1323c-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 14:06:36 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-f96364f5-bfea-4e37-a227-4e028b2dd9c9 tempest-ProjectReaderTests-123956539 None] Lock "cinder-491b0b6c-6cfb-4097-b73f-805f5ce1323c-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 14:06:36 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-88c35bd9-db7a-40b6-8ede-e5598cf6463b tempest-ProjectMemberTests-718446646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-77b3539a-4e6f-4aae-876d-4cdb2ca57ecd {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:06:36 devstack sudo[105481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-77b3539a-4e6f-4aae-876d-4cdb2ca57ecd Jul 13 14:06:36 devstack sudo[105481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:06:36 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-f96364f5-bfea-4e37-a227-4e028b2dd9c9 tempest-ProjectReaderTests-123956539 None] Acquiring lock "cinder-quobyte-491b0b6c-6cfb-4097-b73f-805f5ce1323c" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 14:06:36 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ed6dc8e-c36a-4e34-a4ac-4861e92e5dd7 tempest-SnapshotDependencyTests-1674021511 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 14:06:36 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-f96364f5-bfea-4e37-a227-4e028b2dd9c9 tempest-ProjectReaderTests-123956539 None] Lock "cinder-quobyte-491b0b6c-6cfb-4097-b73f-805f5ce1323c" acquired by "delete_volume" :: waited 0.033s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 14:06:36 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-3ed6dc8e-c36a-4e34-a4ac-4861e92e5dd7 tempest-SnapshotDependencyTests-1674021511 None] Flow 'volume_create_manager' (21150570-1adb-4a57-a596-f100381d58f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 14:06:36 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-3ed6dc8e-c36a-4e34-a4ac-4861e92e5dd7 tempest-SnapshotDependencyTests-1674021511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb9b2098-1a17-4699-a294-681a7700a581) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:06:36 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[366bc395-bff0-4a9a-ba72-60e00cb37f73]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 14:06:36 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-f96364f5-bfea-4e37-a227-4e028b2dd9c9 tempest-ProjectReaderTests-123956539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-491b0b6c-6cfb-4097-b73f-805f5ce1323c {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:06:37 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-3ed6dc8e-c36a-4e34-a4ac-4861e92e5dd7 tempest-SnapshotDependencyTests-1674021511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb9b2098-1a17-4699-a294-681a7700a581) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T12:06:37Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1dd791a3-22b8-4254-a4cc-e2d5f95a93df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7d9b0e094c84fa587e57be9640bc8e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T12:06:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=7eb2aea2-dc27-458c-8885-95b3cb578000,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T12:06:37Z,use_quota=True,user_id='f7710644902a49fea7639af7ac0ed6c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1147de8b-623b-426c-a13d-7fc824a80f67),volume_type_id=1147de8b-623b-426c-a13d-7fc824a80f67)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:06:37 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-3ed6dc8e-c36a-4e34-a4ac-4861e92e5dd7 tempest-SnapshotDependencyTests-1674021511 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d027d45-4701-43a3-b2b0-70a40d261a22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:06:37 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-3ed6dc8e-c36a-4e34-a4ac-4861e92e5dd7 tempest-SnapshotDependencyTests-1674021511 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d027d45-4701-43a3-b2b0-70a40d261a22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:06:37 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-3ed6dc8e-c36a-4e34-a4ac-4861e92e5dd7 tempest-SnapshotDependencyTests-1674021511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (658f6185-f9ca-46ab-81f5-6f42fdc8a6ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:06:37 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-3ed6dc8e-c36a-4e34-a4ac-4861e92e5dd7 tempest-SnapshotDependencyTests-1674021511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (658f6185-f9ca-46ab-81f5-6f42fdc8a6ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '1dd791a3-22b8-4254-a4cc-e2d5f95a93df', 'volume_name': 'volume-1dd791a3-22b8-4254-a4cc-e2d5f95a93df', 'volume_size': 1, 'snapshot_id': '7eb2aea2-dc27-458c-8885-95b3cb578000'}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:06:37 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-3ed6dc8e-c36a-4e34-a4ac-4861e92e5dd7 tempest-SnapshotDependencyTests-1674021511 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1954522-62aa-4797-9ef3-e212751e0d5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:06:37 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-3ed6dc8e-c36a-4e34-a4ac-4861e92e5dd7 tempest-SnapshotDependencyTests-1674021511 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1954522-62aa-4797-9ef3-e212751e0d5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:06:37 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-3ed6dc8e-c36a-4e34-a4ac-4861e92e5dd7 tempest-SnapshotDependencyTests-1674021511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c365f915-1332-447d-92f3-c142f80e60e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:06:37 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-3ed6dc8e-c36a-4e34-a4ac-4861e92e5dd7 tempest-SnapshotDependencyTests-1674021511 None] Volume 1dd791a3-22b8-4254-a4cc-e2d5f95a93df: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-1dd791a3-22b8-4254-a4cc-e2d5f95a93df', 'volume_size': 1, 'snapshot_id': '7eb2aea2-dc27-458c-8885-95b3cb578000'} Jul 13 14:06:37 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-3ed6dc8e-c36a-4e34-a4ac-4861e92e5dd7 tempest-SnapshotDependencyTests-1674021511 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 14:06:37 devstack sudo[105483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-491b0b6c-6cfb-4097-b73f-805f5ce1323c Jul 13 14:06:37 devstack sudo[105483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:06:37 devstack sudo[105481]: pam_unix(sudo:session): session closed for user root Jul 13 14:06:37 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-88c35bd9-db7a-40b6-8ede-e5598cf6463b tempest-ProjectMemberTests-718446646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-77b3539a-4e6f-4aae-876d-4cdb2ca57ecd" returned: 0 in 0.267s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:06:37 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-88c35bd9-db7a-40b6-8ede-e5598cf6463b tempest-ProjectMemberTests-718446646 None] <== create_volume: return (842ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'} {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 13 14:06:37 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-88c35bd9-db7a-40b6-8ede-e5598cf6463b tempest-ProjectMemberTests-718446646 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.845s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 14:06:37 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-3ed6dc8e-c36a-4e34-a4ac-4861e92e5dd7 tempest-SnapshotDependencyTests-1674021511 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.056s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 14:06:37 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-3ed6dc8e-c36a-4e34-a4ac-4861e92e5dd7 tempest-SnapshotDependencyTests-1674021511 None] Acquiring lock "cinder-quobyte-7eb2aea2-dc27-458c-8885-95b3cb578000-1dd791a3-22b8-4254-a4cc-e2d5f95a93df" by "_create_volume_from_snapshot" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 14:06:37 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-88c35bd9-db7a-40b6-8ede-e5598cf6463b tempest-ProjectMemberTests-718446646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42ee16cd-34fe-4125-9f4c-0865a7284f49) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-77b3539a-4e6f-4aae-876d-4cdb2ca57ecd', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:06:37 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-88c35bd9-db7a-40b6-8ede-e5598cf6463b tempest-ProjectMemberTests-718446646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d09ee78-89c3-4acb-bddc-38241fc97647) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:06:37 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-3ed6dc8e-c36a-4e34-a4ac-4861e92e5dd7 tempest-SnapshotDependencyTests-1674021511 None] Lock "cinder-quobyte-7eb2aea2-dc27-458c-8885-95b3cb578000-1dd791a3-22b8-4254-a4cc-e2d5f95a93df" acquired by "_create_volume_from_snapshot" :: waited 0.028s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 14:06:37 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-3ed6dc8e-c36a-4e34-a4ac-4861e92e5dd7 tempest-SnapshotDependencyTests-1674021511 None] Creating volume 1dd791a3-22b8-4254-a4cc-e2d5f95a93df from snapshot 7eb2aea2-dc27-458c-8885-95b3cb578000 {{(pid=87098) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 13 14:06:37 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-3ed6dc8e-c36a-4e34-a4ac-4861e92e5dd7 tempest-SnapshotDependencyTests-1674021511 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 14:06:37 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-3ed6dc8e-c36a-4e34-a4ac-4861e92e5dd7 tempest-SnapshotDependencyTests-1674021511 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 14:06:37 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-3ed6dc8e-c36a-4e34-a4ac-4861e92e5dd7 tempest-SnapshotDependencyTests-1674021511 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 14:06:37 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-3ed6dc8e-c36a-4e34-a4ac-4861e92e5dd7 tempest-SnapshotDependencyTests-1674021511 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 14:06:37 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-3ed6dc8e-c36a-4e34-a4ac-4861e92e5dd7 tempest-SnapshotDependencyTests-1674021511 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 14:06:37 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-3ed6dc8e-c36a-4e34-a4ac-4861e92e5dd7 tempest-SnapshotDependencyTests-1674021511 None] Selected osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 14:06:37 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-3ed6dc8e-c36a-4e34-a4ac-4861e92e5dd7 tempest-SnapshotDependencyTests-1674021511 None] Acquiring lock "cinder-quobyte-1dd791a3-22b8-4254-a4cc-e2d5f95a93df" by "_copy_volume_from_snapshot" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 14:06:37 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-3ed6dc8e-c36a-4e34-a4ac-4861e92e5dd7 tempest-SnapshotDependencyTests-1674021511 None] Lock "cinder-quobyte-1dd791a3-22b8-4254-a4cc-e2d5f95a93df" acquired by "_copy_volume_from_snapshot" :: waited 0.023s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 14:06:37 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-3ed6dc8e-c36a-4e34-a4ac-4861e92e5dd7 tempest-SnapshotDependencyTests-1674021511 None] snapshot: 7eb2aea2-dc27-458c-8885-95b3cb578000, volume: 1dd791a3-22b8-4254-a4cc-e2d5f95a93df, {{(pid=87098) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 13 14:06:37 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-88c35bd9-db7a-40b6-8ede-e5598cf6463b tempest-ProjectMemberTests-718446646 None] Volume volume-77b3539a-4e6f-4aae-876d-4cdb2ca57ecd (77b3539a-4e6f-4aae-876d-4cdb2ca57ecd): created successfully Jul 13 14:06:37 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-88c35bd9-db7a-40b6-8ede-e5598cf6463b tempest-ProjectMemberTests-718446646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d09ee78-89c3-4acb-bddc-38241fc97647) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:06:37 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-88c35bd9-db7a-40b6-8ede-e5598cf6463b tempest-ProjectMemberTests-718446646 None] Flow 'volume_create_manager' (b8527261-66ab-4534-b3ea-035fdb6f935f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 14:06:37 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-3ed6dc8e-c36a-4e34-a4ac-4861e92e5dd7 tempest-SnapshotDependencyTests-1674021511 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 14:06:37 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-3ed6dc8e-c36a-4e34-a4ac-4861e92e5dd7 tempest-SnapshotDependencyTests-1674021511 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 14:06:37 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-3ed6dc8e-c36a-4e34-a4ac-4861e92e5dd7 tempest-SnapshotDependencyTests-1674021511 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 14:06:37 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-3ed6dc8e-c36a-4e34-a4ac-4861e92e5dd7 tempest-SnapshotDependencyTests-1674021511 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 14:06:37 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-3ed6dc8e-c36a-4e34-a4ac-4861e92e5dd7 tempest-SnapshotDependencyTests-1674021511 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 14:06:37 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-88c35bd9-db7a-40b6-8ede-e5598cf6463b tempest-ProjectMemberTests-718446646 None] Created volume successfully. Jul 13 14:06:37 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c09f16f-be10-4e03-bc4f-528e985211cc]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 14:06:37 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-3ed6dc8e-c36a-4e34-a4ac-4861e92e5dd7 tempest-SnapshotDependencyTests-1674021511 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-6c995f44-a4f9-482e-8a4f-48e6860dfdbd.7eb2aea2-dc27-458c-8885-95b3cb578000 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:06:37 devstack sudo[105483]: pam_unix(sudo:session): session closed for user root Jul 13 14:06:37 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-f96364f5-bfea-4e37-a227-4e028b2dd9c9 tempest-ProjectReaderTests-123956539 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-491b0b6c-6cfb-4097-b73f-805f5ce1323c" returned: 0 in 0.385s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:06:37 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-f96364f5-bfea-4e37-a227-4e028b2dd9c9 tempest-ProjectReaderTests-123956539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-491b0b6c-6cfb-4097-b73f-805f5ce1323c {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:06:37 devstack sudo[105487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-6c995f44-a4f9-482e-8a4f-48e6860dfdbd.7eb2aea2-dc27-458c-8885-95b3cb578000 Jul 13 14:06:37 devstack sudo[105487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:06:37 devstack sudo[105491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-491b0b6c-6cfb-4097-b73f-805f5ce1323c Jul 13 14:06:37 devstack sudo[105491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:06:37 devstack sudo[105491]: pam_unix(sudo:session): session closed for user root Jul 13 14:06:37 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-f96364f5-bfea-4e37-a227-4e028b2dd9c9 tempest-ProjectReaderTests-123956539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-491b0b6c-6cfb-4097-b73f-805f5ce1323c" returned: 0 in 0.253s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:06:37 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-f96364f5-bfea-4e37-a227-4e028b2dd9c9 tempest-ProjectReaderTests-123956539 None] Lock "cinder-quobyte-491b0b6c-6cfb-4097-b73f-805f5ce1323c" released by "delete_volume" :: held 0.695s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 14:06:37 devstack sudo[105487]: pam_unix(sudo:session): session closed for user root Jul 13 14:06:37 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-3ed6dc8e-c36a-4e34-a4ac-4861e92e5dd7 tempest-SnapshotDependencyTests-1674021511 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-6c995f44-a4f9-482e-8a4f-48e6860dfdbd.7eb2aea2-dc27-458c-8885-95b3cb578000" returned: 0 in 0.394s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:06:37 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-3ed6dc8e-c36a-4e34-a4ac-4861e92e5dd7 tempest-SnapshotDependencyTests-1674021511 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6c995f44-a4f9-482e-8a4f-48e6860dfdbd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87098) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 13 14:06:37 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-3ed6dc8e-c36a-4e34-a4ac-4861e92e5dd7 tempest-SnapshotDependencyTests-1674021511 None] will copy from snapshot at /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-6c995f44-a4f9-482e-8a4f-48e6860dfdbd {{(pid=87098) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 13 14:06:37 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-3ed6dc8e-c36a-4e34-a4ac-4861e92e5dd7 tempest-SnapshotDependencyTests-1674021511 None] Creating direct copy from snapshot {{(pid=87098) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 13 14:06:37 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[77cde76f-7ac5-4495-af83-f91d657ef6d0]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 14:06:37 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-3ed6dc8e-c36a-4e34-a4ac-4861e92e5dd7 tempest-SnapshotDependencyTests-1674021511 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-6c995f44-a4f9-482e-8a4f-48e6860dfdbd {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:06:37 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-f96364f5-bfea-4e37-a227-4e028b2dd9c9 tempest-ProjectReaderTests-123956539 None] Created reservations ['241f5c99-ef94-4d49-8a60-28393cc242d5', '891d52f7-ffb2-4d85-9b23-79250f73fd86', 'ff8278ff-7aee-4492-9dbd-14853a8a49c6', 'ff908d7b-225a-40a5-9e30-23716a8364b8'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 14:06:37 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-f96364f5-bfea-4e37-a227-4e028b2dd9c9 tempest-ProjectReaderTests-123956539 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 14:06:37 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-f96364f5-bfea-4e37-a227-4e028b2dd9c9 tempest-ProjectReaderTests-123956539 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 14:06:37 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-f96364f5-bfea-4e37-a227-4e028b2dd9c9 tempest-ProjectReaderTests-123956539 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 14:06:37 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-f96364f5-bfea-4e37-a227-4e028b2dd9c9 tempest-ProjectReaderTests-123956539 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 14:06:37 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-f96364f5-bfea-4e37-a227-4e028b2dd9c9 tempest-ProjectReaderTests-123956539 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 14:06:37 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-f96364f5-bfea-4e37-a227-4e028b2dd9c9 tempest-ProjectReaderTests-123956539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:06:37 devstack sudo[105498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-6c995f44-a4f9-482e-8a4f-48e6860dfdbd Jul 13 14:06:37 devstack sudo[105498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:06:37 devstack sudo[105500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 Jul 13 14:06:37 devstack sudo[105500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:06:38 devstack sudo[105500]: pam_unix(sudo:session): session closed for user root Jul 13 14:06:38 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-f96364f5-bfea-4e37-a227-4e028b2dd9c9 tempest-ProjectReaderTests-123956539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78" returned: 0 in 0.285s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:06:38 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-f96364f5-bfea-4e37-a227-4e028b2dd9c9 tempest-ProjectReaderTests-123956539 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 14:06:38 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-f96364f5-bfea-4e37-a227-4e028b2dd9c9 tempest-ProjectReaderTests-123956539 None] Deleted volume successfully. Jul 13 14:06:38 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-f96364f5-bfea-4e37-a227-4e028b2dd9c9 tempest-ProjectReaderTests-123956539 None] Lock "cinder-491b0b6c-6cfb-4097-b73f-805f5ce1323c-delete_volume" released by "delete_volume" :: held 1.268s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 14:06:38 devstack sudo[105498]: pam_unix(sudo:session): session closed for user root Jul 13 14:06:38 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-3ed6dc8e-c36a-4e34-a4ac-4861e92e5dd7 tempest-SnapshotDependencyTests-1674021511 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-6c995f44-a4f9-482e-8a4f-48e6860dfdbd" returned: 0 in 0.441s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:06:38 devstack cinder-volume[87098]: DEBUG cinder.utils [None req-3ed6dc8e-c36a-4e34-a4ac-4861e92e5dd7 tempest-SnapshotDependencyTests-1674021511 None] Path /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-1dd791a3-22b8-4254-a4cc-e2d5f95a93df not found in is_blk_device check {{(pid=87098) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 13 14:06:38 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-3ed6dc8e-c36a-4e34-a4ac-4861e92e5dd7 tempest-SnapshotDependencyTests-1674021511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-6c995f44-a4f9-482e-8a4f-48e6860dfdbd /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-1dd791a3-22b8-4254-a4cc-e2d5f95a93df {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:06:38 devstack sudo[105506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-6c995f44-a4f9-482e-8a4f-48e6860dfdbd /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-1dd791a3-22b8-4254-a4cc-e2d5f95a93df Jul 13 14:06:38 devstack sudo[105506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:06:38 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-41129b0e-8300-491f-b16d-cf6bd68a8eff tempest-ProjectMemberTests-718446646 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 14:06:42 devstack sudo[105506]: pam_unix(sudo:session): session closed for user root Jul 13 14:06:42 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-3ed6dc8e-c36a-4e34-a4ac-4861e92e5dd7 tempest-SnapshotDependencyTests-1674021511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-6c995f44-a4f9-482e-8a4f-48e6860dfdbd /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-1dd791a3-22b8-4254-a4cc-e2d5f95a93df" returned: 0 in 4.762s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:06:42 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[97832599-8a6e-4414-b82f-5b0ac81d4133]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 14:06:42 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-3ed6dc8e-c36a-4e34-a4ac-4861e92e5dd7 tempest-SnapshotDependencyTests-1674021511 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-6c995f44-a4f9-482e-8a4f-48e6860dfdbd {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:06:43 devstack sudo[105519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-6c995f44-a4f9-482e-8a4f-48e6860dfdbd Jul 13 14:06:43 devstack sudo[105519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:06:43 devstack sudo[105519]: pam_unix(sudo:session): session closed for user root Jul 13 14:06:43 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-3ed6dc8e-c36a-4e34-a4ac-4861e92e5dd7 tempest-SnapshotDependencyTests-1674021511 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-6c995f44-a4f9-482e-8a4f-48e6860dfdbd" returned: 0 in 0.517s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:06:43 devstack cinder-volume[87098]: DEBUG cinder.image.image_utils [None req-3ed6dc8e-c36a-4e34-a4ac-4861e92e5dd7 tempest-SnapshotDependencyTests-1674021511 None] Image conversion details: src /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-6c995f44-a4f9-482e-8a4f-48e6860dfdbd, size 1024.00 MB, duration 4.76 sec, destination /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-1dd791a3-22b8-4254-a4cc-e2d5f95a93df {{(pid=87098) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 13 14:06:43 devstack cinder-volume[87098]: INFO cinder.image.image_utils [None req-3ed6dc8e-c36a-4e34-a4ac-4861e92e5dd7 tempest-SnapshotDependencyTests-1674021511 None] Converted 1024.00 MB image at 214.96 MB/s Jul 13 14:06:43 devstack cinder-volume[87098]: WARNING cinder.volume.drivers.remotefs [None req-3ed6dc8e-c36a-4e34-a4ac-4861e92e5dd7 tempest-SnapshotDependencyTests-1674021511 None] /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-1dd791a3-22b8-4254-a4cc-e2d5f95a93df is being set with open permissions: ugo+rw Jul 13 14:06:43 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-3ed6dc8e-c36a-4e34-a4ac-4861e92e5dd7 tempest-SnapshotDependencyTests-1674021511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-1dd791a3-22b8-4254-a4cc-e2d5f95a93df {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:06:43 devstack sudo[105524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-1dd791a3-22b8-4254-a4cc-e2d5f95a93df Jul 13 14:06:43 devstack sudo[105524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:06:43 devstack sudo[105524]: pam_unix(sudo:session): session closed for user root Jul 13 14:06:43 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-3ed6dc8e-c36a-4e34-a4ac-4861e92e5dd7 tempest-SnapshotDependencyTests-1674021511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-1dd791a3-22b8-4254-a4cc-e2d5f95a93df" returned: 0 in 0.246s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:06:43 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-3ed6dc8e-c36a-4e34-a4ac-4861e92e5dd7 tempest-SnapshotDependencyTests-1674021511 None] Lock "cinder-quobyte-1dd791a3-22b8-4254-a4cc-e2d5f95a93df" released by "_copy_volume_from_snapshot" :: held 6.482s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 14:06:43 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-3ed6dc8e-c36a-4e34-a4ac-4861e92e5dd7 tempest-SnapshotDependencyTests-1674021511 None] Lock "cinder-quobyte-7eb2aea2-dc27-458c-8885-95b3cb578000-1dd791a3-22b8-4254-a4cc-e2d5f95a93df" released by "_create_volume_from_snapshot" :: held 6.524s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 14:06:43 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-3ed6dc8e-c36a-4e34-a4ac-4861e92e5dd7 tempest-SnapshotDependencyTests-1674021511 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.554s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 14:06:43 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-41129b0e-8300-491f-b16d-cf6bd68a8eff tempest-ProjectMemberTests-718446646 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.486s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 14:06:43 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-41129b0e-8300-491f-b16d-cf6bd68a8eff tempest-ProjectMemberTests-718446646 None] Creating offline snapshot af856347-acc4-4e55-8ad9-2c132d2c22e3 of volume 77b3539a-4e6f-4aae-876d-4cdb2ca57ecd {{(pid=87098) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 13 14:06:43 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-3ed6dc8e-c36a-4e34-a4ac-4861e92e5dd7 tempest-SnapshotDependencyTests-1674021511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c365f915-1332-447d-92f3-c142f80e60e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1dd791a3-22b8-4254-a4cc-e2d5f95a93df', 'volume_size': 1, 'snapshot_id': '7eb2aea2-dc27-458c-8885-95b3cb578000'}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:06:43 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-3ed6dc8e-c36a-4e34-a4ac-4861e92e5dd7 tempest-SnapshotDependencyTests-1674021511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de5b88f9-1fb8-4566-ad4d-29e951b2bc78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:06:43 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d36cb7c-a642-44b4-aeee-140f16717007]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 14:06:43 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-41129b0e-8300-491f-b16d-cf6bd68a8eff tempest-ProjectMemberTests-718446646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-77b3539a-4e6f-4aae-876d-4cdb2ca57ecd {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:06:43 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-3ed6dc8e-c36a-4e34-a4ac-4861e92e5dd7 tempest-SnapshotDependencyTests-1674021511 None] Volume volume-1dd791a3-22b8-4254-a4cc-e2d5f95a93df (1dd791a3-22b8-4254-a4cc-e2d5f95a93df): created successfully Jul 13 14:06:43 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-3ed6dc8e-c36a-4e34-a4ac-4861e92e5dd7 tempest-SnapshotDependencyTests-1674021511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de5b88f9-1fb8-4566-ad4d-29e951b2bc78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:06:43 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-3ed6dc8e-c36a-4e34-a4ac-4861e92e5dd7 tempest-SnapshotDependencyTests-1674021511 None] Flow 'volume_create_manager' (21150570-1adb-4a57-a596-f100381d58f5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 14:06:43 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-3ed6dc8e-c36a-4e34-a4ac-4861e92e5dd7 tempest-SnapshotDependencyTests-1674021511 None] Created volume successfully. Jul 13 14:06:43 devstack sudo[105527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-77b3539a-4e6f-4aae-876d-4cdb2ca57ecd Jul 13 14:06:43 devstack sudo[105527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:06:44 devstack sudo[105527]: pam_unix(sudo:session): session closed for user root Jul 13 14:06:44 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-41129b0e-8300-491f-b16d-cf6bd68a8eff tempest-ProjectMemberTests-718446646 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-77b3539a-4e6f-4aae-876d-4cdb2ca57ecd" returned: 0 in 0.345s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:06:44 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-41129b0e-8300-491f-b16d-cf6bd68a8eff tempest-ProjectMemberTests-718446646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-77b3539a-4e6f-4aae-876d-4cdb2ca57ecd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-77b3539a-4e6f-4aae-876d-4cdb2ca57ecd.af856347-acc4-4e55-8ad9-2c132d2c22e3 1G {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:06:44 devstack sudo[105532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-77b3539a-4e6f-4aae-876d-4cdb2ca57ecd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-77b3539a-4e6f-4aae-876d-4cdb2ca57ecd.af856347-acc4-4e55-8ad9-2c132d2c22e3 1G Jul 13 14:06:44 devstack sudo[105532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:06:44 devstack sudo[105532]: pam_unix(sudo:session): session closed for user root Jul 13 14:06:44 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-41129b0e-8300-491f-b16d-cf6bd68a8eff tempest-ProjectMemberTests-718446646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-77b3539a-4e6f-4aae-876d-4cdb2ca57ecd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-77b3539a-4e6f-4aae-876d-4cdb2ca57ecd.af856347-acc4-4e55-8ad9-2c132d2c22e3 1G" returned: 0 in 0.391s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:06:44 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-41129b0e-8300-491f-b16d-cf6bd68a8eff tempest-ProjectMemberTests-718446646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-77b3539a-4e6f-4aae-876d-4cdb2ca57ecd -F qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-77b3539a-4e6f-4aae-876d-4cdb2ca57ecd.af856347-acc4-4e55-8ad9-2c132d2c22e3 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:06:44 devstack sudo[105538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-77b3539a-4e6f-4aae-876d-4cdb2ca57ecd -F qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-77b3539a-4e6f-4aae-876d-4cdb2ca57ecd.af856347-acc4-4e55-8ad9-2c132d2c22e3 Jul 13 14:06:44 devstack sudo[105538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:06:44 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-49dd3649-1cb3-4b9a-874c-bbf489af0120 tempest-SnapshotDependencyTests-1674021511 None] Acquiring lock "cinder-7eb2aea2-dc27-458c-8885-95b3cb578000-delete_snapshot" by "delete_snapshot" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 14:06:44 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-49dd3649-1cb3-4b9a-874c-bbf489af0120 tempest-SnapshotDependencyTests-1674021511 None] Lock "cinder-7eb2aea2-dc27-458c-8885-95b3cb578000-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 14:06:44 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-49dd3649-1cb3-4b9a-874c-bbf489af0120 tempest-SnapshotDependencyTests-1674021511 None] Acquiring lock "cinder-quobyte-6c995f44-a4f9-482e-8a4f-48e6860dfdbd" by "delete_snapshot" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 14:06:44 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-49dd3649-1cb3-4b9a-874c-bbf489af0120 tempest-SnapshotDependencyTests-1674021511 None] Lock "cinder-quobyte-6c995f44-a4f9-482e-8a4f-48e6860dfdbd" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 14:06:44 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-49dd3649-1cb3-4b9a-874c-bbf489af0120 tempest-SnapshotDependencyTests-1674021511 None] Acquiring lock "cinder-quobyte-7eb2aea2-dc27-458c-8885-95b3cb578000" by "_delete_snapshot" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 14:06:44 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-49dd3649-1cb3-4b9a-874c-bbf489af0120 tempest-SnapshotDependencyTests-1674021511 None] Lock "cinder-quobyte-7eb2aea2-dc27-458c-8885-95b3cb578000" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 14:06:44 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-49dd3649-1cb3-4b9a-874c-bbf489af0120 tempest-SnapshotDependencyTests-1674021511 None] Deleting offline snapshot 7eb2aea2-dc27-458c-8885-95b3cb578000 of volume 6c995f44-a4f9-482e-8a4f-48e6860dfdbd {{(pid=87098) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 13 14:06:44 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-49dd3649-1cb3-4b9a-874c-bbf489af0120 tempest-SnapshotDependencyTests-1674021511 None] snapshot_file for this snap is: volume-6c995f44-a4f9-482e-8a4f-48e6860dfdbd.7eb2aea2-dc27-458c-8885-95b3cb578000 {{(pid=87098) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 13 14:06:44 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3015571-f603-471f-9082-98712cad48bb]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 14:06:44 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-49dd3649-1cb3-4b9a-874c-bbf489af0120 tempest-SnapshotDependencyTests-1674021511 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-6c995f44-a4f9-482e-8a4f-48e6860dfdbd.7eb2aea2-dc27-458c-8885-95b3cb578000 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:06:44 devstack sudo[105540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-6c995f44-a4f9-482e-8a4f-48e6860dfdbd.7eb2aea2-dc27-458c-8885-95b3cb578000 Jul 13 14:06:44 devstack sudo[105540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:06:44 devstack sudo[105538]: pam_unix(sudo:session): session closed for user root Jul 13 14:06:44 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-41129b0e-8300-491f-b16d-cf6bd68a8eff tempest-ProjectMemberTests-718446646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-77b3539a-4e6f-4aae-876d-4cdb2ca57ecd -F qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-77b3539a-4e6f-4aae-876d-4cdb2ca57ecd.af856347-acc4-4e55-8ad9-2c132d2c22e3" returned: 0 in 0.300s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:06:44 devstack cinder-volume[87098]: WARNING cinder.volume.drivers.remotefs [None req-41129b0e-8300-491f-b16d-cf6bd68a8eff tempest-ProjectMemberTests-718446646 None] /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-77b3539a-4e6f-4aae-876d-4cdb2ca57ecd.af856347-acc4-4e55-8ad9-2c132d2c22e3 is being set with open permissions: ugo+rw Jul 13 14:06:44 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-41129b0e-8300-491f-b16d-cf6bd68a8eff tempest-ProjectMemberTests-718446646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-77b3539a-4e6f-4aae-876d-4cdb2ca57ecd.af856347-acc4-4e55-8ad9-2c132d2c22e3 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:06:44 devstack sudo[105545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-77b3539a-4e6f-4aae-876d-4cdb2ca57ecd.af856347-acc4-4e55-8ad9-2c132d2c22e3 Jul 13 14:06:44 devstack sudo[105545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:06:45 devstack sudo[105540]: pam_unix(sudo:session): session closed for user root Jul 13 14:06:45 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-49dd3649-1cb3-4b9a-874c-bbf489af0120 tempest-SnapshotDependencyTests-1674021511 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-6c995f44-a4f9-482e-8a4f-48e6860dfdbd.7eb2aea2-dc27-458c-8885-95b3cb578000" returned: 0 in 0.369s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:06:45 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-49dd3649-1cb3-4b9a-874c-bbf489af0120 tempest-SnapshotDependencyTests-1674021511 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6c995f44-a4f9-482e-8a4f-48e6860dfdbd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87098) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 13 14:06:45 devstack sudo[105545]: pam_unix(sudo:session): session closed for user root Jul 13 14:06:45 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-41129b0e-8300-491f-b16d-cf6bd68a8eff tempest-ProjectMemberTests-718446646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-77b3539a-4e6f-4aae-876d-4cdb2ca57ecd.af856347-acc4-4e55-8ad9-2c132d2c22e3" returned: 0 in 0.256s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:06:45 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[25d7fc2e-8db4-4821-8ee0-410f6fc676d6]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 14:06:45 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-49dd3649-1cb3-4b9a-874c-bbf489af0120 tempest-SnapshotDependencyTests-1674021511 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-6c995f44-a4f9-482e-8a4f-48e6860dfdbd {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:06:45 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-41129b0e-8300-491f-b16d-cf6bd68a8eff tempest-ProjectMemberTests-718446646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-77b3539a-4e6f-4aae-876d-4cdb2ca57ecd.info {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:06:45 devstack sudo[105552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-77b3539a-4e6f-4aae-876d-4cdb2ca57ecd.info Jul 13 14:06:45 devstack sudo[105552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:06:45 devstack sudo[105551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-6c995f44-a4f9-482e-8a4f-48e6860dfdbd Jul 13 14:06:45 devstack sudo[105551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:06:45 devstack sudo[105552]: pam_unix(sudo:session): session closed for user root Jul 13 14:06:45 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-41129b0e-8300-491f-b16d-cf6bd68a8eff tempest-ProjectMemberTests-718446646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-77b3539a-4e6f-4aae-876d-4cdb2ca57ecd.info" returned: 0 in 0.249s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:06:45 devstack cinder-volume[87098]: WARNING cinder.volume.drivers.remotefs [None req-41129b0e-8300-491f-b16d-cf6bd68a8eff tempest-ProjectMemberTests-718446646 None] /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-77b3539a-4e6f-4aae-876d-4cdb2ca57ecd.info is being set with open permissions: ugo+rw Jul 13 14:06:45 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-41129b0e-8300-491f-b16d-cf6bd68a8eff tempest-ProjectMemberTests-718446646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-77b3539a-4e6f-4aae-876d-4cdb2ca57ecd.info {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:06:45 devstack sudo[105556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-77b3539a-4e6f-4aae-876d-4cdb2ca57ecd.info Jul 13 14:06:45 devstack sudo[105556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:06:45 devstack sudo[105551]: pam_unix(sudo:session): session closed for user root Jul 13 14:06:45 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-49dd3649-1cb3-4b9a-874c-bbf489af0120 tempest-SnapshotDependencyTests-1674021511 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-6c995f44-a4f9-482e-8a4f-48e6860dfdbd" returned: 0 in 0.363s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:06:45 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-49dd3649-1cb3-4b9a-874c-bbf489af0120 tempest-SnapshotDependencyTests-1674021511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-6c995f44-a4f9-482e-8a4f-48e6860dfdbd.7eb2aea2-dc27-458c-8885-95b3cb578000 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:06:45 devstack sudo[105562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-6c995f44-a4f9-482e-8a4f-48e6860dfdbd.7eb2aea2-dc27-458c-8885-95b3cb578000 Jul 13 14:06:45 devstack sudo[105562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:06:45 devstack sudo[105556]: pam_unix(sudo:session): session closed for user root Jul 13 14:06:45 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-41129b0e-8300-491f-b16d-cf6bd68a8eff tempest-ProjectMemberTests-718446646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-77b3539a-4e6f-4aae-876d-4cdb2ca57ecd.info" returned: 0 in 0.243s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:06:45 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-41129b0e-8300-491f-b16d-cf6bd68a8eff tempest-ProjectMemberTests-718446646 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.897s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 14:06:45 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-41129b0e-8300-491f-b16d-cf6bd68a8eff tempest-ProjectMemberTests-718446646 None] Create snapshot completed successfully Jul 13 14:06:45 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-b1385803-8325-4ae7-883b-e9218dea42e9 tempest-ProjectMemberTests-718446646 None] Acquiring lock "cinder-af856347-acc4-4e55-8ad9-2c132d2c22e3-delete_snapshot" by "delete_snapshot" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 14:06:45 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-b1385803-8325-4ae7-883b-e9218dea42e9 tempest-ProjectMemberTests-718446646 None] Lock "cinder-af856347-acc4-4e55-8ad9-2c132d2c22e3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 14:06:45 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-b1385803-8325-4ae7-883b-e9218dea42e9 tempest-ProjectMemberTests-718446646 None] Acquiring lock "cinder-quobyte-77b3539a-4e6f-4aae-876d-4cdb2ca57ecd" by "delete_snapshot" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 14:06:45 devstack sudo[105562]: pam_unix(sudo:session): session closed for user root Jul 13 14:06:45 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-49dd3649-1cb3-4b9a-874c-bbf489af0120 tempest-SnapshotDependencyTests-1674021511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-6c995f44-a4f9-482e-8a4f-48e6860dfdbd.7eb2aea2-dc27-458c-8885-95b3cb578000" returned: 0 in 0.361s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:06:45 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-49dd3649-1cb3-4b9a-874c-bbf489af0120 tempest-SnapshotDependencyTests-1674021511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-6c995f44-a4f9-482e-8a4f-48e6860dfdbd.7eb2aea2-dc27-458c-8885-95b3cb578000 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:06:45 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-b1385803-8325-4ae7-883b-e9218dea42e9 tempest-ProjectMemberTests-718446646 None] Lock "cinder-quobyte-77b3539a-4e6f-4aae-876d-4cdb2ca57ecd" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 14:06:45 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-b1385803-8325-4ae7-883b-e9218dea42e9 tempest-ProjectMemberTests-718446646 None] Acquiring lock "cinder-quobyte-af856347-acc4-4e55-8ad9-2c132d2c22e3" by "_delete_snapshot" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 14:06:45 devstack sudo[105568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-6c995f44-a4f9-482e-8a4f-48e6860dfdbd.7eb2aea2-dc27-458c-8885-95b3cb578000 Jul 13 14:06:45 devstack sudo[105568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:06:45 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-b1385803-8325-4ae7-883b-e9218dea42e9 tempest-ProjectMemberTests-718446646 None] Lock "cinder-quobyte-af856347-acc4-4e55-8ad9-2c132d2c22e3" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 14:06:45 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-b1385803-8325-4ae7-883b-e9218dea42e9 tempest-ProjectMemberTests-718446646 None] Deleting offline snapshot af856347-acc4-4e55-8ad9-2c132d2c22e3 of volume 77b3539a-4e6f-4aae-876d-4cdb2ca57ecd {{(pid=87098) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 13 14:06:45 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-b1385803-8325-4ae7-883b-e9218dea42e9 tempest-ProjectMemberTests-718446646 None] snapshot_file for this snap is: volume-77b3539a-4e6f-4aae-876d-4cdb2ca57ecd.af856347-acc4-4e55-8ad9-2c132d2c22e3 {{(pid=87098) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 13 14:06:45 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[929d9596-93a5-428b-8f0d-15b9ba67615c]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 14:06:45 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-b1385803-8325-4ae7-883b-e9218dea42e9 tempest-ProjectMemberTests-718446646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-77b3539a-4e6f-4aae-876d-4cdb2ca57ecd.af856347-acc4-4e55-8ad9-2c132d2c22e3 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:06:45 devstack sudo[105570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-77b3539a-4e6f-4aae-876d-4cdb2ca57ecd.af856347-acc4-4e55-8ad9-2c132d2c22e3 Jul 13 14:06:45 devstack sudo[105570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:06:46 devstack sudo[105568]: pam_unix(sudo:session): session closed for user root Jul 13 14:06:46 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-49dd3649-1cb3-4b9a-874c-bbf489af0120 tempest-SnapshotDependencyTests-1674021511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-6c995f44-a4f9-482e-8a4f-48e6860dfdbd.7eb2aea2-dc27-458c-8885-95b3cb578000" returned: 0 in 0.254s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:06:46 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-49dd3649-1cb3-4b9a-874c-bbf489af0120 tempest-SnapshotDependencyTests-1674021511 None] Lock "cinder-quobyte-7eb2aea2-dc27-458c-8885-95b3cb578000" released by "_delete_snapshot" :: held 1.451s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 14:06:46 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-49dd3649-1cb3-4b9a-874c-bbf489af0120 tempest-SnapshotDependencyTests-1674021511 None] Lock "cinder-quobyte-6c995f44-a4f9-482e-8a4f-48e6860dfdbd" released by "delete_snapshot" :: held 1.479s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 14:06:46 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-49dd3649-1cb3-4b9a-874c-bbf489af0120 tempest-SnapshotDependencyTests-1674021511 None] Created reservations ['4f242669-36a6-4cca-af94-ae210155ac5c', '6a101132-8b57-41bd-91c2-b73b2a623870', 'f20b6f26-06a4-4436-b536-29425adf29a8', 'f14a58db-638b-4732-b701-4136e7dc32e5'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 14:06:46 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-49dd3649-1cb3-4b9a-874c-bbf489af0120 tempest-SnapshotDependencyTests-1674021511 None] Delete snapshot completed successfully. Jul 13 14:06:46 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-49dd3649-1cb3-4b9a-874c-bbf489af0120 tempest-SnapshotDependencyTests-1674021511 None] Lock "cinder-7eb2aea2-dc27-458c-8885-95b3cb578000-delete_snapshot" released by "delete_snapshot" :: held 1.624s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 14:06:46 devstack sudo[105570]: pam_unix(sudo:session): session closed for user root Jul 13 14:06:46 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-b1385803-8325-4ae7-883b-e9218dea42e9 tempest-ProjectMemberTests-718446646 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-77b3539a-4e6f-4aae-876d-4cdb2ca57ecd.af856347-acc4-4e55-8ad9-2c132d2c22e3" returned: 0 in 0.379s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:06:46 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-b1385803-8325-4ae7-883b-e9218dea42e9 tempest-ProjectMemberTests-718446646 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-77b3539a-4e6f-4aae-876d-4cdb2ca57ecd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87098) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 13 14:06:46 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4d79ce8-8ed7-4e1b-a0fd-55080cfaef36]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 14:06:46 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-b1385803-8325-4ae7-883b-e9218dea42e9 tempest-ProjectMemberTests-718446646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-77b3539a-4e6f-4aae-876d-4cdb2ca57ecd {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:06:46 devstack sudo[105576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-77b3539a-4e6f-4aae-876d-4cdb2ca57ecd Jul 13 14:06:46 devstack sudo[105576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:06:46 devstack sudo[105576]: pam_unix(sudo:session): session closed for user root Jul 13 14:06:46 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-b1385803-8325-4ae7-883b-e9218dea42e9 tempest-ProjectMemberTests-718446646 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-77b3539a-4e6f-4aae-876d-4cdb2ca57ecd" returned: 0 in 0.349s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:06:46 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-b1385803-8325-4ae7-883b-e9218dea42e9 tempest-ProjectMemberTests-718446646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-77b3539a-4e6f-4aae-876d-4cdb2ca57ecd.af856347-acc4-4e55-8ad9-2c132d2c22e3 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:06:46 devstack sudo[105581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-77b3539a-4e6f-4aae-876d-4cdb2ca57ecd.af856347-acc4-4e55-8ad9-2c132d2c22e3 Jul 13 14:06:46 devstack sudo[105581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:06:46 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-4ead076e-66f3-4532-9454-0d9f1c698e11 tempest-SnapshotDependencyTests-1674021511 None] Acquiring lock "cinder-6c995f44-a4f9-482e-8a4f-48e6860dfdbd-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 14:06:46 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-4ead076e-66f3-4532-9454-0d9f1c698e11 tempest-SnapshotDependencyTests-1674021511 None] Lock "cinder-6c995f44-a4f9-482e-8a4f-48e6860dfdbd-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 14:06:46 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-4ead076e-66f3-4532-9454-0d9f1c698e11 tempest-SnapshotDependencyTests-1674021511 None] Acquiring lock "cinder-quobyte-6c995f44-a4f9-482e-8a4f-48e6860dfdbd" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 14:06:46 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-4ead076e-66f3-4532-9454-0d9f1c698e11 tempest-SnapshotDependencyTests-1674021511 None] Lock "cinder-quobyte-6c995f44-a4f9-482e-8a4f-48e6860dfdbd" acquired by "delete_volume" :: waited 0.014s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 14:06:46 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[c624d1c1-d864-455e-ad7b-d2676c2c0397]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 14:06:46 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-4ead076e-66f3-4532-9454-0d9f1c698e11 tempest-SnapshotDependencyTests-1674021511 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-6c995f44-a4f9-482e-8a4f-48e6860dfdbd {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:06:46 devstack sudo[105585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-6c995f44-a4f9-482e-8a4f-48e6860dfdbd Jul 13 14:06:46 devstack sudo[105585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:06:46 devstack sudo[105581]: pam_unix(sudo:session): session closed for user root Jul 13 14:06:46 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-b1385803-8325-4ae7-883b-e9218dea42e9 tempest-ProjectMemberTests-718446646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-77b3539a-4e6f-4aae-876d-4cdb2ca57ecd.af856347-acc4-4e55-8ad9-2c132d2c22e3" returned: 0 in 0.366s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:06:46 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-b1385803-8325-4ae7-883b-e9218dea42e9 tempest-ProjectMemberTests-718446646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-77b3539a-4e6f-4aae-876d-4cdb2ca57ecd.af856347-acc4-4e55-8ad9-2c132d2c22e3 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:06:46 devstack sudo[105589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-77b3539a-4e6f-4aae-876d-4cdb2ca57ecd.af856347-acc4-4e55-8ad9-2c132d2c22e3 Jul 13 14:06:46 devstack sudo[105589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:06:47 devstack sudo[105589]: pam_unix(sudo:session): session closed for user root Jul 13 14:06:47 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-b1385803-8325-4ae7-883b-e9218dea42e9 tempest-ProjectMemberTests-718446646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-77b3539a-4e6f-4aae-876d-4cdb2ca57ecd.af856347-acc4-4e55-8ad9-2c132d2c22e3" returned: 0 in 0.256s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:06:47 devstack sudo[105585]: pam_unix(sudo:session): session closed for user root Jul 13 14:06:47 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-4ead076e-66f3-4532-9454-0d9f1c698e11 tempest-SnapshotDependencyTests-1674021511 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-6c995f44-a4f9-482e-8a4f-48e6860dfdbd" returned: 0 in 0.401s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:06:47 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-4ead076e-66f3-4532-9454-0d9f1c698e11 tempest-SnapshotDependencyTests-1674021511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-6c995f44-a4f9-482e-8a4f-48e6860dfdbd {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:06:47 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-b1385803-8325-4ae7-883b-e9218dea42e9 tempest-ProjectMemberTests-718446646 None] Lock "cinder-quobyte-af856347-acc4-4e55-8ad9-2c132d2c22e3" released by "_delete_snapshot" :: held 1.464s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 14:06:47 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-b1385803-8325-4ae7-883b-e9218dea42e9 tempest-ProjectMemberTests-718446646 None] Lock "cinder-quobyte-77b3539a-4e6f-4aae-876d-4cdb2ca57ecd" released by "delete_snapshot" :: held 1.489s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 14:06:47 devstack sudo[105596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-6c995f44-a4f9-482e-8a4f-48e6860dfdbd Jul 13 14:06:47 devstack sudo[105596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:06:47 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-b1385803-8325-4ae7-883b-e9218dea42e9 tempest-ProjectMemberTests-718446646 None] Created reservations ['d7a40321-866e-41f2-977d-51bafeaddaf4', 'f225655f-7c64-42b5-951d-10b637b162b0', '434bbcf5-82b4-459f-ab31-dc882815bc1b', '84a91a17-f6d0-475b-b394-92267556d0f0'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 14:06:47 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-b1385803-8325-4ae7-883b-e9218dea42e9 tempest-ProjectMemberTests-718446646 None] Delete snapshot completed successfully. Jul 13 14:06:47 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-b1385803-8325-4ae7-883b-e9218dea42e9 tempest-ProjectMemberTests-718446646 None] Lock "cinder-af856347-acc4-4e55-8ad9-2c132d2c22e3-delete_snapshot" released by "delete_snapshot" :: held 1.636s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 14:06:47 devstack sudo[105596]: pam_unix(sudo:session): session closed for user root Jul 13 14:06:47 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-4ead076e-66f3-4532-9454-0d9f1c698e11 tempest-SnapshotDependencyTests-1674021511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-6c995f44-a4f9-482e-8a4f-48e6860dfdbd" returned: 0 in 0.243s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:06:47 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-4ead076e-66f3-4532-9454-0d9f1c698e11 tempest-SnapshotDependencyTests-1674021511 None] Lock "cinder-quobyte-6c995f44-a4f9-482e-8a4f-48e6860dfdbd" released by "delete_volume" :: held 0.705s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 14:06:47 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-4ead076e-66f3-4532-9454-0d9f1c698e11 tempest-SnapshotDependencyTests-1674021511 None] Created reservations ['02eaae77-c59f-4406-a500-2e4fed603295', '7095da3d-ba9e-4ce1-b737-efb3c05b3b6e', '30bad9bc-ce19-4eeb-bd4e-256ed7bdf7c3', '59efc8f1-31f8-454b-a260-5b5ab0f3ed93'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 14:06:47 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-4ead076e-66f3-4532-9454-0d9f1c698e11 tempest-SnapshotDependencyTests-1674021511 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 14:06:47 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-4ead076e-66f3-4532-9454-0d9f1c698e11 tempest-SnapshotDependencyTests-1674021511 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 14:06:47 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-4ead076e-66f3-4532-9454-0d9f1c698e11 tempest-SnapshotDependencyTests-1674021511 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 14:06:47 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-4ead076e-66f3-4532-9454-0d9f1c698e11 tempest-SnapshotDependencyTests-1674021511 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 14:06:47 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-4ead076e-66f3-4532-9454-0d9f1c698e11 tempest-SnapshotDependencyTests-1674021511 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 14:06:47 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-4ead076e-66f3-4532-9454-0d9f1c698e11 tempest-SnapshotDependencyTests-1674021511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:06:47 devstack sudo[105599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 Jul 13 14:06:47 devstack sudo[105599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:06:47 devstack sudo[105599]: pam_unix(sudo:session): session closed for user root Jul 13 14:06:47 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-4ead076e-66f3-4532-9454-0d9f1c698e11 tempest-SnapshotDependencyTests-1674021511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78" returned: 0 in 0.246s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:06:47 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-4ead076e-66f3-4532-9454-0d9f1c698e11 tempest-SnapshotDependencyTests-1674021511 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 14:06:47 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-4ead076e-66f3-4532-9454-0d9f1c698e11 tempest-SnapshotDependencyTests-1674021511 None] Deleted volume successfully. Jul 13 14:06:47 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-4ead076e-66f3-4532-9454-0d9f1c698e11 tempest-SnapshotDependencyTests-1674021511 None] Lock "cinder-6c995f44-a4f9-482e-8a4f-48e6860dfdbd-delete_volume" released by "delete_volume" :: held 1.141s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 14:06:47 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-c592c444-7ff5-4e4e-a122-efda2b89bc2e tempest-SnapshotDependencyTests-1674021511 None] Acquiring lock "cinder-1dd791a3-22b8-4254-a4cc-e2d5f95a93df-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 14:06:47 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-c592c444-7ff5-4e4e-a122-efda2b89bc2e tempest-SnapshotDependencyTests-1674021511 None] Lock "cinder-1dd791a3-22b8-4254-a4cc-e2d5f95a93df-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 14:06:47 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-134884e6-5dd6-44e7-8e65-e02f39615bba tempest-ProjectMemberTests-718446646 None] Acquiring lock "cinder-77b3539a-4e6f-4aae-876d-4cdb2ca57ecd-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 14:06:47 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-c592c444-7ff5-4e4e-a122-efda2b89bc2e tempest-SnapshotDependencyTests-1674021511 None] Acquiring lock "cinder-quobyte-1dd791a3-22b8-4254-a4cc-e2d5f95a93df" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 14:06:47 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-134884e6-5dd6-44e7-8e65-e02f39615bba tempest-ProjectMemberTests-718446646 None] Lock "cinder-77b3539a-4e6f-4aae-876d-4cdb2ca57ecd-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 14:06:47 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-c592c444-7ff5-4e4e-a122-efda2b89bc2e tempest-SnapshotDependencyTests-1674021511 None] Lock "cinder-quobyte-1dd791a3-22b8-4254-a4cc-e2d5f95a93df" acquired by "delete_volume" :: waited 0.025s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 14:06:48 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[22c22736-a46f-46e4-a01d-a57ba2d21dcb]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 14:06:48 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-c592c444-7ff5-4e4e-a122-efda2b89bc2e tempest-SnapshotDependencyTests-1674021511 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-1dd791a3-22b8-4254-a4cc-e2d5f95a93df {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:06:48 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-134884e6-5dd6-44e7-8e65-e02f39615bba tempest-ProjectMemberTests-718446646 None] Acquiring lock "cinder-quobyte-77b3539a-4e6f-4aae-876d-4cdb2ca57ecd" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 14:06:48 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-134884e6-5dd6-44e7-8e65-e02f39615bba tempest-ProjectMemberTests-718446646 None] Lock "cinder-quobyte-77b3539a-4e6f-4aae-876d-4cdb2ca57ecd" acquired by "delete_volume" :: waited 0.015s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 14:06:48 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bc3b002-603e-429b-b5cd-db02f87703b3]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 14:06:48 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-134884e6-5dd6-44e7-8e65-e02f39615bba tempest-ProjectMemberTests-718446646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-77b3539a-4e6f-4aae-876d-4cdb2ca57ecd {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:06:48 devstack sudo[105602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-1dd791a3-22b8-4254-a4cc-e2d5f95a93df Jul 13 14:06:48 devstack sudo[105602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:06:48 devstack sudo[105603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-77b3539a-4e6f-4aae-876d-4cdb2ca57ecd Jul 13 14:06:48 devstack sudo[105603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:06:48 devstack sudo[105602]: pam_unix(sudo:session): session closed for user root Jul 13 14:06:48 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-c592c444-7ff5-4e4e-a122-efda2b89bc2e tempest-SnapshotDependencyTests-1674021511 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-1dd791a3-22b8-4254-a4cc-e2d5f95a93df" returned: 0 in 0.363s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:06:48 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-c592c444-7ff5-4e4e-a122-efda2b89bc2e tempest-SnapshotDependencyTests-1674021511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-1dd791a3-22b8-4254-a4cc-e2d5f95a93df {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:06:48 devstack sudo[105609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-1dd791a3-22b8-4254-a4cc-e2d5f95a93df Jul 13 14:06:48 devstack sudo[105609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:06:48 devstack sudo[105603]: pam_unix(sudo:session): session closed for user root Jul 13 14:06:48 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-134884e6-5dd6-44e7-8e65-e02f39615bba tempest-ProjectMemberTests-718446646 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-77b3539a-4e6f-4aae-876d-4cdb2ca57ecd" returned: 0 in 0.375s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:06:48 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-134884e6-5dd6-44e7-8e65-e02f39615bba tempest-ProjectMemberTests-718446646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-77b3539a-4e6f-4aae-876d-4cdb2ca57ecd {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:06:48 devstack sudo[105614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-77b3539a-4e6f-4aae-876d-4cdb2ca57ecd Jul 13 14:06:48 devstack sudo[105614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:06:48 devstack sudo[105609]: pam_unix(sudo:session): session closed for user root Jul 13 14:06:48 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-c592c444-7ff5-4e4e-a122-efda2b89bc2e tempest-SnapshotDependencyTests-1674021511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-1dd791a3-22b8-4254-a4cc-e2d5f95a93df" returned: 0 in 0.252s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:06:48 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-c592c444-7ff5-4e4e-a122-efda2b89bc2e tempest-SnapshotDependencyTests-1674021511 None] Lock "cinder-quobyte-1dd791a3-22b8-4254-a4cc-e2d5f95a93df" released by "delete_volume" :: held 0.659s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 14:06:48 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-c592c444-7ff5-4e4e-a122-efda2b89bc2e tempest-SnapshotDependencyTests-1674021511 None] Created reservations ['b0762b5b-e4b5-43c4-9c42-96516459a9d2', '05d2ad0d-6e96-4615-87a2-06ab61578318', '1aa1a05e-00a7-4325-9ee9-82a190d6a5eb', 'f35135b9-56fa-4841-b7cb-5c6433fe8c1a'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 14:06:48 devstack sudo[105614]: pam_unix(sudo:session): session closed for user root Jul 13 14:06:48 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-134884e6-5dd6-44e7-8e65-e02f39615bba tempest-ProjectMemberTests-718446646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-77b3539a-4e6f-4aae-876d-4cdb2ca57ecd" returned: 0 in 0.263s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:06:48 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-134884e6-5dd6-44e7-8e65-e02f39615bba tempest-ProjectMemberTests-718446646 None] Lock "cinder-quobyte-77b3539a-4e6f-4aae-876d-4cdb2ca57ecd" released by "delete_volume" :: held 0.707s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 14:06:48 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-c592c444-7ff5-4e4e-a122-efda2b89bc2e tempest-SnapshotDependencyTests-1674021511 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 14:06:48 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-c592c444-7ff5-4e4e-a122-efda2b89bc2e tempest-SnapshotDependencyTests-1674021511 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 14:06:48 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-c592c444-7ff5-4e4e-a122-efda2b89bc2e tempest-SnapshotDependencyTests-1674021511 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 14:06:48 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-c592c444-7ff5-4e4e-a122-efda2b89bc2e tempest-SnapshotDependencyTests-1674021511 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 14:06:48 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-c592c444-7ff5-4e4e-a122-efda2b89bc2e tempest-SnapshotDependencyTests-1674021511 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 14:06:48 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-c592c444-7ff5-4e4e-a122-efda2b89bc2e tempest-SnapshotDependencyTests-1674021511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:06:48 devstack sudo[105618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 Jul 13 14:06:48 devstack sudo[105618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:06:48 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-134884e6-5dd6-44e7-8e65-e02f39615bba tempest-ProjectMemberTests-718446646 None] Created reservations ['7357fe15-4ea0-4ffc-b23c-7185f5d864ed', 'caa40bc1-88f0-48fa-971f-d37128db6cd9', '4612543c-4d30-4586-a87e-3a589499479b', '325d499c-de5b-48b8-9e47-ffeb11b8fc3f'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 14:06:48 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-134884e6-5dd6-44e7-8e65-e02f39615bba tempest-ProjectMemberTests-718446646 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 14:06:48 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-134884e6-5dd6-44e7-8e65-e02f39615bba tempest-ProjectMemberTests-718446646 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 14:06:48 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-134884e6-5dd6-44e7-8e65-e02f39615bba tempest-ProjectMemberTests-718446646 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 14:06:48 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-134884e6-5dd6-44e7-8e65-e02f39615bba tempest-ProjectMemberTests-718446646 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 14:06:48 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-134884e6-5dd6-44e7-8e65-e02f39615bba tempest-ProjectMemberTests-718446646 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 14:06:48 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-134884e6-5dd6-44e7-8e65-e02f39615bba tempest-ProjectMemberTests-718446646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:06:48 devstack sudo[105620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 Jul 13 14:06:48 devstack sudo[105620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:06:49 devstack sudo[105618]: pam_unix(sudo:session): session closed for user root Jul 13 14:06:49 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-c592c444-7ff5-4e4e-a122-efda2b89bc2e tempest-SnapshotDependencyTests-1674021511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78" returned: 0 in 0.267s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:06:49 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-c592c444-7ff5-4e4e-a122-efda2b89bc2e tempest-SnapshotDependencyTests-1674021511 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 14:06:49 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-c592c444-7ff5-4e4e-a122-efda2b89bc2e tempest-SnapshotDependencyTests-1674021511 None] Deleted volume successfully. Jul 13 14:06:49 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-c592c444-7ff5-4e4e-a122-efda2b89bc2e tempest-SnapshotDependencyTests-1674021511 None] Lock "cinder-1dd791a3-22b8-4254-a4cc-e2d5f95a93df-delete_volume" released by "delete_volume" :: held 1.173s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 14:06:49 devstack sudo[105620]: pam_unix(sudo:session): session closed for user root Jul 13 14:06:49 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-134884e6-5dd6-44e7-8e65-e02f39615bba tempest-ProjectMemberTests-718446646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78" returned: 0 in 0.274s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:06:49 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-134884e6-5dd6-44e7-8e65-e02f39615bba tempest-ProjectMemberTests-718446646 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 14:06:49 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-134884e6-5dd6-44e7-8e65-e02f39615bba tempest-ProjectMemberTests-718446646 None] Deleted volume successfully. Jul 13 14:06:49 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-134884e6-5dd6-44e7-8e65-e02f39615bba tempest-ProjectMemberTests-718446646 None] Lock "cinder-77b3539a-4e6f-4aae-876d-4cdb2ca57ecd-delete_volume" released by "delete_volume" :: held 1.218s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 14:06:49 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-6b6d2f9a-34cf-472e-bffe-afca23cd13f0 tempest-ProjectMemberTests-718446646 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 14:06:49 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-6b6d2f9a-34cf-472e-bffe-afca23cd13f0 tempest-ProjectMemberTests-718446646 None] Flow 'volume_create_manager' (24295f53-9e41-4cc1-bb91-5ffbfe77cc06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 14:06:49 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-6b6d2f9a-34cf-472e-bffe-afca23cd13f0 tempest-ProjectMemberTests-718446646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea4e3d4f-6157-495a-8d06-e51521b94ca6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:06:49 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-6b6d2f9a-34cf-472e-bffe-afca23cd13f0 tempest-ProjectMemberTests-718446646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea4e3d4f-6157-495a-8d06-e51521b94ca6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T12:06:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-488051616',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6197ff2b-5931-4f4e-aae7-4e782a815415,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2bb0e12a2763448b9d28151e1e814854',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T12:06:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T12:06:50Z,use_quota=True,user_id='2d16431e25f348deb700350f5b150c69',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1147de8b-623b-426c-a13d-7fc824a80f67),volume_type_id=1147de8b-623b-426c-a13d-7fc824a80f67)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:06:49 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-6b6d2f9a-34cf-472e-bffe-afca23cd13f0 tempest-ProjectMemberTests-718446646 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3baed2a3-2f0d-43c1-bd2f-89bfe88d8d03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:06:49 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-6b6d2f9a-34cf-472e-bffe-afca23cd13f0 tempest-ProjectMemberTests-718446646 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3baed2a3-2f0d-43c1-bd2f-89bfe88d8d03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:06:49 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-6b6d2f9a-34cf-472e-bffe-afca23cd13f0 tempest-ProjectMemberTests-718446646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9da46835-b7cf-42f6-b841-394285b73082) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:06:49 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-6b6d2f9a-34cf-472e-bffe-afca23cd13f0 tempest-ProjectMemberTests-718446646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9da46835-b7cf-42f6-b841-394285b73082) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6197ff2b-5931-4f4e-aae7-4e782a815415', 'volume_name': 'volume-6197ff2b-5931-4f4e-aae7-4e782a815415', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:06:49 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-6b6d2f9a-34cf-472e-bffe-afca23cd13f0 tempest-ProjectMemberTests-718446646 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d06500d7-be12-4268-b10c-363cd1d60571) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:06:49 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-6b6d2f9a-34cf-472e-bffe-afca23cd13f0 tempest-ProjectMemberTests-718446646 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d06500d7-be12-4268-b10c-363cd1d60571) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:06:49 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-6b6d2f9a-34cf-472e-bffe-afca23cd13f0 tempest-ProjectMemberTests-718446646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c53c4037-adb4-4db0-a529-9b90513eba84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:06:49 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-6b6d2f9a-34cf-472e-bffe-afca23cd13f0 tempest-ProjectMemberTests-718446646 None] Volume 6197ff2b-5931-4f4e-aae7-4e782a815415: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6197ff2b-5931-4f4e-aae7-4e782a815415', 'volume_size': 1} Jul 13 14:06:49 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-6b6d2f9a-34cf-472e-bffe-afca23cd13f0 tempest-ProjectMemberTests-718446646 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 14:06:49 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-6b6d2f9a-34cf-472e-bffe-afca23cd13f0 tempest-ProjectMemberTests-718446646 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 14:06:49 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-6b6d2f9a-34cf-472e-bffe-afca23cd13f0 tempest-ProjectMemberTests-718446646 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T12:06:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-488051616',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6197ff2b-5931-4f4e-aae7-4e782a815415,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2bb0e12a2763448b9d28151e1e814854',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T12:06:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T12:06:50Z,use_quota=True,user_id='2d16431e25f348deb700350f5b150c69',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1147de8b-623b-426c-a13d-7fc824a80f67),volume_type_id=1147de8b-623b-426c-a13d-7fc824a80f67)}" {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 13 14:06:49 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-6b6d2f9a-34cf-472e-bffe-afca23cd13f0 tempest-ProjectMemberTests-718446646 None] Creating volume 6197ff2b-5931-4f4e-aae7-4e782a815415 {{(pid=87098) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 13 14:06:49 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-6b6d2f9a-34cf-472e-bffe-afca23cd13f0 tempest-ProjectMemberTests-718446646 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 14:06:49 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-6b6d2f9a-34cf-472e-bffe-afca23cd13f0 tempest-ProjectMemberTests-718446646 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 14:06:49 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-6b6d2f9a-34cf-472e-bffe-afca23cd13f0 tempest-ProjectMemberTests-718446646 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 14:06:49 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-6b6d2f9a-34cf-472e-bffe-afca23cd13f0 tempest-ProjectMemberTests-718446646 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 14:06:49 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-6b6d2f9a-34cf-472e-bffe-afca23cd13f0 tempest-ProjectMemberTests-718446646 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 14:06:49 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-6b6d2f9a-34cf-472e-bffe-afca23cd13f0 tempest-ProjectMemberTests-718446646 None] Selected osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 14:06:49 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-6b6d2f9a-34cf-472e-bffe-afca23cd13f0 tempest-ProjectMemberTests-718446646 None] casted to osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 Jul 13 14:06:49 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-6b6d2f9a-34cf-472e-bffe-afca23cd13f0 tempest-ProjectMemberTests-718446646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-6197ff2b-5931-4f4e-aae7-4e782a815415 1073741824 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:06:49 devstack sudo[105624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-6197ff2b-5931-4f4e-aae7-4e782a815415 1073741824 Jul 13 14:06:49 devstack sudo[105624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:06:50 devstack sudo[105624]: pam_unix(sudo:session): session closed for user root Jul 13 14:06:50 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-6b6d2f9a-34cf-472e-bffe-afca23cd13f0 tempest-ProjectMemberTests-718446646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-6197ff2b-5931-4f4e-aae7-4e782a815415 1073741824" returned: 0 in 0.459s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:06:50 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-6b6d2f9a-34cf-472e-bffe-afca23cd13f0 tempest-ProjectMemberTests-718446646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-6197ff2b-5931-4f4e-aae7-4e782a815415 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:06:50 devstack sudo[105629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-6197ff2b-5931-4f4e-aae7-4e782a815415 Jul 13 14:06:50 devstack sudo[105629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:06:50 devstack sudo[105629]: pam_unix(sudo:session): session closed for user root Jul 13 14:06:50 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-6b6d2f9a-34cf-472e-bffe-afca23cd13f0 tempest-ProjectMemberTests-718446646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-6197ff2b-5931-4f4e-aae7-4e782a815415" returned: 0 in 0.250s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:06:50 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-6b6d2f9a-34cf-472e-bffe-afca23cd13f0 tempest-ProjectMemberTests-718446646 None] <== create_volume: return (758ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'} {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 13 14:06:50 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-6b6d2f9a-34cf-472e-bffe-afca23cd13f0 tempest-ProjectMemberTests-718446646 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.761s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 14:06:50 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-6b6d2f9a-34cf-472e-bffe-afca23cd13f0 tempest-ProjectMemberTests-718446646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c53c4037-adb4-4db0-a529-9b90513eba84) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6197ff2b-5931-4f4e-aae7-4e782a815415', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:06:50 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-6b6d2f9a-34cf-472e-bffe-afca23cd13f0 tempest-ProjectMemberTests-718446646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8cc120a-79e5-4344-9887-fac709f3efad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:06:50 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-6b6d2f9a-34cf-472e-bffe-afca23cd13f0 tempest-ProjectMemberTests-718446646 None] Volume volume-6197ff2b-5931-4f4e-aae7-4e782a815415 (6197ff2b-5931-4f4e-aae7-4e782a815415): created successfully Jul 13 14:06:50 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-6b6d2f9a-34cf-472e-bffe-afca23cd13f0 tempest-ProjectMemberTests-718446646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8cc120a-79e5-4344-9887-fac709f3efad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:06:50 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-6b6d2f9a-34cf-472e-bffe-afca23cd13f0 tempest-ProjectMemberTests-718446646 None] Flow 'volume_create_manager' (24295f53-9e41-4cc1-bb91-5ffbfe77cc06) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 14:06:50 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-6b6d2f9a-34cf-472e-bffe-afca23cd13f0 tempest-ProjectMemberTests-718446646 None] Created volume successfully. Jul 13 14:06:50 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-3d2587f1-f0c1-4047-b97e-5d2d8f7f1847 tempest-ProjectMemberTests-718446646 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 14:06:50 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-3d2587f1-f0c1-4047-b97e-5d2d8f7f1847 tempest-ProjectMemberTests-718446646 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 14:06:50 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-3d2587f1-f0c1-4047-b97e-5d2d8f7f1847 tempest-ProjectMemberTests-718446646 None] Creating offline snapshot 65bcd02b-504e-437b-83b1-5173ff4ef832 of volume 6197ff2b-5931-4f4e-aae7-4e782a815415 {{(pid=87098) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 13 14:06:50 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[d244ac6b-db37-4caa-b1e5-25620c77ae63]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 14:06:50 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-3d2587f1-f0c1-4047-b97e-5d2d8f7f1847 tempest-ProjectMemberTests-718446646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-6197ff2b-5931-4f4e-aae7-4e782a815415 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:06:50 devstack sudo[105633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-6197ff2b-5931-4f4e-aae7-4e782a815415 Jul 13 14:06:50 devstack sudo[105633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:06:51 devstack sudo[105633]: pam_unix(sudo:session): session closed for user root Jul 13 14:06:51 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-3d2587f1-f0c1-4047-b97e-5d2d8f7f1847 tempest-ProjectMemberTests-718446646 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-6197ff2b-5931-4f4e-aae7-4e782a815415" returned: 0 in 0.419s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:06:51 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-3d2587f1-f0c1-4047-b97e-5d2d8f7f1847 tempest-ProjectMemberTests-718446646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-6197ff2b-5931-4f4e-aae7-4e782a815415,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-6197ff2b-5931-4f4e-aae7-4e782a815415.65bcd02b-504e-437b-83b1-5173ff4ef832 1G {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:06:51 devstack sudo[105639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-6197ff2b-5931-4f4e-aae7-4e782a815415,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-6197ff2b-5931-4f4e-aae7-4e782a815415.65bcd02b-504e-437b-83b1-5173ff4ef832 1G Jul 13 14:06:51 devstack sudo[105639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:06:51 devstack sudo[105639]: pam_unix(sudo:session): session closed for user root Jul 13 14:06:51 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-3d2587f1-f0c1-4047-b97e-5d2d8f7f1847 tempest-ProjectMemberTests-718446646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-6197ff2b-5931-4f4e-aae7-4e782a815415,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-6197ff2b-5931-4f4e-aae7-4e782a815415.65bcd02b-504e-437b-83b1-5173ff4ef832 1G" returned: 0 in 0.430s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:06:51 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-3d2587f1-f0c1-4047-b97e-5d2d8f7f1847 tempest-ProjectMemberTests-718446646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6197ff2b-5931-4f4e-aae7-4e782a815415 -F qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-6197ff2b-5931-4f4e-aae7-4e782a815415.65bcd02b-504e-437b-83b1-5173ff4ef832 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:06:51 devstack sudo[105645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6197ff2b-5931-4f4e-aae7-4e782a815415 -F qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-6197ff2b-5931-4f4e-aae7-4e782a815415.65bcd02b-504e-437b-83b1-5173ff4ef832 Jul 13 14:06:51 devstack sudo[105645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:06:51 devstack sudo[105645]: pam_unix(sudo:session): session closed for user root Jul 13 14:06:52 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-3d2587f1-f0c1-4047-b97e-5d2d8f7f1847 tempest-ProjectMemberTests-718446646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6197ff2b-5931-4f4e-aae7-4e782a815415 -F qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-6197ff2b-5931-4f4e-aae7-4e782a815415.65bcd02b-504e-437b-83b1-5173ff4ef832" returned: 0 in 0.329s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:06:52 devstack cinder-volume[87098]: WARNING cinder.volume.drivers.remotefs [None req-3d2587f1-f0c1-4047-b97e-5d2d8f7f1847 tempest-ProjectMemberTests-718446646 None] /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-6197ff2b-5931-4f4e-aae7-4e782a815415.65bcd02b-504e-437b-83b1-5173ff4ef832 is being set with open permissions: ugo+rw Jul 13 14:06:52 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-3d2587f1-f0c1-4047-b97e-5d2d8f7f1847 tempest-ProjectMemberTests-718446646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-6197ff2b-5931-4f4e-aae7-4e782a815415.65bcd02b-504e-437b-83b1-5173ff4ef832 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:06:52 devstack sudo[105650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-6197ff2b-5931-4f4e-aae7-4e782a815415.65bcd02b-504e-437b-83b1-5173ff4ef832 Jul 13 14:06:52 devstack sudo[105650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:06:52 devstack sudo[105650]: pam_unix(sudo:session): session closed for user root Jul 13 14:06:52 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-3d2587f1-f0c1-4047-b97e-5d2d8f7f1847 tempest-ProjectMemberTests-718446646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-6197ff2b-5931-4f4e-aae7-4e782a815415.65bcd02b-504e-437b-83b1-5173ff4ef832" returned: 0 in 0.260s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:06:52 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-3d2587f1-f0c1-4047-b97e-5d2d8f7f1847 tempest-ProjectMemberTests-718446646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-6197ff2b-5931-4f4e-aae7-4e782a815415.info {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:06:52 devstack sudo[105653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-6197ff2b-5931-4f4e-aae7-4e782a815415.info Jul 13 14:06:52 devstack sudo[105653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:06:52 devstack sudo[105653]: pam_unix(sudo:session): session closed for user root Jul 13 14:06:52 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-3d2587f1-f0c1-4047-b97e-5d2d8f7f1847 tempest-ProjectMemberTests-718446646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-6197ff2b-5931-4f4e-aae7-4e782a815415.info" returned: 0 in 0.270s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:06:52 devstack cinder-volume[87098]: WARNING cinder.volume.drivers.remotefs [None req-3d2587f1-f0c1-4047-b97e-5d2d8f7f1847 tempest-ProjectMemberTests-718446646 None] /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-6197ff2b-5931-4f4e-aae7-4e782a815415.info is being set with open permissions: ugo+rw Jul 13 14:06:52 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-3d2587f1-f0c1-4047-b97e-5d2d8f7f1847 tempest-ProjectMemberTests-718446646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-6197ff2b-5931-4f4e-aae7-4e782a815415.info {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:06:52 devstack sudo[105656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-6197ff2b-5931-4f4e-aae7-4e782a815415.info Jul 13 14:06:52 devstack sudo[105656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:06:52 devstack sudo[105656]: pam_unix(sudo:session): session closed for user root Jul 13 14:06:52 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-3d2587f1-f0c1-4047-b97e-5d2d8f7f1847 tempest-ProjectMemberTests-718446646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-6197ff2b-5931-4f4e-aae7-4e782a815415.info" returned: 0 in 0.308s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:06:52 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-3d2587f1-f0c1-4047-b97e-5d2d8f7f1847 tempest-ProjectMemberTests-718446646 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.106s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 14:06:52 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-3d2587f1-f0c1-4047-b97e-5d2d8f7f1847 tempest-ProjectMemberTests-718446646 None] Create snapshot completed successfully Jul 13 14:06:53 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-6e76724c-7e04-4e56-8ae6-4d8debc0ea95 tempest-ProjectMemberTests-718446646 None] Acquiring lock "cinder-65bcd02b-504e-437b-83b1-5173ff4ef832-delete_snapshot" by "delete_snapshot" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 14:06:54 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-6e76724c-7e04-4e56-8ae6-4d8debc0ea95 tempest-ProjectMemberTests-718446646 None] Lock "cinder-65bcd02b-504e-437b-83b1-5173ff4ef832-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 14:06:54 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-6e76724c-7e04-4e56-8ae6-4d8debc0ea95 tempest-ProjectMemberTests-718446646 None] Acquiring lock "cinder-quobyte-6197ff2b-5931-4f4e-aae7-4e782a815415" by "delete_snapshot" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 14:06:54 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-6e76724c-7e04-4e56-8ae6-4d8debc0ea95 tempest-ProjectMemberTests-718446646 None] Lock "cinder-quobyte-6197ff2b-5931-4f4e-aae7-4e782a815415" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 14:06:54 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-6e76724c-7e04-4e56-8ae6-4d8debc0ea95 tempest-ProjectMemberTests-718446646 None] Acquiring lock "cinder-quobyte-65bcd02b-504e-437b-83b1-5173ff4ef832" by "_delete_snapshot" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 14:06:54 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-6e76724c-7e04-4e56-8ae6-4d8debc0ea95 tempest-ProjectMemberTests-718446646 None] Lock "cinder-quobyte-65bcd02b-504e-437b-83b1-5173ff4ef832" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 14:06:54 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-6e76724c-7e04-4e56-8ae6-4d8debc0ea95 tempest-ProjectMemberTests-718446646 None] Deleting offline snapshot 65bcd02b-504e-437b-83b1-5173ff4ef832 of volume 6197ff2b-5931-4f4e-aae7-4e782a815415 {{(pid=87098) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 13 14:06:54 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-6e76724c-7e04-4e56-8ae6-4d8debc0ea95 tempest-ProjectMemberTests-718446646 None] snapshot_file for this snap is: volume-6197ff2b-5931-4f4e-aae7-4e782a815415.65bcd02b-504e-437b-83b1-5173ff4ef832 {{(pid=87098) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 13 14:06:54 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae44cc44-1a0a-4080-b9be-5b07a0625e5b]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 14:06:54 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-6e76724c-7e04-4e56-8ae6-4d8debc0ea95 tempest-ProjectMemberTests-718446646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-6197ff2b-5931-4f4e-aae7-4e782a815415.65bcd02b-504e-437b-83b1-5173ff4ef832 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:06:54 devstack sudo[105661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-6197ff2b-5931-4f4e-aae7-4e782a815415.65bcd02b-504e-437b-83b1-5173ff4ef832 Jul 13 14:06:54 devstack sudo[105661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:06:54 devstack sudo[105661]: pam_unix(sudo:session): session closed for user root Jul 13 14:06:54 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-6e76724c-7e04-4e56-8ae6-4d8debc0ea95 tempest-ProjectMemberTests-718446646 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-6197ff2b-5931-4f4e-aae7-4e782a815415.65bcd02b-504e-437b-83b1-5173ff4ef832" returned: 0 in 0.394s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:06:54 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-6e76724c-7e04-4e56-8ae6-4d8debc0ea95 tempest-ProjectMemberTests-718446646 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6197ff2b-5931-4f4e-aae7-4e782a815415(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87098) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 13 14:06:54 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7e348a9-597f-4aac-981c-59c74962101f]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 14:06:54 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-6e76724c-7e04-4e56-8ae6-4d8debc0ea95 tempest-ProjectMemberTests-718446646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-6197ff2b-5931-4f4e-aae7-4e782a815415 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:06:54 devstack sudo[105666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-6197ff2b-5931-4f4e-aae7-4e782a815415 Jul 13 14:06:54 devstack sudo[105666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:06:54 devstack sudo[105666]: pam_unix(sudo:session): session closed for user root Jul 13 14:06:54 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-6e76724c-7e04-4e56-8ae6-4d8debc0ea95 tempest-ProjectMemberTests-718446646 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-6197ff2b-5931-4f4e-aae7-4e782a815415" returned: 0 in 0.412s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:06:54 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-6e76724c-7e04-4e56-8ae6-4d8debc0ea95 tempest-ProjectMemberTests-718446646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-6197ff2b-5931-4f4e-aae7-4e782a815415.65bcd02b-504e-437b-83b1-5173ff4ef832 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:06:54 devstack sudo[105671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-6197ff2b-5931-4f4e-aae7-4e782a815415.65bcd02b-504e-437b-83b1-5173ff4ef832 Jul 13 14:06:54 devstack sudo[105671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:06:55 devstack sudo[105671]: pam_unix(sudo:session): session closed for user root Jul 13 14:06:55 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-6e76724c-7e04-4e56-8ae6-4d8debc0ea95 tempest-ProjectMemberTests-718446646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-6197ff2b-5931-4f4e-aae7-4e782a815415.65bcd02b-504e-437b-83b1-5173ff4ef832" returned: 0 in 0.383s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:06:55 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-6e76724c-7e04-4e56-8ae6-4d8debc0ea95 tempest-ProjectMemberTests-718446646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-6197ff2b-5931-4f4e-aae7-4e782a815415.65bcd02b-504e-437b-83b1-5173ff4ef832 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:06:55 devstack sudo[105676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-6197ff2b-5931-4f4e-aae7-4e782a815415.65bcd02b-504e-437b-83b1-5173ff4ef832 Jul 13 14:06:55 devstack sudo[105676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:06:55 devstack sudo[105676]: pam_unix(sudo:session): session closed for user root Jul 13 14:06:55 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-6e76724c-7e04-4e56-8ae6-4d8debc0ea95 tempest-ProjectMemberTests-718446646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-6197ff2b-5931-4f4e-aae7-4e782a815415.65bcd02b-504e-437b-83b1-5173ff4ef832" returned: 0 in 0.284s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:06:55 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-6e76724c-7e04-4e56-8ae6-4d8debc0ea95 tempest-ProjectMemberTests-718446646 None] Lock "cinder-quobyte-65bcd02b-504e-437b-83b1-5173ff4ef832" released by "_delete_snapshot" :: held 1.598s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 14:06:55 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-6e76724c-7e04-4e56-8ae6-4d8debc0ea95 tempest-ProjectMemberTests-718446646 None] Lock "cinder-quobyte-6197ff2b-5931-4f4e-aae7-4e782a815415" released by "delete_snapshot" :: held 1.625s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 14:06:55 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-6e76724c-7e04-4e56-8ae6-4d8debc0ea95 tempest-ProjectMemberTests-718446646 None] Created reservations ['ec52db93-58ca-4da0-b11d-361d656a5285', 'e61b2a39-6664-4d4a-967c-20c8c1563ee8', '926d5b0f-9c02-46be-8781-ac9850f11b65', 'ca88f4f9-de5d-40ba-813c-188d5184d9e0'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 14:06:55 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-6e76724c-7e04-4e56-8ae6-4d8debc0ea95 tempest-ProjectMemberTests-718446646 None] Delete snapshot completed successfully. Jul 13 14:06:55 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-6e76724c-7e04-4e56-8ae6-4d8debc0ea95 tempest-ProjectMemberTests-718446646 None] Lock "cinder-65bcd02b-504e-437b-83b1-5173ff4ef832-delete_snapshot" released by "delete_snapshot" :: held 1.780s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 14:06:56 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-3325724a-beb2-4b2e-a96f-317275271ef3 tempest-ProjectMemberTests-718446646 None] Acquiring lock "cinder-6197ff2b-5931-4f4e-aae7-4e782a815415-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 14:06:56 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-3325724a-beb2-4b2e-a96f-317275271ef3 tempest-ProjectMemberTests-718446646 None] Lock "cinder-6197ff2b-5931-4f4e-aae7-4e782a815415-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 14:06:56 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-3325724a-beb2-4b2e-a96f-317275271ef3 tempest-ProjectMemberTests-718446646 None] Acquiring lock "cinder-quobyte-6197ff2b-5931-4f4e-aae7-4e782a815415" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 14:06:56 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-3325724a-beb2-4b2e-a96f-317275271ef3 tempest-ProjectMemberTests-718446646 None] Lock "cinder-quobyte-6197ff2b-5931-4f4e-aae7-4e782a815415" acquired by "delete_volume" :: waited 0.019s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 14:06:56 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b094cf6-be89-45c4-8de3-ab9af6f7a0a6]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 14:06:56 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-3325724a-beb2-4b2e-a96f-317275271ef3 tempest-ProjectMemberTests-718446646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-6197ff2b-5931-4f4e-aae7-4e782a815415 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:06:56 devstack sudo[105680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-6197ff2b-5931-4f4e-aae7-4e782a815415 Jul 13 14:06:56 devstack sudo[105680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:06:56 devstack sudo[105680]: pam_unix(sudo:session): session closed for user root Jul 13 14:06:56 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-3325724a-beb2-4b2e-a96f-317275271ef3 tempest-ProjectMemberTests-718446646 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-6197ff2b-5931-4f4e-aae7-4e782a815415" returned: 0 in 0.368s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:06:56 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-3325724a-beb2-4b2e-a96f-317275271ef3 tempest-ProjectMemberTests-718446646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-6197ff2b-5931-4f4e-aae7-4e782a815415 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:06:56 devstack sudo[105685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-6197ff2b-5931-4f4e-aae7-4e782a815415 Jul 13 14:06:56 devstack sudo[105685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:06:56 devstack sudo[105685]: pam_unix(sudo:session): session closed for user root Jul 13 14:06:56 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-3325724a-beb2-4b2e-a96f-317275271ef3 tempest-ProjectMemberTests-718446646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-6197ff2b-5931-4f4e-aae7-4e782a815415" returned: 0 in 0.261s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:06:56 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-3325724a-beb2-4b2e-a96f-317275271ef3 tempest-ProjectMemberTests-718446646 None] Lock "cinder-quobyte-6197ff2b-5931-4f4e-aae7-4e782a815415" released by "delete_volume" :: held 0.695s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 14:06:57 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-3325724a-beb2-4b2e-a96f-317275271ef3 tempest-ProjectMemberTests-718446646 None] Created reservations ['6efc8186-2c37-4919-a0bf-77fc13ef408c', '672ccce9-337b-44c5-b469-251ec48456be', 'c00b4308-669e-4709-8ef5-432d166ad803', 'e632cef8-c369-40c5-bf81-eb9ed1f140fb'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 14:06:57 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-3325724a-beb2-4b2e-a96f-317275271ef3 tempest-ProjectMemberTests-718446646 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 14:06:57 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-3325724a-beb2-4b2e-a96f-317275271ef3 tempest-ProjectMemberTests-718446646 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 14:06:57 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-3325724a-beb2-4b2e-a96f-317275271ef3 tempest-ProjectMemberTests-718446646 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 14:06:57 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-3325724a-beb2-4b2e-a96f-317275271ef3 tempest-ProjectMemberTests-718446646 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 14:06:57 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-3325724a-beb2-4b2e-a96f-317275271ef3 tempest-ProjectMemberTests-718446646 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 14:06:57 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-3325724a-beb2-4b2e-a96f-317275271ef3 tempest-ProjectMemberTests-718446646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:06:57 devstack sudo[105688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 Jul 13 14:06:57 devstack sudo[105688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:06:57 devstack sudo[105688]: pam_unix(sudo:session): session closed for user root Jul 13 14:06:57 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-3325724a-beb2-4b2e-a96f-317275271ef3 tempest-ProjectMemberTests-718446646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78" returned: 0 in 0.276s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:06:57 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-3325724a-beb2-4b2e-a96f-317275271ef3 tempest-ProjectMemberTests-718446646 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 14:06:57 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-3325724a-beb2-4b2e-a96f-317275271ef3 tempest-ProjectMemberTests-718446646 None] Deleted volume successfully. Jul 13 14:06:57 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-3325724a-beb2-4b2e-a96f-317275271ef3 tempest-ProjectMemberTests-718446646 None] Lock "cinder-6197ff2b-5931-4f4e-aae7-4e782a815415-delete_volume" released by "delete_volume" :: held 1.196s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 14:06:57 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-22ff5538-c9f3-47a1-9b92-9bfacd4e026f tempest-ProjectMemberTests-718446646 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 14:06:57 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-22ff5538-c9f3-47a1-9b92-9bfacd4e026f tempest-ProjectMemberTests-718446646 None] Flow 'volume_create_manager' (cde2d0f4-1baa-43ca-bb36-7b3ccb4f936b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 14:06:57 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-22ff5538-c9f3-47a1-9b92-9bfacd4e026f tempest-ProjectMemberTests-718446646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25094214-c91f-465c-b2e0-dc5ed457faa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:06:57 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-22ff5538-c9f3-47a1-9b92-9bfacd4e026f tempest-ProjectMemberTests-718446646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25094214-c91f-465c-b2e0-dc5ed457faa4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T12:06:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-308860195',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b440b185-cf3d-47e7-b66d-98e1ef3e3970,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2bb0e12a2763448b9d28151e1e814854',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T12:06:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T12:06:58Z,use_quota=True,user_id='2d16431e25f348deb700350f5b150c69',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1147de8b-623b-426c-a13d-7fc824a80f67),volume_type_id=1147de8b-623b-426c-a13d-7fc824a80f67)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:06:57 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-22ff5538-c9f3-47a1-9b92-9bfacd4e026f tempest-ProjectMemberTests-718446646 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f6fd614-8fd7-44a3-bf2a-f9597a884d1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:06:57 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-22ff5538-c9f3-47a1-9b92-9bfacd4e026f tempest-ProjectMemberTests-718446646 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f6fd614-8fd7-44a3-bf2a-f9597a884d1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:06:57 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-22ff5538-c9f3-47a1-9b92-9bfacd4e026f tempest-ProjectMemberTests-718446646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14f6bee5-b859-4b02-bf6c-4c669150afbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:06:57 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-22ff5538-c9f3-47a1-9b92-9bfacd4e026f tempest-ProjectMemberTests-718446646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14f6bee5-b859-4b02-bf6c-4c669150afbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b440b185-cf3d-47e7-b66d-98e1ef3e3970', 'volume_name': 'volume-b440b185-cf3d-47e7-b66d-98e1ef3e3970', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:06:57 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-22ff5538-c9f3-47a1-9b92-9bfacd4e026f tempest-ProjectMemberTests-718446646 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7bb4bcb2-8f79-4092-9f83-9beafbb801a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:06:57 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-22ff5538-c9f3-47a1-9b92-9bfacd4e026f tempest-ProjectMemberTests-718446646 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7bb4bcb2-8f79-4092-9f83-9beafbb801a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:06:57 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-22ff5538-c9f3-47a1-9b92-9bfacd4e026f tempest-ProjectMemberTests-718446646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8843cc7-50c7-4e16-8aaf-43870b7efd49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:06:57 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-22ff5538-c9f3-47a1-9b92-9bfacd4e026f tempest-ProjectMemberTests-718446646 None] Volume b440b185-cf3d-47e7-b66d-98e1ef3e3970: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b440b185-cf3d-47e7-b66d-98e1ef3e3970', 'volume_size': 1} Jul 13 14:06:57 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-22ff5538-c9f3-47a1-9b92-9bfacd4e026f tempest-ProjectMemberTests-718446646 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 14:06:57 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-22ff5538-c9f3-47a1-9b92-9bfacd4e026f tempest-ProjectMemberTests-718446646 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 14:06:57 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-22ff5538-c9f3-47a1-9b92-9bfacd4e026f tempest-ProjectMemberTests-718446646 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T12:06:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-308860195',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b440b185-cf3d-47e7-b66d-98e1ef3e3970,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2bb0e12a2763448b9d28151e1e814854',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T12:06:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T12:06:58Z,use_quota=True,user_id='2d16431e25f348deb700350f5b150c69',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1147de8b-623b-426c-a13d-7fc824a80f67),volume_type_id=1147de8b-623b-426c-a13d-7fc824a80f67)}" {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 13 14:06:57 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-22ff5538-c9f3-47a1-9b92-9bfacd4e026f tempest-ProjectMemberTests-718446646 None] Creating volume b440b185-cf3d-47e7-b66d-98e1ef3e3970 {{(pid=87098) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 13 14:06:57 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-22ff5538-c9f3-47a1-9b92-9bfacd4e026f tempest-ProjectMemberTests-718446646 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 14:06:57 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-22ff5538-c9f3-47a1-9b92-9bfacd4e026f tempest-ProjectMemberTests-718446646 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 14:06:57 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-22ff5538-c9f3-47a1-9b92-9bfacd4e026f tempest-ProjectMemberTests-718446646 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 14:06:57 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-22ff5538-c9f3-47a1-9b92-9bfacd4e026f tempest-ProjectMemberTests-718446646 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 14:06:57 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-22ff5538-c9f3-47a1-9b92-9bfacd4e026f tempest-ProjectMemberTests-718446646 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 14:06:57 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-22ff5538-c9f3-47a1-9b92-9bfacd4e026f tempest-ProjectMemberTests-718446646 None] Selected osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 14:06:57 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-22ff5538-c9f3-47a1-9b92-9bfacd4e026f tempest-ProjectMemberTests-718446646 None] casted to osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 Jul 13 14:06:57 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-22ff5538-c9f3-47a1-9b92-9bfacd4e026f tempest-ProjectMemberTests-718446646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-b440b185-cf3d-47e7-b66d-98e1ef3e3970 1073741824 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:06:57 devstack sudo[105692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-b440b185-cf3d-47e7-b66d-98e1ef3e3970 1073741824 Jul 13 14:06:57 devstack sudo[105692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:06:58 devstack sudo[105692]: pam_unix(sudo:session): session closed for user root Jul 13 14:06:58 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-22ff5538-c9f3-47a1-9b92-9bfacd4e026f tempest-ProjectMemberTests-718446646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-b440b185-cf3d-47e7-b66d-98e1ef3e3970 1073741824" returned: 0 in 0.416s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:06:58 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-22ff5538-c9f3-47a1-9b92-9bfacd4e026f tempest-ProjectMemberTests-718446646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-b440b185-cf3d-47e7-b66d-98e1ef3e3970 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:06:58 devstack sudo[105697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-b440b185-cf3d-47e7-b66d-98e1ef3e3970 Jul 13 14:06:58 devstack sudo[105697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:06:58 devstack sudo[105697]: pam_unix(sudo:session): session closed for user root Jul 13 14:06:58 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-22ff5538-c9f3-47a1-9b92-9bfacd4e026f tempest-ProjectMemberTests-718446646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-b440b185-cf3d-47e7-b66d-98e1ef3e3970" returned: 0 in 0.234s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:06:58 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-22ff5538-c9f3-47a1-9b92-9bfacd4e026f tempest-ProjectMemberTests-718446646 None] <== create_volume: return (690ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'} {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 13 14:06:58 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-22ff5538-c9f3-47a1-9b92-9bfacd4e026f tempest-ProjectMemberTests-718446646 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.693s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 14:06:58 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-22ff5538-c9f3-47a1-9b92-9bfacd4e026f tempest-ProjectMemberTests-718446646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8843cc7-50c7-4e16-8aaf-43870b7efd49) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b440b185-cf3d-47e7-b66d-98e1ef3e3970', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:06:58 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-22ff5538-c9f3-47a1-9b92-9bfacd4e026f tempest-ProjectMemberTests-718446646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (778b07b0-01b3-4373-a63a-768d863772df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:06:58 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-22ff5538-c9f3-47a1-9b92-9bfacd4e026f tempest-ProjectMemberTests-718446646 None] Volume volume-b440b185-cf3d-47e7-b66d-98e1ef3e3970 (b440b185-cf3d-47e7-b66d-98e1ef3e3970): created successfully Jul 13 14:06:58 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-22ff5538-c9f3-47a1-9b92-9bfacd4e026f tempest-ProjectMemberTests-718446646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (778b07b0-01b3-4373-a63a-768d863772df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:06:58 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-22ff5538-c9f3-47a1-9b92-9bfacd4e026f tempest-ProjectMemberTests-718446646 None] Flow 'volume_create_manager' (cde2d0f4-1baa-43ca-bb36-7b3ccb4f936b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 14:06:58 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-22ff5538-c9f3-47a1-9b92-9bfacd4e026f tempest-ProjectMemberTests-718446646 None] Created volume successfully. Jul 13 14:06:58 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-7be53006-6356-4f67-b676-4d0c2e117367 tempest-ProjectMemberTests-718446646 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 14:06:58 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-7be53006-6356-4f67-b676-4d0c2e117367 tempest-ProjectMemberTests-718446646 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 14:06:58 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-7be53006-6356-4f67-b676-4d0c2e117367 tempest-ProjectMemberTests-718446646 None] Creating offline snapshot b5e145c4-0281-41f5-9807-12cda4389494 of volume b440b185-cf3d-47e7-b66d-98e1ef3e3970 {{(pid=87098) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 13 14:06:59 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[f10d530d-01b3-496c-8309-3074a42ff204]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 14:06:59 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-7be53006-6356-4f67-b676-4d0c2e117367 tempest-ProjectMemberTests-718446646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-b440b185-cf3d-47e7-b66d-98e1ef3e3970 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:06:59 devstack sudo[105700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-b440b185-cf3d-47e7-b66d-98e1ef3e3970 Jul 13 14:06:59 devstack sudo[105700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:06:59 devstack sudo[105700]: pam_unix(sudo:session): session closed for user root Jul 13 14:06:59 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-7be53006-6356-4f67-b676-4d0c2e117367 tempest-ProjectMemberTests-718446646 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-b440b185-cf3d-47e7-b66d-98e1ef3e3970" returned: 0 in 0.345s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:06:59 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-7be53006-6356-4f67-b676-4d0c2e117367 tempest-ProjectMemberTests-718446646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-b440b185-cf3d-47e7-b66d-98e1ef3e3970,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-b440b185-cf3d-47e7-b66d-98e1ef3e3970.b5e145c4-0281-41f5-9807-12cda4389494 1G {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:06:59 devstack sudo[105705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-b440b185-cf3d-47e7-b66d-98e1ef3e3970,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-b440b185-cf3d-47e7-b66d-98e1ef3e3970.b5e145c4-0281-41f5-9807-12cda4389494 1G Jul 13 14:06:59 devstack sudo[105705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:06:59 devstack sudo[105705]: pam_unix(sudo:session): session closed for user root Jul 13 14:06:59 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-7be53006-6356-4f67-b676-4d0c2e117367 tempest-ProjectMemberTests-718446646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-b440b185-cf3d-47e7-b66d-98e1ef3e3970,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-b440b185-cf3d-47e7-b66d-98e1ef3e3970.b5e145c4-0281-41f5-9807-12cda4389494 1G" returned: 0 in 0.380s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:06:59 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-7be53006-6356-4f67-b676-4d0c2e117367 tempest-ProjectMemberTests-718446646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b440b185-cf3d-47e7-b66d-98e1ef3e3970 -F qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-b440b185-cf3d-47e7-b66d-98e1ef3e3970.b5e145c4-0281-41f5-9807-12cda4389494 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:06:59 devstack sudo[105710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b440b185-cf3d-47e7-b66d-98e1ef3e3970 -F qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-b440b185-cf3d-47e7-b66d-98e1ef3e3970.b5e145c4-0281-41f5-9807-12cda4389494 Jul 13 14:06:59 devstack sudo[105710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:07:00 devstack sudo[105710]: pam_unix(sudo:session): session closed for user root Jul 13 14:07:00 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-7be53006-6356-4f67-b676-4d0c2e117367 tempest-ProjectMemberTests-718446646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b440b185-cf3d-47e7-b66d-98e1ef3e3970 -F qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-b440b185-cf3d-47e7-b66d-98e1ef3e3970.b5e145c4-0281-41f5-9807-12cda4389494" returned: 0 in 0.287s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:07:00 devstack cinder-volume[87098]: WARNING cinder.volume.drivers.remotefs [None req-7be53006-6356-4f67-b676-4d0c2e117367 tempest-ProjectMemberTests-718446646 None] /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-b440b185-cf3d-47e7-b66d-98e1ef3e3970.b5e145c4-0281-41f5-9807-12cda4389494 is being set with open permissions: ugo+rw Jul 13 14:07:00 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-7be53006-6356-4f67-b676-4d0c2e117367 tempest-ProjectMemberTests-718446646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-b440b185-cf3d-47e7-b66d-98e1ef3e3970.b5e145c4-0281-41f5-9807-12cda4389494 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:07:00 devstack sudo[105716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-b440b185-cf3d-47e7-b66d-98e1ef3e3970.b5e145c4-0281-41f5-9807-12cda4389494 Jul 13 14:07:00 devstack sudo[105716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:07:00 devstack sudo[105716]: pam_unix(sudo:session): session closed for user root Jul 13 14:07:00 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-7be53006-6356-4f67-b676-4d0c2e117367 tempest-ProjectMemberTests-718446646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-b440b185-cf3d-47e7-b66d-98e1ef3e3970.b5e145c4-0281-41f5-9807-12cda4389494" returned: 0 in 0.240s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:07:00 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-7be53006-6356-4f67-b676-4d0c2e117367 tempest-ProjectMemberTests-718446646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-b440b185-cf3d-47e7-b66d-98e1ef3e3970.info {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:07:00 devstack sudo[105719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-b440b185-cf3d-47e7-b66d-98e1ef3e3970.info Jul 13 14:07:00 devstack sudo[105719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:07:00 devstack sudo[105719]: pam_unix(sudo:session): session closed for user root Jul 13 14:07:00 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-7be53006-6356-4f67-b676-4d0c2e117367 tempest-ProjectMemberTests-718446646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-b440b185-cf3d-47e7-b66d-98e1ef3e3970.info" returned: 0 in 0.245s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:07:00 devstack cinder-volume[87098]: WARNING cinder.volume.drivers.remotefs [None req-7be53006-6356-4f67-b676-4d0c2e117367 tempest-ProjectMemberTests-718446646 None] /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-b440b185-cf3d-47e7-b66d-98e1ef3e3970.info is being set with open permissions: ugo+rw Jul 13 14:07:00 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-7be53006-6356-4f67-b676-4d0c2e117367 tempest-ProjectMemberTests-718446646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-b440b185-cf3d-47e7-b66d-98e1ef3e3970.info {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:07:00 devstack sudo[105722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-b440b185-cf3d-47e7-b66d-98e1ef3e3970.info Jul 13 14:07:00 devstack sudo[105722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:07:00 devstack sudo[105722]: pam_unix(sudo:session): session closed for user root Jul 13 14:07:00 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-7be53006-6356-4f67-b676-4d0c2e117367 tempest-ProjectMemberTests-718446646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-b440b185-cf3d-47e7-b66d-98e1ef3e3970.info" returned: 0 in 0.236s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:07:00 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-7be53006-6356-4f67-b676-4d0c2e117367 tempest-ProjectMemberTests-718446646 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.809s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 14:07:00 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-7be53006-6356-4f67-b676-4d0c2e117367 tempest-ProjectMemberTests-718446646 None] Create snapshot completed successfully Jul 13 14:07:01 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-6c0c097f-4237-49de-8d0f-5b25fda6e7f6 tempest-ProjectMemberTests-718446646 None] Acquiring lock "cinder-b5e145c4-0281-41f5-9807-12cda4389494-delete_snapshot" by "delete_snapshot" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 14:07:01 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-6c0c097f-4237-49de-8d0f-5b25fda6e7f6 tempest-ProjectMemberTests-718446646 None] Lock "cinder-b5e145c4-0281-41f5-9807-12cda4389494-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 14:07:01 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-6c0c097f-4237-49de-8d0f-5b25fda6e7f6 tempest-ProjectMemberTests-718446646 None] Acquiring lock "cinder-quobyte-b440b185-cf3d-47e7-b66d-98e1ef3e3970" by "delete_snapshot" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 14:07:01 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-6c0c097f-4237-49de-8d0f-5b25fda6e7f6 tempest-ProjectMemberTests-718446646 None] Lock "cinder-quobyte-b440b185-cf3d-47e7-b66d-98e1ef3e3970" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 14:07:01 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-6c0c097f-4237-49de-8d0f-5b25fda6e7f6 tempest-ProjectMemberTests-718446646 None] Acquiring lock "cinder-quobyte-b5e145c4-0281-41f5-9807-12cda4389494" by "_delete_snapshot" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 14:07:01 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-6c0c097f-4237-49de-8d0f-5b25fda6e7f6 tempest-ProjectMemberTests-718446646 None] Lock "cinder-quobyte-b5e145c4-0281-41f5-9807-12cda4389494" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 14:07:01 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-6c0c097f-4237-49de-8d0f-5b25fda6e7f6 tempest-ProjectMemberTests-718446646 None] Deleting offline snapshot b5e145c4-0281-41f5-9807-12cda4389494 of volume b440b185-cf3d-47e7-b66d-98e1ef3e3970 {{(pid=87098) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 13 14:07:01 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-6c0c097f-4237-49de-8d0f-5b25fda6e7f6 tempest-ProjectMemberTests-718446646 None] snapshot_file for this snap is: volume-b440b185-cf3d-47e7-b66d-98e1ef3e3970.b5e145c4-0281-41f5-9807-12cda4389494 {{(pid=87098) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 13 14:07:01 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[9efb448f-12f0-4f51-a6a4-66780354a874]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 14:07:01 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-6c0c097f-4237-49de-8d0f-5b25fda6e7f6 tempest-ProjectMemberTests-718446646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-b440b185-cf3d-47e7-b66d-98e1ef3e3970.b5e145c4-0281-41f5-9807-12cda4389494 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:07:01 devstack sudo[105725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-b440b185-cf3d-47e7-b66d-98e1ef3e3970.b5e145c4-0281-41f5-9807-12cda4389494 Jul 13 14:07:01 devstack sudo[105725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:07:01 devstack sudo[105725]: pam_unix(sudo:session): session closed for user root Jul 13 14:07:01 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-6c0c097f-4237-49de-8d0f-5b25fda6e7f6 tempest-ProjectMemberTests-718446646 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-b440b185-cf3d-47e7-b66d-98e1ef3e3970.b5e145c4-0281-41f5-9807-12cda4389494" returned: 0 in 0.368s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:07:01 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-6c0c097f-4237-49de-8d0f-5b25fda6e7f6 tempest-ProjectMemberTests-718446646 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b440b185-cf3d-47e7-b66d-98e1ef3e3970(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87098) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 13 14:07:01 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c637a40-d57e-43a0-b2ba-a3555de16a8a]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 14:07:01 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-6c0c097f-4237-49de-8d0f-5b25fda6e7f6 tempest-ProjectMemberTests-718446646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-b440b185-cf3d-47e7-b66d-98e1ef3e3970 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:07:01 devstack sudo[105730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-b440b185-cf3d-47e7-b66d-98e1ef3e3970 Jul 13 14:07:01 devstack sudo[105730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:07:01 devstack sudo[105730]: pam_unix(sudo:session): session closed for user root Jul 13 14:07:01 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-6c0c097f-4237-49de-8d0f-5b25fda6e7f6 tempest-ProjectMemberTests-718446646 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-b440b185-cf3d-47e7-b66d-98e1ef3e3970" returned: 0 in 0.351s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:07:01 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-6c0c097f-4237-49de-8d0f-5b25fda6e7f6 tempest-ProjectMemberTests-718446646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-b440b185-cf3d-47e7-b66d-98e1ef3e3970.b5e145c4-0281-41f5-9807-12cda4389494 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:07:01 devstack sudo[105735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-b440b185-cf3d-47e7-b66d-98e1ef3e3970.b5e145c4-0281-41f5-9807-12cda4389494 Jul 13 14:07:02 devstack sudo[105735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:07:02 devstack sudo[105735]: pam_unix(sudo:session): session closed for user root Jul 13 14:07:02 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-6c0c097f-4237-49de-8d0f-5b25fda6e7f6 tempest-ProjectMemberTests-718446646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-b440b185-cf3d-47e7-b66d-98e1ef3e3970.b5e145c4-0281-41f5-9807-12cda4389494" returned: 0 in 0.323s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:07:02 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-6c0c097f-4237-49de-8d0f-5b25fda6e7f6 tempest-ProjectMemberTests-718446646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-b440b185-cf3d-47e7-b66d-98e1ef3e3970.b5e145c4-0281-41f5-9807-12cda4389494 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:07:02 devstack sudo[105740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-b440b185-cf3d-47e7-b66d-98e1ef3e3970.b5e145c4-0281-41f5-9807-12cda4389494 Jul 13 14:07:02 devstack sudo[105740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:07:02 devstack sudo[105740]: pam_unix(sudo:session): session closed for user root Jul 13 14:07:02 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-6c0c097f-4237-49de-8d0f-5b25fda6e7f6 tempest-ProjectMemberTests-718446646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-b440b185-cf3d-47e7-b66d-98e1ef3e3970.b5e145c4-0281-41f5-9807-12cda4389494" returned: 0 in 0.238s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:07:02 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-6c0c097f-4237-49de-8d0f-5b25fda6e7f6 tempest-ProjectMemberTests-718446646 None] Lock "cinder-quobyte-b5e145c4-0281-41f5-9807-12cda4389494" released by "_delete_snapshot" :: held 1.378s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 14:07:02 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-6c0c097f-4237-49de-8d0f-5b25fda6e7f6 tempest-ProjectMemberTests-718446646 None] Lock "cinder-quobyte-b440b185-cf3d-47e7-b66d-98e1ef3e3970" released by "delete_snapshot" :: held 1.403s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 14:07:02 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-6c0c097f-4237-49de-8d0f-5b25fda6e7f6 tempest-ProjectMemberTests-718446646 None] Created reservations ['b636f354-f5f8-45e8-9758-f77fe85d2092', '83f4c399-c64c-4020-98cc-99bb0ca66022', '09732bbe-43c6-4dd2-925c-84975d8e29b8', '77cf87a9-71e8-4dfa-9e8b-85e45fd76e08'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 14:07:02 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-6c0c097f-4237-49de-8d0f-5b25fda6e7f6 tempest-ProjectMemberTests-718446646 None] Delete snapshot completed successfully. Jul 13 14:07:02 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-6c0c097f-4237-49de-8d0f-5b25fda6e7f6 tempest-ProjectMemberTests-718446646 None] Lock "cinder-b5e145c4-0281-41f5-9807-12cda4389494-delete_snapshot" released by "delete_snapshot" :: held 1.536s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 14:07:03 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-c9ff82e8-f09a-41d1-8cff-b9c37d392fc3 tempest-ProjectMemberTests-718446646 None] Acquiring lock "cinder-b440b185-cf3d-47e7-b66d-98e1ef3e3970-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 14:07:03 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-c9ff82e8-f09a-41d1-8cff-b9c37d392fc3 tempest-ProjectMemberTests-718446646 None] Lock "cinder-b440b185-cf3d-47e7-b66d-98e1ef3e3970-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 14:07:03 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-c9ff82e8-f09a-41d1-8cff-b9c37d392fc3 tempest-ProjectMemberTests-718446646 None] Acquiring lock "cinder-quobyte-b440b185-cf3d-47e7-b66d-98e1ef3e3970" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 14:07:03 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-c9ff82e8-f09a-41d1-8cff-b9c37d392fc3 tempest-ProjectMemberTests-718446646 None] Lock "cinder-quobyte-b440b185-cf3d-47e7-b66d-98e1ef3e3970" acquired by "delete_volume" :: waited 0.016s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 14:07:03 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[9788d7ba-4cec-4330-8ff8-40c5fad4b8a7]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 14:07:03 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-c9ff82e8-f09a-41d1-8cff-b9c37d392fc3 tempest-ProjectMemberTests-718446646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-b440b185-cf3d-47e7-b66d-98e1ef3e3970 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:07:03 devstack sudo[105743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-b440b185-cf3d-47e7-b66d-98e1ef3e3970 Jul 13 14:07:03 devstack sudo[105743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:07:03 devstack sudo[105743]: pam_unix(sudo:session): session closed for user root Jul 13 14:07:03 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-c9ff82e8-f09a-41d1-8cff-b9c37d392fc3 tempest-ProjectMemberTests-718446646 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-b440b185-cf3d-47e7-b66d-98e1ef3e3970" returned: 0 in 0.347s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:07:03 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-c9ff82e8-f09a-41d1-8cff-b9c37d392fc3 tempest-ProjectMemberTests-718446646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-b440b185-cf3d-47e7-b66d-98e1ef3e3970 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:07:03 devstack sudo[105748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-b440b185-cf3d-47e7-b66d-98e1ef3e3970 Jul 13 14:07:03 devstack sudo[105748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:07:03 devstack sudo[105748]: pam_unix(sudo:session): session closed for user root Jul 13 14:07:03 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-c9ff82e8-f09a-41d1-8cff-b9c37d392fc3 tempest-ProjectMemberTests-718446646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-b440b185-cf3d-47e7-b66d-98e1ef3e3970" returned: 0 in 0.237s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:07:04 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-c9ff82e8-f09a-41d1-8cff-b9c37d392fc3 tempest-ProjectMemberTests-718446646 None] Lock "cinder-quobyte-b440b185-cf3d-47e7-b66d-98e1ef3e3970" released by "delete_volume" :: held 0.644s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 14:07:04 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-c9ff82e8-f09a-41d1-8cff-b9c37d392fc3 tempest-ProjectMemberTests-718446646 None] Created reservations ['02e366f8-f236-4b47-bb93-ebc86f3a51d9', 'cd0c8a7c-6727-4556-a155-7b7e1ac2eece', '30e08d6e-4cdf-4e62-b308-026f1bfc351e', '5e7d06b9-bdfb-4958-a30f-c9377867a76e'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 14:07:04 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-c9ff82e8-f09a-41d1-8cff-b9c37d392fc3 tempest-ProjectMemberTests-718446646 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 14:07:04 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-c9ff82e8-f09a-41d1-8cff-b9c37d392fc3 tempest-ProjectMemberTests-718446646 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 14:07:04 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-c9ff82e8-f09a-41d1-8cff-b9c37d392fc3 tempest-ProjectMemberTests-718446646 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 14:07:04 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-c9ff82e8-f09a-41d1-8cff-b9c37d392fc3 tempest-ProjectMemberTests-718446646 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 14:07:04 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-c9ff82e8-f09a-41d1-8cff-b9c37d392fc3 tempest-ProjectMemberTests-718446646 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 14:07:04 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-c9ff82e8-f09a-41d1-8cff-b9c37d392fc3 tempest-ProjectMemberTests-718446646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:07:04 devstack sudo[105751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 Jul 13 14:07:04 devstack sudo[105751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:07:04 devstack sudo[105751]: pam_unix(sudo:session): session closed for user root Jul 13 14:07:04 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-c9ff82e8-f09a-41d1-8cff-b9c37d392fc3 tempest-ProjectMemberTests-718446646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78" returned: 0 in 0.241s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:07:04 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-c9ff82e8-f09a-41d1-8cff-b9c37d392fc3 tempest-ProjectMemberTests-718446646 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 14:07:04 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-c9ff82e8-f09a-41d1-8cff-b9c37d392fc3 tempest-ProjectMemberTests-718446646 None] Deleted volume successfully. Jul 13 14:07:04 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-c9ff82e8-f09a-41d1-8cff-b9c37d392fc3 tempest-ProjectMemberTests-718446646 None] Lock "cinder-b440b185-cf3d-47e7-b66d-98e1ef3e3970-delete_volume" released by "delete_volume" :: held 1.081s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 14:07:04 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-1e75678d-905e-4b53-b6a9-b4498ad9f55d tempest-ProjectMemberTests-718446646 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 14:07:04 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-1e75678d-905e-4b53-b6a9-b4498ad9f55d tempest-ProjectMemberTests-718446646 None] Flow 'volume_create_manager' (c3ffe4c8-c27c-44bf-9208-7b4bdbf447fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 14:07:04 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-1e75678d-905e-4b53-b6a9-b4498ad9f55d tempest-ProjectMemberTests-718446646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2157d190-863e-4c32-b1a4-299e10ca4477) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:07:04 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-1e75678d-905e-4b53-b6a9-b4498ad9f55d tempest-ProjectMemberTests-718446646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2157d190-863e-4c32-b1a4-299e10ca4477) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T12:07:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1436838735',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc978249-5e16-43bc-8384-5c0a2028e75f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2bb0e12a2763448b9d28151e1e814854',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T12:07:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T12:07:05Z,use_quota=True,user_id='2d16431e25f348deb700350f5b150c69',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1147de8b-623b-426c-a13d-7fc824a80f67),volume_type_id=1147de8b-623b-426c-a13d-7fc824a80f67)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:07:04 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-1e75678d-905e-4b53-b6a9-b4498ad9f55d tempest-ProjectMemberTests-718446646 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a38a6f30-15e2-4634-93c4-b1853b80d416) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:07:04 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-1e75678d-905e-4b53-b6a9-b4498ad9f55d tempest-ProjectMemberTests-718446646 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a38a6f30-15e2-4634-93c4-b1853b80d416) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:07:04 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-1e75678d-905e-4b53-b6a9-b4498ad9f55d tempest-ProjectMemberTests-718446646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c50d1f6c-21ef-4ea0-9574-d5a9e8b22a17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:07:04 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-1e75678d-905e-4b53-b6a9-b4498ad9f55d tempest-ProjectMemberTests-718446646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c50d1f6c-21ef-4ea0-9574-d5a9e8b22a17) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cc978249-5e16-43bc-8384-5c0a2028e75f', 'volume_name': 'volume-cc978249-5e16-43bc-8384-5c0a2028e75f', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:07:04 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-1e75678d-905e-4b53-b6a9-b4498ad9f55d tempest-ProjectMemberTests-718446646 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73db0e0d-b452-43e6-b35b-18d4d00edebd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:07:04 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-1e75678d-905e-4b53-b6a9-b4498ad9f55d tempest-ProjectMemberTests-718446646 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73db0e0d-b452-43e6-b35b-18d4d00edebd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:07:04 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-1e75678d-905e-4b53-b6a9-b4498ad9f55d tempest-ProjectMemberTests-718446646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70161983-a775-473f-8a0e-80745174bd0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:07:04 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-1e75678d-905e-4b53-b6a9-b4498ad9f55d tempest-ProjectMemberTests-718446646 None] Volume cc978249-5e16-43bc-8384-5c0a2028e75f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cc978249-5e16-43bc-8384-5c0a2028e75f', 'volume_size': 1} Jul 13 14:07:04 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-1e75678d-905e-4b53-b6a9-b4498ad9f55d tempest-ProjectMemberTests-718446646 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 14:07:04 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-1e75678d-905e-4b53-b6a9-b4498ad9f55d tempest-ProjectMemberTests-718446646 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 14:07:04 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-1e75678d-905e-4b53-b6a9-b4498ad9f55d tempest-ProjectMemberTests-718446646 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T12:07:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1436838735',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc978249-5e16-43bc-8384-5c0a2028e75f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2bb0e12a2763448b9d28151e1e814854',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T12:07:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T12:07:05Z,use_quota=True,user_id='2d16431e25f348deb700350f5b150c69',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1147de8b-623b-426c-a13d-7fc824a80f67),volume_type_id=1147de8b-623b-426c-a13d-7fc824a80f67)}" {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 13 14:07:04 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-1e75678d-905e-4b53-b6a9-b4498ad9f55d tempest-ProjectMemberTests-718446646 None] Creating volume cc978249-5e16-43bc-8384-5c0a2028e75f {{(pid=87098) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 13 14:07:04 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-1e75678d-905e-4b53-b6a9-b4498ad9f55d tempest-ProjectMemberTests-718446646 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 14:07:04 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-1e75678d-905e-4b53-b6a9-b4498ad9f55d tempest-ProjectMemberTests-718446646 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 14:07:04 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-1e75678d-905e-4b53-b6a9-b4498ad9f55d tempest-ProjectMemberTests-718446646 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 14:07:04 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-1e75678d-905e-4b53-b6a9-b4498ad9f55d tempest-ProjectMemberTests-718446646 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 14:07:04 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-1e75678d-905e-4b53-b6a9-b4498ad9f55d tempest-ProjectMemberTests-718446646 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 14:07:04 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-1e75678d-905e-4b53-b6a9-b4498ad9f55d tempest-ProjectMemberTests-718446646 None] Selected osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 14:07:04 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-1e75678d-905e-4b53-b6a9-b4498ad9f55d tempest-ProjectMemberTests-718446646 None] casted to osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 Jul 13 14:07:04 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-1e75678d-905e-4b53-b6a9-b4498ad9f55d tempest-ProjectMemberTests-718446646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-cc978249-5e16-43bc-8384-5c0a2028e75f 1073741824 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:07:04 devstack sudo[105754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-cc978249-5e16-43bc-8384-5c0a2028e75f 1073741824 Jul 13 14:07:04 devstack sudo[105754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:07:05 devstack sudo[105754]: pam_unix(sudo:session): session closed for user root Jul 13 14:07:05 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-1e75678d-905e-4b53-b6a9-b4498ad9f55d tempest-ProjectMemberTests-718446646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-cc978249-5e16-43bc-8384-5c0a2028e75f 1073741824" returned: 0 in 0.405s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:07:05 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-1e75678d-905e-4b53-b6a9-b4498ad9f55d tempest-ProjectMemberTests-718446646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-cc978249-5e16-43bc-8384-5c0a2028e75f {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:07:05 devstack sudo[105759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-cc978249-5e16-43bc-8384-5c0a2028e75f Jul 13 14:07:05 devstack sudo[105759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:07:05 devstack sudo[105759]: pam_unix(sudo:session): session closed for user root Jul 13 14:07:05 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-1e75678d-905e-4b53-b6a9-b4498ad9f55d tempest-ProjectMemberTests-718446646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-cc978249-5e16-43bc-8384-5c0a2028e75f" returned: 0 in 0.239s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:07:05 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-1e75678d-905e-4b53-b6a9-b4498ad9f55d tempest-ProjectMemberTests-718446646 None] <== create_volume: return (685ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'} {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 13 14:07:05 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-1e75678d-905e-4b53-b6a9-b4498ad9f55d tempest-ProjectMemberTests-718446646 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.687s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 14:07:05 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-1e75678d-905e-4b53-b6a9-b4498ad9f55d tempest-ProjectMemberTests-718446646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70161983-a775-473f-8a0e-80745174bd0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cc978249-5e16-43bc-8384-5c0a2028e75f', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:07:05 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-1e75678d-905e-4b53-b6a9-b4498ad9f55d tempest-ProjectMemberTests-718446646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d832a7b2-668b-4345-a2e7-3f453c29e3c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:07:05 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-1e75678d-905e-4b53-b6a9-b4498ad9f55d tempest-ProjectMemberTests-718446646 None] Volume volume-cc978249-5e16-43bc-8384-5c0a2028e75f (cc978249-5e16-43bc-8384-5c0a2028e75f): created successfully Jul 13 14:07:05 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-1e75678d-905e-4b53-b6a9-b4498ad9f55d tempest-ProjectMemberTests-718446646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d832a7b2-668b-4345-a2e7-3f453c29e3c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:07:05 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-1e75678d-905e-4b53-b6a9-b4498ad9f55d tempest-ProjectMemberTests-718446646 None] Flow 'volume_create_manager' (c3ffe4c8-c27c-44bf-9208-7b4bdbf447fb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 14:07:05 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-1e75678d-905e-4b53-b6a9-b4498ad9f55d tempest-ProjectMemberTests-718446646 None] Created volume successfully. Jul 13 14:07:05 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-e67f7108-52f3-48cd-9cdb-f914e1a4a694 tempest-ProjectMemberTests-718446646 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 14:07:05 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-e67f7108-52f3-48cd-9cdb-f914e1a4a694 tempest-ProjectMemberTests-718446646 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 14:07:06 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-e67f7108-52f3-48cd-9cdb-f914e1a4a694 tempest-ProjectMemberTests-718446646 None] Creating offline snapshot 6b63eb93-4672-4cee-b03a-55b43af0c2a4 of volume cc978249-5e16-43bc-8384-5c0a2028e75f {{(pid=87098) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 13 14:07:06 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a00d3b8-5d11-4bdd-907e-50af50a09258]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 14:07:06 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-e67f7108-52f3-48cd-9cdb-f914e1a4a694 tempest-ProjectMemberTests-718446646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-cc978249-5e16-43bc-8384-5c0a2028e75f {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:07:06 devstack sudo[105762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-cc978249-5e16-43bc-8384-5c0a2028e75f Jul 13 14:07:06 devstack sudo[105762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:07:06 devstack sudo[105762]: pam_unix(sudo:session): session closed for user root Jul 13 14:07:06 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-e67f7108-52f3-48cd-9cdb-f914e1a4a694 tempest-ProjectMemberTests-718446646 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-cc978249-5e16-43bc-8384-5c0a2028e75f" returned: 0 in 0.357s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:07:06 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-e67f7108-52f3-48cd-9cdb-f914e1a4a694 tempest-ProjectMemberTests-718446646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-cc978249-5e16-43bc-8384-5c0a2028e75f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-cc978249-5e16-43bc-8384-5c0a2028e75f.6b63eb93-4672-4cee-b03a-55b43af0c2a4 1G {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:07:06 devstack sudo[105767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-cc978249-5e16-43bc-8384-5c0a2028e75f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-cc978249-5e16-43bc-8384-5c0a2028e75f.6b63eb93-4672-4cee-b03a-55b43af0c2a4 1G Jul 13 14:07:06 devstack sudo[105767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:07:06 devstack sudo[105767]: pam_unix(sudo:session): session closed for user root Jul 13 14:07:06 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-e67f7108-52f3-48cd-9cdb-f914e1a4a694 tempest-ProjectMemberTests-718446646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-cc978249-5e16-43bc-8384-5c0a2028e75f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-cc978249-5e16-43bc-8384-5c0a2028e75f.6b63eb93-4672-4cee-b03a-55b43af0c2a4 1G" returned: 0 in 0.375s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:07:06 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-e67f7108-52f3-48cd-9cdb-f914e1a4a694 tempest-ProjectMemberTests-718446646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cc978249-5e16-43bc-8384-5c0a2028e75f -F qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-cc978249-5e16-43bc-8384-5c0a2028e75f.6b63eb93-4672-4cee-b03a-55b43af0c2a4 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:07:06 devstack sudo[105773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cc978249-5e16-43bc-8384-5c0a2028e75f -F qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-cc978249-5e16-43bc-8384-5c0a2028e75f.6b63eb93-4672-4cee-b03a-55b43af0c2a4 Jul 13 14:07:06 devstack sudo[105773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:07:07 devstack sudo[105773]: pam_unix(sudo:session): session closed for user root Jul 13 14:07:07 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-e67f7108-52f3-48cd-9cdb-f914e1a4a694 tempest-ProjectMemberTests-718446646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cc978249-5e16-43bc-8384-5c0a2028e75f -F qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-cc978249-5e16-43bc-8384-5c0a2028e75f.6b63eb93-4672-4cee-b03a-55b43af0c2a4" returned: 0 in 0.287s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:07:07 devstack cinder-volume[87098]: WARNING cinder.volume.drivers.remotefs [None req-e67f7108-52f3-48cd-9cdb-f914e1a4a694 tempest-ProjectMemberTests-718446646 None] /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-cc978249-5e16-43bc-8384-5c0a2028e75f.6b63eb93-4672-4cee-b03a-55b43af0c2a4 is being set with open permissions: ugo+rw Jul 13 14:07:07 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-e67f7108-52f3-48cd-9cdb-f914e1a4a694 tempest-ProjectMemberTests-718446646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-cc978249-5e16-43bc-8384-5c0a2028e75f.6b63eb93-4672-4cee-b03a-55b43af0c2a4 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:07:07 devstack sudo[105778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-cc978249-5e16-43bc-8384-5c0a2028e75f.6b63eb93-4672-4cee-b03a-55b43af0c2a4 Jul 13 14:07:07 devstack sudo[105778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:07:07 devstack sudo[105778]: pam_unix(sudo:session): session closed for user root Jul 13 14:07:07 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-e67f7108-52f3-48cd-9cdb-f914e1a4a694 tempest-ProjectMemberTests-718446646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-cc978249-5e16-43bc-8384-5c0a2028e75f.6b63eb93-4672-4cee-b03a-55b43af0c2a4" returned: 0 in 0.239s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:07:07 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-e67f7108-52f3-48cd-9cdb-f914e1a4a694 tempest-ProjectMemberTests-718446646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-cc978249-5e16-43bc-8384-5c0a2028e75f.info {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:07:07 devstack sudo[105782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-cc978249-5e16-43bc-8384-5c0a2028e75f.info Jul 13 14:07:07 devstack sudo[105782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:07:07 devstack sudo[105782]: pam_unix(sudo:session): session closed for user root Jul 13 14:07:07 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-e67f7108-52f3-48cd-9cdb-f914e1a4a694 tempest-ProjectMemberTests-718446646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-cc978249-5e16-43bc-8384-5c0a2028e75f.info" returned: 0 in 0.246s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:07:07 devstack cinder-volume[87098]: WARNING cinder.volume.drivers.remotefs [None req-e67f7108-52f3-48cd-9cdb-f914e1a4a694 tempest-ProjectMemberTests-718446646 None] /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-cc978249-5e16-43bc-8384-5c0a2028e75f.info is being set with open permissions: ugo+rw Jul 13 14:07:07 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-e67f7108-52f3-48cd-9cdb-f914e1a4a694 tempest-ProjectMemberTests-718446646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-cc978249-5e16-43bc-8384-5c0a2028e75f.info {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:07:07 devstack sudo[105785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-cc978249-5e16-43bc-8384-5c0a2028e75f.info Jul 13 14:07:07 devstack sudo[105785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:07:07 devstack sudo[105785]: pam_unix(sudo:session): session closed for user root Jul 13 14:07:07 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-e67f7108-52f3-48cd-9cdb-f914e1a4a694 tempest-ProjectMemberTests-718446646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-cc978249-5e16-43bc-8384-5c0a2028e75f.info" returned: 0 in 0.228s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:07:07 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-e67f7108-52f3-48cd-9cdb-f914e1a4a694 tempest-ProjectMemberTests-718446646 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.815s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 14:07:07 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-e67f7108-52f3-48cd-9cdb-f914e1a4a694 tempest-ProjectMemberTests-718446646 None] Create snapshot completed successfully Jul 13 14:07:08 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-961d6c6d-892f-40cc-adbd-9db2b8d4ee09 tempest-ProjectMemberTests-718446646 None] Acquiring lock "cinder-6b63eb93-4672-4cee-b03a-55b43af0c2a4-delete_snapshot" by "delete_snapshot" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 14:07:08 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-961d6c6d-892f-40cc-adbd-9db2b8d4ee09 tempest-ProjectMemberTests-718446646 None] Lock "cinder-6b63eb93-4672-4cee-b03a-55b43af0c2a4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 14:07:08 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-961d6c6d-892f-40cc-adbd-9db2b8d4ee09 tempest-ProjectMemberTests-718446646 None] Acquiring lock "cinder-quobyte-cc978249-5e16-43bc-8384-5c0a2028e75f" by "delete_snapshot" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 14:07:08 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-961d6c6d-892f-40cc-adbd-9db2b8d4ee09 tempest-ProjectMemberTests-718446646 None] Lock "cinder-quobyte-cc978249-5e16-43bc-8384-5c0a2028e75f" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 14:07:08 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-961d6c6d-892f-40cc-adbd-9db2b8d4ee09 tempest-ProjectMemberTests-718446646 None] Acquiring lock "cinder-quobyte-6b63eb93-4672-4cee-b03a-55b43af0c2a4" by "_delete_snapshot" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 14:07:08 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-961d6c6d-892f-40cc-adbd-9db2b8d4ee09 tempest-ProjectMemberTests-718446646 None] Lock "cinder-quobyte-6b63eb93-4672-4cee-b03a-55b43af0c2a4" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 14:07:08 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-961d6c6d-892f-40cc-adbd-9db2b8d4ee09 tempest-ProjectMemberTests-718446646 None] Deleting offline snapshot 6b63eb93-4672-4cee-b03a-55b43af0c2a4 of volume cc978249-5e16-43bc-8384-5c0a2028e75f {{(pid=87098) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 13 14:07:08 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-961d6c6d-892f-40cc-adbd-9db2b8d4ee09 tempest-ProjectMemberTests-718446646 None] snapshot_file for this snap is: volume-cc978249-5e16-43bc-8384-5c0a2028e75f.6b63eb93-4672-4cee-b03a-55b43af0c2a4 {{(pid=87098) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 13 14:07:08 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[a670cf02-4644-4dd7-896b-9c6f1500d051]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 14:07:08 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-961d6c6d-892f-40cc-adbd-9db2b8d4ee09 tempest-ProjectMemberTests-718446646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-cc978249-5e16-43bc-8384-5c0a2028e75f.6b63eb93-4672-4cee-b03a-55b43af0c2a4 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:07:08 devstack sudo[105788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-cc978249-5e16-43bc-8384-5c0a2028e75f.6b63eb93-4672-4cee-b03a-55b43af0c2a4 Jul 13 14:07:08 devstack sudo[105788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:07:08 devstack sudo[105788]: pam_unix(sudo:session): session closed for user root Jul 13 14:07:08 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-961d6c6d-892f-40cc-adbd-9db2b8d4ee09 tempest-ProjectMemberTests-718446646 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-cc978249-5e16-43bc-8384-5c0a2028e75f.6b63eb93-4672-4cee-b03a-55b43af0c2a4" returned: 0 in 0.345s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:07:08 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-961d6c6d-892f-40cc-adbd-9db2b8d4ee09 tempest-ProjectMemberTests-718446646 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cc978249-5e16-43bc-8384-5c0a2028e75f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87098) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 13 14:07:08 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ac60f26-36a3-455f-b601-e2466230c5e1]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 14:07:08 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-961d6c6d-892f-40cc-adbd-9db2b8d4ee09 tempest-ProjectMemberTests-718446646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-cc978249-5e16-43bc-8384-5c0a2028e75f {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:07:08 devstack sudo[105793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-cc978249-5e16-43bc-8384-5c0a2028e75f Jul 13 14:07:08 devstack sudo[105793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:07:08 devstack sudo[105793]: pam_unix(sudo:session): session closed for user root Jul 13 14:07:08 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-961d6c6d-892f-40cc-adbd-9db2b8d4ee09 tempest-ProjectMemberTests-718446646 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-cc978249-5e16-43bc-8384-5c0a2028e75f" returned: 0 in 0.340s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:07:08 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-961d6c6d-892f-40cc-adbd-9db2b8d4ee09 tempest-ProjectMemberTests-718446646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-cc978249-5e16-43bc-8384-5c0a2028e75f.6b63eb93-4672-4cee-b03a-55b43af0c2a4 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:07:08 devstack sudo[105798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-cc978249-5e16-43bc-8384-5c0a2028e75f.6b63eb93-4672-4cee-b03a-55b43af0c2a4 Jul 13 14:07:08 devstack sudo[105798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:07:09 devstack sudo[105798]: pam_unix(sudo:session): session closed for user root Jul 13 14:07:09 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-961d6c6d-892f-40cc-adbd-9db2b8d4ee09 tempest-ProjectMemberTests-718446646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-cc978249-5e16-43bc-8384-5c0a2028e75f.6b63eb93-4672-4cee-b03a-55b43af0c2a4" returned: 0 in 0.325s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:07:09 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-961d6c6d-892f-40cc-adbd-9db2b8d4ee09 tempest-ProjectMemberTests-718446646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-cc978249-5e16-43bc-8384-5c0a2028e75f.6b63eb93-4672-4cee-b03a-55b43af0c2a4 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:07:09 devstack sudo[105803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-cc978249-5e16-43bc-8384-5c0a2028e75f.6b63eb93-4672-4cee-b03a-55b43af0c2a4 Jul 13 14:07:09 devstack sudo[105803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:07:09 devstack sudo[105803]: pam_unix(sudo:session): session closed for user root Jul 13 14:07:09 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-961d6c6d-892f-40cc-adbd-9db2b8d4ee09 tempest-ProjectMemberTests-718446646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-cc978249-5e16-43bc-8384-5c0a2028e75f.6b63eb93-4672-4cee-b03a-55b43af0c2a4" returned: 0 in 0.235s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:07:09 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-961d6c6d-892f-40cc-adbd-9db2b8d4ee09 tempest-ProjectMemberTests-718446646 None] Lock "cinder-quobyte-6b63eb93-4672-4cee-b03a-55b43af0c2a4" released by "_delete_snapshot" :: held 1.333s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 14:07:09 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-961d6c6d-892f-40cc-adbd-9db2b8d4ee09 tempest-ProjectMemberTests-718446646 None] Lock "cinder-quobyte-cc978249-5e16-43bc-8384-5c0a2028e75f" released by "delete_snapshot" :: held 1.354s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 14:07:09 devstack cinder-volume[87098]: DEBUG dbcounter [-] [87098] Writing DB stats cinder:UPDATE=190,cinder:SELECT=133,cinder:INSERT=42,cinder:DELETE=9 {{(pid=87098) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 13 14:07:09 devstack cinder-volume[87098]: DEBUG dbcounter [-] [87098] Writing DB stats cinder:SELECT=130,cinder:UPDATE=144,cinder:INSERT=47,cinder:DELETE=20 {{(pid=87098) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 13 14:07:09 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-961d6c6d-892f-40cc-adbd-9db2b8d4ee09 tempest-ProjectMemberTests-718446646 None] Created reservations ['47df7a27-5ed2-4755-af7d-221b4862052a', '04e1c4d1-159b-4274-964e-340db06d0be1', '094712d5-8e46-4a0a-8a65-d475d75a65c6', '5f98c459-16a2-432d-a74c-8a69475857b6'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 14:07:09 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-961d6c6d-892f-40cc-adbd-9db2b8d4ee09 tempest-ProjectMemberTests-718446646 None] Delete snapshot completed successfully. Jul 13 14:07:09 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-961d6c6d-892f-40cc-adbd-9db2b8d4ee09 tempest-ProjectMemberTests-718446646 None] Lock "cinder-6b63eb93-4672-4cee-b03a-55b43af0c2a4-delete_snapshot" released by "delete_snapshot" :: held 1.485s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 14:07:10 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-404e0668-bc39-4ef5-a56f-50649a4726ea tempest-ProjectMemberTests-718446646 None] Acquiring lock "cinder-cc978249-5e16-43bc-8384-5c0a2028e75f-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 14:07:10 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-404e0668-bc39-4ef5-a56f-50649a4726ea tempest-ProjectMemberTests-718446646 None] Lock "cinder-cc978249-5e16-43bc-8384-5c0a2028e75f-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 14:07:10 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-404e0668-bc39-4ef5-a56f-50649a4726ea tempest-ProjectMemberTests-718446646 None] Acquiring lock "cinder-quobyte-cc978249-5e16-43bc-8384-5c0a2028e75f" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 14:07:10 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-404e0668-bc39-4ef5-a56f-50649a4726ea tempest-ProjectMemberTests-718446646 None] Lock "cinder-quobyte-cc978249-5e16-43bc-8384-5c0a2028e75f" acquired by "delete_volume" :: waited 0.014s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 14:07:10 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[72dea24a-38bd-46bb-a9ac-af5ff00b2e2f]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 14:07:10 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-404e0668-bc39-4ef5-a56f-50649a4726ea tempest-ProjectMemberTests-718446646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-cc978249-5e16-43bc-8384-5c0a2028e75f {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:07:10 devstack sudo[105806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-cc978249-5e16-43bc-8384-5c0a2028e75f Jul 13 14:07:10 devstack sudo[105806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:07:10 devstack sudo[105806]: pam_unix(sudo:session): session closed for user root Jul 13 14:07:10 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-404e0668-bc39-4ef5-a56f-50649a4726ea tempest-ProjectMemberTests-718446646 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-cc978249-5e16-43bc-8384-5c0a2028e75f" returned: 0 in 0.343s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:07:10 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-404e0668-bc39-4ef5-a56f-50649a4726ea tempest-ProjectMemberTests-718446646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-cc978249-5e16-43bc-8384-5c0a2028e75f {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:07:10 devstack sudo[105811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-cc978249-5e16-43bc-8384-5c0a2028e75f Jul 13 14:07:10 devstack sudo[105811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:07:10 devstack sudo[105811]: pam_unix(sudo:session): session closed for user root Jul 13 14:07:10 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-404e0668-bc39-4ef5-a56f-50649a4726ea tempest-ProjectMemberTests-718446646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-cc978249-5e16-43bc-8384-5c0a2028e75f" returned: 0 in 0.233s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:07:10 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-404e0668-bc39-4ef5-a56f-50649a4726ea tempest-ProjectMemberTests-718446646 None] Lock "cinder-quobyte-cc978249-5e16-43bc-8384-5c0a2028e75f" released by "delete_volume" :: held 0.629s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 14:07:11 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-404e0668-bc39-4ef5-a56f-50649a4726ea tempest-ProjectMemberTests-718446646 None] Created reservations ['6272b39f-d2e5-4bd3-b749-8f4aca1a0a9c', '9efcddda-07ee-4697-8b6b-9f4e572672cb', 'f1879776-04c4-4f64-b844-ba3e5d43900b', 'b1886ca1-5982-4f63-a49b-9cc48be79a9b'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 14:07:11 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-404e0668-bc39-4ef5-a56f-50649a4726ea tempest-ProjectMemberTests-718446646 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 14:07:11 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-404e0668-bc39-4ef5-a56f-50649a4726ea tempest-ProjectMemberTests-718446646 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 14:07:11 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-404e0668-bc39-4ef5-a56f-50649a4726ea tempest-ProjectMemberTests-718446646 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 14:07:11 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-404e0668-bc39-4ef5-a56f-50649a4726ea tempest-ProjectMemberTests-718446646 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 14:07:11 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-404e0668-bc39-4ef5-a56f-50649a4726ea tempest-ProjectMemberTests-718446646 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 14:07:11 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-404e0668-bc39-4ef5-a56f-50649a4726ea tempest-ProjectMemberTests-718446646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:07:11 devstack sudo[105814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 Jul 13 14:07:11 devstack sudo[105814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:07:11 devstack sudo[105814]: pam_unix(sudo:session): session closed for user root Jul 13 14:07:11 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-404e0668-bc39-4ef5-a56f-50649a4726ea tempest-ProjectMemberTests-718446646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78" returned: 0 in 0.239s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:07:11 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-404e0668-bc39-4ef5-a56f-50649a4726ea tempest-ProjectMemberTests-718446646 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 14:07:11 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-404e0668-bc39-4ef5-a56f-50649a4726ea tempest-ProjectMemberTests-718446646 None] Deleted volume successfully. Jul 13 14:07:11 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-404e0668-bc39-4ef5-a56f-50649a4726ea tempest-ProjectMemberTests-718446646 None] Lock "cinder-cc978249-5e16-43bc-8384-5c0a2028e75f-delete_volume" released by "delete_volume" :: held 1.048s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 14:07:12 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-d470ddae-775d-4a7d-98e5-2928dbcb1ab5 tempest-ProjectMemberTests-718446646 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 14:07:12 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-d470ddae-775d-4a7d-98e5-2928dbcb1ab5 tempest-ProjectMemberTests-718446646 None] Flow 'volume_create_manager' (0a76403c-4cd3-4e75-8a73-0fe5b814f508) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 14:07:12 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-d470ddae-775d-4a7d-98e5-2928dbcb1ab5 tempest-ProjectMemberTests-718446646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a87417c-fd0d-4016-8d93-25c238c40b76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:07:12 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-d470ddae-775d-4a7d-98e5-2928dbcb1ab5 tempest-ProjectMemberTests-718446646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a87417c-fd0d-4016-8d93-25c238c40b76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T12:07:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2120100694',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b641efe7-fae3-4343-bb93-1bc236d387ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2bb0e12a2763448b9d28151e1e814854',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T12:07:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T12:07:12Z,use_quota=True,user_id='2d16431e25f348deb700350f5b150c69',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1147de8b-623b-426c-a13d-7fc824a80f67),volume_type_id=1147de8b-623b-426c-a13d-7fc824a80f67)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:07:12 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-d470ddae-775d-4a7d-98e5-2928dbcb1ab5 tempest-ProjectMemberTests-718446646 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38b1756b-f9b3-4f54-9796-7e106ac9c18b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:07:12 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-d470ddae-775d-4a7d-98e5-2928dbcb1ab5 tempest-ProjectMemberTests-718446646 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38b1756b-f9b3-4f54-9796-7e106ac9c18b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:07:12 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-d470ddae-775d-4a7d-98e5-2928dbcb1ab5 tempest-ProjectMemberTests-718446646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea647343-063c-4517-ae80-264b15efdbfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:07:12 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-d470ddae-775d-4a7d-98e5-2928dbcb1ab5 tempest-ProjectMemberTests-718446646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea647343-063c-4517-ae80-264b15efdbfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b641efe7-fae3-4343-bb93-1bc236d387ad', 'volume_name': 'volume-b641efe7-fae3-4343-bb93-1bc236d387ad', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:07:12 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-d470ddae-775d-4a7d-98e5-2928dbcb1ab5 tempest-ProjectMemberTests-718446646 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9fdbbf57-7720-440c-b581-64d773b3bbad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:07:12 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-d470ddae-775d-4a7d-98e5-2928dbcb1ab5 tempest-ProjectMemberTests-718446646 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9fdbbf57-7720-440c-b581-64d773b3bbad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:07:12 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-d470ddae-775d-4a7d-98e5-2928dbcb1ab5 tempest-ProjectMemberTests-718446646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8dfcc10-a24c-42df-b0ac-64293f4a69e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:07:12 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-d470ddae-775d-4a7d-98e5-2928dbcb1ab5 tempest-ProjectMemberTests-718446646 None] Volume b641efe7-fae3-4343-bb93-1bc236d387ad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b641efe7-fae3-4343-bb93-1bc236d387ad', 'volume_size': 1} Jul 13 14:07:12 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-d470ddae-775d-4a7d-98e5-2928dbcb1ab5 tempest-ProjectMemberTests-718446646 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 14:07:12 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-d470ddae-775d-4a7d-98e5-2928dbcb1ab5 tempest-ProjectMemberTests-718446646 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 14:07:12 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-d470ddae-775d-4a7d-98e5-2928dbcb1ab5 tempest-ProjectMemberTests-718446646 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T12:07:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2120100694',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b641efe7-fae3-4343-bb93-1bc236d387ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2bb0e12a2763448b9d28151e1e814854',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T12:07:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T12:07:12Z,use_quota=True,user_id='2d16431e25f348deb700350f5b150c69',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1147de8b-623b-426c-a13d-7fc824a80f67),volume_type_id=1147de8b-623b-426c-a13d-7fc824a80f67)}" {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 13 14:07:12 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-d470ddae-775d-4a7d-98e5-2928dbcb1ab5 tempest-ProjectMemberTests-718446646 None] Creating volume b641efe7-fae3-4343-bb93-1bc236d387ad {{(pid=87098) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 13 14:07:12 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-d470ddae-775d-4a7d-98e5-2928dbcb1ab5 tempest-ProjectMemberTests-718446646 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 14:07:12 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-d470ddae-775d-4a7d-98e5-2928dbcb1ab5 tempest-ProjectMemberTests-718446646 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 14:07:12 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-d470ddae-775d-4a7d-98e5-2928dbcb1ab5 tempest-ProjectMemberTests-718446646 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 14:07:12 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-d470ddae-775d-4a7d-98e5-2928dbcb1ab5 tempest-ProjectMemberTests-718446646 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 14:07:12 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-d470ddae-775d-4a7d-98e5-2928dbcb1ab5 tempest-ProjectMemberTests-718446646 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 14:07:12 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-d470ddae-775d-4a7d-98e5-2928dbcb1ab5 tempest-ProjectMemberTests-718446646 None] Selected osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 14:07:12 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-d470ddae-775d-4a7d-98e5-2928dbcb1ab5 tempest-ProjectMemberTests-718446646 None] casted to osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 Jul 13 14:07:12 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-d470ddae-775d-4a7d-98e5-2928dbcb1ab5 tempest-ProjectMemberTests-718446646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-b641efe7-fae3-4343-bb93-1bc236d387ad 1073741824 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:07:12 devstack sudo[105817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-b641efe7-fae3-4343-bb93-1bc236d387ad 1073741824 Jul 13 14:07:12 devstack sudo[105817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:07:12 devstack sudo[105817]: pam_unix(sudo:session): session closed for user root Jul 13 14:07:12 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-d470ddae-775d-4a7d-98e5-2928dbcb1ab5 tempest-ProjectMemberTests-718446646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-b641efe7-fae3-4343-bb93-1bc236d387ad 1073741824" returned: 0 in 0.387s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:07:12 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-d470ddae-775d-4a7d-98e5-2928dbcb1ab5 tempest-ProjectMemberTests-718446646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-b641efe7-fae3-4343-bb93-1bc236d387ad {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:07:12 devstack sudo[105823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-b641efe7-fae3-4343-bb93-1bc236d387ad Jul 13 14:07:12 devstack sudo[105823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:07:12 devstack sudo[105823]: pam_unix(sudo:session): session closed for user root Jul 13 14:07:12 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-d470ddae-775d-4a7d-98e5-2928dbcb1ab5 tempest-ProjectMemberTests-718446646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-b641efe7-fae3-4343-bb93-1bc236d387ad" returned: 0 in 0.247s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:07:12 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-d470ddae-775d-4a7d-98e5-2928dbcb1ab5 tempest-ProjectMemberTests-718446646 None] <== create_volume: return (678ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'} {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 13 14:07:12 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-d470ddae-775d-4a7d-98e5-2928dbcb1ab5 tempest-ProjectMemberTests-718446646 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.680s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 14:07:12 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-d470ddae-775d-4a7d-98e5-2928dbcb1ab5 tempest-ProjectMemberTests-718446646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8dfcc10-a24c-42df-b0ac-64293f4a69e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b641efe7-fae3-4343-bb93-1bc236d387ad', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:07:12 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-d470ddae-775d-4a7d-98e5-2928dbcb1ab5 tempest-ProjectMemberTests-718446646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6642d74a-8b3b-484f-b22d-0ebaa9fb4deb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:07:12 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-d470ddae-775d-4a7d-98e5-2928dbcb1ab5 tempest-ProjectMemberTests-718446646 None] Volume volume-b641efe7-fae3-4343-bb93-1bc236d387ad (b641efe7-fae3-4343-bb93-1bc236d387ad): created successfully Jul 13 14:07:12 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-d470ddae-775d-4a7d-98e5-2928dbcb1ab5 tempest-ProjectMemberTests-718446646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6642d74a-8b3b-484f-b22d-0ebaa9fb4deb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:07:12 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-d470ddae-775d-4a7d-98e5-2928dbcb1ab5 tempest-ProjectMemberTests-718446646 None] Flow 'volume_create_manager' (0a76403c-4cd3-4e75-8a73-0fe5b814f508) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 14:07:12 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-d470ddae-775d-4a7d-98e5-2928dbcb1ab5 tempest-ProjectMemberTests-718446646 None] Created volume successfully. Jul 13 14:07:13 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-b93e669d-c64f-4dc9-970f-81abbe468522 tempest-ProjectMemberTests-718446646 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 14:07:13 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-b93e669d-c64f-4dc9-970f-81abbe468522 tempest-ProjectMemberTests-718446646 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 14:07:13 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-b93e669d-c64f-4dc9-970f-81abbe468522 tempest-ProjectMemberTests-718446646 None] Creating offline snapshot 8cdc82b9-b020-4e24-919c-f24843408015 of volume b641efe7-fae3-4343-bb93-1bc236d387ad {{(pid=87098) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 13 14:07:13 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[38a44f11-5165-4230-9f22-c0d8600dfbec]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 14:07:13 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-b93e669d-c64f-4dc9-970f-81abbe468522 tempest-ProjectMemberTests-718446646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-b641efe7-fae3-4343-bb93-1bc236d387ad {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:07:13 devstack sudo[105826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-b641efe7-fae3-4343-bb93-1bc236d387ad Jul 13 14:07:13 devstack sudo[105826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:07:13 devstack sudo[105826]: pam_unix(sudo:session): session closed for user root Jul 13 14:07:13 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-b93e669d-c64f-4dc9-970f-81abbe468522 tempest-ProjectMemberTests-718446646 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-b641efe7-fae3-4343-bb93-1bc236d387ad" returned: 0 in 0.365s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:07:13 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-b93e669d-c64f-4dc9-970f-81abbe468522 tempest-ProjectMemberTests-718446646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-b641efe7-fae3-4343-bb93-1bc236d387ad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-b641efe7-fae3-4343-bb93-1bc236d387ad.8cdc82b9-b020-4e24-919c-f24843408015 1G {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:07:13 devstack sudo[105831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-b641efe7-fae3-4343-bb93-1bc236d387ad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-b641efe7-fae3-4343-bb93-1bc236d387ad.8cdc82b9-b020-4e24-919c-f24843408015 1G Jul 13 14:07:13 devstack sudo[105831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:07:14 devstack sudo[105831]: pam_unix(sudo:session): session closed for user root Jul 13 14:07:14 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-b93e669d-c64f-4dc9-970f-81abbe468522 tempest-ProjectMemberTests-718446646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-b641efe7-fae3-4343-bb93-1bc236d387ad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-b641efe7-fae3-4343-bb93-1bc236d387ad.8cdc82b9-b020-4e24-919c-f24843408015 1G" returned: 0 in 0.378s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:07:14 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-b93e669d-c64f-4dc9-970f-81abbe468522 tempest-ProjectMemberTests-718446646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b641efe7-fae3-4343-bb93-1bc236d387ad -F qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-b641efe7-fae3-4343-bb93-1bc236d387ad.8cdc82b9-b020-4e24-919c-f24843408015 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:07:14 devstack sudo[105837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b641efe7-fae3-4343-bb93-1bc236d387ad -F qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-b641efe7-fae3-4343-bb93-1bc236d387ad.8cdc82b9-b020-4e24-919c-f24843408015 Jul 13 14:07:14 devstack sudo[105837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:07:14 devstack sudo[105837]: pam_unix(sudo:session): session closed for user root Jul 13 14:07:14 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-b93e669d-c64f-4dc9-970f-81abbe468522 tempest-ProjectMemberTests-718446646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b641efe7-fae3-4343-bb93-1bc236d387ad -F qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-b641efe7-fae3-4343-bb93-1bc236d387ad.8cdc82b9-b020-4e24-919c-f24843408015" returned: 0 in 0.284s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:07:14 devstack cinder-volume[87098]: WARNING cinder.volume.drivers.remotefs [None req-b93e669d-c64f-4dc9-970f-81abbe468522 tempest-ProjectMemberTests-718446646 None] /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-b641efe7-fae3-4343-bb93-1bc236d387ad.8cdc82b9-b020-4e24-919c-f24843408015 is being set with open permissions: ugo+rw Jul 13 14:07:14 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-b93e669d-c64f-4dc9-970f-81abbe468522 tempest-ProjectMemberTests-718446646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-b641efe7-fae3-4343-bb93-1bc236d387ad.8cdc82b9-b020-4e24-919c-f24843408015 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:07:14 devstack sudo[105842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-b641efe7-fae3-4343-bb93-1bc236d387ad.8cdc82b9-b020-4e24-919c-f24843408015 Jul 13 14:07:14 devstack sudo[105842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:07:14 devstack sudo[105842]: pam_unix(sudo:session): session closed for user root Jul 13 14:07:14 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-b93e669d-c64f-4dc9-970f-81abbe468522 tempest-ProjectMemberTests-718446646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-b641efe7-fae3-4343-bb93-1bc236d387ad.8cdc82b9-b020-4e24-919c-f24843408015" returned: 0 in 0.231s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:07:14 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-b93e669d-c64f-4dc9-970f-81abbe468522 tempest-ProjectMemberTests-718446646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-b641efe7-fae3-4343-bb93-1bc236d387ad.info {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:07:14 devstack sudo[105845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-b641efe7-fae3-4343-bb93-1bc236d387ad.info Jul 13 14:07:14 devstack sudo[105845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:07:14 devstack sudo[105845]: pam_unix(sudo:session): session closed for user root Jul 13 14:07:14 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-b93e669d-c64f-4dc9-970f-81abbe468522 tempest-ProjectMemberTests-718446646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-b641efe7-fae3-4343-bb93-1bc236d387ad.info" returned: 0 in 0.240s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:07:14 devstack cinder-volume[87098]: WARNING cinder.volume.drivers.remotefs [None req-b93e669d-c64f-4dc9-970f-81abbe468522 tempest-ProjectMemberTests-718446646 None] /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-b641efe7-fae3-4343-bb93-1bc236d387ad.info is being set with open permissions: ugo+rw Jul 13 14:07:14 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-b93e669d-c64f-4dc9-970f-81abbe468522 tempest-ProjectMemberTests-718446646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-b641efe7-fae3-4343-bb93-1bc236d387ad.info {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:07:14 devstack sudo[105848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-b641efe7-fae3-4343-bb93-1bc236d387ad.info Jul 13 14:07:14 devstack sudo[105848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:07:15 devstack sudo[105848]: pam_unix(sudo:session): session closed for user root Jul 13 14:07:15 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-b93e669d-c64f-4dc9-970f-81abbe468522 tempest-ProjectMemberTests-718446646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-b641efe7-fae3-4343-bb93-1bc236d387ad.info" returned: 0 in 0.262s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:07:15 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-b93e669d-c64f-4dc9-970f-81abbe468522 tempest-ProjectMemberTests-718446646 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.839s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 14:07:15 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-b93e669d-c64f-4dc9-970f-81abbe468522 tempest-ProjectMemberTests-718446646 None] Create snapshot completed successfully Jul 13 14:07:15 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-a53a94d2-5a5f-426c-9a74-b88becc8fe59 tempest-ProjectMemberTests-718446646 None] Acquiring lock "cinder-8cdc82b9-b020-4e24-919c-f24843408015-delete_snapshot" by "delete_snapshot" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 14:07:15 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-a53a94d2-5a5f-426c-9a74-b88becc8fe59 tempest-ProjectMemberTests-718446646 None] Lock "cinder-8cdc82b9-b020-4e24-919c-f24843408015-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 14:07:15 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-a53a94d2-5a5f-426c-9a74-b88becc8fe59 tempest-ProjectMemberTests-718446646 None] Acquiring lock "cinder-quobyte-b641efe7-fae3-4343-bb93-1bc236d387ad" by "delete_snapshot" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 14:07:15 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-a53a94d2-5a5f-426c-9a74-b88becc8fe59 tempest-ProjectMemberTests-718446646 None] Lock "cinder-quobyte-b641efe7-fae3-4343-bb93-1bc236d387ad" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 14:07:15 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-a53a94d2-5a5f-426c-9a74-b88becc8fe59 tempest-ProjectMemberTests-718446646 None] Acquiring lock "cinder-quobyte-8cdc82b9-b020-4e24-919c-f24843408015" by "_delete_snapshot" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 14:07:15 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-a53a94d2-5a5f-426c-9a74-b88becc8fe59 tempest-ProjectMemberTests-718446646 None] Lock "cinder-quobyte-8cdc82b9-b020-4e24-919c-f24843408015" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 14:07:15 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-a53a94d2-5a5f-426c-9a74-b88becc8fe59 tempest-ProjectMemberTests-718446646 None] Deleting offline snapshot 8cdc82b9-b020-4e24-919c-f24843408015 of volume b641efe7-fae3-4343-bb93-1bc236d387ad {{(pid=87098) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 13 14:07:15 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-a53a94d2-5a5f-426c-9a74-b88becc8fe59 tempest-ProjectMemberTests-718446646 None] snapshot_file for this snap is: volume-b641efe7-fae3-4343-bb93-1bc236d387ad.8cdc82b9-b020-4e24-919c-f24843408015 {{(pid=87098) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 13 14:07:15 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfbd86dd-cbd3-4d90-912a-3bc96c5d7945]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 14:07:15 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-a53a94d2-5a5f-426c-9a74-b88becc8fe59 tempest-ProjectMemberTests-718446646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-b641efe7-fae3-4343-bb93-1bc236d387ad.8cdc82b9-b020-4e24-919c-f24843408015 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:07:15 devstack sudo[105852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-b641efe7-fae3-4343-bb93-1bc236d387ad.8cdc82b9-b020-4e24-919c-f24843408015 Jul 13 14:07:15 devstack sudo[105852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:07:15 devstack sudo[105852]: pam_unix(sudo:session): session closed for user root Jul 13 14:07:15 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-a53a94d2-5a5f-426c-9a74-b88becc8fe59 tempest-ProjectMemberTests-718446646 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-b641efe7-fae3-4343-bb93-1bc236d387ad.8cdc82b9-b020-4e24-919c-f24843408015" returned: 0 in 0.353s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:07:15 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-a53a94d2-5a5f-426c-9a74-b88becc8fe59 tempest-ProjectMemberTests-718446646 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b641efe7-fae3-4343-bb93-1bc236d387ad(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87098) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 13 14:07:15 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[3387f555-e1c3-468d-9eec-81b132e26d99]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 14:07:15 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-a53a94d2-5a5f-426c-9a74-b88becc8fe59 tempest-ProjectMemberTests-718446646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-b641efe7-fae3-4343-bb93-1bc236d387ad {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:07:16 devstack sudo[105857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-b641efe7-fae3-4343-bb93-1bc236d387ad Jul 13 14:07:16 devstack sudo[105857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:07:16 devstack sudo[105857]: pam_unix(sudo:session): session closed for user root Jul 13 14:07:16 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-a53a94d2-5a5f-426c-9a74-b88becc8fe59 tempest-ProjectMemberTests-718446646 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-b641efe7-fae3-4343-bb93-1bc236d387ad" returned: 0 in 0.362s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:07:16 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-a53a94d2-5a5f-426c-9a74-b88becc8fe59 tempest-ProjectMemberTests-718446646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-b641efe7-fae3-4343-bb93-1bc236d387ad.8cdc82b9-b020-4e24-919c-f24843408015 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:07:16 devstack sudo[105898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-b641efe7-fae3-4343-bb93-1bc236d387ad.8cdc82b9-b020-4e24-919c-f24843408015 Jul 13 14:07:16 devstack sudo[105898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:07:16 devstack sudo[105898]: pam_unix(sudo:session): session closed for user root Jul 13 14:07:16 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-a53a94d2-5a5f-426c-9a74-b88becc8fe59 tempest-ProjectMemberTests-718446646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-b641efe7-fae3-4343-bb93-1bc236d387ad.8cdc82b9-b020-4e24-919c-f24843408015" returned: 0 in 0.330s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:07:16 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-a53a94d2-5a5f-426c-9a74-b88becc8fe59 tempest-ProjectMemberTests-718446646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-b641efe7-fae3-4343-bb93-1bc236d387ad.8cdc82b9-b020-4e24-919c-f24843408015 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:07:16 devstack sudo[105903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-b641efe7-fae3-4343-bb93-1bc236d387ad.8cdc82b9-b020-4e24-919c-f24843408015 Jul 13 14:07:16 devstack sudo[105903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:07:16 devstack sudo[105903]: pam_unix(sudo:session): session closed for user root Jul 13 14:07:16 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-a53a94d2-5a5f-426c-9a74-b88becc8fe59 tempest-ProjectMemberTests-718446646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-b641efe7-fae3-4343-bb93-1bc236d387ad.8cdc82b9-b020-4e24-919c-f24843408015" returned: 0 in 0.238s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:07:16 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-a53a94d2-5a5f-426c-9a74-b88becc8fe59 tempest-ProjectMemberTests-718446646 None] Lock "cinder-quobyte-8cdc82b9-b020-4e24-919c-f24843408015" released by "_delete_snapshot" :: held 1.366s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 14:07:16 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-a53a94d2-5a5f-426c-9a74-b88becc8fe59 tempest-ProjectMemberTests-718446646 None] Lock "cinder-quobyte-b641efe7-fae3-4343-bb93-1bc236d387ad" released by "delete_snapshot" :: held 1.390s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 14:07:16 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-a53a94d2-5a5f-426c-9a74-b88becc8fe59 tempest-ProjectMemberTests-718446646 None] Created reservations ['c36d67c4-c200-427c-b57b-46cd12f4d583', '64152e7c-831f-469e-853c-1fc44c0fb885', 'e71cc9d4-484b-4fbd-a7fc-f03238caf1cd', '1915e2c6-8eed-4eac-8b75-364a605d2246'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 14:07:17 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-a53a94d2-5a5f-426c-9a74-b88becc8fe59 tempest-ProjectMemberTests-718446646 None] Delete snapshot completed successfully. Jul 13 14:07:17 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-a53a94d2-5a5f-426c-9a74-b88becc8fe59 tempest-ProjectMemberTests-718446646 None] Lock "cinder-8cdc82b9-b020-4e24-919c-f24843408015-delete_snapshot" released by "delete_snapshot" :: held 1.515s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 14:07:17 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-96260166-ba62-4030-9433-3c03683c03b3 tempest-ProjectMemberTests-718446646 None] Acquiring lock "cinder-b641efe7-fae3-4343-bb93-1bc236d387ad-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 14:07:17 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-96260166-ba62-4030-9433-3c03683c03b3 tempest-ProjectMemberTests-718446646 None] Lock "cinder-b641efe7-fae3-4343-bb93-1bc236d387ad-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 14:07:17 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-96260166-ba62-4030-9433-3c03683c03b3 tempest-ProjectMemberTests-718446646 None] Acquiring lock "cinder-quobyte-b641efe7-fae3-4343-bb93-1bc236d387ad" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 14:07:17 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-96260166-ba62-4030-9433-3c03683c03b3 tempest-ProjectMemberTests-718446646 None] Lock "cinder-quobyte-b641efe7-fae3-4343-bb93-1bc236d387ad" acquired by "delete_volume" :: waited 0.013s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 14:07:17 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[32095536-51c2-4755-ba71-d4fac3a597f3]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 14:07:17 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-96260166-ba62-4030-9433-3c03683c03b3 tempest-ProjectMemberTests-718446646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-b641efe7-fae3-4343-bb93-1bc236d387ad {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:07:17 devstack sudo[105907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-b641efe7-fae3-4343-bb93-1bc236d387ad Jul 13 14:07:17 devstack sudo[105907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:07:18 devstack sudo[105907]: pam_unix(sudo:session): session closed for user root Jul 13 14:07:18 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-96260166-ba62-4030-9433-3c03683c03b3 tempest-ProjectMemberTests-718446646 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-b641efe7-fae3-4343-bb93-1bc236d387ad" returned: 0 in 0.359s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:07:18 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-96260166-ba62-4030-9433-3c03683c03b3 tempest-ProjectMemberTests-718446646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-b641efe7-fae3-4343-bb93-1bc236d387ad {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:07:18 devstack sudo[105912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-b641efe7-fae3-4343-bb93-1bc236d387ad Jul 13 14:07:18 devstack sudo[105912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:07:18 devstack sudo[105912]: pam_unix(sudo:session): session closed for user root Jul 13 14:07:18 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-96260166-ba62-4030-9433-3c03683c03b3 tempest-ProjectMemberTests-718446646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-b641efe7-fae3-4343-bb93-1bc236d387ad" returned: 0 in 0.242s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:07:18 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-96260166-ba62-4030-9433-3c03683c03b3 tempest-ProjectMemberTests-718446646 None] Lock "cinder-quobyte-b641efe7-fae3-4343-bb93-1bc236d387ad" released by "delete_volume" :: held 0.656s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 14:07:18 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-96260166-ba62-4030-9433-3c03683c03b3 tempest-ProjectMemberTests-718446646 None] Created reservations ['ca354470-ccce-4486-bc72-322c8c5a55d6', '1054ee5b-7fab-4315-a648-a97bbba57335', 'bfba2022-c637-4f27-a877-c5783d4c4b26', '3b1dd099-7252-4584-a918-f0c433d5f396'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 14:07:18 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-96260166-ba62-4030-9433-3c03683c03b3 tempest-ProjectMemberTests-718446646 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 14:07:18 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-96260166-ba62-4030-9433-3c03683c03b3 tempest-ProjectMemberTests-718446646 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 14:07:18 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-96260166-ba62-4030-9433-3c03683c03b3 tempest-ProjectMemberTests-718446646 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 14:07:18 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-96260166-ba62-4030-9433-3c03683c03b3 tempest-ProjectMemberTests-718446646 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 14:07:18 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-96260166-ba62-4030-9433-3c03683c03b3 tempest-ProjectMemberTests-718446646 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 14:07:18 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-96260166-ba62-4030-9433-3c03683c03b3 tempest-ProjectMemberTests-718446646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:07:18 devstack sudo[105917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 Jul 13 14:07:18 devstack sudo[105917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:07:18 devstack sudo[105917]: pam_unix(sudo:session): session closed for user root Jul 13 14:07:18 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-96260166-ba62-4030-9433-3c03683c03b3 tempest-ProjectMemberTests-718446646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78" returned: 0 in 0.240s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:07:18 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-96260166-ba62-4030-9433-3c03683c03b3 tempest-ProjectMemberTests-718446646 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 14:07:18 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-96260166-ba62-4030-9433-3c03683c03b3 tempest-ProjectMemberTests-718446646 None] Deleted volume successfully. Jul 13 14:07:18 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-96260166-ba62-4030-9433-3c03683c03b3 tempest-ProjectMemberTests-718446646 None] Lock "cinder-b641efe7-fae3-4343-bb93-1bc236d387ad-delete_volume" released by "delete_volume" :: held 1.083s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 14:07:19 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-29fb52de-720d-4bea-a35f-00131ebb11f1 tempest-ProjectMemberTests-718446646 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 14:07:19 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-29fb52de-720d-4bea-a35f-00131ebb11f1 tempest-ProjectMemberTests-718446646 None] Flow 'volume_create_manager' (6d6113fd-60b9-420d-8a29-b887d7022902) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 14:07:19 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-29fb52de-720d-4bea-a35f-00131ebb11f1 tempest-ProjectMemberTests-718446646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8eea13dd-8b18-4e5c-a5ac-7609c91e8ab8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:07:19 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-29fb52de-720d-4bea-a35f-00131ebb11f1 tempest-ProjectMemberTests-718446646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8eea13dd-8b18-4e5c-a5ac-7609c91e8ab8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T12:07:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1388680546',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66b56421-9115-4e22-b842-60aac227ee53,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2bb0e12a2763448b9d28151e1e814854',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T12:07:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T12:07:19Z,use_quota=True,user_id='2d16431e25f348deb700350f5b150c69',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1147de8b-623b-426c-a13d-7fc824a80f67),volume_type_id=1147de8b-623b-426c-a13d-7fc824a80f67)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:07:19 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-29fb52de-720d-4bea-a35f-00131ebb11f1 tempest-ProjectMemberTests-718446646 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1676748-8bf9-4e4a-94aa-fedd927ffc8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:07:19 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-29fb52de-720d-4bea-a35f-00131ebb11f1 tempest-ProjectMemberTests-718446646 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1676748-8bf9-4e4a-94aa-fedd927ffc8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:07:19 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-29fb52de-720d-4bea-a35f-00131ebb11f1 tempest-ProjectMemberTests-718446646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0dbdcb4-a304-4fc3-9a00-1fdf4f3dd424) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:07:19 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-29fb52de-720d-4bea-a35f-00131ebb11f1 tempest-ProjectMemberTests-718446646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0dbdcb4-a304-4fc3-9a00-1fdf4f3dd424) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '66b56421-9115-4e22-b842-60aac227ee53', 'volume_name': 'volume-66b56421-9115-4e22-b842-60aac227ee53', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:07:19 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-29fb52de-720d-4bea-a35f-00131ebb11f1 tempest-ProjectMemberTests-718446646 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4feba65f-29a4-4068-a29b-97517a94e31c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:07:19 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-29fb52de-720d-4bea-a35f-00131ebb11f1 tempest-ProjectMemberTests-718446646 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4feba65f-29a4-4068-a29b-97517a94e31c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:07:19 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-29fb52de-720d-4bea-a35f-00131ebb11f1 tempest-ProjectMemberTests-718446646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (376c41db-f3b3-4a07-b593-4def489c02ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:07:19 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-29fb52de-720d-4bea-a35f-00131ebb11f1 tempest-ProjectMemberTests-718446646 None] Volume 66b56421-9115-4e22-b842-60aac227ee53: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-66b56421-9115-4e22-b842-60aac227ee53', 'volume_size': 1} Jul 13 14:07:19 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-29fb52de-720d-4bea-a35f-00131ebb11f1 tempest-ProjectMemberTests-718446646 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 14:07:19 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-29fb52de-720d-4bea-a35f-00131ebb11f1 tempest-ProjectMemberTests-718446646 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 14:07:19 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-29fb52de-720d-4bea-a35f-00131ebb11f1 tempest-ProjectMemberTests-718446646 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T12:07:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1388680546',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66b56421-9115-4e22-b842-60aac227ee53,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2bb0e12a2763448b9d28151e1e814854',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T12:07:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T12:07:19Z,use_quota=True,user_id='2d16431e25f348deb700350f5b150c69',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1147de8b-623b-426c-a13d-7fc824a80f67),volume_type_id=1147de8b-623b-426c-a13d-7fc824a80f67)}" {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 13 14:07:19 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-29fb52de-720d-4bea-a35f-00131ebb11f1 tempest-ProjectMemberTests-718446646 None] Creating volume 66b56421-9115-4e22-b842-60aac227ee53 {{(pid=87098) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 13 14:07:19 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-29fb52de-720d-4bea-a35f-00131ebb11f1 tempest-ProjectMemberTests-718446646 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 14:07:19 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-29fb52de-720d-4bea-a35f-00131ebb11f1 tempest-ProjectMemberTests-718446646 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 14:07:19 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-29fb52de-720d-4bea-a35f-00131ebb11f1 tempest-ProjectMemberTests-718446646 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 14:07:19 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-29fb52de-720d-4bea-a35f-00131ebb11f1 tempest-ProjectMemberTests-718446646 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 14:07:19 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-29fb52de-720d-4bea-a35f-00131ebb11f1 tempest-ProjectMemberTests-718446646 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 14:07:19 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-29fb52de-720d-4bea-a35f-00131ebb11f1 tempest-ProjectMemberTests-718446646 None] Selected osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 14:07:19 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-29fb52de-720d-4bea-a35f-00131ebb11f1 tempest-ProjectMemberTests-718446646 None] casted to osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 Jul 13 14:07:19 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-29fb52de-720d-4bea-a35f-00131ebb11f1 tempest-ProjectMemberTests-718446646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-66b56421-9115-4e22-b842-60aac227ee53 1073741824 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:07:19 devstack sudo[105921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-66b56421-9115-4e22-b842-60aac227ee53 1073741824 Jul 13 14:07:19 devstack sudo[105921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:07:19 devstack sudo[105921]: pam_unix(sudo:session): session closed for user root Jul 13 14:07:19 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-29fb52de-720d-4bea-a35f-00131ebb11f1 tempest-ProjectMemberTests-718446646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-66b56421-9115-4e22-b842-60aac227ee53 1073741824" returned: 0 in 0.399s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:07:19 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-29fb52de-720d-4bea-a35f-00131ebb11f1 tempest-ProjectMemberTests-718446646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-66b56421-9115-4e22-b842-60aac227ee53 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:07:19 devstack sudo[105932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-66b56421-9115-4e22-b842-60aac227ee53 Jul 13 14:07:19 devstack sudo[105932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:07:19 devstack sudo[105932]: pam_unix(sudo:session): session closed for user root Jul 13 14:07:19 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-29fb52de-720d-4bea-a35f-00131ebb11f1 tempest-ProjectMemberTests-718446646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-66b56421-9115-4e22-b842-60aac227ee53" returned: 0 in 0.237s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:07:19 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-29fb52de-720d-4bea-a35f-00131ebb11f1 tempest-ProjectMemberTests-718446646 None] <== create_volume: return (674ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'} {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 13 14:07:19 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-29fb52de-720d-4bea-a35f-00131ebb11f1 tempest-ProjectMemberTests-718446646 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.678s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 14:07:20 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-29fb52de-720d-4bea-a35f-00131ebb11f1 tempest-ProjectMemberTests-718446646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (376c41db-f3b3-4a07-b593-4def489c02ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-66b56421-9115-4e22-b842-60aac227ee53', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:07:20 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-29fb52de-720d-4bea-a35f-00131ebb11f1 tempest-ProjectMemberTests-718446646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (629326fb-b04f-4e34-83d1-d5b57e799087) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:07:20 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-29fb52de-720d-4bea-a35f-00131ebb11f1 tempest-ProjectMemberTests-718446646 None] Volume volume-66b56421-9115-4e22-b842-60aac227ee53 (66b56421-9115-4e22-b842-60aac227ee53): created successfully Jul 13 14:07:20 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-29fb52de-720d-4bea-a35f-00131ebb11f1 tempest-ProjectMemberTests-718446646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (629326fb-b04f-4e34-83d1-d5b57e799087) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:07:20 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-29fb52de-720d-4bea-a35f-00131ebb11f1 tempest-ProjectMemberTests-718446646 None] Flow 'volume_create_manager' (6d6113fd-60b9-420d-8a29-b887d7022902) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 14:07:20 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-29fb52de-720d-4bea-a35f-00131ebb11f1 tempest-ProjectMemberTests-718446646 None] Created volume successfully. Jul 13 14:07:20 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-b32424b0-9427-4caf-916f-1b571bec392b tempest-ProjectMemberTests-718446646 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 14:07:20 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-b32424b0-9427-4caf-916f-1b571bec392b tempest-ProjectMemberTests-718446646 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 14:07:20 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-b32424b0-9427-4caf-916f-1b571bec392b tempest-ProjectMemberTests-718446646 None] Creating offline snapshot 192ae549-7f02-4d09-9b8c-7aa35f7744dd of volume 66b56421-9115-4e22-b842-60aac227ee53 {{(pid=87098) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 13 14:07:20 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[acf448a0-c0f5-42c1-b7e1-647e7550cdba]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 14:07:20 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-b32424b0-9427-4caf-916f-1b571bec392b tempest-ProjectMemberTests-718446646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-66b56421-9115-4e22-b842-60aac227ee53 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:07:20 devstack sudo[105935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-66b56421-9115-4e22-b842-60aac227ee53 Jul 13 14:07:20 devstack sudo[105935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:07:20 devstack sudo[105935]: pam_unix(sudo:session): session closed for user root Jul 13 14:07:20 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-b32424b0-9427-4caf-916f-1b571bec392b tempest-ProjectMemberTests-718446646 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-66b56421-9115-4e22-b842-60aac227ee53" returned: 0 in 0.390s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:07:20 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-b32424b0-9427-4caf-916f-1b571bec392b tempest-ProjectMemberTests-718446646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-66b56421-9115-4e22-b842-60aac227ee53,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-66b56421-9115-4e22-b842-60aac227ee53.192ae549-7f02-4d09-9b8c-7aa35f7744dd 1G {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:07:20 devstack sudo[105943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-66b56421-9115-4e22-b842-60aac227ee53,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-66b56421-9115-4e22-b842-60aac227ee53.192ae549-7f02-4d09-9b8c-7aa35f7744dd 1G Jul 13 14:07:20 devstack sudo[105943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:07:21 devstack sudo[105943]: pam_unix(sudo:session): session closed for user root Jul 13 14:07:21 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-b32424b0-9427-4caf-916f-1b571bec392b tempest-ProjectMemberTests-718446646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-66b56421-9115-4e22-b842-60aac227ee53,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-66b56421-9115-4e22-b842-60aac227ee53.192ae549-7f02-4d09-9b8c-7aa35f7744dd 1G" returned: 0 in 0.392s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:07:21 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-b32424b0-9427-4caf-916f-1b571bec392b tempest-ProjectMemberTests-718446646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-66b56421-9115-4e22-b842-60aac227ee53 -F qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-66b56421-9115-4e22-b842-60aac227ee53.192ae549-7f02-4d09-9b8c-7aa35f7744dd {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:07:21 devstack sudo[105948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-66b56421-9115-4e22-b842-60aac227ee53 -F qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-66b56421-9115-4e22-b842-60aac227ee53.192ae549-7f02-4d09-9b8c-7aa35f7744dd Jul 13 14:07:21 devstack sudo[105948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:07:21 devstack sudo[105948]: pam_unix(sudo:session): session closed for user root Jul 13 14:07:21 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-b32424b0-9427-4caf-916f-1b571bec392b tempest-ProjectMemberTests-718446646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-66b56421-9115-4e22-b842-60aac227ee53 -F qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-66b56421-9115-4e22-b842-60aac227ee53.192ae549-7f02-4d09-9b8c-7aa35f7744dd" returned: 0 in 0.281s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:07:21 devstack cinder-volume[87098]: WARNING cinder.volume.drivers.remotefs [None req-b32424b0-9427-4caf-916f-1b571bec392b tempest-ProjectMemberTests-718446646 None] /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-66b56421-9115-4e22-b842-60aac227ee53.192ae549-7f02-4d09-9b8c-7aa35f7744dd is being set with open permissions: ugo+rw Jul 13 14:07:21 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-b32424b0-9427-4caf-916f-1b571bec392b tempest-ProjectMemberTests-718446646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-66b56421-9115-4e22-b842-60aac227ee53.192ae549-7f02-4d09-9b8c-7aa35f7744dd {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:07:21 devstack sudo[105953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-66b56421-9115-4e22-b842-60aac227ee53.192ae549-7f02-4d09-9b8c-7aa35f7744dd Jul 13 14:07:21 devstack sudo[105953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:07:21 devstack sudo[105953]: pam_unix(sudo:session): session closed for user root Jul 13 14:07:21 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-b32424b0-9427-4caf-916f-1b571bec392b tempest-ProjectMemberTests-718446646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-66b56421-9115-4e22-b842-60aac227ee53.192ae549-7f02-4d09-9b8c-7aa35f7744dd" returned: 0 in 0.234s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:07:21 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-b32424b0-9427-4caf-916f-1b571bec392b tempest-ProjectMemberTests-718446646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-66b56421-9115-4e22-b842-60aac227ee53.info {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:07:21 devstack sudo[105956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-66b56421-9115-4e22-b842-60aac227ee53.info Jul 13 14:07:21 devstack sudo[105956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:07:21 devstack sudo[105956]: pam_unix(sudo:session): session closed for user root Jul 13 14:07:21 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-b32424b0-9427-4caf-916f-1b571bec392b tempest-ProjectMemberTests-718446646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-66b56421-9115-4e22-b842-60aac227ee53.info" returned: 0 in 0.237s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:07:21 devstack cinder-volume[87098]: WARNING cinder.volume.drivers.remotefs [None req-b32424b0-9427-4caf-916f-1b571bec392b tempest-ProjectMemberTests-718446646 None] /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-66b56421-9115-4e22-b842-60aac227ee53.info is being set with open permissions: ugo+rw Jul 13 14:07:21 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-b32424b0-9427-4caf-916f-1b571bec392b tempest-ProjectMemberTests-718446646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-66b56421-9115-4e22-b842-60aac227ee53.info {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:07:22 devstack sudo[105959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-66b56421-9115-4e22-b842-60aac227ee53.info Jul 13 14:07:22 devstack sudo[105959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:07:22 devstack sudo[105959]: pam_unix(sudo:session): session closed for user root Jul 13 14:07:22 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-b32424b0-9427-4caf-916f-1b571bec392b tempest-ProjectMemberTests-718446646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-66b56421-9115-4e22-b842-60aac227ee53.info" returned: 0 in 0.239s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:07:22 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-b32424b0-9427-4caf-916f-1b571bec392b tempest-ProjectMemberTests-718446646 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.847s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 14:07:22 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-b32424b0-9427-4caf-916f-1b571bec392b tempest-ProjectMemberTests-718446646 None] Create snapshot completed successfully Jul 13 14:07:22 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-9b33d671-adc7-4ebb-aa0b-12b647b44d20 tempest-ProjectMemberTests-718446646 None] Acquiring lock "cinder-192ae549-7f02-4d09-9b8c-7aa35f7744dd-delete_snapshot" by "delete_snapshot" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 14:07:22 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-9b33d671-adc7-4ebb-aa0b-12b647b44d20 tempest-ProjectMemberTests-718446646 None] Lock "cinder-192ae549-7f02-4d09-9b8c-7aa35f7744dd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 14:07:22 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-9b33d671-adc7-4ebb-aa0b-12b647b44d20 tempest-ProjectMemberTests-718446646 None] Acquiring lock "cinder-quobyte-66b56421-9115-4e22-b842-60aac227ee53" by "delete_snapshot" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 14:07:22 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-9b33d671-adc7-4ebb-aa0b-12b647b44d20 tempest-ProjectMemberTests-718446646 None] Lock "cinder-quobyte-66b56421-9115-4e22-b842-60aac227ee53" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 14:07:22 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-9b33d671-adc7-4ebb-aa0b-12b647b44d20 tempest-ProjectMemberTests-718446646 None] Acquiring lock "cinder-quobyte-192ae549-7f02-4d09-9b8c-7aa35f7744dd" by "_delete_snapshot" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 14:07:22 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-9b33d671-adc7-4ebb-aa0b-12b647b44d20 tempest-ProjectMemberTests-718446646 None] Lock "cinder-quobyte-192ae549-7f02-4d09-9b8c-7aa35f7744dd" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 14:07:22 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-9b33d671-adc7-4ebb-aa0b-12b647b44d20 tempest-ProjectMemberTests-718446646 None] Deleting offline snapshot 192ae549-7f02-4d09-9b8c-7aa35f7744dd of volume 66b56421-9115-4e22-b842-60aac227ee53 {{(pid=87098) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 13 14:07:22 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-9b33d671-adc7-4ebb-aa0b-12b647b44d20 tempest-ProjectMemberTests-718446646 None] snapshot_file for this snap is: volume-66b56421-9115-4e22-b842-60aac227ee53.192ae549-7f02-4d09-9b8c-7aa35f7744dd {{(pid=87098) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 13 14:07:22 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[5841672d-0550-4f1a-8f17-56c132fcbc9d]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 14:07:22 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-9b33d671-adc7-4ebb-aa0b-12b647b44d20 tempest-ProjectMemberTests-718446646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-66b56421-9115-4e22-b842-60aac227ee53.192ae549-7f02-4d09-9b8c-7aa35f7744dd {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:07:22 devstack sudo[105962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-66b56421-9115-4e22-b842-60aac227ee53.192ae549-7f02-4d09-9b8c-7aa35f7744dd Jul 13 14:07:22 devstack sudo[105962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:07:23 devstack sudo[105962]: pam_unix(sudo:session): session closed for user root Jul 13 14:07:23 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-9b33d671-adc7-4ebb-aa0b-12b647b44d20 tempest-ProjectMemberTests-718446646 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-66b56421-9115-4e22-b842-60aac227ee53.192ae549-7f02-4d09-9b8c-7aa35f7744dd" returned: 0 in 0.348s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:07:23 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-9b33d671-adc7-4ebb-aa0b-12b647b44d20 tempest-ProjectMemberTests-718446646 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-66b56421-9115-4e22-b842-60aac227ee53(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87098) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 13 14:07:23 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[54abcf5c-6499-44b7-a253-0446e93d4005]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 14:07:23 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-9b33d671-adc7-4ebb-aa0b-12b647b44d20 tempest-ProjectMemberTests-718446646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-66b56421-9115-4e22-b842-60aac227ee53 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:07:23 devstack sudo[105967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-66b56421-9115-4e22-b842-60aac227ee53 Jul 13 14:07:23 devstack sudo[105967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:07:23 devstack sudo[105967]: pam_unix(sudo:session): session closed for user root Jul 13 14:07:23 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-9b33d671-adc7-4ebb-aa0b-12b647b44d20 tempest-ProjectMemberTests-718446646 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-66b56421-9115-4e22-b842-60aac227ee53" returned: 0 in 0.349s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:07:23 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-9b33d671-adc7-4ebb-aa0b-12b647b44d20 tempest-ProjectMemberTests-718446646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-66b56421-9115-4e22-b842-60aac227ee53.192ae549-7f02-4d09-9b8c-7aa35f7744dd {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:07:23 devstack sudo[105972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-66b56421-9115-4e22-b842-60aac227ee53.192ae549-7f02-4d09-9b8c-7aa35f7744dd Jul 13 14:07:23 devstack sudo[105972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:07:23 devstack sudo[105972]: pam_unix(sudo:session): session closed for user root Jul 13 14:07:23 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-9b33d671-adc7-4ebb-aa0b-12b647b44d20 tempest-ProjectMemberTests-718446646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-66b56421-9115-4e22-b842-60aac227ee53.192ae549-7f02-4d09-9b8c-7aa35f7744dd" returned: 0 in 0.329s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:07:23 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-9b33d671-adc7-4ebb-aa0b-12b647b44d20 tempest-ProjectMemberTests-718446646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-66b56421-9115-4e22-b842-60aac227ee53.192ae549-7f02-4d09-9b8c-7aa35f7744dd {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:07:23 devstack sudo[105977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-66b56421-9115-4e22-b842-60aac227ee53.192ae549-7f02-4d09-9b8c-7aa35f7744dd Jul 13 14:07:23 devstack sudo[105977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:07:23 devstack sudo[105977]: pam_unix(sudo:session): session closed for user root Jul 13 14:07:23 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-9b33d671-adc7-4ebb-aa0b-12b647b44d20 tempest-ProjectMemberTests-718446646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-66b56421-9115-4e22-b842-60aac227ee53.192ae549-7f02-4d09-9b8c-7aa35f7744dd" returned: 0 in 0.240s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:07:24 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-9b33d671-adc7-4ebb-aa0b-12b647b44d20 tempest-ProjectMemberTests-718446646 None] Lock "cinder-quobyte-192ae549-7f02-4d09-9b8c-7aa35f7744dd" released by "_delete_snapshot" :: held 1.356s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 14:07:24 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-9b33d671-adc7-4ebb-aa0b-12b647b44d20 tempest-ProjectMemberTests-718446646 None] Lock "cinder-quobyte-66b56421-9115-4e22-b842-60aac227ee53" released by "delete_snapshot" :: held 1.375s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 14:07:24 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-9b33d671-adc7-4ebb-aa0b-12b647b44d20 tempest-ProjectMemberTests-718446646 None] Created reservations ['1d1eb5a6-9c81-4f1d-a6f8-26c5de3a5d62', '33299adb-ca75-458c-93cf-84bf53d877f6', '2c748bcd-4900-4dca-826a-c004a5f848cc', 'fff23c73-e93e-4ebb-95a5-a29af0516bac'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 14:07:24 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-9b33d671-adc7-4ebb-aa0b-12b647b44d20 tempest-ProjectMemberTests-718446646 None] Delete snapshot completed successfully. Jul 13 14:07:24 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-9b33d671-adc7-4ebb-aa0b-12b647b44d20 tempest-ProjectMemberTests-718446646 None] Lock "cinder-192ae549-7f02-4d09-9b8c-7aa35f7744dd-delete_snapshot" released by "delete_snapshot" :: held 1.508s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 14:07:24 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-d9045da0-7822-47fb-a3fc-a1f28c4f9d1b tempest-ProjectMemberTests-718446646 None] Acquiring lock "cinder-66b56421-9115-4e22-b842-60aac227ee53-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 14:07:24 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-d9045da0-7822-47fb-a3fc-a1f28c4f9d1b tempest-ProjectMemberTests-718446646 None] Lock "cinder-66b56421-9115-4e22-b842-60aac227ee53-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 14:07:24 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-d9045da0-7822-47fb-a3fc-a1f28c4f9d1b tempest-ProjectMemberTests-718446646 None] Acquiring lock "cinder-quobyte-66b56421-9115-4e22-b842-60aac227ee53" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 14:07:24 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-d9045da0-7822-47fb-a3fc-a1f28c4f9d1b tempest-ProjectMemberTests-718446646 None] Lock "cinder-quobyte-66b56421-9115-4e22-b842-60aac227ee53" acquired by "delete_volume" :: waited 0.013s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 14:07:24 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[0120be0f-d758-489b-a96c-fecef7227341]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 14:07:24 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-d9045da0-7822-47fb-a3fc-a1f28c4f9d1b tempest-ProjectMemberTests-718446646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-66b56421-9115-4e22-b842-60aac227ee53 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:07:24 devstack sudo[105980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-66b56421-9115-4e22-b842-60aac227ee53 Jul 13 14:07:24 devstack sudo[105980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:07:25 devstack sudo[105980]: pam_unix(sudo:session): session closed for user root Jul 13 14:07:25 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-d9045da0-7822-47fb-a3fc-a1f28c4f9d1b tempest-ProjectMemberTests-718446646 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-66b56421-9115-4e22-b842-60aac227ee53" returned: 0 in 0.347s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:07:25 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-d9045da0-7822-47fb-a3fc-a1f28c4f9d1b tempest-ProjectMemberTests-718446646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-66b56421-9115-4e22-b842-60aac227ee53 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:07:25 devstack sudo[105985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-66b56421-9115-4e22-b842-60aac227ee53 Jul 13 14:07:25 devstack sudo[105985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:07:25 devstack sudo[105985]: pam_unix(sudo:session): session closed for user root Jul 13 14:07:25 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-d9045da0-7822-47fb-a3fc-a1f28c4f9d1b tempest-ProjectMemberTests-718446646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-66b56421-9115-4e22-b842-60aac227ee53" returned: 0 in 0.243s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:07:25 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-d9045da0-7822-47fb-a3fc-a1f28c4f9d1b tempest-ProjectMemberTests-718446646 None] Lock "cinder-quobyte-66b56421-9115-4e22-b842-60aac227ee53" released by "delete_volume" :: held 0.642s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 14:07:25 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-d9045da0-7822-47fb-a3fc-a1f28c4f9d1b tempest-ProjectMemberTests-718446646 None] Created reservations ['7c7b8278-1dea-4427-8a3c-46b547de3065', 'f0fe6fff-e566-4bff-a047-844e3196362a', 'fedb3c6f-9d18-4ac1-aedd-321db55123dd', '869d020e-cef1-4bef-ba52-0d80d2108176'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 14:07:25 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-d9045da0-7822-47fb-a3fc-a1f28c4f9d1b tempest-ProjectMemberTests-718446646 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 14:07:25 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-d9045da0-7822-47fb-a3fc-a1f28c4f9d1b tempest-ProjectMemberTests-718446646 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 14:07:25 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-d9045da0-7822-47fb-a3fc-a1f28c4f9d1b tempest-ProjectMemberTests-718446646 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 14:07:25 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-d9045da0-7822-47fb-a3fc-a1f28c4f9d1b tempest-ProjectMemberTests-718446646 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 14:07:25 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-d9045da0-7822-47fb-a3fc-a1f28c4f9d1b tempest-ProjectMemberTests-718446646 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 14:07:25 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-d9045da0-7822-47fb-a3fc-a1f28c4f9d1b tempest-ProjectMemberTests-718446646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:07:25 devstack sudo[105988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 Jul 13 14:07:25 devstack sudo[105988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:07:25 devstack sudo[105988]: pam_unix(sudo:session): session closed for user root Jul 13 14:07:25 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-d9045da0-7822-47fb-a3fc-a1f28c4f9d1b tempest-ProjectMemberTests-718446646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78" returned: 0 in 0.239s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:07:25 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-d9045da0-7822-47fb-a3fc-a1f28c4f9d1b tempest-ProjectMemberTests-718446646 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 14:07:25 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-d9045da0-7822-47fb-a3fc-a1f28c4f9d1b tempest-ProjectMemberTests-718446646 None] Deleted volume successfully. Jul 13 14:07:25 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-d9045da0-7822-47fb-a3fc-a1f28c4f9d1b tempest-ProjectMemberTests-718446646 None] Lock "cinder-66b56421-9115-4e22-b842-60aac227ee53-delete_volume" released by "delete_volume" :: held 1.068s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 14:07:29 devstack cinder-volume[87098]: DEBUG oslo_service.periodic_task [None req-727a1692-ea28-4a77-b327-0d94e8f01efb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87098) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 13 14:07:29 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-727a1692-ea28-4a77-b327-0d94e8f01efb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 14:07:29 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-727a1692-ea28-4a77-b327-0d94e8f01efb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 14:07:29 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-727a1692-ea28-4a77-b327-0d94e8f01efb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 14:07:29 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-727a1692-ea28-4a77-b327-0d94e8f01efb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 14:07:29 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-727a1692-ea28-4a77-b327-0d94e8f01efb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 14:07:29 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-727a1692-ea28-4a77-b327-0d94e8f01efb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:07:29 devstack sudo[105992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 Jul 13 14:07:29 devstack sudo[105992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:07:29 devstack sudo[105992]: pam_unix(sudo:session): session closed for user root Jul 13 14:07:29 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-727a1692-ea28-4a77-b327-0d94e8f01efb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78" returned: 0 in 0.256s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:07:29 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-727a1692-ea28-4a77-b327-0d94e8f01efb None None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 14:07:29 devstack cinder-volume[87098]: DEBUG oslo_service.periodic_task [None req-727a1692-ea28-4a77-b327-0d94e8f01efb None None] Running periodic task VolumeManager._thread_info {{(pid=87098) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 13 14:07:29 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-727a1692-ea28-4a77-b327-0d94e8f01efb None None] thread count: 28 {{(pid=87098) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 13 14:07:29 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-727a1692-ea28-4a77-b327-0d94e8f01efb None None] thread info: [<_MainThread(MainThread, started 127988054597760)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87098) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 13 14:07:29 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb810f6e-2d24-4b57-911f-1947fdf2fc5e tempest-ProjectReaderTests-1270836308 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 14:07:29 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-fb810f6e-2d24-4b57-911f-1947fdf2fc5e tempest-ProjectReaderTests-1270836308 None] Flow 'volume_create_manager' (fbaf5be4-119a-4dcd-b89a-f07dbaaa84eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 14:07:29 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-fb810f6e-2d24-4b57-911f-1947fdf2fc5e tempest-ProjectReaderTests-1270836308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (601026fe-4ae4-4ddb-8542-00a75a2674d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:07:29 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-fb810f6e-2d24-4b57-911f-1947fdf2fc5e tempest-ProjectReaderTests-1270836308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (601026fe-4ae4-4ddb-8542-00a75a2674d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T12:07:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-551187346',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07a74b19-eb2d-456a-8b11-9c23c7938391,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5612681542240199a2dae951a562fb6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T12:07:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T12:07:29Z,use_quota=True,user_id='81e774189ca14036a506f36d525af45e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1147de8b-623b-426c-a13d-7fc824a80f67),volume_type_id=1147de8b-623b-426c-a13d-7fc824a80f67)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:07:29 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-fb810f6e-2d24-4b57-911f-1947fdf2fc5e tempest-ProjectReaderTests-1270836308 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06633f74-bc38-408c-bb18-6bca3c56811f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:07:29 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-fb810f6e-2d24-4b57-911f-1947fdf2fc5e tempest-ProjectReaderTests-1270836308 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06633f74-bc38-408c-bb18-6bca3c56811f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:07:29 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-fb810f6e-2d24-4b57-911f-1947fdf2fc5e tempest-ProjectReaderTests-1270836308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7420afab-0728-42f4-af51-c6834b91dbfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:07:29 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-fb810f6e-2d24-4b57-911f-1947fdf2fc5e tempest-ProjectReaderTests-1270836308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7420afab-0728-42f4-af51-c6834b91dbfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '07a74b19-eb2d-456a-8b11-9c23c7938391', 'volume_name': 'volume-07a74b19-eb2d-456a-8b11-9c23c7938391', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:07:29 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-fb810f6e-2d24-4b57-911f-1947fdf2fc5e tempest-ProjectReaderTests-1270836308 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7408a0f4-7b6d-47a0-a338-892ffe278d01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:07:29 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-fb810f6e-2d24-4b57-911f-1947fdf2fc5e tempest-ProjectReaderTests-1270836308 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7408a0f4-7b6d-47a0-a338-892ffe278d01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:07:29 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-fb810f6e-2d24-4b57-911f-1947fdf2fc5e tempest-ProjectReaderTests-1270836308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56622a18-5781-4cdf-beec-d67fec7b353f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:07:29 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-fb810f6e-2d24-4b57-911f-1947fdf2fc5e tempest-ProjectReaderTests-1270836308 None] Volume 07a74b19-eb2d-456a-8b11-9c23c7938391: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-07a74b19-eb2d-456a-8b11-9c23c7938391', 'volume_size': 1} Jul 13 14:07:29 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-fb810f6e-2d24-4b57-911f-1947fdf2fc5e tempest-ProjectReaderTests-1270836308 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 14:07:29 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-fb810f6e-2d24-4b57-911f-1947fdf2fc5e tempest-ProjectReaderTests-1270836308 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 14:07:29 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-fb810f6e-2d24-4b57-911f-1947fdf2fc5e tempest-ProjectReaderTests-1270836308 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T12:07:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-551187346',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07a74b19-eb2d-456a-8b11-9c23c7938391,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5612681542240199a2dae951a562fb6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T12:07:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T12:07:29Z,use_quota=True,user_id='81e774189ca14036a506f36d525af45e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1147de8b-623b-426c-a13d-7fc824a80f67),volume_type_id=1147de8b-623b-426c-a13d-7fc824a80f67)}" {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 13 14:07:29 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-fb810f6e-2d24-4b57-911f-1947fdf2fc5e tempest-ProjectReaderTests-1270836308 None] Creating volume 07a74b19-eb2d-456a-8b11-9c23c7938391 {{(pid=87098) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 13 14:07:29 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-fb810f6e-2d24-4b57-911f-1947fdf2fc5e tempest-ProjectReaderTests-1270836308 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 14:07:29 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-fb810f6e-2d24-4b57-911f-1947fdf2fc5e tempest-ProjectReaderTests-1270836308 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 14:07:29 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-fb810f6e-2d24-4b57-911f-1947fdf2fc5e tempest-ProjectReaderTests-1270836308 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 14:07:29 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-fb810f6e-2d24-4b57-911f-1947fdf2fc5e tempest-ProjectReaderTests-1270836308 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 14:07:29 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-fb810f6e-2d24-4b57-911f-1947fdf2fc5e tempest-ProjectReaderTests-1270836308 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 14:07:29 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-fb810f6e-2d24-4b57-911f-1947fdf2fc5e tempest-ProjectReaderTests-1270836308 None] Selected osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 14:07:29 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-fb810f6e-2d24-4b57-911f-1947fdf2fc5e tempest-ProjectReaderTests-1270836308 None] casted to osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 Jul 13 14:07:29 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-fb810f6e-2d24-4b57-911f-1947fdf2fc5e tempest-ProjectReaderTests-1270836308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-07a74b19-eb2d-456a-8b11-9c23c7938391 1073741824 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:07:29 devstack sudo[105995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-07a74b19-eb2d-456a-8b11-9c23c7938391 1073741824 Jul 13 14:07:29 devstack sudo[105995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:07:29 devstack sudo[105995]: pam_unix(sudo:session): session closed for user root Jul 13 14:07:29 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-fb810f6e-2d24-4b57-911f-1947fdf2fc5e tempest-ProjectReaderTests-1270836308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-07a74b19-eb2d-456a-8b11-9c23c7938391 1073741824" returned: 0 in 0.411s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:07:30 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-fb810f6e-2d24-4b57-911f-1947fdf2fc5e tempest-ProjectReaderTests-1270836308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-07a74b19-eb2d-456a-8b11-9c23c7938391 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:07:30 devstack sudo[106001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-07a74b19-eb2d-456a-8b11-9c23c7938391 Jul 13 14:07:30 devstack sudo[106001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:07:30 devstack sudo[106001]: pam_unix(sudo:session): session closed for user root Jul 13 14:07:30 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-fb810f6e-2d24-4b57-911f-1947fdf2fc5e tempest-ProjectReaderTests-1270836308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-07a74b19-eb2d-456a-8b11-9c23c7938391" returned: 0 in 0.240s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:07:30 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-fb810f6e-2d24-4b57-911f-1947fdf2fc5e tempest-ProjectReaderTests-1270836308 None] <== create_volume: return (688ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'} {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 13 14:07:30 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-fb810f6e-2d24-4b57-911f-1947fdf2fc5e tempest-ProjectReaderTests-1270836308 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.691s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 14:07:30 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-fb810f6e-2d24-4b57-911f-1947fdf2fc5e tempest-ProjectReaderTests-1270836308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56622a18-5781-4cdf-beec-d67fec7b353f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-07a74b19-eb2d-456a-8b11-9c23c7938391', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:07:30 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-fb810f6e-2d24-4b57-911f-1947fdf2fc5e tempest-ProjectReaderTests-1270836308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9cb1f53-95b6-4481-929b-c2135e1e3244) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:07:30 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-fb810f6e-2d24-4b57-911f-1947fdf2fc5e tempest-ProjectReaderTests-1270836308 None] Volume volume-07a74b19-eb2d-456a-8b11-9c23c7938391 (07a74b19-eb2d-456a-8b11-9c23c7938391): created successfully Jul 13 14:07:30 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-fb810f6e-2d24-4b57-911f-1947fdf2fc5e tempest-ProjectReaderTests-1270836308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9cb1f53-95b6-4481-929b-c2135e1e3244) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:07:30 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-fb810f6e-2d24-4b57-911f-1947fdf2fc5e tempest-ProjectReaderTests-1270836308 None] Flow 'volume_create_manager' (fbaf5be4-119a-4dcd-b89a-f07dbaaa84eb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 14:07:30 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-fb810f6e-2d24-4b57-911f-1947fdf2fc5e tempest-ProjectReaderTests-1270836308 None] Created volume successfully. Jul 13 14:07:30 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-8e8b5571-864f-4036-85bc-787b4f8e8d4f tempest-ProjectReaderTests-1270836308 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 14:07:30 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-8e8b5571-864f-4036-85bc-787b4f8e8d4f tempest-ProjectReaderTests-1270836308 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 14:07:30 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-8e8b5571-864f-4036-85bc-787b4f8e8d4f tempest-ProjectReaderTests-1270836308 None] Creating offline snapshot df19777c-ab09-46a3-b04d-ab4903dd7819 of volume 07a74b19-eb2d-456a-8b11-9c23c7938391 {{(pid=87098) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 13 14:07:30 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a465996-232a-4fb2-a977-1e5913a98830]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 14:07:30 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-8e8b5571-864f-4036-85bc-787b4f8e8d4f tempest-ProjectReaderTests-1270836308 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-07a74b19-eb2d-456a-8b11-9c23c7938391 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:07:30 devstack sudo[106004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-07a74b19-eb2d-456a-8b11-9c23c7938391 Jul 13 14:07:30 devstack sudo[106004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:07:31 devstack sudo[106004]: pam_unix(sudo:session): session closed for user root Jul 13 14:07:31 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-8e8b5571-864f-4036-85bc-787b4f8e8d4f tempest-ProjectReaderTests-1270836308 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-07a74b19-eb2d-456a-8b11-9c23c7938391" returned: 0 in 0.342s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:07:31 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-8e8b5571-864f-4036-85bc-787b4f8e8d4f tempest-ProjectReaderTests-1270836308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-07a74b19-eb2d-456a-8b11-9c23c7938391,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-07a74b19-eb2d-456a-8b11-9c23c7938391.df19777c-ab09-46a3-b04d-ab4903dd7819 1G {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:07:31 devstack sudo[106009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-07a74b19-eb2d-456a-8b11-9c23c7938391,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-07a74b19-eb2d-456a-8b11-9c23c7938391.df19777c-ab09-46a3-b04d-ab4903dd7819 1G Jul 13 14:07:31 devstack sudo[106009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:07:31 devstack sudo[106009]: pam_unix(sudo:session): session closed for user root Jul 13 14:07:31 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-8e8b5571-864f-4036-85bc-787b4f8e8d4f tempest-ProjectReaderTests-1270836308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-07a74b19-eb2d-456a-8b11-9c23c7938391,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-07a74b19-eb2d-456a-8b11-9c23c7938391.df19777c-ab09-46a3-b04d-ab4903dd7819 1G" returned: 0 in 0.393s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:07:31 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-8e8b5571-864f-4036-85bc-787b4f8e8d4f tempest-ProjectReaderTests-1270836308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-07a74b19-eb2d-456a-8b11-9c23c7938391 -F qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-07a74b19-eb2d-456a-8b11-9c23c7938391.df19777c-ab09-46a3-b04d-ab4903dd7819 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:07:31 devstack sudo[106014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-07a74b19-eb2d-456a-8b11-9c23c7938391 -F qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-07a74b19-eb2d-456a-8b11-9c23c7938391.df19777c-ab09-46a3-b04d-ab4903dd7819 Jul 13 14:07:31 devstack sudo[106014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:07:31 devstack sudo[106014]: pam_unix(sudo:session): session closed for user root Jul 13 14:07:31 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-8e8b5571-864f-4036-85bc-787b4f8e8d4f tempest-ProjectReaderTests-1270836308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-07a74b19-eb2d-456a-8b11-9c23c7938391 -F qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-07a74b19-eb2d-456a-8b11-9c23c7938391.df19777c-ab09-46a3-b04d-ab4903dd7819" returned: 0 in 0.282s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:07:31 devstack cinder-volume[87098]: WARNING cinder.volume.drivers.remotefs [None req-8e8b5571-864f-4036-85bc-787b4f8e8d4f tempest-ProjectReaderTests-1270836308 None] /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-07a74b19-eb2d-456a-8b11-9c23c7938391.df19777c-ab09-46a3-b04d-ab4903dd7819 is being set with open permissions: ugo+rw Jul 13 14:07:31 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-8e8b5571-864f-4036-85bc-787b4f8e8d4f tempest-ProjectReaderTests-1270836308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-07a74b19-eb2d-456a-8b11-9c23c7938391.df19777c-ab09-46a3-b04d-ab4903dd7819 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:07:31 devstack sudo[106019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-07a74b19-eb2d-456a-8b11-9c23c7938391.df19777c-ab09-46a3-b04d-ab4903dd7819 Jul 13 14:07:31 devstack sudo[106019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:07:31 devstack sudo[106019]: pam_unix(sudo:session): session closed for user root Jul 13 14:07:31 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-8e8b5571-864f-4036-85bc-787b4f8e8d4f tempest-ProjectReaderTests-1270836308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-07a74b19-eb2d-456a-8b11-9c23c7938391.df19777c-ab09-46a3-b04d-ab4903dd7819" returned: 0 in 0.233s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:07:31 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-8e8b5571-864f-4036-85bc-787b4f8e8d4f tempest-ProjectReaderTests-1270836308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-07a74b19-eb2d-456a-8b11-9c23c7938391.info {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:07:31 devstack sudo[106022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-07a74b19-eb2d-456a-8b11-9c23c7938391.info Jul 13 14:07:31 devstack sudo[106022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:07:32 devstack sudo[106022]: pam_unix(sudo:session): session closed for user root Jul 13 14:07:32 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-8e8b5571-864f-4036-85bc-787b4f8e8d4f tempest-ProjectReaderTests-1270836308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-07a74b19-eb2d-456a-8b11-9c23c7938391.info" returned: 0 in 0.260s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:07:32 devstack cinder-volume[87098]: WARNING cinder.volume.drivers.remotefs [None req-8e8b5571-864f-4036-85bc-787b4f8e8d4f tempest-ProjectReaderTests-1270836308 None] /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-07a74b19-eb2d-456a-8b11-9c23c7938391.info is being set with open permissions: ugo+rw Jul 13 14:07:32 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-8e8b5571-864f-4036-85bc-787b4f8e8d4f tempest-ProjectReaderTests-1270836308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-07a74b19-eb2d-456a-8b11-9c23c7938391.info {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:07:32 devstack sudo[106025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-07a74b19-eb2d-456a-8b11-9c23c7938391.info Jul 13 14:07:32 devstack sudo[106025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:07:32 devstack sudo[106025]: pam_unix(sudo:session): session closed for user root Jul 13 14:07:32 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-8e8b5571-864f-4036-85bc-787b4f8e8d4f tempest-ProjectReaderTests-1270836308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-07a74b19-eb2d-456a-8b11-9c23c7938391.info" returned: 0 in 0.238s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:07:32 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-8e8b5571-864f-4036-85bc-787b4f8e8d4f tempest-ProjectReaderTests-1270836308 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.824s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 14:07:32 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-8e8b5571-864f-4036-85bc-787b4f8e8d4f tempest-ProjectReaderTests-1270836308 None] Create snapshot completed successfully Jul 13 14:07:32 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-addb23e8-50d7-43cf-9dee-f16f3dbde792 tempest-ProjectReaderTests-1270836308 None] Acquiring lock "cinder-df19777c-ab09-46a3-b04d-ab4903dd7819-delete_snapshot" by "delete_snapshot" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 14:07:32 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-addb23e8-50d7-43cf-9dee-f16f3dbde792 tempest-ProjectReaderTests-1270836308 None] Lock "cinder-df19777c-ab09-46a3-b04d-ab4903dd7819-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 14:07:32 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-addb23e8-50d7-43cf-9dee-f16f3dbde792 tempest-ProjectReaderTests-1270836308 None] Acquiring lock "cinder-quobyte-07a74b19-eb2d-456a-8b11-9c23c7938391" by "delete_snapshot" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 14:07:32 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-addb23e8-50d7-43cf-9dee-f16f3dbde792 tempest-ProjectReaderTests-1270836308 None] Lock "cinder-quobyte-07a74b19-eb2d-456a-8b11-9c23c7938391" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 14:07:32 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-addb23e8-50d7-43cf-9dee-f16f3dbde792 tempest-ProjectReaderTests-1270836308 None] Acquiring lock "cinder-quobyte-df19777c-ab09-46a3-b04d-ab4903dd7819" by "_delete_snapshot" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 14:07:32 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-addb23e8-50d7-43cf-9dee-f16f3dbde792 tempest-ProjectReaderTests-1270836308 None] Lock "cinder-quobyte-df19777c-ab09-46a3-b04d-ab4903dd7819" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 14:07:32 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-addb23e8-50d7-43cf-9dee-f16f3dbde792 tempest-ProjectReaderTests-1270836308 None] Deleting offline snapshot df19777c-ab09-46a3-b04d-ab4903dd7819 of volume 07a74b19-eb2d-456a-8b11-9c23c7938391 {{(pid=87098) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 13 14:07:32 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-addb23e8-50d7-43cf-9dee-f16f3dbde792 tempest-ProjectReaderTests-1270836308 None] snapshot_file for this snap is: volume-07a74b19-eb2d-456a-8b11-9c23c7938391.df19777c-ab09-46a3-b04d-ab4903dd7819 {{(pid=87098) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 13 14:07:32 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f992816-f249-4954-b323-e6cd4343abd1]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 14:07:32 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-addb23e8-50d7-43cf-9dee-f16f3dbde792 tempest-ProjectReaderTests-1270836308 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-07a74b19-eb2d-456a-8b11-9c23c7938391.df19777c-ab09-46a3-b04d-ab4903dd7819 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:07:33 devstack sudo[106028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-07a74b19-eb2d-456a-8b11-9c23c7938391.df19777c-ab09-46a3-b04d-ab4903dd7819 Jul 13 14:07:33 devstack sudo[106028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:07:33 devstack sudo[106028]: pam_unix(sudo:session): session closed for user root Jul 13 14:07:33 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-addb23e8-50d7-43cf-9dee-f16f3dbde792 tempest-ProjectReaderTests-1270836308 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-07a74b19-eb2d-456a-8b11-9c23c7938391.df19777c-ab09-46a3-b04d-ab4903dd7819" returned: 0 in 0.347s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:07:33 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-addb23e8-50d7-43cf-9dee-f16f3dbde792 tempest-ProjectReaderTests-1270836308 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-07a74b19-eb2d-456a-8b11-9c23c7938391(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87098) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 13 14:07:33 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[d132ac19-58bc-443f-bfb1-6fdca46d4040]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 14:07:33 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-addb23e8-50d7-43cf-9dee-f16f3dbde792 tempest-ProjectReaderTests-1270836308 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-07a74b19-eb2d-456a-8b11-9c23c7938391 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:07:33 devstack sudo[106033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-07a74b19-eb2d-456a-8b11-9c23c7938391 Jul 13 14:07:33 devstack sudo[106033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:07:33 devstack sudo[106033]: pam_unix(sudo:session): session closed for user root Jul 13 14:07:33 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-addb23e8-50d7-43cf-9dee-f16f3dbde792 tempest-ProjectReaderTests-1270836308 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-07a74b19-eb2d-456a-8b11-9c23c7938391" returned: 0 in 0.347s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:07:33 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-addb23e8-50d7-43cf-9dee-f16f3dbde792 tempest-ProjectReaderTests-1270836308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-07a74b19-eb2d-456a-8b11-9c23c7938391.df19777c-ab09-46a3-b04d-ab4903dd7819 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:07:33 devstack sudo[106038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-07a74b19-eb2d-456a-8b11-9c23c7938391.df19777c-ab09-46a3-b04d-ab4903dd7819 Jul 13 14:07:33 devstack sudo[106038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:07:33 devstack sudo[106038]: pam_unix(sudo:session): session closed for user root Jul 13 14:07:33 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-addb23e8-50d7-43cf-9dee-f16f3dbde792 tempest-ProjectReaderTests-1270836308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-07a74b19-eb2d-456a-8b11-9c23c7938391.df19777c-ab09-46a3-b04d-ab4903dd7819" returned: 0 in 0.330s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:07:33 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-addb23e8-50d7-43cf-9dee-f16f3dbde792 tempest-ProjectReaderTests-1270836308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-07a74b19-eb2d-456a-8b11-9c23c7938391.df19777c-ab09-46a3-b04d-ab4903dd7819 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:07:34 devstack sudo[106044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-07a74b19-eb2d-456a-8b11-9c23c7938391.df19777c-ab09-46a3-b04d-ab4903dd7819 Jul 13 14:07:34 devstack sudo[106044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:07:34 devstack sudo[106044]: pam_unix(sudo:session): session closed for user root Jul 13 14:07:34 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-addb23e8-50d7-43cf-9dee-f16f3dbde792 tempest-ProjectReaderTests-1270836308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-07a74b19-eb2d-456a-8b11-9c23c7938391.df19777c-ab09-46a3-b04d-ab4903dd7819" returned: 0 in 0.240s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:07:34 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-addb23e8-50d7-43cf-9dee-f16f3dbde792 tempest-ProjectReaderTests-1270836308 None] Lock "cinder-quobyte-df19777c-ab09-46a3-b04d-ab4903dd7819" released by "_delete_snapshot" :: held 1.346s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 14:07:34 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-addb23e8-50d7-43cf-9dee-f16f3dbde792 tempest-ProjectReaderTests-1270836308 None] Lock "cinder-quobyte-07a74b19-eb2d-456a-8b11-9c23c7938391" released by "delete_snapshot" :: held 1.366s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 14:07:34 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-addb23e8-50d7-43cf-9dee-f16f3dbde792 tempest-ProjectReaderTests-1270836308 None] Created reservations ['1c517c12-173a-4479-a671-7c6cdcf810c5', 'ecc9c5f3-22db-44fc-b25d-a9b19a2da99d', 'e9635278-a4e9-486f-a839-a25b64736407', 'bc3e6ef9-00e8-4bb2-aa30-8b42cc0002bb'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 14:07:34 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-addb23e8-50d7-43cf-9dee-f16f3dbde792 tempest-ProjectReaderTests-1270836308 None] Delete snapshot completed successfully. Jul 13 14:07:34 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-addb23e8-50d7-43cf-9dee-f16f3dbde792 tempest-ProjectReaderTests-1270836308 None] Lock "cinder-df19777c-ab09-46a3-b04d-ab4903dd7819-delete_snapshot" released by "delete_snapshot" :: held 1.491s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 14:07:35 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-15bf8151-fa71-49cf-be9c-e81ddef52803 tempest-ProjectReaderTests-1270836308 None] Acquiring lock "cinder-07a74b19-eb2d-456a-8b11-9c23c7938391-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 14:07:35 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-15bf8151-fa71-49cf-be9c-e81ddef52803 tempest-ProjectReaderTests-1270836308 None] Lock "cinder-07a74b19-eb2d-456a-8b11-9c23c7938391-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 14:07:35 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-15bf8151-fa71-49cf-be9c-e81ddef52803 tempest-ProjectReaderTests-1270836308 None] Acquiring lock "cinder-quobyte-07a74b19-eb2d-456a-8b11-9c23c7938391" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 14:07:35 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-15bf8151-fa71-49cf-be9c-e81ddef52803 tempest-ProjectReaderTests-1270836308 None] Lock "cinder-quobyte-07a74b19-eb2d-456a-8b11-9c23c7938391" acquired by "delete_volume" :: waited 0.015s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 14:07:35 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[fca390ca-85d1-459c-a484-385580097169]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 14:07:35 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-15bf8151-fa71-49cf-be9c-e81ddef52803 tempest-ProjectReaderTests-1270836308 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-07a74b19-eb2d-456a-8b11-9c23c7938391 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:07:35 devstack sudo[106047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-07a74b19-eb2d-456a-8b11-9c23c7938391 Jul 13 14:07:35 devstack sudo[106047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:07:35 devstack sudo[106047]: pam_unix(sudo:session): session closed for user root Jul 13 14:07:35 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-15bf8151-fa71-49cf-be9c-e81ddef52803 tempest-ProjectReaderTests-1270836308 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-07a74b19-eb2d-456a-8b11-9c23c7938391" returned: 0 in 0.338s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:07:35 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-15bf8151-fa71-49cf-be9c-e81ddef52803 tempest-ProjectReaderTests-1270836308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-07a74b19-eb2d-456a-8b11-9c23c7938391 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:07:35 devstack sudo[106052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-07a74b19-eb2d-456a-8b11-9c23c7938391 Jul 13 14:07:35 devstack sudo[106052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:07:35 devstack sudo[106052]: pam_unix(sudo:session): session closed for user root Jul 13 14:07:35 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-15bf8151-fa71-49cf-be9c-e81ddef52803 tempest-ProjectReaderTests-1270836308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-07a74b19-eb2d-456a-8b11-9c23c7938391" returned: 0 in 0.241s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:07:35 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-15bf8151-fa71-49cf-be9c-e81ddef52803 tempest-ProjectReaderTests-1270836308 None] Lock "cinder-quobyte-07a74b19-eb2d-456a-8b11-9c23c7938391" released by "delete_volume" :: held 0.639s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 14:07:35 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-15bf8151-fa71-49cf-be9c-e81ddef52803 tempest-ProjectReaderTests-1270836308 None] Created reservations ['3c247c74-6a16-42dd-8b9c-6f462b6736ed', 'd7bb966a-8d7b-48a3-89cc-a67b6d929cb7', '3d87a7be-5396-4ffc-892d-000552c25dc6', '6d45a139-72f0-4a3a-b84b-e0dc4aee382b'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 14:07:35 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-15bf8151-fa71-49cf-be9c-e81ddef52803 tempest-ProjectReaderTests-1270836308 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 14:07:35 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-15bf8151-fa71-49cf-be9c-e81ddef52803 tempest-ProjectReaderTests-1270836308 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 14:07:35 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-15bf8151-fa71-49cf-be9c-e81ddef52803 tempest-ProjectReaderTests-1270836308 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 14:07:35 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-15bf8151-fa71-49cf-be9c-e81ddef52803 tempest-ProjectReaderTests-1270836308 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 14:07:35 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-15bf8151-fa71-49cf-be9c-e81ddef52803 tempest-ProjectReaderTests-1270836308 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 14:07:35 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-15bf8151-fa71-49cf-be9c-e81ddef52803 tempest-ProjectReaderTests-1270836308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:07:35 devstack sudo[106055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 Jul 13 14:07:35 devstack sudo[106055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:07:36 devstack sudo[106055]: pam_unix(sudo:session): session closed for user root Jul 13 14:07:36 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-15bf8151-fa71-49cf-be9c-e81ddef52803 tempest-ProjectReaderTests-1270836308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78" returned: 0 in 0.240s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:07:36 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-15bf8151-fa71-49cf-be9c-e81ddef52803 tempest-ProjectReaderTests-1270836308 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 14:07:36 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-15bf8151-fa71-49cf-be9c-e81ddef52803 tempest-ProjectReaderTests-1270836308 None] Deleted volume successfully. Jul 13 14:07:36 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-15bf8151-fa71-49cf-be9c-e81ddef52803 tempest-ProjectReaderTests-1270836308 None] Lock "cinder-07a74b19-eb2d-456a-8b11-9c23c7938391-delete_volume" released by "delete_volume" :: held 1.070s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 14:07:36 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-41d65da4-c0fd-4dbc-ad3f-dbec1b6293fd tempest-ProjectReaderTests-1270836308 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 14:07:36 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-41d65da4-c0fd-4dbc-ad3f-dbec1b6293fd tempest-ProjectReaderTests-1270836308 None] Flow 'volume_create_manager' (7efb55ba-b8a7-40ef-b084-74ac968a0607) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 14:07:36 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-41d65da4-c0fd-4dbc-ad3f-dbec1b6293fd tempest-ProjectReaderTests-1270836308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21854813-9baa-4bf2-b728-dbdab45c11dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:07:36 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-41d65da4-c0fd-4dbc-ad3f-dbec1b6293fd tempest-ProjectReaderTests-1270836308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21854813-9baa-4bf2-b728-dbdab45c11dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T12:07:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-803861958',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb4bfa33-f49e-4e16-a278-0d5536a2cf52,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5612681542240199a2dae951a562fb6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T12:07:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T12:07:37Z,use_quota=True,user_id='81e774189ca14036a506f36d525af45e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1147de8b-623b-426c-a13d-7fc824a80f67),volume_type_id=1147de8b-623b-426c-a13d-7fc824a80f67)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:07:36 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-41d65da4-c0fd-4dbc-ad3f-dbec1b6293fd tempest-ProjectReaderTests-1270836308 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3e6acbe-fcea-4662-a72a-55f2a4adac18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:07:36 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-41d65da4-c0fd-4dbc-ad3f-dbec1b6293fd tempest-ProjectReaderTests-1270836308 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3e6acbe-fcea-4662-a72a-55f2a4adac18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:07:36 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-41d65da4-c0fd-4dbc-ad3f-dbec1b6293fd tempest-ProjectReaderTests-1270836308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c3163b7-6f76-4b93-983d-e946fc3b7c7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:07:36 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-41d65da4-c0fd-4dbc-ad3f-dbec1b6293fd tempest-ProjectReaderTests-1270836308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c3163b7-6f76-4b93-983d-e946fc3b7c7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cb4bfa33-f49e-4e16-a278-0d5536a2cf52', 'volume_name': 'volume-cb4bfa33-f49e-4e16-a278-0d5536a2cf52', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:07:36 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-41d65da4-c0fd-4dbc-ad3f-dbec1b6293fd tempest-ProjectReaderTests-1270836308 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c4987d6-0a17-4119-9b24-0cce3f99829c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:07:36 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-41d65da4-c0fd-4dbc-ad3f-dbec1b6293fd tempest-ProjectReaderTests-1270836308 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c4987d6-0a17-4119-9b24-0cce3f99829c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:07:36 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-41d65da4-c0fd-4dbc-ad3f-dbec1b6293fd tempest-ProjectReaderTests-1270836308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2446b45-b035-4189-b295-c97b48f29e8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:07:36 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-41d65da4-c0fd-4dbc-ad3f-dbec1b6293fd tempest-ProjectReaderTests-1270836308 None] Volume cb4bfa33-f49e-4e16-a278-0d5536a2cf52: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cb4bfa33-f49e-4e16-a278-0d5536a2cf52', 'volume_size': 1} Jul 13 14:07:36 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-41d65da4-c0fd-4dbc-ad3f-dbec1b6293fd tempest-ProjectReaderTests-1270836308 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 14:07:36 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-41d65da4-c0fd-4dbc-ad3f-dbec1b6293fd tempest-ProjectReaderTests-1270836308 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 14:07:36 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-41d65da4-c0fd-4dbc-ad3f-dbec1b6293fd tempest-ProjectReaderTests-1270836308 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T12:07:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-803861958',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb4bfa33-f49e-4e16-a278-0d5536a2cf52,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5612681542240199a2dae951a562fb6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T12:07:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T12:07:37Z,use_quota=True,user_id='81e774189ca14036a506f36d525af45e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1147de8b-623b-426c-a13d-7fc824a80f67),volume_type_id=1147de8b-623b-426c-a13d-7fc824a80f67)}" {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 13 14:07:36 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-41d65da4-c0fd-4dbc-ad3f-dbec1b6293fd tempest-ProjectReaderTests-1270836308 None] Creating volume cb4bfa33-f49e-4e16-a278-0d5536a2cf52 {{(pid=87098) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 13 14:07:36 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-41d65da4-c0fd-4dbc-ad3f-dbec1b6293fd tempest-ProjectReaderTests-1270836308 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 14:07:36 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-41d65da4-c0fd-4dbc-ad3f-dbec1b6293fd tempest-ProjectReaderTests-1270836308 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 14:07:36 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-41d65da4-c0fd-4dbc-ad3f-dbec1b6293fd tempest-ProjectReaderTests-1270836308 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 14:07:36 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-41d65da4-c0fd-4dbc-ad3f-dbec1b6293fd tempest-ProjectReaderTests-1270836308 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 14:07:36 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-41d65da4-c0fd-4dbc-ad3f-dbec1b6293fd tempest-ProjectReaderTests-1270836308 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 14:07:36 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-41d65da4-c0fd-4dbc-ad3f-dbec1b6293fd tempest-ProjectReaderTests-1270836308 None] Selected osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 14:07:36 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-41d65da4-c0fd-4dbc-ad3f-dbec1b6293fd tempest-ProjectReaderTests-1270836308 None] casted to osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 Jul 13 14:07:36 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-41d65da4-c0fd-4dbc-ad3f-dbec1b6293fd tempest-ProjectReaderTests-1270836308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-cb4bfa33-f49e-4e16-a278-0d5536a2cf52 1073741824 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:07:36 devstack sudo[106058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-cb4bfa33-f49e-4e16-a278-0d5536a2cf52 1073741824 Jul 13 14:07:36 devstack sudo[106058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:07:37 devstack sudo[106058]: pam_unix(sudo:session): session closed for user root Jul 13 14:07:37 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-41d65da4-c0fd-4dbc-ad3f-dbec1b6293fd tempest-ProjectReaderTests-1270836308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-cb4bfa33-f49e-4e16-a278-0d5536a2cf52 1073741824" returned: 0 in 0.404s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:07:37 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-41d65da4-c0fd-4dbc-ad3f-dbec1b6293fd tempest-ProjectReaderTests-1270836308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-cb4bfa33-f49e-4e16-a278-0d5536a2cf52 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:07:37 devstack sudo[106064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-cb4bfa33-f49e-4e16-a278-0d5536a2cf52 Jul 13 14:07:37 devstack sudo[106064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:07:37 devstack sudo[106064]: pam_unix(sudo:session): session closed for user root Jul 13 14:07:37 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-41d65da4-c0fd-4dbc-ad3f-dbec1b6293fd tempest-ProjectReaderTests-1270836308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-cb4bfa33-f49e-4e16-a278-0d5536a2cf52" returned: 0 in 0.250s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:07:37 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-41d65da4-c0fd-4dbc-ad3f-dbec1b6293fd tempest-ProjectReaderTests-1270836308 None] <== create_volume: return (695ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'} {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 13 14:07:37 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-41d65da4-c0fd-4dbc-ad3f-dbec1b6293fd tempest-ProjectReaderTests-1270836308 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.697s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 14:07:37 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-41d65da4-c0fd-4dbc-ad3f-dbec1b6293fd tempest-ProjectReaderTests-1270836308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2446b45-b035-4189-b295-c97b48f29e8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cb4bfa33-f49e-4e16-a278-0d5536a2cf52', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:07:37 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-41d65da4-c0fd-4dbc-ad3f-dbec1b6293fd tempest-ProjectReaderTests-1270836308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e01a649-119a-4697-b75a-9f53fd71699d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:07:37 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-41d65da4-c0fd-4dbc-ad3f-dbec1b6293fd tempest-ProjectReaderTests-1270836308 None] Volume volume-cb4bfa33-f49e-4e16-a278-0d5536a2cf52 (cb4bfa33-f49e-4e16-a278-0d5536a2cf52): created successfully Jul 13 14:07:37 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-41d65da4-c0fd-4dbc-ad3f-dbec1b6293fd tempest-ProjectReaderTests-1270836308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e01a649-119a-4697-b75a-9f53fd71699d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:07:37 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-41d65da4-c0fd-4dbc-ad3f-dbec1b6293fd tempest-ProjectReaderTests-1270836308 None] Flow 'volume_create_manager' (7efb55ba-b8a7-40ef-b084-74ac968a0607) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 14:07:37 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-41d65da4-c0fd-4dbc-ad3f-dbec1b6293fd tempest-ProjectReaderTests-1270836308 None] Created volume successfully. Jul 13 14:07:37 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-0dabc032-5afd-4567-b4bc-5f2231079615 tempest-ProjectReaderTests-1270836308 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 14:07:37 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-0dabc032-5afd-4567-b4bc-5f2231079615 tempest-ProjectReaderTests-1270836308 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 14:07:37 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-0dabc032-5afd-4567-b4bc-5f2231079615 tempest-ProjectReaderTests-1270836308 None] Creating offline snapshot e4c51ffc-3f75-4c96-9a87-3c0512c4ff8a of volume cb4bfa33-f49e-4e16-a278-0d5536a2cf52 {{(pid=87098) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 13 14:07:37 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[9730dd67-43c3-48af-ad89-cc1d03d893d2]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 14:07:37 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-0dabc032-5afd-4567-b4bc-5f2231079615 tempest-ProjectReaderTests-1270836308 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-cb4bfa33-f49e-4e16-a278-0d5536a2cf52 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:07:37 devstack sudo[106068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-cb4bfa33-f49e-4e16-a278-0d5536a2cf52 Jul 13 14:07:37 devstack sudo[106068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:07:38 devstack sudo[106068]: pam_unix(sudo:session): session closed for user root Jul 13 14:07:38 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-0dabc032-5afd-4567-b4bc-5f2231079615 tempest-ProjectReaderTests-1270836308 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-cb4bfa33-f49e-4e16-a278-0d5536a2cf52" returned: 0 in 0.347s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:07:38 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-0dabc032-5afd-4567-b4bc-5f2231079615 tempest-ProjectReaderTests-1270836308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-cb4bfa33-f49e-4e16-a278-0d5536a2cf52,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-cb4bfa33-f49e-4e16-a278-0d5536a2cf52.e4c51ffc-3f75-4c96-9a87-3c0512c4ff8a 1G {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:07:38 devstack sudo[106073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-cb4bfa33-f49e-4e16-a278-0d5536a2cf52,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-cb4bfa33-f49e-4e16-a278-0d5536a2cf52.e4c51ffc-3f75-4c96-9a87-3c0512c4ff8a 1G Jul 13 14:07:38 devstack sudo[106073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:07:38 devstack sudo[106073]: pam_unix(sudo:session): session closed for user root Jul 13 14:07:38 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-0dabc032-5afd-4567-b4bc-5f2231079615 tempest-ProjectReaderTests-1270836308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-cb4bfa33-f49e-4e16-a278-0d5536a2cf52,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-cb4bfa33-f49e-4e16-a278-0d5536a2cf52.e4c51ffc-3f75-4c96-9a87-3c0512c4ff8a 1G" returned: 0 in 0.386s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:07:38 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-0dabc032-5afd-4567-b4bc-5f2231079615 tempest-ProjectReaderTests-1270836308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cb4bfa33-f49e-4e16-a278-0d5536a2cf52 -F qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-cb4bfa33-f49e-4e16-a278-0d5536a2cf52.e4c51ffc-3f75-4c96-9a87-3c0512c4ff8a {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:07:38 devstack sudo[106078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cb4bfa33-f49e-4e16-a278-0d5536a2cf52 -F qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-cb4bfa33-f49e-4e16-a278-0d5536a2cf52.e4c51ffc-3f75-4c96-9a87-3c0512c4ff8a Jul 13 14:07:38 devstack sudo[106078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:07:38 devstack sudo[106078]: pam_unix(sudo:session): session closed for user root Jul 13 14:07:38 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-0dabc032-5afd-4567-b4bc-5f2231079615 tempest-ProjectReaderTests-1270836308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cb4bfa33-f49e-4e16-a278-0d5536a2cf52 -F qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-cb4bfa33-f49e-4e16-a278-0d5536a2cf52.e4c51ffc-3f75-4c96-9a87-3c0512c4ff8a" returned: 0 in 0.298s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:07:38 devstack cinder-volume[87098]: WARNING cinder.volume.drivers.remotefs [None req-0dabc032-5afd-4567-b4bc-5f2231079615 tempest-ProjectReaderTests-1270836308 None] /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-cb4bfa33-f49e-4e16-a278-0d5536a2cf52.e4c51ffc-3f75-4c96-9a87-3c0512c4ff8a is being set with open permissions: ugo+rw Jul 13 14:07:38 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-0dabc032-5afd-4567-b4bc-5f2231079615 tempest-ProjectReaderTests-1270836308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-cb4bfa33-f49e-4e16-a278-0d5536a2cf52.e4c51ffc-3f75-4c96-9a87-3c0512c4ff8a {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:07:38 devstack sudo[106083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-cb4bfa33-f49e-4e16-a278-0d5536a2cf52.e4c51ffc-3f75-4c96-9a87-3c0512c4ff8a Jul 13 14:07:38 devstack sudo[106083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:07:39 devstack sudo[106083]: pam_unix(sudo:session): session closed for user root Jul 13 14:07:39 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-0dabc032-5afd-4567-b4bc-5f2231079615 tempest-ProjectReaderTests-1270836308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-cb4bfa33-f49e-4e16-a278-0d5536a2cf52.e4c51ffc-3f75-4c96-9a87-3c0512c4ff8a" returned: 0 in 0.242s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:07:39 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-0dabc032-5afd-4567-b4bc-5f2231079615 tempest-ProjectReaderTests-1270836308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-cb4bfa33-f49e-4e16-a278-0d5536a2cf52.info {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:07:39 devstack sudo[106086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-cb4bfa33-f49e-4e16-a278-0d5536a2cf52.info Jul 13 14:07:39 devstack sudo[106086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:07:39 devstack sudo[106086]: pam_unix(sudo:session): session closed for user root Jul 13 14:07:39 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-0dabc032-5afd-4567-b4bc-5f2231079615 tempest-ProjectReaderTests-1270836308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-cb4bfa33-f49e-4e16-a278-0d5536a2cf52.info" returned: 0 in 0.247s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:07:39 devstack cinder-volume[87098]: WARNING cinder.volume.drivers.remotefs [None req-0dabc032-5afd-4567-b4bc-5f2231079615 tempest-ProjectReaderTests-1270836308 None] /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-cb4bfa33-f49e-4e16-a278-0d5536a2cf52.info is being set with open permissions: ugo+rw Jul 13 14:07:39 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-0dabc032-5afd-4567-b4bc-5f2231079615 tempest-ProjectReaderTests-1270836308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-cb4bfa33-f49e-4e16-a278-0d5536a2cf52.info {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:07:39 devstack sudo[106089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-cb4bfa33-f49e-4e16-a278-0d5536a2cf52.info Jul 13 14:07:39 devstack sudo[106089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:07:39 devstack sudo[106089]: pam_unix(sudo:session): session closed for user root Jul 13 14:07:39 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-0dabc032-5afd-4567-b4bc-5f2231079615 tempest-ProjectReaderTests-1270836308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-cb4bfa33-f49e-4e16-a278-0d5536a2cf52.info" returned: 0 in 0.238s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:07:39 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-0dabc032-5afd-4567-b4bc-5f2231079615 tempest-ProjectReaderTests-1270836308 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.834s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 14:07:39 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-0dabc032-5afd-4567-b4bc-5f2231079615 tempest-ProjectReaderTests-1270836308 None] Create snapshot completed successfully Jul 13 14:07:39 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-2d5ee3c9-d51b-4b87-9a6d-015dd50b1568 tempest-ProjectReaderTests-1270836308 None] Acquiring lock "cinder-e4c51ffc-3f75-4c96-9a87-3c0512c4ff8a-delete_snapshot" by "delete_snapshot" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 14:07:39 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-2d5ee3c9-d51b-4b87-9a6d-015dd50b1568 tempest-ProjectReaderTests-1270836308 None] Lock "cinder-e4c51ffc-3f75-4c96-9a87-3c0512c4ff8a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 14:07:39 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-2d5ee3c9-d51b-4b87-9a6d-015dd50b1568 tempest-ProjectReaderTests-1270836308 None] Acquiring lock "cinder-quobyte-cb4bfa33-f49e-4e16-a278-0d5536a2cf52" by "delete_snapshot" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 14:07:39 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-2d5ee3c9-d51b-4b87-9a6d-015dd50b1568 tempest-ProjectReaderTests-1270836308 None] Lock "cinder-quobyte-cb4bfa33-f49e-4e16-a278-0d5536a2cf52" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 14:07:39 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-2d5ee3c9-d51b-4b87-9a6d-015dd50b1568 tempest-ProjectReaderTests-1270836308 None] Acquiring lock "cinder-quobyte-e4c51ffc-3f75-4c96-9a87-3c0512c4ff8a" by "_delete_snapshot" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 14:07:39 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-2d5ee3c9-d51b-4b87-9a6d-015dd50b1568 tempest-ProjectReaderTests-1270836308 None] Lock "cinder-quobyte-e4c51ffc-3f75-4c96-9a87-3c0512c4ff8a" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 14:07:39 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-2d5ee3c9-d51b-4b87-9a6d-015dd50b1568 tempest-ProjectReaderTests-1270836308 None] Deleting offline snapshot e4c51ffc-3f75-4c96-9a87-3c0512c4ff8a of volume cb4bfa33-f49e-4e16-a278-0d5536a2cf52 {{(pid=87098) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 13 14:07:39 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-2d5ee3c9-d51b-4b87-9a6d-015dd50b1568 tempest-ProjectReaderTests-1270836308 None] snapshot_file for this snap is: volume-cb4bfa33-f49e-4e16-a278-0d5536a2cf52.e4c51ffc-3f75-4c96-9a87-3c0512c4ff8a {{(pid=87098) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 13 14:07:39 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[c714309b-015f-4c23-bc41-2ddf0cc7285d]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 14:07:39 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-2d5ee3c9-d51b-4b87-9a6d-015dd50b1568 tempest-ProjectReaderTests-1270836308 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-cb4bfa33-f49e-4e16-a278-0d5536a2cf52.e4c51ffc-3f75-4c96-9a87-3c0512c4ff8a {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:07:40 devstack sudo[106092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-cb4bfa33-f49e-4e16-a278-0d5536a2cf52.e4c51ffc-3f75-4c96-9a87-3c0512c4ff8a Jul 13 14:07:40 devstack sudo[106092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:07:40 devstack sudo[106092]: pam_unix(sudo:session): session closed for user root Jul 13 14:07:40 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-2d5ee3c9-d51b-4b87-9a6d-015dd50b1568 tempest-ProjectReaderTests-1270836308 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-cb4bfa33-f49e-4e16-a278-0d5536a2cf52.e4c51ffc-3f75-4c96-9a87-3c0512c4ff8a" returned: 0 in 0.347s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:07:40 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-2d5ee3c9-d51b-4b87-9a6d-015dd50b1568 tempest-ProjectReaderTests-1270836308 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cb4bfa33-f49e-4e16-a278-0d5536a2cf52(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87098) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 13 14:07:40 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[56978230-34d1-4c08-83fb-24259196bc5c]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 14:07:40 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-2d5ee3c9-d51b-4b87-9a6d-015dd50b1568 tempest-ProjectReaderTests-1270836308 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-cb4bfa33-f49e-4e16-a278-0d5536a2cf52 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:07:40 devstack sudo[106097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-cb4bfa33-f49e-4e16-a278-0d5536a2cf52 Jul 13 14:07:40 devstack sudo[106097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:07:40 devstack sudo[106097]: pam_unix(sudo:session): session closed for user root Jul 13 14:07:40 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-2d5ee3c9-d51b-4b87-9a6d-015dd50b1568 tempest-ProjectReaderTests-1270836308 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-cb4bfa33-f49e-4e16-a278-0d5536a2cf52" returned: 0 in 0.341s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:07:40 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-2d5ee3c9-d51b-4b87-9a6d-015dd50b1568 tempest-ProjectReaderTests-1270836308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-cb4bfa33-f49e-4e16-a278-0d5536a2cf52.e4c51ffc-3f75-4c96-9a87-3c0512c4ff8a {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:07:40 devstack sudo[106102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-cb4bfa33-f49e-4e16-a278-0d5536a2cf52.e4c51ffc-3f75-4c96-9a87-3c0512c4ff8a Jul 13 14:07:40 devstack sudo[106102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:07:40 devstack sudo[106102]: pam_unix(sudo:session): session closed for user root Jul 13 14:07:40 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-2d5ee3c9-d51b-4b87-9a6d-015dd50b1568 tempest-ProjectReaderTests-1270836308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-cb4bfa33-f49e-4e16-a278-0d5536a2cf52.e4c51ffc-3f75-4c96-9a87-3c0512c4ff8a" returned: 0 in 0.327s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:07:40 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-2d5ee3c9-d51b-4b87-9a6d-015dd50b1568 tempest-ProjectReaderTests-1270836308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-cb4bfa33-f49e-4e16-a278-0d5536a2cf52.e4c51ffc-3f75-4c96-9a87-3c0512c4ff8a {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:07:41 devstack sudo[106108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-cb4bfa33-f49e-4e16-a278-0d5536a2cf52.e4c51ffc-3f75-4c96-9a87-3c0512c4ff8a Jul 13 14:07:41 devstack sudo[106108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:07:41 devstack sudo[106108]: pam_unix(sudo:session): session closed for user root Jul 13 14:07:41 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-2d5ee3c9-d51b-4b87-9a6d-015dd50b1568 tempest-ProjectReaderTests-1270836308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-cb4bfa33-f49e-4e16-a278-0d5536a2cf52.e4c51ffc-3f75-4c96-9a87-3c0512c4ff8a" returned: 0 in 0.236s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:07:41 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-2d5ee3c9-d51b-4b87-9a6d-015dd50b1568 tempest-ProjectReaderTests-1270836308 None] Lock "cinder-quobyte-e4c51ffc-3f75-4c96-9a87-3c0512c4ff8a" released by "_delete_snapshot" :: held 1.343s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 14:07:41 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-2d5ee3c9-d51b-4b87-9a6d-015dd50b1568 tempest-ProjectReaderTests-1270836308 None] Lock "cinder-quobyte-cb4bfa33-f49e-4e16-a278-0d5536a2cf52" released by "delete_snapshot" :: held 1.366s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 14:07:41 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-2d5ee3c9-d51b-4b87-9a6d-015dd50b1568 tempest-ProjectReaderTests-1270836308 None] Created reservations ['e86b1e7b-1f7c-4f85-84d0-06368d5cfe2d', 'd76c02d3-70bf-4a27-ad0c-60303b455c28', 'b6769cec-4dbb-40ef-8976-704034228fe4', 'a97c86db-fab0-4b6c-8b1c-bd5a163fbeb1'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 14:07:41 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-2d5ee3c9-d51b-4b87-9a6d-015dd50b1568 tempest-ProjectReaderTests-1270836308 None] Delete snapshot completed successfully. Jul 13 14:07:41 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-2d5ee3c9-d51b-4b87-9a6d-015dd50b1568 tempest-ProjectReaderTests-1270836308 None] Lock "cinder-e4c51ffc-3f75-4c96-9a87-3c0512c4ff8a-delete_snapshot" released by "delete_snapshot" :: held 1.496s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 14:07:42 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-57dfeeef-c7c1-49d5-ac6a-3a334979514f tempest-ProjectReaderTests-1270836308 None] Acquiring lock "cinder-cb4bfa33-f49e-4e16-a278-0d5536a2cf52-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 14:07:42 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-57dfeeef-c7c1-49d5-ac6a-3a334979514f tempest-ProjectReaderTests-1270836308 None] Lock "cinder-cb4bfa33-f49e-4e16-a278-0d5536a2cf52-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 14:07:42 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-57dfeeef-c7c1-49d5-ac6a-3a334979514f tempest-ProjectReaderTests-1270836308 None] Acquiring lock "cinder-quobyte-cb4bfa33-f49e-4e16-a278-0d5536a2cf52" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 14:07:42 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-57dfeeef-c7c1-49d5-ac6a-3a334979514f tempest-ProjectReaderTests-1270836308 None] Lock "cinder-quobyte-cb4bfa33-f49e-4e16-a278-0d5536a2cf52" acquired by "delete_volume" :: waited 0.015s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 14:07:42 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7e67760-89e9-4ed5-978c-446ea56f99eb]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 14:07:42 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-57dfeeef-c7c1-49d5-ac6a-3a334979514f tempest-ProjectReaderTests-1270836308 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-cb4bfa33-f49e-4e16-a278-0d5536a2cf52 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:07:42 devstack sudo[106111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-cb4bfa33-f49e-4e16-a278-0d5536a2cf52 Jul 13 14:07:42 devstack sudo[106111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:07:42 devstack sudo[106111]: pam_unix(sudo:session): session closed for user root Jul 13 14:07:42 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-57dfeeef-c7c1-49d5-ac6a-3a334979514f tempest-ProjectReaderTests-1270836308 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-cb4bfa33-f49e-4e16-a278-0d5536a2cf52" returned: 0 in 0.346s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:07:42 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-57dfeeef-c7c1-49d5-ac6a-3a334979514f tempest-ProjectReaderTests-1270836308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-cb4bfa33-f49e-4e16-a278-0d5536a2cf52 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:07:42 devstack sudo[106116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-cb4bfa33-f49e-4e16-a278-0d5536a2cf52 Jul 13 14:07:42 devstack sudo[106116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:07:42 devstack sudo[106116]: pam_unix(sudo:session): session closed for user root Jul 13 14:07:42 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-57dfeeef-c7c1-49d5-ac6a-3a334979514f tempest-ProjectReaderTests-1270836308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-cb4bfa33-f49e-4e16-a278-0d5536a2cf52" returned: 0 in 0.239s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:07:42 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-57dfeeef-c7c1-49d5-ac6a-3a334979514f tempest-ProjectReaderTests-1270836308 None] Lock "cinder-quobyte-cb4bfa33-f49e-4e16-a278-0d5536a2cf52" released by "delete_volume" :: held 0.639s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 14:07:42 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-57dfeeef-c7c1-49d5-ac6a-3a334979514f tempest-ProjectReaderTests-1270836308 None] Created reservations ['699db15b-65de-467a-8675-28266169ad90', 'a04f0c6a-bb45-4492-b422-b8aa756dfd07', '3bf6d58d-3e7c-4aa8-b6ef-bafadb809728', 'fd103ee2-fff8-4c66-8c5a-1c272c210a98'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 14:07:42 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-57dfeeef-c7c1-49d5-ac6a-3a334979514f tempest-ProjectReaderTests-1270836308 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 14:07:42 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-57dfeeef-c7c1-49d5-ac6a-3a334979514f tempest-ProjectReaderTests-1270836308 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 14:07:42 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-57dfeeef-c7c1-49d5-ac6a-3a334979514f tempest-ProjectReaderTests-1270836308 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 14:07:42 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-57dfeeef-c7c1-49d5-ac6a-3a334979514f tempest-ProjectReaderTests-1270836308 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 14:07:42 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-57dfeeef-c7c1-49d5-ac6a-3a334979514f tempest-ProjectReaderTests-1270836308 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 14:07:42 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-57dfeeef-c7c1-49d5-ac6a-3a334979514f tempest-ProjectReaderTests-1270836308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:07:42 devstack sudo[106119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 Jul 13 14:07:42 devstack sudo[106119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:07:43 devstack sudo[106119]: pam_unix(sudo:session): session closed for user root Jul 13 14:07:43 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-57dfeeef-c7c1-49d5-ac6a-3a334979514f tempest-ProjectReaderTests-1270836308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78" returned: 0 in 0.236s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:07:43 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-57dfeeef-c7c1-49d5-ac6a-3a334979514f tempest-ProjectReaderTests-1270836308 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 14:07:43 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-57dfeeef-c7c1-49d5-ac6a-3a334979514f tempest-ProjectReaderTests-1270836308 None] Deleted volume successfully. Jul 13 14:07:43 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-57dfeeef-c7c1-49d5-ac6a-3a334979514f tempest-ProjectReaderTests-1270836308 None] Lock "cinder-cb4bfa33-f49e-4e16-a278-0d5536a2cf52-delete_volume" released by "delete_volume" :: held 1.060s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 14:07:43 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-96cc33b1-57f2-4c58-911f-1659dc0fe16e tempest-ProjectReaderTests-1270836308 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 14:07:43 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-96cc33b1-57f2-4c58-911f-1659dc0fe16e tempest-ProjectReaderTests-1270836308 None] Flow 'volume_create_manager' (5efe6626-6df2-4514-8476-eb5884ba367d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 14:07:43 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-96cc33b1-57f2-4c58-911f-1659dc0fe16e tempest-ProjectReaderTests-1270836308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (173fe219-5797-4874-9a10-3936f56e80bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:07:43 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-96cc33b1-57f2-4c58-911f-1659dc0fe16e tempest-ProjectReaderTests-1270836308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (173fe219-5797-4874-9a10-3936f56e80bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T12:07:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-774401075',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04f0918e-ea87-4660-b87f-6f0f7f628ce2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5612681542240199a2dae951a562fb6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T12:07:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T12:07:44Z,use_quota=True,user_id='81e774189ca14036a506f36d525af45e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1147de8b-623b-426c-a13d-7fc824a80f67),volume_type_id=1147de8b-623b-426c-a13d-7fc824a80f67)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:07:43 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-96cc33b1-57f2-4c58-911f-1659dc0fe16e tempest-ProjectReaderTests-1270836308 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c030995c-57e1-45db-bcef-cb795058a85a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:07:43 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-96cc33b1-57f2-4c58-911f-1659dc0fe16e tempest-ProjectReaderTests-1270836308 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c030995c-57e1-45db-bcef-cb795058a85a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:07:43 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-96cc33b1-57f2-4c58-911f-1659dc0fe16e tempest-ProjectReaderTests-1270836308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f068c9f-902b-49e2-8c24-bd7c95037eb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:07:43 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-96cc33b1-57f2-4c58-911f-1659dc0fe16e tempest-ProjectReaderTests-1270836308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f068c9f-902b-49e2-8c24-bd7c95037eb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '04f0918e-ea87-4660-b87f-6f0f7f628ce2', 'volume_name': 'volume-04f0918e-ea87-4660-b87f-6f0f7f628ce2', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:07:43 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-96cc33b1-57f2-4c58-911f-1659dc0fe16e tempest-ProjectReaderTests-1270836308 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a3489e2-4927-44bf-bc7b-0731eab12b4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:07:43 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-96cc33b1-57f2-4c58-911f-1659dc0fe16e tempest-ProjectReaderTests-1270836308 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a3489e2-4927-44bf-bc7b-0731eab12b4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:07:43 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-96cc33b1-57f2-4c58-911f-1659dc0fe16e tempest-ProjectReaderTests-1270836308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (568de337-8736-4aa0-88ab-1a6433f322bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:07:43 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-96cc33b1-57f2-4c58-911f-1659dc0fe16e tempest-ProjectReaderTests-1270836308 None] Volume 04f0918e-ea87-4660-b87f-6f0f7f628ce2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-04f0918e-ea87-4660-b87f-6f0f7f628ce2', 'volume_size': 1} Jul 13 14:07:43 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-96cc33b1-57f2-4c58-911f-1659dc0fe16e tempest-ProjectReaderTests-1270836308 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 14:07:43 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-96cc33b1-57f2-4c58-911f-1659dc0fe16e tempest-ProjectReaderTests-1270836308 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 14:07:43 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-96cc33b1-57f2-4c58-911f-1659dc0fe16e tempest-ProjectReaderTests-1270836308 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T12:07:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-774401075',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04f0918e-ea87-4660-b87f-6f0f7f628ce2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5612681542240199a2dae951a562fb6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T12:07:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T12:07:44Z,use_quota=True,user_id='81e774189ca14036a506f36d525af45e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1147de8b-623b-426c-a13d-7fc824a80f67),volume_type_id=1147de8b-623b-426c-a13d-7fc824a80f67)}" {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 13 14:07:43 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-96cc33b1-57f2-4c58-911f-1659dc0fe16e tempest-ProjectReaderTests-1270836308 None] Creating volume 04f0918e-ea87-4660-b87f-6f0f7f628ce2 {{(pid=87098) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 13 14:07:43 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-96cc33b1-57f2-4c58-911f-1659dc0fe16e tempest-ProjectReaderTests-1270836308 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 14:07:43 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-96cc33b1-57f2-4c58-911f-1659dc0fe16e tempest-ProjectReaderTests-1270836308 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 14:07:43 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-96cc33b1-57f2-4c58-911f-1659dc0fe16e tempest-ProjectReaderTests-1270836308 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 14:07:43 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-96cc33b1-57f2-4c58-911f-1659dc0fe16e tempest-ProjectReaderTests-1270836308 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 14:07:43 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-96cc33b1-57f2-4c58-911f-1659dc0fe16e tempest-ProjectReaderTests-1270836308 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 14:07:43 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-96cc33b1-57f2-4c58-911f-1659dc0fe16e tempest-ProjectReaderTests-1270836308 None] Selected osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 14:07:43 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-96cc33b1-57f2-4c58-911f-1659dc0fe16e tempest-ProjectReaderTests-1270836308 None] casted to osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 Jul 13 14:07:43 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-96cc33b1-57f2-4c58-911f-1659dc0fe16e tempest-ProjectReaderTests-1270836308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-04f0918e-ea87-4660-b87f-6f0f7f628ce2 1073741824 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:07:43 devstack sudo[106122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-04f0918e-ea87-4660-b87f-6f0f7f628ce2 1073741824 Jul 13 14:07:43 devstack sudo[106122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:07:44 devstack sudo[106122]: pam_unix(sudo:session): session closed for user root Jul 13 14:07:44 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-96cc33b1-57f2-4c58-911f-1659dc0fe16e tempest-ProjectReaderTests-1270836308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-04f0918e-ea87-4660-b87f-6f0f7f628ce2 1073741824" returned: 0 in 0.398s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:07:44 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-96cc33b1-57f2-4c58-911f-1659dc0fe16e tempest-ProjectReaderTests-1270836308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-04f0918e-ea87-4660-b87f-6f0f7f628ce2 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:07:44 devstack sudo[106127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-04f0918e-ea87-4660-b87f-6f0f7f628ce2 Jul 13 14:07:44 devstack sudo[106127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:07:44 devstack sudo[106127]: pam_unix(sudo:session): session closed for user root Jul 13 14:07:44 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-96cc33b1-57f2-4c58-911f-1659dc0fe16e tempest-ProjectReaderTests-1270836308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-04f0918e-ea87-4660-b87f-6f0f7f628ce2" returned: 0 in 0.247s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:07:44 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-96cc33b1-57f2-4c58-911f-1659dc0fe16e tempest-ProjectReaderTests-1270836308 None] <== create_volume: return (683ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'} {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 13 14:07:44 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-96cc33b1-57f2-4c58-911f-1659dc0fe16e tempest-ProjectReaderTests-1270836308 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.686s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 14:07:44 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-96cc33b1-57f2-4c58-911f-1659dc0fe16e tempest-ProjectReaderTests-1270836308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (568de337-8736-4aa0-88ab-1a6433f322bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-04f0918e-ea87-4660-b87f-6f0f7f628ce2', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:07:44 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-96cc33b1-57f2-4c58-911f-1659dc0fe16e tempest-ProjectReaderTests-1270836308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7959c085-deab-43cc-854b-43d394fa22c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:07:44 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-96cc33b1-57f2-4c58-911f-1659dc0fe16e tempest-ProjectReaderTests-1270836308 None] Volume volume-04f0918e-ea87-4660-b87f-6f0f7f628ce2 (04f0918e-ea87-4660-b87f-6f0f7f628ce2): created successfully Jul 13 14:07:44 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-96cc33b1-57f2-4c58-911f-1659dc0fe16e tempest-ProjectReaderTests-1270836308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7959c085-deab-43cc-854b-43d394fa22c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:07:44 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-96cc33b1-57f2-4c58-911f-1659dc0fe16e tempest-ProjectReaderTests-1270836308 None] Flow 'volume_create_manager' (5efe6626-6df2-4514-8476-eb5884ba367d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 14:07:44 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-96cc33b1-57f2-4c58-911f-1659dc0fe16e tempest-ProjectReaderTests-1270836308 None] Created volume successfully. Jul 13 14:07:44 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-48afd459-bdbc-4651-af51-07ccfd38ebd0 tempest-ProjectReaderTests-1270836308 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 14:07:44 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-48afd459-bdbc-4651-af51-07ccfd38ebd0 tempest-ProjectReaderTests-1270836308 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 14:07:44 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-48afd459-bdbc-4651-af51-07ccfd38ebd0 tempest-ProjectReaderTests-1270836308 None] Creating offline snapshot d1cf54cd-322a-434c-8cac-27b02ba07a38 of volume 04f0918e-ea87-4660-b87f-6f0f7f628ce2 {{(pid=87098) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 13 14:07:44 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f37ad9a-f975-4625-83fb-83f583be9723]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 14:07:44 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-48afd459-bdbc-4651-af51-07ccfd38ebd0 tempest-ProjectReaderTests-1270836308 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-04f0918e-ea87-4660-b87f-6f0f7f628ce2 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:07:44 devstack sudo[106130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-04f0918e-ea87-4660-b87f-6f0f7f628ce2 Jul 13 14:07:44 devstack sudo[106130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:07:45 devstack sudo[106130]: pam_unix(sudo:session): session closed for user root Jul 13 14:07:45 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-48afd459-bdbc-4651-af51-07ccfd38ebd0 tempest-ProjectReaderTests-1270836308 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-04f0918e-ea87-4660-b87f-6f0f7f628ce2" returned: 0 in 0.353s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:07:45 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-48afd459-bdbc-4651-af51-07ccfd38ebd0 tempest-ProjectReaderTests-1270836308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-04f0918e-ea87-4660-b87f-6f0f7f628ce2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-04f0918e-ea87-4660-b87f-6f0f7f628ce2.d1cf54cd-322a-434c-8cac-27b02ba07a38 1G {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:07:45 devstack sudo[106135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-04f0918e-ea87-4660-b87f-6f0f7f628ce2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-04f0918e-ea87-4660-b87f-6f0f7f628ce2.d1cf54cd-322a-434c-8cac-27b02ba07a38 1G Jul 13 14:07:45 devstack sudo[106135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:07:45 devstack sudo[106135]: pam_unix(sudo:session): session closed for user root Jul 13 14:07:45 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-48afd459-bdbc-4651-af51-07ccfd38ebd0 tempest-ProjectReaderTests-1270836308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-04f0918e-ea87-4660-b87f-6f0f7f628ce2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-04f0918e-ea87-4660-b87f-6f0f7f628ce2.d1cf54cd-322a-434c-8cac-27b02ba07a38 1G" returned: 0 in 0.383s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:07:45 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-48afd459-bdbc-4651-af51-07ccfd38ebd0 tempest-ProjectReaderTests-1270836308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-04f0918e-ea87-4660-b87f-6f0f7f628ce2 -F qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-04f0918e-ea87-4660-b87f-6f0f7f628ce2.d1cf54cd-322a-434c-8cac-27b02ba07a38 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:07:45 devstack sudo[106140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-04f0918e-ea87-4660-b87f-6f0f7f628ce2 -F qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-04f0918e-ea87-4660-b87f-6f0f7f628ce2.d1cf54cd-322a-434c-8cac-27b02ba07a38 Jul 13 14:07:45 devstack sudo[106140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:07:45 devstack sudo[106140]: pam_unix(sudo:session): session closed for user root Jul 13 14:07:45 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-48afd459-bdbc-4651-af51-07ccfd38ebd0 tempest-ProjectReaderTests-1270836308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-04f0918e-ea87-4660-b87f-6f0f7f628ce2 -F qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-04f0918e-ea87-4660-b87f-6f0f7f628ce2.d1cf54cd-322a-434c-8cac-27b02ba07a38" returned: 0 in 0.284s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:07:45 devstack cinder-volume[87098]: WARNING cinder.volume.drivers.remotefs [None req-48afd459-bdbc-4651-af51-07ccfd38ebd0 tempest-ProjectReaderTests-1270836308 None] /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-04f0918e-ea87-4660-b87f-6f0f7f628ce2.d1cf54cd-322a-434c-8cac-27b02ba07a38 is being set with open permissions: ugo+rw Jul 13 14:07:45 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-48afd459-bdbc-4651-af51-07ccfd38ebd0 tempest-ProjectReaderTests-1270836308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-04f0918e-ea87-4660-b87f-6f0f7f628ce2.d1cf54cd-322a-434c-8cac-27b02ba07a38 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:07:45 devstack sudo[106145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-04f0918e-ea87-4660-b87f-6f0f7f628ce2.d1cf54cd-322a-434c-8cac-27b02ba07a38 Jul 13 14:07:45 devstack sudo[106145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:07:46 devstack sudo[106145]: pam_unix(sudo:session): session closed for user root Jul 13 14:07:46 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-48afd459-bdbc-4651-af51-07ccfd38ebd0 tempest-ProjectReaderTests-1270836308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-04f0918e-ea87-4660-b87f-6f0f7f628ce2.d1cf54cd-322a-434c-8cac-27b02ba07a38" returned: 0 in 0.240s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:07:46 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-48afd459-bdbc-4651-af51-07ccfd38ebd0 tempest-ProjectReaderTests-1270836308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-04f0918e-ea87-4660-b87f-6f0f7f628ce2.info {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:07:46 devstack sudo[106148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-04f0918e-ea87-4660-b87f-6f0f7f628ce2.info Jul 13 14:07:46 devstack sudo[106148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:07:46 devstack sudo[106148]: pam_unix(sudo:session): session closed for user root Jul 13 14:07:46 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-48afd459-bdbc-4651-af51-07ccfd38ebd0 tempest-ProjectReaderTests-1270836308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-04f0918e-ea87-4660-b87f-6f0f7f628ce2.info" returned: 0 in 0.252s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:07:46 devstack cinder-volume[87098]: WARNING cinder.volume.drivers.remotefs [None req-48afd459-bdbc-4651-af51-07ccfd38ebd0 tempest-ProjectReaderTests-1270836308 None] /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-04f0918e-ea87-4660-b87f-6f0f7f628ce2.info is being set with open permissions: ugo+rw Jul 13 14:07:46 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-48afd459-bdbc-4651-af51-07ccfd38ebd0 tempest-ProjectReaderTests-1270836308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-04f0918e-ea87-4660-b87f-6f0f7f628ce2.info {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:07:46 devstack sudo[106151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-04f0918e-ea87-4660-b87f-6f0f7f628ce2.info Jul 13 14:07:46 devstack sudo[106151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:07:46 devstack sudo[106151]: pam_unix(sudo:session): session closed for user root Jul 13 14:07:46 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-48afd459-bdbc-4651-af51-07ccfd38ebd0 tempest-ProjectReaderTests-1270836308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-04f0918e-ea87-4660-b87f-6f0f7f628ce2.info" returned: 0 in 0.241s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:07:46 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-48afd459-bdbc-4651-af51-07ccfd38ebd0 tempest-ProjectReaderTests-1270836308 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.829s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 14:07:46 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-48afd459-bdbc-4651-af51-07ccfd38ebd0 tempest-ProjectReaderTests-1270836308 None] Create snapshot completed successfully Jul 13 14:07:46 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-3d36a27a-151c-47a3-aae9-88ee13d1d1f4 tempest-ProjectReaderTests-1270836308 None] Acquiring lock "cinder-d1cf54cd-322a-434c-8cac-27b02ba07a38-delete_snapshot" by "delete_snapshot" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 14:07:46 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-3d36a27a-151c-47a3-aae9-88ee13d1d1f4 tempest-ProjectReaderTests-1270836308 None] Lock "cinder-d1cf54cd-322a-434c-8cac-27b02ba07a38-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 14:07:46 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-3d36a27a-151c-47a3-aae9-88ee13d1d1f4 tempest-ProjectReaderTests-1270836308 None] Acquiring lock "cinder-quobyte-04f0918e-ea87-4660-b87f-6f0f7f628ce2" by "delete_snapshot" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 14:07:46 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-3d36a27a-151c-47a3-aae9-88ee13d1d1f4 tempest-ProjectReaderTests-1270836308 None] Lock "cinder-quobyte-04f0918e-ea87-4660-b87f-6f0f7f628ce2" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 14:07:46 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-3d36a27a-151c-47a3-aae9-88ee13d1d1f4 tempest-ProjectReaderTests-1270836308 None] Acquiring lock "cinder-quobyte-d1cf54cd-322a-434c-8cac-27b02ba07a38" by "_delete_snapshot" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 14:07:46 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-3d36a27a-151c-47a3-aae9-88ee13d1d1f4 tempest-ProjectReaderTests-1270836308 None] Lock "cinder-quobyte-d1cf54cd-322a-434c-8cac-27b02ba07a38" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 14:07:46 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-3d36a27a-151c-47a3-aae9-88ee13d1d1f4 tempest-ProjectReaderTests-1270836308 None] Deleting offline snapshot d1cf54cd-322a-434c-8cac-27b02ba07a38 of volume 04f0918e-ea87-4660-b87f-6f0f7f628ce2 {{(pid=87098) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 13 14:07:46 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-3d36a27a-151c-47a3-aae9-88ee13d1d1f4 tempest-ProjectReaderTests-1270836308 None] snapshot_file for this snap is: volume-04f0918e-ea87-4660-b87f-6f0f7f628ce2.d1cf54cd-322a-434c-8cac-27b02ba07a38 {{(pid=87098) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 13 14:07:46 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[39e82a49-9f77-4db4-a6ed-5ab3847049dc]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 14:07:46 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-3d36a27a-151c-47a3-aae9-88ee13d1d1f4 tempest-ProjectReaderTests-1270836308 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-04f0918e-ea87-4660-b87f-6f0f7f628ce2.d1cf54cd-322a-434c-8cac-27b02ba07a38 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:07:47 devstack sudo[106154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-04f0918e-ea87-4660-b87f-6f0f7f628ce2.d1cf54cd-322a-434c-8cac-27b02ba07a38 Jul 13 14:07:47 devstack sudo[106154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:07:47 devstack sudo[106154]: pam_unix(sudo:session): session closed for user root Jul 13 14:07:47 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-3d36a27a-151c-47a3-aae9-88ee13d1d1f4 tempest-ProjectReaderTests-1270836308 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-04f0918e-ea87-4660-b87f-6f0f7f628ce2.d1cf54cd-322a-434c-8cac-27b02ba07a38" returned: 0 in 0.347s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:07:47 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-3d36a27a-151c-47a3-aae9-88ee13d1d1f4 tempest-ProjectReaderTests-1270836308 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-04f0918e-ea87-4660-b87f-6f0f7f628ce2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87098) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 13 14:07:47 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[a51f94d5-e71b-444c-8fa7-68b4fd4cce96]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 14:07:47 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-3d36a27a-151c-47a3-aae9-88ee13d1d1f4 tempest-ProjectReaderTests-1270836308 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-04f0918e-ea87-4660-b87f-6f0f7f628ce2 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:07:47 devstack sudo[106160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-04f0918e-ea87-4660-b87f-6f0f7f628ce2 Jul 13 14:07:47 devstack sudo[106160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:07:47 devstack sudo[106160]: pam_unix(sudo:session): session closed for user root Jul 13 14:07:47 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-3d36a27a-151c-47a3-aae9-88ee13d1d1f4 tempest-ProjectReaderTests-1270836308 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-04f0918e-ea87-4660-b87f-6f0f7f628ce2" returned: 0 in 0.354s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:07:47 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-3d36a27a-151c-47a3-aae9-88ee13d1d1f4 tempest-ProjectReaderTests-1270836308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-04f0918e-ea87-4660-b87f-6f0f7f628ce2.d1cf54cd-322a-434c-8cac-27b02ba07a38 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:07:47 devstack sudo[106165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-04f0918e-ea87-4660-b87f-6f0f7f628ce2.d1cf54cd-322a-434c-8cac-27b02ba07a38 Jul 13 14:07:47 devstack sudo[106165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:07:48 devstack sudo[106165]: pam_unix(sudo:session): session closed for user root Jul 13 14:07:48 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-3d36a27a-151c-47a3-aae9-88ee13d1d1f4 tempest-ProjectReaderTests-1270836308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-04f0918e-ea87-4660-b87f-6f0f7f628ce2.d1cf54cd-322a-434c-8cac-27b02ba07a38" returned: 0 in 0.335s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:07:48 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-3d36a27a-151c-47a3-aae9-88ee13d1d1f4 tempest-ProjectReaderTests-1270836308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-04f0918e-ea87-4660-b87f-6f0f7f628ce2.d1cf54cd-322a-434c-8cac-27b02ba07a38 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:07:48 devstack sudo[106170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-04f0918e-ea87-4660-b87f-6f0f7f628ce2.d1cf54cd-322a-434c-8cac-27b02ba07a38 Jul 13 14:07:48 devstack sudo[106170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:07:48 devstack sudo[106170]: pam_unix(sudo:session): session closed for user root Jul 13 14:07:48 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-3d36a27a-151c-47a3-aae9-88ee13d1d1f4 tempest-ProjectReaderTests-1270836308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-04f0918e-ea87-4660-b87f-6f0f7f628ce2.d1cf54cd-322a-434c-8cac-27b02ba07a38" returned: 0 in 0.251s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:07:48 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-3d36a27a-151c-47a3-aae9-88ee13d1d1f4 tempest-ProjectReaderTests-1270836308 None] Lock "cinder-quobyte-d1cf54cd-322a-434c-8cac-27b02ba07a38" released by "_delete_snapshot" :: held 1.373s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 14:07:48 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-3d36a27a-151c-47a3-aae9-88ee13d1d1f4 tempest-ProjectReaderTests-1270836308 None] Lock "cinder-quobyte-04f0918e-ea87-4660-b87f-6f0f7f628ce2" released by "delete_snapshot" :: held 1.395s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 14:07:48 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-3d36a27a-151c-47a3-aae9-88ee13d1d1f4 tempest-ProjectReaderTests-1270836308 None] Created reservations ['5775e422-569c-47be-8d6f-4eca6ce751e8', '22e21d26-e28e-417c-93eb-5ca959e8161e', '57587960-8aa5-4874-8ed7-13259d102f71', '29a01945-1dae-4962-8ca8-de6bc620ea65'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 14:07:48 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-3d36a27a-151c-47a3-aae9-88ee13d1d1f4 tempest-ProjectReaderTests-1270836308 None] Delete snapshot completed successfully. Jul 13 14:07:48 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-3d36a27a-151c-47a3-aae9-88ee13d1d1f4 tempest-ProjectReaderTests-1270836308 None] Lock "cinder-d1cf54cd-322a-434c-8cac-27b02ba07a38-delete_snapshot" released by "delete_snapshot" :: held 1.535s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 14:07:49 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-f4e710ff-d2ac-4b5f-839e-833ce56a6044 tempest-ProjectReaderTests-1270836308 None] Acquiring lock "cinder-04f0918e-ea87-4660-b87f-6f0f7f628ce2-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 14:07:49 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-f4e710ff-d2ac-4b5f-839e-833ce56a6044 tempest-ProjectReaderTests-1270836308 None] Lock "cinder-04f0918e-ea87-4660-b87f-6f0f7f628ce2-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 14:07:49 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-f4e710ff-d2ac-4b5f-839e-833ce56a6044 tempest-ProjectReaderTests-1270836308 None] Acquiring lock "cinder-quobyte-04f0918e-ea87-4660-b87f-6f0f7f628ce2" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 14:07:49 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-f4e710ff-d2ac-4b5f-839e-833ce56a6044 tempest-ProjectReaderTests-1270836308 None] Lock "cinder-quobyte-04f0918e-ea87-4660-b87f-6f0f7f628ce2" acquired by "delete_volume" :: waited 0.017s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 14:07:49 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b4ed512-ed03-4e6a-bf2f-ca46751589d5]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 14:07:49 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-f4e710ff-d2ac-4b5f-839e-833ce56a6044 tempest-ProjectReaderTests-1270836308 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-04f0918e-ea87-4660-b87f-6f0f7f628ce2 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:07:49 devstack sudo[106173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-04f0918e-ea87-4660-b87f-6f0f7f628ce2 Jul 13 14:07:49 devstack sudo[106173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:07:49 devstack sudo[106173]: pam_unix(sudo:session): session closed for user root Jul 13 14:07:49 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-f4e710ff-d2ac-4b5f-839e-833ce56a6044 tempest-ProjectReaderTests-1270836308 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-04f0918e-ea87-4660-b87f-6f0f7f628ce2" returned: 0 in 0.368s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:07:49 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-f4e710ff-d2ac-4b5f-839e-833ce56a6044 tempest-ProjectReaderTests-1270836308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-04f0918e-ea87-4660-b87f-6f0f7f628ce2 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:07:49 devstack sudo[106178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-04f0918e-ea87-4660-b87f-6f0f7f628ce2 Jul 13 14:07:49 devstack sudo[106178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:07:49 devstack sudo[106178]: pam_unix(sudo:session): session closed for user root Jul 13 14:07:49 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-f4e710ff-d2ac-4b5f-839e-833ce56a6044 tempest-ProjectReaderTests-1270836308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-04f0918e-ea87-4660-b87f-6f0f7f628ce2" returned: 0 in 0.251s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:07:49 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-f4e710ff-d2ac-4b5f-839e-833ce56a6044 tempest-ProjectReaderTests-1270836308 None] Lock "cinder-quobyte-04f0918e-ea87-4660-b87f-6f0f7f628ce2" released by "delete_volume" :: held 0.679s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 14:07:49 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-f4e710ff-d2ac-4b5f-839e-833ce56a6044 tempest-ProjectReaderTests-1270836308 None] Created reservations ['4163752a-06ca-4c09-b735-a925e7192100', 'e49c2315-343f-4feb-a123-2275f21d84a7', '89c0a0a8-3836-4feb-94c7-11936aa546a5', '241c2776-5659-48a6-834d-6c290179f7be'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 14:07:49 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-f4e710ff-d2ac-4b5f-839e-833ce56a6044 tempest-ProjectReaderTests-1270836308 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 14:07:49 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-f4e710ff-d2ac-4b5f-839e-833ce56a6044 tempest-ProjectReaderTests-1270836308 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 14:07:49 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-f4e710ff-d2ac-4b5f-839e-833ce56a6044 tempest-ProjectReaderTests-1270836308 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 14:07:49 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-f4e710ff-d2ac-4b5f-839e-833ce56a6044 tempest-ProjectReaderTests-1270836308 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 14:07:49 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-f4e710ff-d2ac-4b5f-839e-833ce56a6044 tempest-ProjectReaderTests-1270836308 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 14:07:49 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-f4e710ff-d2ac-4b5f-839e-833ce56a6044 tempest-ProjectReaderTests-1270836308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:07:49 devstack sudo[106181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 Jul 13 14:07:49 devstack sudo[106181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:07:50 devstack sudo[106181]: pam_unix(sudo:session): session closed for user root Jul 13 14:07:50 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-f4e710ff-d2ac-4b5f-839e-833ce56a6044 tempest-ProjectReaderTests-1270836308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78" returned: 0 in 0.266s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:07:50 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-f4e710ff-d2ac-4b5f-839e-833ce56a6044 tempest-ProjectReaderTests-1270836308 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 14:07:50 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-f4e710ff-d2ac-4b5f-839e-833ce56a6044 tempest-ProjectReaderTests-1270836308 None] Deleted volume successfully. Jul 13 14:07:50 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-f4e710ff-d2ac-4b5f-839e-833ce56a6044 tempest-ProjectReaderTests-1270836308 None] Lock "cinder-04f0918e-ea87-4660-b87f-6f0f7f628ce2-delete_volume" released by "delete_volume" :: held 1.139s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 14:07:50 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-cb52bcae-bd4b-42c6-8463-b11701bde6c7 tempest-ProjectReaderTests-1270836308 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 14:07:50 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-cb52bcae-bd4b-42c6-8463-b11701bde6c7 tempest-ProjectReaderTests-1270836308 None] Flow 'volume_create_manager' (3d57c43c-42ea-4943-bf27-2615a8f35b4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 14:07:50 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-cb52bcae-bd4b-42c6-8463-b11701bde6c7 tempest-ProjectReaderTests-1270836308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c8d8a2c-c990-4846-ab17-f272b3921a11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:07:50 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-cb52bcae-bd4b-42c6-8463-b11701bde6c7 tempest-ProjectReaderTests-1270836308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c8d8a2c-c990-4846-ab17-f272b3921a11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T12:07:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-338351592',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04070641-441f-46bf-be58-1bf7b82cf104,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5612681542240199a2dae951a562fb6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T12:07:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T12:07:51Z,use_quota=True,user_id='81e774189ca14036a506f36d525af45e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1147de8b-623b-426c-a13d-7fc824a80f67),volume_type_id=1147de8b-623b-426c-a13d-7fc824a80f67)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:07:50 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-cb52bcae-bd4b-42c6-8463-b11701bde6c7 tempest-ProjectReaderTests-1270836308 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1b8b569-0066-46ec-80a6-d753f6c48f22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:07:50 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-cb52bcae-bd4b-42c6-8463-b11701bde6c7 tempest-ProjectReaderTests-1270836308 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1b8b569-0066-46ec-80a6-d753f6c48f22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:07:50 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-cb52bcae-bd4b-42c6-8463-b11701bde6c7 tempest-ProjectReaderTests-1270836308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c6c4c48-e3c3-4b49-85fb-05dbb25a0d9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:07:50 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-cb52bcae-bd4b-42c6-8463-b11701bde6c7 tempest-ProjectReaderTests-1270836308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c6c4c48-e3c3-4b49-85fb-05dbb25a0d9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '04070641-441f-46bf-be58-1bf7b82cf104', 'volume_name': 'volume-04070641-441f-46bf-be58-1bf7b82cf104', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:07:50 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-cb52bcae-bd4b-42c6-8463-b11701bde6c7 tempest-ProjectReaderTests-1270836308 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13d5f06b-5832-4402-ac9d-52bc2ae0508e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:07:50 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-cb52bcae-bd4b-42c6-8463-b11701bde6c7 tempest-ProjectReaderTests-1270836308 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13d5f06b-5832-4402-ac9d-52bc2ae0508e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:07:50 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-cb52bcae-bd4b-42c6-8463-b11701bde6c7 tempest-ProjectReaderTests-1270836308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cfb88e11-0fa5-4c2d-b7fa-aab784f69bce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:07:50 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-cb52bcae-bd4b-42c6-8463-b11701bde6c7 tempest-ProjectReaderTests-1270836308 None] Volume 04070641-441f-46bf-be58-1bf7b82cf104: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-04070641-441f-46bf-be58-1bf7b82cf104', 'volume_size': 1} Jul 13 14:07:50 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-cb52bcae-bd4b-42c6-8463-b11701bde6c7 tempest-ProjectReaderTests-1270836308 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 14:07:50 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-cb52bcae-bd4b-42c6-8463-b11701bde6c7 tempest-ProjectReaderTests-1270836308 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 14:07:50 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-cb52bcae-bd4b-42c6-8463-b11701bde6c7 tempest-ProjectReaderTests-1270836308 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T12:07:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-338351592',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04070641-441f-46bf-be58-1bf7b82cf104,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5612681542240199a2dae951a562fb6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T12:07:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T12:07:51Z,use_quota=True,user_id='81e774189ca14036a506f36d525af45e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1147de8b-623b-426c-a13d-7fc824a80f67),volume_type_id=1147de8b-623b-426c-a13d-7fc824a80f67)}" {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 13 14:07:50 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-cb52bcae-bd4b-42c6-8463-b11701bde6c7 tempest-ProjectReaderTests-1270836308 None] Creating volume 04070641-441f-46bf-be58-1bf7b82cf104 {{(pid=87098) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 13 14:07:50 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-cb52bcae-bd4b-42c6-8463-b11701bde6c7 tempest-ProjectReaderTests-1270836308 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 14:07:50 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-cb52bcae-bd4b-42c6-8463-b11701bde6c7 tempest-ProjectReaderTests-1270836308 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 14:07:50 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-cb52bcae-bd4b-42c6-8463-b11701bde6c7 tempest-ProjectReaderTests-1270836308 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 14:07:50 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-cb52bcae-bd4b-42c6-8463-b11701bde6c7 tempest-ProjectReaderTests-1270836308 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 14:07:50 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-cb52bcae-bd4b-42c6-8463-b11701bde6c7 tempest-ProjectReaderTests-1270836308 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 14:07:50 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-cb52bcae-bd4b-42c6-8463-b11701bde6c7 tempest-ProjectReaderTests-1270836308 None] Selected osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 14:07:50 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-cb52bcae-bd4b-42c6-8463-b11701bde6c7 tempest-ProjectReaderTests-1270836308 None] casted to osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 Jul 13 14:07:50 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-cb52bcae-bd4b-42c6-8463-b11701bde6c7 tempest-ProjectReaderTests-1270836308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-04070641-441f-46bf-be58-1bf7b82cf104 1073741824 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:07:50 devstack sudo[106184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-04070641-441f-46bf-be58-1bf7b82cf104 1073741824 Jul 13 14:07:50 devstack sudo[106184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:07:51 devstack sudo[106184]: pam_unix(sudo:session): session closed for user root Jul 13 14:07:51 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-cb52bcae-bd4b-42c6-8463-b11701bde6c7 tempest-ProjectReaderTests-1270836308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-04070641-441f-46bf-be58-1bf7b82cf104 1073741824" returned: 0 in 0.408s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:07:51 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-cb52bcae-bd4b-42c6-8463-b11701bde6c7 tempest-ProjectReaderTests-1270836308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-04070641-441f-46bf-be58-1bf7b82cf104 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:07:51 devstack sudo[106189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-04070641-441f-46bf-be58-1bf7b82cf104 Jul 13 14:07:51 devstack sudo[106189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:07:51 devstack sudo[106189]: pam_unix(sudo:session): session closed for user root Jul 13 14:07:51 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-cb52bcae-bd4b-42c6-8463-b11701bde6c7 tempest-ProjectReaderTests-1270836308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-04070641-441f-46bf-be58-1bf7b82cf104" returned: 0 in 0.239s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:07:51 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-cb52bcae-bd4b-42c6-8463-b11701bde6c7 tempest-ProjectReaderTests-1270836308 None] <== create_volume: return (689ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'} {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 13 14:07:51 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-cb52bcae-bd4b-42c6-8463-b11701bde6c7 tempest-ProjectReaderTests-1270836308 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.692s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 14:07:51 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-cb52bcae-bd4b-42c6-8463-b11701bde6c7 tempest-ProjectReaderTests-1270836308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cfb88e11-0fa5-4c2d-b7fa-aab784f69bce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-04070641-441f-46bf-be58-1bf7b82cf104', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:07:51 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-cb52bcae-bd4b-42c6-8463-b11701bde6c7 tempest-ProjectReaderTests-1270836308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50a1e702-946b-4820-a6f2-ebb58c907a37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:07:51 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-cb52bcae-bd4b-42c6-8463-b11701bde6c7 tempest-ProjectReaderTests-1270836308 None] Volume volume-04070641-441f-46bf-be58-1bf7b82cf104 (04070641-441f-46bf-be58-1bf7b82cf104): created successfully Jul 13 14:07:51 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-cb52bcae-bd4b-42c6-8463-b11701bde6c7 tempest-ProjectReaderTests-1270836308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50a1e702-946b-4820-a6f2-ebb58c907a37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:07:51 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-cb52bcae-bd4b-42c6-8463-b11701bde6c7 tempest-ProjectReaderTests-1270836308 None] Flow 'volume_create_manager' (3d57c43c-42ea-4943-bf27-2615a8f35b4a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 14:07:51 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-cb52bcae-bd4b-42c6-8463-b11701bde6c7 tempest-ProjectReaderTests-1270836308 None] Created volume successfully. Jul 13 14:07:51 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-2e3cb453-63bd-4b2f-a8c0-7bab2e0a56ab tempest-ProjectReaderTests-1270836308 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 14:07:51 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-2e3cb453-63bd-4b2f-a8c0-7bab2e0a56ab tempest-ProjectReaderTests-1270836308 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 14:07:51 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-2e3cb453-63bd-4b2f-a8c0-7bab2e0a56ab tempest-ProjectReaderTests-1270836308 None] Creating offline snapshot fe42cfc6-7374-4a36-8708-17a2db051f89 of volume 04070641-441f-46bf-be58-1bf7b82cf104 {{(pid=87098) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 13 14:07:51 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[02767100-c4bd-44b7-bb89-f44003bfa802]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 14:07:51 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-2e3cb453-63bd-4b2f-a8c0-7bab2e0a56ab tempest-ProjectReaderTests-1270836308 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-04070641-441f-46bf-be58-1bf7b82cf104 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:07:51 devstack sudo[106192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-04070641-441f-46bf-be58-1bf7b82cf104 Jul 13 14:07:51 devstack sudo[106192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:07:52 devstack sudo[106192]: pam_unix(sudo:session): session closed for user root Jul 13 14:07:52 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-2e3cb453-63bd-4b2f-a8c0-7bab2e0a56ab tempest-ProjectReaderTests-1270836308 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-04070641-441f-46bf-be58-1bf7b82cf104" returned: 0 in 0.349s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:07:52 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-2e3cb453-63bd-4b2f-a8c0-7bab2e0a56ab tempest-ProjectReaderTests-1270836308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-04070641-441f-46bf-be58-1bf7b82cf104,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-04070641-441f-46bf-be58-1bf7b82cf104.fe42cfc6-7374-4a36-8708-17a2db051f89 1G {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:07:52 devstack sudo[106197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-04070641-441f-46bf-be58-1bf7b82cf104,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-04070641-441f-46bf-be58-1bf7b82cf104.fe42cfc6-7374-4a36-8708-17a2db051f89 1G Jul 13 14:07:52 devstack sudo[106197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:07:52 devstack sudo[106197]: pam_unix(sudo:session): session closed for user root Jul 13 14:07:52 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-2e3cb453-63bd-4b2f-a8c0-7bab2e0a56ab tempest-ProjectReaderTests-1270836308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-04070641-441f-46bf-be58-1bf7b82cf104,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-04070641-441f-46bf-be58-1bf7b82cf104.fe42cfc6-7374-4a36-8708-17a2db051f89 1G" returned: 0 in 0.399s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:07:52 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-2e3cb453-63bd-4b2f-a8c0-7bab2e0a56ab tempest-ProjectReaderTests-1270836308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-04070641-441f-46bf-be58-1bf7b82cf104 -F qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-04070641-441f-46bf-be58-1bf7b82cf104.fe42cfc6-7374-4a36-8708-17a2db051f89 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:07:52 devstack sudo[106202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-04070641-441f-46bf-be58-1bf7b82cf104 -F qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-04070641-441f-46bf-be58-1bf7b82cf104.fe42cfc6-7374-4a36-8708-17a2db051f89 Jul 13 14:07:52 devstack sudo[106202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:07:52 devstack sudo[106202]: pam_unix(sudo:session): session closed for user root Jul 13 14:07:52 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-2e3cb453-63bd-4b2f-a8c0-7bab2e0a56ab tempest-ProjectReaderTests-1270836308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-04070641-441f-46bf-be58-1bf7b82cf104 -F qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-04070641-441f-46bf-be58-1bf7b82cf104.fe42cfc6-7374-4a36-8708-17a2db051f89" returned: 0 in 0.305s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:07:52 devstack cinder-volume[87098]: WARNING cinder.volume.drivers.remotefs [None req-2e3cb453-63bd-4b2f-a8c0-7bab2e0a56ab tempest-ProjectReaderTests-1270836308 None] /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-04070641-441f-46bf-be58-1bf7b82cf104.fe42cfc6-7374-4a36-8708-17a2db051f89 is being set with open permissions: ugo+rw Jul 13 14:07:52 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-2e3cb453-63bd-4b2f-a8c0-7bab2e0a56ab tempest-ProjectReaderTests-1270836308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-04070641-441f-46bf-be58-1bf7b82cf104.fe42cfc6-7374-4a36-8708-17a2db051f89 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:07:52 devstack sudo[106207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-04070641-441f-46bf-be58-1bf7b82cf104.fe42cfc6-7374-4a36-8708-17a2db051f89 Jul 13 14:07:52 devstack sudo[106207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:07:53 devstack sudo[106207]: pam_unix(sudo:session): session closed for user root Jul 13 14:07:53 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-2e3cb453-63bd-4b2f-a8c0-7bab2e0a56ab tempest-ProjectReaderTests-1270836308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-04070641-441f-46bf-be58-1bf7b82cf104.fe42cfc6-7374-4a36-8708-17a2db051f89" returned: 0 in 0.273s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:07:53 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-2e3cb453-63bd-4b2f-a8c0-7bab2e0a56ab tempest-ProjectReaderTests-1270836308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-04070641-441f-46bf-be58-1bf7b82cf104.info {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:07:53 devstack sudo[106213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-04070641-441f-46bf-be58-1bf7b82cf104.info Jul 13 14:07:53 devstack sudo[106213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:07:53 devstack sudo[106213]: pam_unix(sudo:session): session closed for user root Jul 13 14:07:53 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-2e3cb453-63bd-4b2f-a8c0-7bab2e0a56ab tempest-ProjectReaderTests-1270836308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-04070641-441f-46bf-be58-1bf7b82cf104.info" returned: 0 in 0.257s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:07:53 devstack cinder-volume[87098]: WARNING cinder.volume.drivers.remotefs [None req-2e3cb453-63bd-4b2f-a8c0-7bab2e0a56ab tempest-ProjectReaderTests-1270836308 None] /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-04070641-441f-46bf-be58-1bf7b82cf104.info is being set with open permissions: ugo+rw Jul 13 14:07:53 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-2e3cb453-63bd-4b2f-a8c0-7bab2e0a56ab tempest-ProjectReaderTests-1270836308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-04070641-441f-46bf-be58-1bf7b82cf104.info {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:07:53 devstack sudo[106216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-04070641-441f-46bf-be58-1bf7b82cf104.info Jul 13 14:07:53 devstack sudo[106216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:07:53 devstack sudo[106216]: pam_unix(sudo:session): session closed for user root Jul 13 14:07:53 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-2e3cb453-63bd-4b2f-a8c0-7bab2e0a56ab tempest-ProjectReaderTests-1270836308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-04070641-441f-46bf-be58-1bf7b82cf104.info" returned: 0 in 0.240s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:07:53 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-2e3cb453-63bd-4b2f-a8c0-7bab2e0a56ab tempest-ProjectReaderTests-1270836308 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.908s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 14:07:53 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-2e3cb453-63bd-4b2f-a8c0-7bab2e0a56ab tempest-ProjectReaderTests-1270836308 None] Create snapshot completed successfully Jul 13 14:07:53 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-5da767c8-cd3c-4fa0-885b-2fbc6d476e6b tempest-ProjectReaderTests-1270836308 None] Acquiring lock "cinder-fe42cfc6-7374-4a36-8708-17a2db051f89-delete_snapshot" by "delete_snapshot" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 14:07:53 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-5da767c8-cd3c-4fa0-885b-2fbc6d476e6b tempest-ProjectReaderTests-1270836308 None] Lock "cinder-fe42cfc6-7374-4a36-8708-17a2db051f89-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 14:07:53 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-5da767c8-cd3c-4fa0-885b-2fbc6d476e6b tempest-ProjectReaderTests-1270836308 None] Acquiring lock "cinder-quobyte-04070641-441f-46bf-be58-1bf7b82cf104" by "delete_snapshot" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 14:07:53 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-5da767c8-cd3c-4fa0-885b-2fbc6d476e6b tempest-ProjectReaderTests-1270836308 None] Lock "cinder-quobyte-04070641-441f-46bf-be58-1bf7b82cf104" acquired by "delete_snapshot" :: waited 0.013s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 14:07:53 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-5da767c8-cd3c-4fa0-885b-2fbc6d476e6b tempest-ProjectReaderTests-1270836308 None] Acquiring lock "cinder-quobyte-fe42cfc6-7374-4a36-8708-17a2db051f89" by "_delete_snapshot" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 14:07:53 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-5da767c8-cd3c-4fa0-885b-2fbc6d476e6b tempest-ProjectReaderTests-1270836308 None] Lock "cinder-quobyte-fe42cfc6-7374-4a36-8708-17a2db051f89" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 14:07:53 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-5da767c8-cd3c-4fa0-885b-2fbc6d476e6b tempest-ProjectReaderTests-1270836308 None] Deleting offline snapshot fe42cfc6-7374-4a36-8708-17a2db051f89 of volume 04070641-441f-46bf-be58-1bf7b82cf104 {{(pid=87098) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 13 14:07:53 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-5da767c8-cd3c-4fa0-885b-2fbc6d476e6b tempest-ProjectReaderTests-1270836308 None] snapshot_file for this snap is: volume-04070641-441f-46bf-be58-1bf7b82cf104.fe42cfc6-7374-4a36-8708-17a2db051f89 {{(pid=87098) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 13 14:07:53 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[ece74c02-ffab-4f67-9cef-506d31a91434]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 14:07:53 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-5da767c8-cd3c-4fa0-885b-2fbc6d476e6b tempest-ProjectReaderTests-1270836308 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-04070641-441f-46bf-be58-1bf7b82cf104.fe42cfc6-7374-4a36-8708-17a2db051f89 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:07:54 devstack sudo[106219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-04070641-441f-46bf-be58-1bf7b82cf104.fe42cfc6-7374-4a36-8708-17a2db051f89 Jul 13 14:07:54 devstack sudo[106219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:07:54 devstack sudo[106219]: pam_unix(sudo:session): session closed for user root Jul 13 14:07:54 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-5da767c8-cd3c-4fa0-885b-2fbc6d476e6b tempest-ProjectReaderTests-1270836308 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-04070641-441f-46bf-be58-1bf7b82cf104.fe42cfc6-7374-4a36-8708-17a2db051f89" returned: 0 in 0.345s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:07:54 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-5da767c8-cd3c-4fa0-885b-2fbc6d476e6b tempest-ProjectReaderTests-1270836308 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-04070641-441f-46bf-be58-1bf7b82cf104(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87098) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 13 14:07:54 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[5758ec83-f23c-410e-a997-e370e3261cf9]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 14:07:54 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-5da767c8-cd3c-4fa0-885b-2fbc6d476e6b tempest-ProjectReaderTests-1270836308 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-04070641-441f-46bf-be58-1bf7b82cf104 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:07:54 devstack sudo[106225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-04070641-441f-46bf-be58-1bf7b82cf104 Jul 13 14:07:54 devstack sudo[106225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:07:54 devstack sudo[106225]: pam_unix(sudo:session): session closed for user root Jul 13 14:07:54 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-5da767c8-cd3c-4fa0-885b-2fbc6d476e6b tempest-ProjectReaderTests-1270836308 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-04070641-441f-46bf-be58-1bf7b82cf104" returned: 0 in 0.356s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:07:54 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-5da767c8-cd3c-4fa0-885b-2fbc6d476e6b tempest-ProjectReaderTests-1270836308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-04070641-441f-46bf-be58-1bf7b82cf104.fe42cfc6-7374-4a36-8708-17a2db051f89 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:07:54 devstack sudo[106230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-04070641-441f-46bf-be58-1bf7b82cf104.fe42cfc6-7374-4a36-8708-17a2db051f89 Jul 13 14:07:54 devstack sudo[106230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:07:55 devstack sudo[106230]: pam_unix(sudo:session): session closed for user root Jul 13 14:07:55 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-5da767c8-cd3c-4fa0-885b-2fbc6d476e6b tempest-ProjectReaderTests-1270836308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-04070641-441f-46bf-be58-1bf7b82cf104.fe42cfc6-7374-4a36-8708-17a2db051f89" returned: 0 in 0.353s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:07:55 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-5da767c8-cd3c-4fa0-885b-2fbc6d476e6b tempest-ProjectReaderTests-1270836308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-04070641-441f-46bf-be58-1bf7b82cf104.fe42cfc6-7374-4a36-8708-17a2db051f89 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:07:55 devstack sudo[106235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-04070641-441f-46bf-be58-1bf7b82cf104.fe42cfc6-7374-4a36-8708-17a2db051f89 Jul 13 14:07:55 devstack sudo[106235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:07:55 devstack sudo[106235]: pam_unix(sudo:session): session closed for user root Jul 13 14:07:55 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-5da767c8-cd3c-4fa0-885b-2fbc6d476e6b tempest-ProjectReaderTests-1270836308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-04070641-441f-46bf-be58-1bf7b82cf104.fe42cfc6-7374-4a36-8708-17a2db051f89" returned: 0 in 0.260s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:07:55 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-5da767c8-cd3c-4fa0-885b-2fbc6d476e6b tempest-ProjectReaderTests-1270836308 None] Lock "cinder-quobyte-fe42cfc6-7374-4a36-8708-17a2db051f89" released by "_delete_snapshot" :: held 1.401s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 14:07:55 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-5da767c8-cd3c-4fa0-885b-2fbc6d476e6b tempest-ProjectReaderTests-1270836308 None] Lock "cinder-quobyte-04070641-441f-46bf-be58-1bf7b82cf104" released by "delete_snapshot" :: held 1.423s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 14:07:55 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-5da767c8-cd3c-4fa0-885b-2fbc6d476e6b tempest-ProjectReaderTests-1270836308 None] Created reservations ['492a4054-20b8-4bc9-9bea-e3b363013278', '1a0451a4-fe4b-462d-a971-f767c4724dde', 'c8a9a15e-f656-45ae-94f4-aa49e6ecacf4', 'f415824f-2148-4240-b7af-1b3658fbd12a'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 14:07:55 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-5da767c8-cd3c-4fa0-885b-2fbc6d476e6b tempest-ProjectReaderTests-1270836308 None] Delete snapshot completed successfully. Jul 13 14:07:55 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-5da767c8-cd3c-4fa0-885b-2fbc6d476e6b tempest-ProjectReaderTests-1270836308 None] Lock "cinder-fe42cfc6-7374-4a36-8708-17a2db051f89-delete_snapshot" released by "delete_snapshot" :: held 1.547s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 14:07:56 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-9ec01039-37cd-4ea0-bf8b-dbf643558b15 tempest-ProjectReaderTests-1270836308 None] Acquiring lock "cinder-04070641-441f-46bf-be58-1bf7b82cf104-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 14:07:56 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-9ec01039-37cd-4ea0-bf8b-dbf643558b15 tempest-ProjectReaderTests-1270836308 None] Lock "cinder-04070641-441f-46bf-be58-1bf7b82cf104-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 14:07:56 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-9ec01039-37cd-4ea0-bf8b-dbf643558b15 tempest-ProjectReaderTests-1270836308 None] Acquiring lock "cinder-quobyte-04070641-441f-46bf-be58-1bf7b82cf104" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 14:07:56 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-9ec01039-37cd-4ea0-bf8b-dbf643558b15 tempest-ProjectReaderTests-1270836308 None] Lock "cinder-quobyte-04070641-441f-46bf-be58-1bf7b82cf104" acquired by "delete_volume" :: waited 0.020s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 14:07:56 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[440167b2-bd1e-4132-a850-a5c4178637c9]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 14:07:56 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-9ec01039-37cd-4ea0-bf8b-dbf643558b15 tempest-ProjectReaderTests-1270836308 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-04070641-441f-46bf-be58-1bf7b82cf104 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:07:56 devstack sudo[106238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-04070641-441f-46bf-be58-1bf7b82cf104 Jul 13 14:07:56 devstack sudo[106238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:07:56 devstack sudo[106238]: pam_unix(sudo:session): session closed for user root Jul 13 14:07:56 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-9ec01039-37cd-4ea0-bf8b-dbf643558b15 tempest-ProjectReaderTests-1270836308 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-04070641-441f-46bf-be58-1bf7b82cf104" returned: 0 in 0.359s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:07:56 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-9ec01039-37cd-4ea0-bf8b-dbf643558b15 tempest-ProjectReaderTests-1270836308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-04070641-441f-46bf-be58-1bf7b82cf104 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:07:56 devstack sudo[106243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-04070641-441f-46bf-be58-1bf7b82cf104 Jul 13 14:07:56 devstack sudo[106243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:07:56 devstack sudo[106243]: pam_unix(sudo:session): session closed for user root Jul 13 14:07:56 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-9ec01039-37cd-4ea0-bf8b-dbf643558b15 tempest-ProjectReaderTests-1270836308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-04070641-441f-46bf-be58-1bf7b82cf104" returned: 0 in 0.236s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:07:56 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-9ec01039-37cd-4ea0-bf8b-dbf643558b15 tempest-ProjectReaderTests-1270836308 None] Lock "cinder-quobyte-04070641-441f-46bf-be58-1bf7b82cf104" released by "delete_volume" :: held 0.647s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 14:07:56 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-9ec01039-37cd-4ea0-bf8b-dbf643558b15 tempest-ProjectReaderTests-1270836308 None] Created reservations ['c3f2b51c-ebea-4c24-829d-9ef7ea368bfc', 'f0fb578e-5e30-41b4-8dbb-c1d6f6add1b8', '16080b9a-cf30-4e20-81c4-a5adb9880391', '4fe57bed-063f-4bf1-add6-9a17abecfcc3'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 14:07:56 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-9ec01039-37cd-4ea0-bf8b-dbf643558b15 tempest-ProjectReaderTests-1270836308 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 14:07:56 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-9ec01039-37cd-4ea0-bf8b-dbf643558b15 tempest-ProjectReaderTests-1270836308 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 14:07:56 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-9ec01039-37cd-4ea0-bf8b-dbf643558b15 tempest-ProjectReaderTests-1270836308 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 14:07:56 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-9ec01039-37cd-4ea0-bf8b-dbf643558b15 tempest-ProjectReaderTests-1270836308 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 14:07:56 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-9ec01039-37cd-4ea0-bf8b-dbf643558b15 tempest-ProjectReaderTests-1270836308 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 14:07:56 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-9ec01039-37cd-4ea0-bf8b-dbf643558b15 tempest-ProjectReaderTests-1270836308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:07:56 devstack sudo[106246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 Jul 13 14:07:56 devstack sudo[106246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:07:57 devstack sudo[106246]: pam_unix(sudo:session): session closed for user root Jul 13 14:07:57 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-9ec01039-37cd-4ea0-bf8b-dbf643558b15 tempest-ProjectReaderTests-1270836308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78" returned: 0 in 0.237s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:07:57 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-9ec01039-37cd-4ea0-bf8b-dbf643558b15 tempest-ProjectReaderTests-1270836308 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 14:07:57 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-9ec01039-37cd-4ea0-bf8b-dbf643558b15 tempest-ProjectReaderTests-1270836308 None] Deleted volume successfully. Jul 13 14:07:57 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-9ec01039-37cd-4ea0-bf8b-dbf643558b15 tempest-ProjectReaderTests-1270836308 None] Lock "cinder-04070641-441f-46bf-be58-1bf7b82cf104-delete_volume" released by "delete_volume" :: held 1.082s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 14:07:57 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-1e67b1b0-13dd-4410-a396-0e23bb8f9ad2 tempest-ProjectReaderTests-1270836308 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 14:07:57 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-1e67b1b0-13dd-4410-a396-0e23bb8f9ad2 tempest-ProjectReaderTests-1270836308 None] Flow 'volume_create_manager' (f0fee0e0-87f1-46f5-aec7-480cb7e2b225) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 14:07:57 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-1e67b1b0-13dd-4410-a396-0e23bb8f9ad2 tempest-ProjectReaderTests-1270836308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a584352-9465-47ea-b123-d67d8114d62d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:07:57 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-1e67b1b0-13dd-4410-a396-0e23bb8f9ad2 tempest-ProjectReaderTests-1270836308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a584352-9465-47ea-b123-d67d8114d62d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T12:07:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1451960915',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5587d8f1-7979-4755-862a-b49a92f4e86b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5612681542240199a2dae951a562fb6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T12:07:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T12:07:58Z,use_quota=True,user_id='81e774189ca14036a506f36d525af45e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1147de8b-623b-426c-a13d-7fc824a80f67),volume_type_id=1147de8b-623b-426c-a13d-7fc824a80f67)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:07:57 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-1e67b1b0-13dd-4410-a396-0e23bb8f9ad2 tempest-ProjectReaderTests-1270836308 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63b226d4-58b9-4f86-aa84-74296dcc3b24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:07:57 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-1e67b1b0-13dd-4410-a396-0e23bb8f9ad2 tempest-ProjectReaderTests-1270836308 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63b226d4-58b9-4f86-aa84-74296dcc3b24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:07:57 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-1e67b1b0-13dd-4410-a396-0e23bb8f9ad2 tempest-ProjectReaderTests-1270836308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80aebd7f-0ce4-44ac-b518-deb2c5d704ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:07:57 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-1e67b1b0-13dd-4410-a396-0e23bb8f9ad2 tempest-ProjectReaderTests-1270836308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80aebd7f-0ce4-44ac-b518-deb2c5d704ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5587d8f1-7979-4755-862a-b49a92f4e86b', 'volume_name': 'volume-5587d8f1-7979-4755-862a-b49a92f4e86b', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:07:57 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-1e67b1b0-13dd-4410-a396-0e23bb8f9ad2 tempest-ProjectReaderTests-1270836308 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c78e54f-d35b-498a-97fd-350bba6e51ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:07:57 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-1e67b1b0-13dd-4410-a396-0e23bb8f9ad2 tempest-ProjectReaderTests-1270836308 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c78e54f-d35b-498a-97fd-350bba6e51ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:07:57 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-1e67b1b0-13dd-4410-a396-0e23bb8f9ad2 tempest-ProjectReaderTests-1270836308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76f2763e-7b52-4fe3-a5e3-1c14b1a9045d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:07:57 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-1e67b1b0-13dd-4410-a396-0e23bb8f9ad2 tempest-ProjectReaderTests-1270836308 None] Volume 5587d8f1-7979-4755-862a-b49a92f4e86b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5587d8f1-7979-4755-862a-b49a92f4e86b', 'volume_size': 1} Jul 13 14:07:57 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-1e67b1b0-13dd-4410-a396-0e23bb8f9ad2 tempest-ProjectReaderTests-1270836308 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 14:07:57 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-1e67b1b0-13dd-4410-a396-0e23bb8f9ad2 tempest-ProjectReaderTests-1270836308 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 14:07:57 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-1e67b1b0-13dd-4410-a396-0e23bb8f9ad2 tempest-ProjectReaderTests-1270836308 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T12:07:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1451960915',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5587d8f1-7979-4755-862a-b49a92f4e86b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5612681542240199a2dae951a562fb6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T12:07:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T12:07:58Z,use_quota=True,user_id='81e774189ca14036a506f36d525af45e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1147de8b-623b-426c-a13d-7fc824a80f67),volume_type_id=1147de8b-623b-426c-a13d-7fc824a80f67)}" {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 13 14:07:57 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-1e67b1b0-13dd-4410-a396-0e23bb8f9ad2 tempest-ProjectReaderTests-1270836308 None] Creating volume 5587d8f1-7979-4755-862a-b49a92f4e86b {{(pid=87098) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 13 14:07:57 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-1e67b1b0-13dd-4410-a396-0e23bb8f9ad2 tempest-ProjectReaderTests-1270836308 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 14:07:57 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-1e67b1b0-13dd-4410-a396-0e23bb8f9ad2 tempest-ProjectReaderTests-1270836308 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 14:07:57 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-1e67b1b0-13dd-4410-a396-0e23bb8f9ad2 tempest-ProjectReaderTests-1270836308 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 14:07:57 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-1e67b1b0-13dd-4410-a396-0e23bb8f9ad2 tempest-ProjectReaderTests-1270836308 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 14:07:57 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-1e67b1b0-13dd-4410-a396-0e23bb8f9ad2 tempest-ProjectReaderTests-1270836308 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 14:07:57 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-1e67b1b0-13dd-4410-a396-0e23bb8f9ad2 tempest-ProjectReaderTests-1270836308 None] Selected osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 14:07:57 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-1e67b1b0-13dd-4410-a396-0e23bb8f9ad2 tempest-ProjectReaderTests-1270836308 None] casted to osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 Jul 13 14:07:57 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-1e67b1b0-13dd-4410-a396-0e23bb8f9ad2 tempest-ProjectReaderTests-1270836308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-5587d8f1-7979-4755-862a-b49a92f4e86b 1073741824 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:07:57 devstack sudo[106250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-5587d8f1-7979-4755-862a-b49a92f4e86b 1073741824 Jul 13 14:07:57 devstack sudo[106250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:07:58 devstack sudo[106250]: pam_unix(sudo:session): session closed for user root Jul 13 14:07:58 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-1e67b1b0-13dd-4410-a396-0e23bb8f9ad2 tempest-ProjectReaderTests-1270836308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-5587d8f1-7979-4755-862a-b49a92f4e86b 1073741824" returned: 0 in 0.391s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:07:58 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-1e67b1b0-13dd-4410-a396-0e23bb8f9ad2 tempest-ProjectReaderTests-1270836308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-5587d8f1-7979-4755-862a-b49a92f4e86b {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:07:58 devstack sudo[106256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-5587d8f1-7979-4755-862a-b49a92f4e86b Jul 13 14:07:58 devstack sudo[106256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:07:58 devstack sudo[106256]: pam_unix(sudo:session): session closed for user root Jul 13 14:07:58 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-1e67b1b0-13dd-4410-a396-0e23bb8f9ad2 tempest-ProjectReaderTests-1270836308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-5587d8f1-7979-4755-862a-b49a92f4e86b" returned: 0 in 0.235s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:07:58 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-1e67b1b0-13dd-4410-a396-0e23bb8f9ad2 tempest-ProjectReaderTests-1270836308 None] <== create_volume: return (664ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'} {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 13 14:07:58 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-1e67b1b0-13dd-4410-a396-0e23bb8f9ad2 tempest-ProjectReaderTests-1270836308 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.667s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 14:07:58 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-1e67b1b0-13dd-4410-a396-0e23bb8f9ad2 tempest-ProjectReaderTests-1270836308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76f2763e-7b52-4fe3-a5e3-1c14b1a9045d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5587d8f1-7979-4755-862a-b49a92f4e86b', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:07:58 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-1e67b1b0-13dd-4410-a396-0e23bb8f9ad2 tempest-ProjectReaderTests-1270836308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d21c74e3-969a-4e9e-99e2-9fa896bb1e41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:07:58 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-1e67b1b0-13dd-4410-a396-0e23bb8f9ad2 tempest-ProjectReaderTests-1270836308 None] Volume volume-5587d8f1-7979-4755-862a-b49a92f4e86b (5587d8f1-7979-4755-862a-b49a92f4e86b): created successfully Jul 13 14:07:58 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-1e67b1b0-13dd-4410-a396-0e23bb8f9ad2 tempest-ProjectReaderTests-1270836308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d21c74e3-969a-4e9e-99e2-9fa896bb1e41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:07:58 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-1e67b1b0-13dd-4410-a396-0e23bb8f9ad2 tempest-ProjectReaderTests-1270836308 None] Flow 'volume_create_manager' (f0fee0e0-87f1-46f5-aec7-480cb7e2b225) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 14:07:58 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-1e67b1b0-13dd-4410-a396-0e23bb8f9ad2 tempest-ProjectReaderTests-1270836308 None] Created volume successfully. Jul 13 14:07:58 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-1a993de9-da74-49b7-a881-64d1923d9588 tempest-ProjectReaderTests-1270836308 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 14:07:58 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-1a993de9-da74-49b7-a881-64d1923d9588 tempest-ProjectReaderTests-1270836308 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 14:07:58 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-1a993de9-da74-49b7-a881-64d1923d9588 tempest-ProjectReaderTests-1270836308 None] Creating offline snapshot 166950b3-6cee-47e6-be39-17f99152c75f of volume 5587d8f1-7979-4755-862a-b49a92f4e86b {{(pid=87098) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 13 14:07:58 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[72a5bc30-c364-4762-b802-8cd1bc98eba1]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 14:07:58 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-1a993de9-da74-49b7-a881-64d1923d9588 tempest-ProjectReaderTests-1270836308 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-5587d8f1-7979-4755-862a-b49a92f4e86b {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:07:58 devstack sudo[106259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-5587d8f1-7979-4755-862a-b49a92f4e86b Jul 13 14:07:58 devstack sudo[106259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:07:59 devstack sudo[106259]: pam_unix(sudo:session): session closed for user root Jul 13 14:07:59 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-1a993de9-da74-49b7-a881-64d1923d9588 tempest-ProjectReaderTests-1270836308 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-5587d8f1-7979-4755-862a-b49a92f4e86b" returned: 0 in 0.356s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:07:59 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-1a993de9-da74-49b7-a881-64d1923d9588 tempest-ProjectReaderTests-1270836308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-5587d8f1-7979-4755-862a-b49a92f4e86b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-5587d8f1-7979-4755-862a-b49a92f4e86b.166950b3-6cee-47e6-be39-17f99152c75f 1G {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:07:59 devstack sudo[106264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-5587d8f1-7979-4755-862a-b49a92f4e86b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-5587d8f1-7979-4755-862a-b49a92f4e86b.166950b3-6cee-47e6-be39-17f99152c75f 1G Jul 13 14:07:59 devstack sudo[106264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:07:59 devstack sudo[106264]: pam_unix(sudo:session): session closed for user root Jul 13 14:07:59 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-1a993de9-da74-49b7-a881-64d1923d9588 tempest-ProjectReaderTests-1270836308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-5587d8f1-7979-4755-862a-b49a92f4e86b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-5587d8f1-7979-4755-862a-b49a92f4e86b.166950b3-6cee-47e6-be39-17f99152c75f 1G" returned: 0 in 0.399s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:07:59 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-1a993de9-da74-49b7-a881-64d1923d9588 tempest-ProjectReaderTests-1270836308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5587d8f1-7979-4755-862a-b49a92f4e86b -F qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-5587d8f1-7979-4755-862a-b49a92f4e86b.166950b3-6cee-47e6-be39-17f99152c75f {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:07:59 devstack sudo[106269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5587d8f1-7979-4755-862a-b49a92f4e86b -F qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-5587d8f1-7979-4755-862a-b49a92f4e86b.166950b3-6cee-47e6-be39-17f99152c75f Jul 13 14:07:59 devstack sudo[106269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:07:59 devstack sudo[106269]: pam_unix(sudo:session): session closed for user root Jul 13 14:07:59 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-1a993de9-da74-49b7-a881-64d1923d9588 tempest-ProjectReaderTests-1270836308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5587d8f1-7979-4755-862a-b49a92f4e86b -F qcow2 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-5587d8f1-7979-4755-862a-b49a92f4e86b.166950b3-6cee-47e6-be39-17f99152c75f" returned: 0 in 0.282s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:07:59 devstack cinder-volume[87098]: WARNING cinder.volume.drivers.remotefs [None req-1a993de9-da74-49b7-a881-64d1923d9588 tempest-ProjectReaderTests-1270836308 None] /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-5587d8f1-7979-4755-862a-b49a92f4e86b.166950b3-6cee-47e6-be39-17f99152c75f is being set with open permissions: ugo+rw Jul 13 14:07:59 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-1a993de9-da74-49b7-a881-64d1923d9588 tempest-ProjectReaderTests-1270836308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-5587d8f1-7979-4755-862a-b49a92f4e86b.166950b3-6cee-47e6-be39-17f99152c75f {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:07:59 devstack sudo[106274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-5587d8f1-7979-4755-862a-b49a92f4e86b.166950b3-6cee-47e6-be39-17f99152c75f Jul 13 14:07:59 devstack sudo[106274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:08:00 devstack sudo[106274]: pam_unix(sudo:session): session closed for user root Jul 13 14:08:00 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-1a993de9-da74-49b7-a881-64d1923d9588 tempest-ProjectReaderTests-1270836308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-5587d8f1-7979-4755-862a-b49a92f4e86b.166950b3-6cee-47e6-be39-17f99152c75f" returned: 0 in 0.244s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:08:00 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-1a993de9-da74-49b7-a881-64d1923d9588 tempest-ProjectReaderTests-1270836308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-5587d8f1-7979-4755-862a-b49a92f4e86b.info {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:08:00 devstack sudo[106277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-5587d8f1-7979-4755-862a-b49a92f4e86b.info Jul 13 14:08:00 devstack sudo[106277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:08:00 devstack sudo[106277]: pam_unix(sudo:session): session closed for user root Jul 13 14:08:00 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-1a993de9-da74-49b7-a881-64d1923d9588 tempest-ProjectReaderTests-1270836308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-5587d8f1-7979-4755-862a-b49a92f4e86b.info" returned: 0 in 0.244s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:08:00 devstack cinder-volume[87098]: WARNING cinder.volume.drivers.remotefs [None req-1a993de9-da74-49b7-a881-64d1923d9588 tempest-ProjectReaderTests-1270836308 None] /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-5587d8f1-7979-4755-862a-b49a92f4e86b.info is being set with open permissions: ugo+rw Jul 13 14:08:00 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-1a993de9-da74-49b7-a881-64d1923d9588 tempest-ProjectReaderTests-1270836308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-5587d8f1-7979-4755-862a-b49a92f4e86b.info {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:08:00 devstack sudo[106280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-5587d8f1-7979-4755-862a-b49a92f4e86b.info Jul 13 14:08:00 devstack sudo[106280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:08:00 devstack sudo[106280]: pam_unix(sudo:session): session closed for user root Jul 13 14:08:00 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-1a993de9-da74-49b7-a881-64d1923d9588 tempest-ProjectReaderTests-1270836308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-5587d8f1-7979-4755-862a-b49a92f4e86b.info" returned: 0 in 0.241s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:08:00 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-1a993de9-da74-49b7-a881-64d1923d9588 tempest-ProjectReaderTests-1270836308 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.839s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 14:08:00 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-1a993de9-da74-49b7-a881-64d1923d9588 tempest-ProjectReaderTests-1270836308 None] Create snapshot completed successfully Jul 13 14:08:00 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-105ad7e3-7b9d-47d9-bbb8-46daae8f0aaf tempest-ProjectReaderTests-1270836308 None] Acquiring lock "cinder-166950b3-6cee-47e6-be39-17f99152c75f-delete_snapshot" by "delete_snapshot" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 14:08:00 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-105ad7e3-7b9d-47d9-bbb8-46daae8f0aaf tempest-ProjectReaderTests-1270836308 None] Lock "cinder-166950b3-6cee-47e6-be39-17f99152c75f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 14:08:00 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-105ad7e3-7b9d-47d9-bbb8-46daae8f0aaf tempest-ProjectReaderTests-1270836308 None] Acquiring lock "cinder-quobyte-5587d8f1-7979-4755-862a-b49a92f4e86b" by "delete_snapshot" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 14:08:00 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-105ad7e3-7b9d-47d9-bbb8-46daae8f0aaf tempest-ProjectReaderTests-1270836308 None] Lock "cinder-quobyte-5587d8f1-7979-4755-862a-b49a92f4e86b" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 14:08:00 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-105ad7e3-7b9d-47d9-bbb8-46daae8f0aaf tempest-ProjectReaderTests-1270836308 None] Acquiring lock "cinder-quobyte-166950b3-6cee-47e6-be39-17f99152c75f" by "_delete_snapshot" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 14:08:00 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-105ad7e3-7b9d-47d9-bbb8-46daae8f0aaf tempest-ProjectReaderTests-1270836308 None] Lock "cinder-quobyte-166950b3-6cee-47e6-be39-17f99152c75f" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 14:08:00 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-105ad7e3-7b9d-47d9-bbb8-46daae8f0aaf tempest-ProjectReaderTests-1270836308 None] Deleting offline snapshot 166950b3-6cee-47e6-be39-17f99152c75f of volume 5587d8f1-7979-4755-862a-b49a92f4e86b {{(pid=87098) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 13 14:08:01 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-105ad7e3-7b9d-47d9-bbb8-46daae8f0aaf tempest-ProjectReaderTests-1270836308 None] snapshot_file for this snap is: volume-5587d8f1-7979-4755-862a-b49a92f4e86b.166950b3-6cee-47e6-be39-17f99152c75f {{(pid=87098) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 13 14:08:01 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[dff46839-b747-4aff-8ca2-cea26576b992]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 14:08:01 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-105ad7e3-7b9d-47d9-bbb8-46daae8f0aaf tempest-ProjectReaderTests-1270836308 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-5587d8f1-7979-4755-862a-b49a92f4e86b.166950b3-6cee-47e6-be39-17f99152c75f {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:08:01 devstack sudo[106283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-5587d8f1-7979-4755-862a-b49a92f4e86b.166950b3-6cee-47e6-be39-17f99152c75f Jul 13 14:08:01 devstack sudo[106283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:08:01 devstack sudo[106283]: pam_unix(sudo:session): session closed for user root Jul 13 14:08:01 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-105ad7e3-7b9d-47d9-bbb8-46daae8f0aaf tempest-ProjectReaderTests-1270836308 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-5587d8f1-7979-4755-862a-b49a92f4e86b.166950b3-6cee-47e6-be39-17f99152c75f" returned: 0 in 0.361s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:08:01 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-105ad7e3-7b9d-47d9-bbb8-46daae8f0aaf tempest-ProjectReaderTests-1270836308 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5587d8f1-7979-4755-862a-b49a92f4e86b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87098) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 13 14:08:01 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[657c9956-b876-4eb0-8ba5-a6599fca520b]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 14:08:01 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-105ad7e3-7b9d-47d9-bbb8-46daae8f0aaf tempest-ProjectReaderTests-1270836308 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-5587d8f1-7979-4755-862a-b49a92f4e86b {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:08:01 devstack sudo[106288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-5587d8f1-7979-4755-862a-b49a92f4e86b Jul 13 14:08:01 devstack sudo[106288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:08:01 devstack sudo[106288]: pam_unix(sudo:session): session closed for user root Jul 13 14:08:01 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-105ad7e3-7b9d-47d9-bbb8-46daae8f0aaf tempest-ProjectReaderTests-1270836308 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-5587d8f1-7979-4755-862a-b49a92f4e86b" returned: 0 in 0.353s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:08:01 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-105ad7e3-7b9d-47d9-bbb8-46daae8f0aaf tempest-ProjectReaderTests-1270836308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-5587d8f1-7979-4755-862a-b49a92f4e86b.166950b3-6cee-47e6-be39-17f99152c75f {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:08:01 devstack sudo[106293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-5587d8f1-7979-4755-862a-b49a92f4e86b.166950b3-6cee-47e6-be39-17f99152c75f Jul 13 14:08:01 devstack sudo[106293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:08:02 devstack sudo[106293]: pam_unix(sudo:session): session closed for user root Jul 13 14:08:02 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-105ad7e3-7b9d-47d9-bbb8-46daae8f0aaf tempest-ProjectReaderTests-1270836308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-5587d8f1-7979-4755-862a-b49a92f4e86b.166950b3-6cee-47e6-be39-17f99152c75f" returned: 0 in 0.330s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:08:02 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-105ad7e3-7b9d-47d9-bbb8-46daae8f0aaf tempest-ProjectReaderTests-1270836308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-5587d8f1-7979-4755-862a-b49a92f4e86b.166950b3-6cee-47e6-be39-17f99152c75f {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:08:02 devstack sudo[106298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-5587d8f1-7979-4755-862a-b49a92f4e86b.166950b3-6cee-47e6-be39-17f99152c75f Jul 13 14:08:02 devstack sudo[106298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:08:02 devstack sudo[106298]: pam_unix(sudo:session): session closed for user root Jul 13 14:08:02 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-105ad7e3-7b9d-47d9-bbb8-46daae8f0aaf tempest-ProjectReaderTests-1270836308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-5587d8f1-7979-4755-862a-b49a92f4e86b.166950b3-6cee-47e6-be39-17f99152c75f" returned: 0 in 0.255s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:08:02 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-105ad7e3-7b9d-47d9-bbb8-46daae8f0aaf tempest-ProjectReaderTests-1270836308 None] Lock "cinder-quobyte-166950b3-6cee-47e6-be39-17f99152c75f" released by "_delete_snapshot" :: held 1.388s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 14:08:02 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-105ad7e3-7b9d-47d9-bbb8-46daae8f0aaf tempest-ProjectReaderTests-1270836308 None] Lock "cinder-quobyte-5587d8f1-7979-4755-862a-b49a92f4e86b" released by "delete_snapshot" :: held 1.412s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 14:08:02 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-105ad7e3-7b9d-47d9-bbb8-46daae8f0aaf tempest-ProjectReaderTests-1270836308 None] Created reservations ['965f8b86-1b4c-40a3-b0b2-74a80f424397', 'eb329483-2936-4c8b-b09d-f37db69f50d0', '24343422-5cb7-494e-8481-35d62447cee1', '603a386d-9dd1-44e7-9b69-410900a81153'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 14:08:02 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-105ad7e3-7b9d-47d9-bbb8-46daae8f0aaf tempest-ProjectReaderTests-1270836308 None] Delete snapshot completed successfully. Jul 13 14:08:02 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-105ad7e3-7b9d-47d9-bbb8-46daae8f0aaf tempest-ProjectReaderTests-1270836308 None] Lock "cinder-166950b3-6cee-47e6-be39-17f99152c75f-delete_snapshot" released by "delete_snapshot" :: held 1.555s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 14:08:03 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-cd9a3e6f-b034-4b9a-a5b9-c7ce1a478a27 tempest-ProjectReaderTests-1270836308 None] Acquiring lock "cinder-5587d8f1-7979-4755-862a-b49a92f4e86b-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 14:08:03 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-cd9a3e6f-b034-4b9a-a5b9-c7ce1a478a27 tempest-ProjectReaderTests-1270836308 None] Lock "cinder-5587d8f1-7979-4755-862a-b49a92f4e86b-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 14:08:03 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-cd9a3e6f-b034-4b9a-a5b9-c7ce1a478a27 tempest-ProjectReaderTests-1270836308 None] Acquiring lock "cinder-quobyte-5587d8f1-7979-4755-862a-b49a92f4e86b" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 14:08:03 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-cd9a3e6f-b034-4b9a-a5b9-c7ce1a478a27 tempest-ProjectReaderTests-1270836308 None] Lock "cinder-quobyte-5587d8f1-7979-4755-862a-b49a92f4e86b" acquired by "delete_volume" :: waited 0.014s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 14:08:03 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[f454e0fe-27d4-4682-b55c-61fe642c4b19]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 14:08:03 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-cd9a3e6f-b034-4b9a-a5b9-c7ce1a478a27 tempest-ProjectReaderTests-1270836308 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-5587d8f1-7979-4755-862a-b49a92f4e86b {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:08:03 devstack sudo[106301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-5587d8f1-7979-4755-862a-b49a92f4e86b Jul 13 14:08:03 devstack sudo[106301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:08:03 devstack sudo[106301]: pam_unix(sudo:session): session closed for user root Jul 13 14:08:03 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-cd9a3e6f-b034-4b9a-a5b9-c7ce1a478a27 tempest-ProjectReaderTests-1270836308 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-5587d8f1-7979-4755-862a-b49a92f4e86b" returned: 0 in 0.368s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:08:03 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-cd9a3e6f-b034-4b9a-a5b9-c7ce1a478a27 tempest-ProjectReaderTests-1270836308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-5587d8f1-7979-4755-862a-b49a92f4e86b {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:08:03 devstack sudo[106306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-5587d8f1-7979-4755-862a-b49a92f4e86b Jul 13 14:08:03 devstack sudo[106306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:08:03 devstack sudo[106306]: pam_unix(sudo:session): session closed for user root Jul 13 14:08:03 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-cd9a3e6f-b034-4b9a-a5b9-c7ce1a478a27 tempest-ProjectReaderTests-1270836308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-5587d8f1-7979-4755-862a-b49a92f4e86b" returned: 0 in 0.242s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:08:03 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-cd9a3e6f-b034-4b9a-a5b9-c7ce1a478a27 tempest-ProjectReaderTests-1270836308 None] Lock "cinder-quobyte-5587d8f1-7979-4755-862a-b49a92f4e86b" released by "delete_volume" :: held 0.671s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 14:08:03 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-cd9a3e6f-b034-4b9a-a5b9-c7ce1a478a27 tempest-ProjectReaderTests-1270836308 None] Created reservations ['c34353f4-e2f6-4c59-b0f7-dbc1709dabfe', 'de23a407-b93f-4769-9498-a8324f81d556', 'ff3172cc-fe0d-4b7c-8c5e-b32550b6e5ac', '7dfdea5a-5eea-4d0b-b1c0-a7876612d42a'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 14:08:03 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-cd9a3e6f-b034-4b9a-a5b9-c7ce1a478a27 tempest-ProjectReaderTests-1270836308 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 14:08:03 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-cd9a3e6f-b034-4b9a-a5b9-c7ce1a478a27 tempest-ProjectReaderTests-1270836308 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 14:08:03 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-cd9a3e6f-b034-4b9a-a5b9-c7ce1a478a27 tempest-ProjectReaderTests-1270836308 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 14:08:03 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-cd9a3e6f-b034-4b9a-a5b9-c7ce1a478a27 tempest-ProjectReaderTests-1270836308 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 14:08:03 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-cd9a3e6f-b034-4b9a-a5b9-c7ce1a478a27 tempest-ProjectReaderTests-1270836308 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 14:08:03 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-cd9a3e6f-b034-4b9a-a5b9-c7ce1a478a27 tempest-ProjectReaderTests-1270836308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:08:03 devstack sudo[106309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 Jul 13 14:08:03 devstack sudo[106309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:08:04 devstack sudo[106309]: pam_unix(sudo:session): session closed for user root Jul 13 14:08:04 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-cd9a3e6f-b034-4b9a-a5b9-c7ce1a478a27 tempest-ProjectReaderTests-1270836308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78" returned: 0 in 0.239s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:08:04 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-cd9a3e6f-b034-4b9a-a5b9-c7ce1a478a27 tempest-ProjectReaderTests-1270836308 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 14:08:04 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-cd9a3e6f-b034-4b9a-a5b9-c7ce1a478a27 tempest-ProjectReaderTests-1270836308 None] Deleted volume successfully. Jul 13 14:08:04 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-cd9a3e6f-b034-4b9a-a5b9-c7ce1a478a27 tempest-ProjectReaderTests-1270836308 None] Lock "cinder-5587d8f1-7979-4755-862a-b49a92f4e86b-delete_volume" released by "delete_volume" :: held 1.115s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 14:08:13 devstack cinder-volume[87098]: DEBUG dbcounter [-] [87098] Writing DB stats cinder:SELECT=112,cinder:INSERT=37,cinder:UPDATE=135,cinder:DELETE=8 {{(pid=87098) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 13 14:08:14 devstack cinder-volume[87098]: DEBUG dbcounter [-] [87098] Writing DB stats cinder:INSERT=41,cinder:UPDATE=145,cinder:SELECT=102,cinder:DELETE=14 {{(pid=87098) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 13 14:08:15 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-d1917eff-a7bf-417f-99e7-e7802ccbecfb tempest-ProjectReaderTests-1606700179 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 14:08:15 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-d1917eff-a7bf-417f-99e7-e7802ccbecfb tempest-ProjectReaderTests-1606700179 None] Flow 'volume_create_manager' (013ad821-fa75-475f-869b-da11bb212f5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 14:08:15 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-d1917eff-a7bf-417f-99e7-e7802ccbecfb tempest-ProjectReaderTests-1606700179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70459b7b-5991-4243-8d6f-ed57ccb58eea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:08:15 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-d1917eff-a7bf-417f-99e7-e7802ccbecfb tempest-ProjectReaderTests-1606700179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70459b7b-5991-4243-8d6f-ed57ccb58eea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T12:08:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-496998593',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9d729ff-bdb5-41f6-94ac-96adbf35a9e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38da0a0ef5e64c5b9939f2813e98e277',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T12:08:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T12:08:15Z,use_quota=True,user_id='0f7e4e969b834f318872ab140abbe5fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1147de8b-623b-426c-a13d-7fc824a80f67),volume_type_id=1147de8b-623b-426c-a13d-7fc824a80f67)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:08:15 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-d1917eff-a7bf-417f-99e7-e7802ccbecfb tempest-ProjectReaderTests-1606700179 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c572f4a-8816-40d7-88bf-fc9bae7df45c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:08:15 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-d1917eff-a7bf-417f-99e7-e7802ccbecfb tempest-ProjectReaderTests-1606700179 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c572f4a-8816-40d7-88bf-fc9bae7df45c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:08:15 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-d1917eff-a7bf-417f-99e7-e7802ccbecfb tempest-ProjectReaderTests-1606700179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35d9f5c5-11cd-4710-b1cf-579eb756ae61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:08:15 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-d1917eff-a7bf-417f-99e7-e7802ccbecfb tempest-ProjectReaderTests-1606700179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35d9f5c5-11cd-4710-b1cf-579eb756ae61) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c9d729ff-bdb5-41f6-94ac-96adbf35a9e3', 'volume_name': 'volume-c9d729ff-bdb5-41f6-94ac-96adbf35a9e3', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:08:15 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-d1917eff-a7bf-417f-99e7-e7802ccbecfb tempest-ProjectReaderTests-1606700179 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3f231e6-bee0-44fc-905b-15c430b5a77b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:08:15 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-d1917eff-a7bf-417f-99e7-e7802ccbecfb tempest-ProjectReaderTests-1606700179 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3f231e6-bee0-44fc-905b-15c430b5a77b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:08:15 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-d1917eff-a7bf-417f-99e7-e7802ccbecfb tempest-ProjectReaderTests-1606700179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f3cf2d8-7a6e-4422-a0fd-9d5c2674858a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:08:15 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-d1917eff-a7bf-417f-99e7-e7802ccbecfb tempest-ProjectReaderTests-1606700179 None] Volume c9d729ff-bdb5-41f6-94ac-96adbf35a9e3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c9d729ff-bdb5-41f6-94ac-96adbf35a9e3', 'volume_size': 1} Jul 13 14:08:15 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-d1917eff-a7bf-417f-99e7-e7802ccbecfb tempest-ProjectReaderTests-1606700179 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 14:08:15 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-d1917eff-a7bf-417f-99e7-e7802ccbecfb tempest-ProjectReaderTests-1606700179 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 14:08:15 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-d1917eff-a7bf-417f-99e7-e7802ccbecfb tempest-ProjectReaderTests-1606700179 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T12:08:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-496998593',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9d729ff-bdb5-41f6-94ac-96adbf35a9e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38da0a0ef5e64c5b9939f2813e98e277',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T12:08:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T12:08:15Z,use_quota=True,user_id='0f7e4e969b834f318872ab140abbe5fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1147de8b-623b-426c-a13d-7fc824a80f67),volume_type_id=1147de8b-623b-426c-a13d-7fc824a80f67)}" {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 13 14:08:15 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-d1917eff-a7bf-417f-99e7-e7802ccbecfb tempest-ProjectReaderTests-1606700179 None] Creating volume c9d729ff-bdb5-41f6-94ac-96adbf35a9e3 {{(pid=87098) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 13 14:08:15 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-d1917eff-a7bf-417f-99e7-e7802ccbecfb tempest-ProjectReaderTests-1606700179 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 14:08:15 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-d1917eff-a7bf-417f-99e7-e7802ccbecfb tempest-ProjectReaderTests-1606700179 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 14:08:15 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-d1917eff-a7bf-417f-99e7-e7802ccbecfb tempest-ProjectReaderTests-1606700179 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 14:08:15 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-d1917eff-a7bf-417f-99e7-e7802ccbecfb tempest-ProjectReaderTests-1606700179 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 14:08:15 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-d1917eff-a7bf-417f-99e7-e7802ccbecfb tempest-ProjectReaderTests-1606700179 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 14:08:15 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-d1917eff-a7bf-417f-99e7-e7802ccbecfb tempest-ProjectReaderTests-1606700179 None] Selected osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 14:08:15 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-d1917eff-a7bf-417f-99e7-e7802ccbecfb tempest-ProjectReaderTests-1606700179 None] casted to osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 Jul 13 14:08:15 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-d1917eff-a7bf-417f-99e7-e7802ccbecfb tempest-ProjectReaderTests-1606700179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-c9d729ff-bdb5-41f6-94ac-96adbf35a9e3 1073741824 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:08:15 devstack sudo[106315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-c9d729ff-bdb5-41f6-94ac-96adbf35a9e3 1073741824 Jul 13 14:08:15 devstack sudo[106315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:08:15 devstack sudo[106315]: pam_unix(sudo:session): session closed for user root Jul 13 14:08:15 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-d1917eff-a7bf-417f-99e7-e7802ccbecfb tempest-ProjectReaderTests-1606700179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-c9d729ff-bdb5-41f6-94ac-96adbf35a9e3 1073741824" returned: 0 in 0.415s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:08:15 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-d1917eff-a7bf-417f-99e7-e7802ccbecfb tempest-ProjectReaderTests-1606700179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-c9d729ff-bdb5-41f6-94ac-96adbf35a9e3 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:08:15 devstack sudo[106321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-c9d729ff-bdb5-41f6-94ac-96adbf35a9e3 Jul 13 14:08:15 devstack sudo[106321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:08:16 devstack sudo[106321]: pam_unix(sudo:session): session closed for user root Jul 13 14:08:16 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-d1917eff-a7bf-417f-99e7-e7802ccbecfb tempest-ProjectReaderTests-1606700179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-c9d729ff-bdb5-41f6-94ac-96adbf35a9e3" returned: 0 in 0.246s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:08:16 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-d1917eff-a7bf-417f-99e7-e7802ccbecfb tempest-ProjectReaderTests-1606700179 None] <== create_volume: return (700ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'} {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 13 14:08:16 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-d1917eff-a7bf-417f-99e7-e7802ccbecfb tempest-ProjectReaderTests-1606700179 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.703s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 14:08:16 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-d1917eff-a7bf-417f-99e7-e7802ccbecfb tempest-ProjectReaderTests-1606700179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f3cf2d8-7a6e-4422-a0fd-9d5c2674858a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c9d729ff-bdb5-41f6-94ac-96adbf35a9e3', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:08:16 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-d1917eff-a7bf-417f-99e7-e7802ccbecfb tempest-ProjectReaderTests-1606700179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1cf4d0ce-4608-4d36-99f4-2ae233259f02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:08:16 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-d1917eff-a7bf-417f-99e7-e7802ccbecfb tempest-ProjectReaderTests-1606700179 None] Volume volume-c9d729ff-bdb5-41f6-94ac-96adbf35a9e3 (c9d729ff-bdb5-41f6-94ac-96adbf35a9e3): created successfully Jul 13 14:08:16 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-d1917eff-a7bf-417f-99e7-e7802ccbecfb tempest-ProjectReaderTests-1606700179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1cf4d0ce-4608-4d36-99f4-2ae233259f02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:08:16 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-d1917eff-a7bf-417f-99e7-e7802ccbecfb tempest-ProjectReaderTests-1606700179 None] Flow 'volume_create_manager' (013ad821-fa75-475f-869b-da11bb212f5d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 14:08:16 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-d1917eff-a7bf-417f-99e7-e7802ccbecfb tempest-ProjectReaderTests-1606700179 None] Created volume successfully. Jul 13 14:08:16 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-f0421004-fbcf-4cf9-91a2-5cf5d35f000f tempest-ProjectReaderTests-1606700179 None] Acquiring lock "cinder-c9d729ff-bdb5-41f6-94ac-96adbf35a9e3-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 14:08:16 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-f0421004-fbcf-4cf9-91a2-5cf5d35f000f tempest-ProjectReaderTests-1606700179 None] Lock "cinder-c9d729ff-bdb5-41f6-94ac-96adbf35a9e3-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 14:08:16 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-f0421004-fbcf-4cf9-91a2-5cf5d35f000f tempest-ProjectReaderTests-1606700179 None] Acquiring lock "cinder-quobyte-c9d729ff-bdb5-41f6-94ac-96adbf35a9e3" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 14:08:16 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-f0421004-fbcf-4cf9-91a2-5cf5d35f000f tempest-ProjectReaderTests-1606700179 None] Lock "cinder-quobyte-c9d729ff-bdb5-41f6-94ac-96adbf35a9e3" acquired by "delete_volume" :: waited 0.015s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 14:08:16 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2b8366e-37f5-4cd0-9cf0-bfb0c309a74f]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 14:08:16 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-f0421004-fbcf-4cf9-91a2-5cf5d35f000f tempest-ProjectReaderTests-1606700179 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-c9d729ff-bdb5-41f6-94ac-96adbf35a9e3 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:08:16 devstack sudo[106360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-c9d729ff-bdb5-41f6-94ac-96adbf35a9e3 Jul 13 14:08:16 devstack sudo[106360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:08:17 devstack sudo[106360]: pam_unix(sudo:session): session closed for user root Jul 13 14:08:17 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-f0421004-fbcf-4cf9-91a2-5cf5d35f000f tempest-ProjectReaderTests-1606700179 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-c9d729ff-bdb5-41f6-94ac-96adbf35a9e3" returned: 0 in 0.362s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:08:17 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-f0421004-fbcf-4cf9-91a2-5cf5d35f000f tempest-ProjectReaderTests-1606700179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-c9d729ff-bdb5-41f6-94ac-96adbf35a9e3 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:08:17 devstack sudo[106365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-c9d729ff-bdb5-41f6-94ac-96adbf35a9e3 Jul 13 14:08:17 devstack sudo[106365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:08:17 devstack sudo[106365]: pam_unix(sudo:session): session closed for user root Jul 13 14:08:17 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-f0421004-fbcf-4cf9-91a2-5cf5d35f000f tempest-ProjectReaderTests-1606700179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-c9d729ff-bdb5-41f6-94ac-96adbf35a9e3" returned: 0 in 0.247s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:08:17 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-f0421004-fbcf-4cf9-91a2-5cf5d35f000f tempest-ProjectReaderTests-1606700179 None] Lock "cinder-quobyte-c9d729ff-bdb5-41f6-94ac-96adbf35a9e3" released by "delete_volume" :: held 0.650s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 14:08:17 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-f0421004-fbcf-4cf9-91a2-5cf5d35f000f tempest-ProjectReaderTests-1606700179 None] Created reservations ['71f00791-fb00-4538-be07-2ed947b13268', '5aecdc91-db2c-4794-a4a5-7eb1002da9d1', 'e25e3383-a67d-4054-a9ea-c88d0713673a', 'fab1f51f-90c8-4b49-bd92-8b24e4a1794f'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 14:08:17 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-f0421004-fbcf-4cf9-91a2-5cf5d35f000f tempest-ProjectReaderTests-1606700179 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 14:08:17 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-f0421004-fbcf-4cf9-91a2-5cf5d35f000f tempest-ProjectReaderTests-1606700179 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 14:08:17 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-f0421004-fbcf-4cf9-91a2-5cf5d35f000f tempest-ProjectReaderTests-1606700179 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 14:08:17 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-f0421004-fbcf-4cf9-91a2-5cf5d35f000f tempest-ProjectReaderTests-1606700179 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 14:08:17 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-f0421004-fbcf-4cf9-91a2-5cf5d35f000f tempest-ProjectReaderTests-1606700179 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 14:08:17 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-f0421004-fbcf-4cf9-91a2-5cf5d35f000f tempest-ProjectReaderTests-1606700179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:08:17 devstack sudo[106369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 Jul 13 14:08:17 devstack sudo[106369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:08:17 devstack sudo[106369]: pam_unix(sudo:session): session closed for user root Jul 13 14:08:17 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-f0421004-fbcf-4cf9-91a2-5cf5d35f000f tempest-ProjectReaderTests-1606700179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78" returned: 0 in 0.258s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:08:17 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-f0421004-fbcf-4cf9-91a2-5cf5d35f000f tempest-ProjectReaderTests-1606700179 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 14:08:17 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-f0421004-fbcf-4cf9-91a2-5cf5d35f000f tempest-ProjectReaderTests-1606700179 None] Deleted volume successfully. Jul 13 14:08:17 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-f0421004-fbcf-4cf9-91a2-5cf5d35f000f tempest-ProjectReaderTests-1606700179 None] Lock "cinder-c9d729ff-bdb5-41f6-94ac-96adbf35a9e3-delete_volume" released by "delete_volume" :: held 1.108s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 14:08:18 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-26f68fec-b864-437a-a5bc-91294f80d1b9 tempest-ProjectReaderTests-1606700179 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 14:08:18 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-26f68fec-b864-437a-a5bc-91294f80d1b9 tempest-ProjectReaderTests-1606700179 None] Flow 'volume_create_manager' (5333f30f-d5d0-406d-a10d-cc5f433af219) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 14:08:18 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-26f68fec-b864-437a-a5bc-91294f80d1b9 tempest-ProjectReaderTests-1606700179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (120f1666-3279-4b38-932a-ca27cc95caa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:08:18 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-26f68fec-b864-437a-a5bc-91294f80d1b9 tempest-ProjectReaderTests-1606700179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (120f1666-3279-4b38-932a-ca27cc95caa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T12:08:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1997518507',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fabebd6a-3db2-41d9-b35e-f534d29540ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38da0a0ef5e64c5b9939f2813e98e277',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T12:08:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T12:08:18Z,use_quota=True,user_id='0f7e4e969b834f318872ab140abbe5fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1147de8b-623b-426c-a13d-7fc824a80f67),volume_type_id=1147de8b-623b-426c-a13d-7fc824a80f67)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:08:18 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-26f68fec-b864-437a-a5bc-91294f80d1b9 tempest-ProjectReaderTests-1606700179 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01df06ae-4d4c-4a70-8900-63108c9bdb39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:08:18 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-26f68fec-b864-437a-a5bc-91294f80d1b9 tempest-ProjectReaderTests-1606700179 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01df06ae-4d4c-4a70-8900-63108c9bdb39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:08:18 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-26f68fec-b864-437a-a5bc-91294f80d1b9 tempest-ProjectReaderTests-1606700179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9ae4711-469c-4c6b-b9d7-076abf9215ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:08:18 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-26f68fec-b864-437a-a5bc-91294f80d1b9 tempest-ProjectReaderTests-1606700179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9ae4711-469c-4c6b-b9d7-076abf9215ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fabebd6a-3db2-41d9-b35e-f534d29540ab', 'volume_name': 'volume-fabebd6a-3db2-41d9-b35e-f534d29540ab', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:08:18 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-26f68fec-b864-437a-a5bc-91294f80d1b9 tempest-ProjectReaderTests-1606700179 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec59c695-497d-40df-9e1a-26dfa8e7208d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:08:18 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-26f68fec-b864-437a-a5bc-91294f80d1b9 tempest-ProjectReaderTests-1606700179 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec59c695-497d-40df-9e1a-26dfa8e7208d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:08:18 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-26f68fec-b864-437a-a5bc-91294f80d1b9 tempest-ProjectReaderTests-1606700179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4bcd2bd-0015-454f-83f2-e8064caf5ddd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:08:18 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-26f68fec-b864-437a-a5bc-91294f80d1b9 tempest-ProjectReaderTests-1606700179 None] Volume fabebd6a-3db2-41d9-b35e-f534d29540ab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fabebd6a-3db2-41d9-b35e-f534d29540ab', 'volume_size': 1} Jul 13 14:08:18 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-26f68fec-b864-437a-a5bc-91294f80d1b9 tempest-ProjectReaderTests-1606700179 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 14:08:18 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-26f68fec-b864-437a-a5bc-91294f80d1b9 tempest-ProjectReaderTests-1606700179 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 14:08:18 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-26f68fec-b864-437a-a5bc-91294f80d1b9 tempest-ProjectReaderTests-1606700179 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T12:08:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1997518507',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fabebd6a-3db2-41d9-b35e-f534d29540ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38da0a0ef5e64c5b9939f2813e98e277',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T12:08:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T12:08:18Z,use_quota=True,user_id='0f7e4e969b834f318872ab140abbe5fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1147de8b-623b-426c-a13d-7fc824a80f67),volume_type_id=1147de8b-623b-426c-a13d-7fc824a80f67)}" {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 13 14:08:18 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-26f68fec-b864-437a-a5bc-91294f80d1b9 tempest-ProjectReaderTests-1606700179 None] Creating volume fabebd6a-3db2-41d9-b35e-f534d29540ab {{(pid=87098) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 13 14:08:18 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-26f68fec-b864-437a-a5bc-91294f80d1b9 tempest-ProjectReaderTests-1606700179 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 14:08:18 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-26f68fec-b864-437a-a5bc-91294f80d1b9 tempest-ProjectReaderTests-1606700179 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 14:08:18 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-26f68fec-b864-437a-a5bc-91294f80d1b9 tempest-ProjectReaderTests-1606700179 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 14:08:18 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-26f68fec-b864-437a-a5bc-91294f80d1b9 tempest-ProjectReaderTests-1606700179 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 14:08:18 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-26f68fec-b864-437a-a5bc-91294f80d1b9 tempest-ProjectReaderTests-1606700179 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 14:08:18 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-26f68fec-b864-437a-a5bc-91294f80d1b9 tempest-ProjectReaderTests-1606700179 None] Selected osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 14:08:18 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-26f68fec-b864-437a-a5bc-91294f80d1b9 tempest-ProjectReaderTests-1606700179 None] casted to osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 Jul 13 14:08:18 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-26f68fec-b864-437a-a5bc-91294f80d1b9 tempest-ProjectReaderTests-1606700179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-fabebd6a-3db2-41d9-b35e-f534d29540ab 1073741824 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:08:18 devstack sudo[106374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-fabebd6a-3db2-41d9-b35e-f534d29540ab 1073741824 Jul 13 14:08:18 devstack sudo[106374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:08:18 devstack sudo[106374]: pam_unix(sudo:session): session closed for user root Jul 13 14:08:18 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-26f68fec-b864-437a-a5bc-91294f80d1b9 tempest-ProjectReaderTests-1606700179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-fabebd6a-3db2-41d9-b35e-f534d29540ab 1073741824" returned: 0 in 0.429s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:08:18 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-26f68fec-b864-437a-a5bc-91294f80d1b9 tempest-ProjectReaderTests-1606700179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-fabebd6a-3db2-41d9-b35e-f534d29540ab {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:08:18 devstack sudo[106379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-fabebd6a-3db2-41d9-b35e-f534d29540ab Jul 13 14:08:18 devstack sudo[106379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:08:19 devstack sudo[106379]: pam_unix(sudo:session): session closed for user root Jul 13 14:08:19 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-26f68fec-b864-437a-a5bc-91294f80d1b9 tempest-ProjectReaderTests-1606700179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-fabebd6a-3db2-41d9-b35e-f534d29540ab" returned: 0 in 0.248s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:08:19 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-26f68fec-b864-437a-a5bc-91294f80d1b9 tempest-ProjectReaderTests-1606700179 None] <== create_volume: return (717ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'} {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 13 14:08:19 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-26f68fec-b864-437a-a5bc-91294f80d1b9 tempest-ProjectReaderTests-1606700179 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.719s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 14:08:19 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-26f68fec-b864-437a-a5bc-91294f80d1b9 tempest-ProjectReaderTests-1606700179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4bcd2bd-0015-454f-83f2-e8064caf5ddd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fabebd6a-3db2-41d9-b35e-f534d29540ab', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:08:19 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-26f68fec-b864-437a-a5bc-91294f80d1b9 tempest-ProjectReaderTests-1606700179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0786fdb-13c9-408e-8dee-4c9a54ea9da9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:08:19 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-26f68fec-b864-437a-a5bc-91294f80d1b9 tempest-ProjectReaderTests-1606700179 None] Volume volume-fabebd6a-3db2-41d9-b35e-f534d29540ab (fabebd6a-3db2-41d9-b35e-f534d29540ab): created successfully Jul 13 14:08:19 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-26f68fec-b864-437a-a5bc-91294f80d1b9 tempest-ProjectReaderTests-1606700179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0786fdb-13c9-408e-8dee-4c9a54ea9da9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:08:19 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-26f68fec-b864-437a-a5bc-91294f80d1b9 tempest-ProjectReaderTests-1606700179 None] Flow 'volume_create_manager' (5333f30f-d5d0-406d-a10d-cc5f433af219) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 14:08:19 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-26f68fec-b864-437a-a5bc-91294f80d1b9 tempest-ProjectReaderTests-1606700179 None] Created volume successfully. Jul 13 14:08:19 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-e2b1e724-f2c5-4c2b-b558-bf83e8fe29da tempest-ProjectReaderTests-1606700179 None] Acquiring lock "cinder-fabebd6a-3db2-41d9-b35e-f534d29540ab-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 14:08:19 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-e2b1e724-f2c5-4c2b-b558-bf83e8fe29da tempest-ProjectReaderTests-1606700179 None] Lock "cinder-fabebd6a-3db2-41d9-b35e-f534d29540ab-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 14:08:19 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-e2b1e724-f2c5-4c2b-b558-bf83e8fe29da tempest-ProjectReaderTests-1606700179 None] Acquiring lock "cinder-quobyte-fabebd6a-3db2-41d9-b35e-f534d29540ab" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 14:08:19 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-e2b1e724-f2c5-4c2b-b558-bf83e8fe29da tempest-ProjectReaderTests-1606700179 None] Lock "cinder-quobyte-fabebd6a-3db2-41d9-b35e-f534d29540ab" acquired by "delete_volume" :: waited 0.014s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 14:08:19 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[19df8b39-2875-4f85-8bed-27e3b19e79c0]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 14:08:19 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-e2b1e724-f2c5-4c2b-b558-bf83e8fe29da tempest-ProjectReaderTests-1606700179 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-fabebd6a-3db2-41d9-b35e-f534d29540ab {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:08:19 devstack sudo[106382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-fabebd6a-3db2-41d9-b35e-f534d29540ab Jul 13 14:08:19 devstack sudo[106382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:08:19 devstack sudo[106382]: pam_unix(sudo:session): session closed for user root Jul 13 14:08:19 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-e2b1e724-f2c5-4c2b-b558-bf83e8fe29da tempest-ProjectReaderTests-1606700179 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-fabebd6a-3db2-41d9-b35e-f534d29540ab" returned: 0 in 0.349s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:08:19 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-e2b1e724-f2c5-4c2b-b558-bf83e8fe29da tempest-ProjectReaderTests-1606700179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-fabebd6a-3db2-41d9-b35e-f534d29540ab {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:08:19 devstack sudo[106393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-fabebd6a-3db2-41d9-b35e-f534d29540ab Jul 13 14:08:19 devstack sudo[106393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:08:19 devstack sudo[106393]: pam_unix(sudo:session): session closed for user root Jul 13 14:08:19 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-e2b1e724-f2c5-4c2b-b558-bf83e8fe29da tempest-ProjectReaderTests-1606700179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-fabebd6a-3db2-41d9-b35e-f534d29540ab" returned: 0 in 0.249s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:08:19 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-e2b1e724-f2c5-4c2b-b558-bf83e8fe29da tempest-ProjectReaderTests-1606700179 None] Lock "cinder-quobyte-fabebd6a-3db2-41d9-b35e-f534d29540ab" released by "delete_volume" :: held 0.636s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 14:08:20 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-e2b1e724-f2c5-4c2b-b558-bf83e8fe29da tempest-ProjectReaderTests-1606700179 None] Created reservations ['e72d3262-a300-437b-afd8-71bceef950cc', 'cdb00294-b3d4-49e6-9f27-7b927f9e49b3', '9d5f62c5-4d67-43d3-98a6-ed98cb7e3c50', '8f36d445-51ab-47f8-a967-9c375be5570b'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 14:08:20 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-e2b1e724-f2c5-4c2b-b558-bf83e8fe29da tempest-ProjectReaderTests-1606700179 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 14:08:20 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-e2b1e724-f2c5-4c2b-b558-bf83e8fe29da tempest-ProjectReaderTests-1606700179 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 14:08:20 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-e2b1e724-f2c5-4c2b-b558-bf83e8fe29da tempest-ProjectReaderTests-1606700179 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 14:08:20 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-e2b1e724-f2c5-4c2b-b558-bf83e8fe29da tempest-ProjectReaderTests-1606700179 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 14:08:20 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-e2b1e724-f2c5-4c2b-b558-bf83e8fe29da tempest-ProjectReaderTests-1606700179 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 14:08:20 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-e2b1e724-f2c5-4c2b-b558-bf83e8fe29da tempest-ProjectReaderTests-1606700179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:08:20 devstack sudo[106396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 Jul 13 14:08:20 devstack sudo[106396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:08:20 devstack sudo[106396]: pam_unix(sudo:session): session closed for user root Jul 13 14:08:20 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-e2b1e724-f2c5-4c2b-b558-bf83e8fe29da tempest-ProjectReaderTests-1606700179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78" returned: 0 in 0.238s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:08:20 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-e2b1e724-f2c5-4c2b-b558-bf83e8fe29da tempest-ProjectReaderTests-1606700179 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 14:08:20 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-e2b1e724-f2c5-4c2b-b558-bf83e8fe29da tempest-ProjectReaderTests-1606700179 None] Deleted volume successfully. Jul 13 14:08:20 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-e2b1e724-f2c5-4c2b-b558-bf83e8fe29da tempest-ProjectReaderTests-1606700179 None] Lock "cinder-fabebd6a-3db2-41d9-b35e-f534d29540ab-delete_volume" released by "delete_volume" :: held 1.069s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 14:08:20 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a6e06d2-060e-4f11-8a23-23fb7b9d7eae tempest-ProjectReaderTests-1606700179 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 14:08:20 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-0a6e06d2-060e-4f11-8a23-23fb7b9d7eae tempest-ProjectReaderTests-1606700179 None] Flow 'volume_create_manager' (24a6617e-b89c-429c-8198-55dc06a0bf3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 14:08:20 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-0a6e06d2-060e-4f11-8a23-23fb7b9d7eae tempest-ProjectReaderTests-1606700179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe20b9cc-2e52-46bc-9b8f-2660f5331a29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:08:20 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-0a6e06d2-060e-4f11-8a23-23fb7b9d7eae tempest-ProjectReaderTests-1606700179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe20b9cc-2e52-46bc-9b8f-2660f5331a29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T12:08:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-103572867',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=443916f8-a391-492e-9f88-2793dfbbeb03,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38da0a0ef5e64c5b9939f2813e98e277',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T12:08:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T12:08:21Z,use_quota=True,user_id='0f7e4e969b834f318872ab140abbe5fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1147de8b-623b-426c-a13d-7fc824a80f67),volume_type_id=1147de8b-623b-426c-a13d-7fc824a80f67)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:08:20 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-0a6e06d2-060e-4f11-8a23-23fb7b9d7eae tempest-ProjectReaderTests-1606700179 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b92fc78b-60f6-41d2-936c-b4733a4208bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:08:20 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-0a6e06d2-060e-4f11-8a23-23fb7b9d7eae tempest-ProjectReaderTests-1606700179 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b92fc78b-60f6-41d2-936c-b4733a4208bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:08:20 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-0a6e06d2-060e-4f11-8a23-23fb7b9d7eae tempest-ProjectReaderTests-1606700179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aaf4bcf1-d74d-44e0-b53f-52a859f344d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:08:20 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-0a6e06d2-060e-4f11-8a23-23fb7b9d7eae tempest-ProjectReaderTests-1606700179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aaf4bcf1-d74d-44e0-b53f-52a859f344d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '443916f8-a391-492e-9f88-2793dfbbeb03', 'volume_name': 'volume-443916f8-a391-492e-9f88-2793dfbbeb03', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:08:20 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-0a6e06d2-060e-4f11-8a23-23fb7b9d7eae tempest-ProjectReaderTests-1606700179 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d0946a2-d65a-40c0-a9f4-61bb3709545a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:08:20 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-0a6e06d2-060e-4f11-8a23-23fb7b9d7eae tempest-ProjectReaderTests-1606700179 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d0946a2-d65a-40c0-a9f4-61bb3709545a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:08:20 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-0a6e06d2-060e-4f11-8a23-23fb7b9d7eae tempest-ProjectReaderTests-1606700179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (483472fe-c7dd-4cd8-a877-44b430d9ddb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:08:20 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-0a6e06d2-060e-4f11-8a23-23fb7b9d7eae tempest-ProjectReaderTests-1606700179 None] Volume 443916f8-a391-492e-9f88-2793dfbbeb03: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-443916f8-a391-492e-9f88-2793dfbbeb03', 'volume_size': 1} Jul 13 14:08:20 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-0a6e06d2-060e-4f11-8a23-23fb7b9d7eae tempest-ProjectReaderTests-1606700179 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 14:08:20 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-0a6e06d2-060e-4f11-8a23-23fb7b9d7eae tempest-ProjectReaderTests-1606700179 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 14:08:20 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-0a6e06d2-060e-4f11-8a23-23fb7b9d7eae tempest-ProjectReaderTests-1606700179 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T12:08:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-103572867',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=443916f8-a391-492e-9f88-2793dfbbeb03,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38da0a0ef5e64c5b9939f2813e98e277',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T12:08:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T12:08:21Z,use_quota=True,user_id='0f7e4e969b834f318872ab140abbe5fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1147de8b-623b-426c-a13d-7fc824a80f67),volume_type_id=1147de8b-623b-426c-a13d-7fc824a80f67)}" {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 13 14:08:20 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-0a6e06d2-060e-4f11-8a23-23fb7b9d7eae tempest-ProjectReaderTests-1606700179 None] Creating volume 443916f8-a391-492e-9f88-2793dfbbeb03 {{(pid=87098) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 13 14:08:20 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-0a6e06d2-060e-4f11-8a23-23fb7b9d7eae tempest-ProjectReaderTests-1606700179 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 14:08:20 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-0a6e06d2-060e-4f11-8a23-23fb7b9d7eae tempest-ProjectReaderTests-1606700179 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 14:08:20 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-0a6e06d2-060e-4f11-8a23-23fb7b9d7eae tempest-ProjectReaderTests-1606700179 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 14:08:20 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-0a6e06d2-060e-4f11-8a23-23fb7b9d7eae tempest-ProjectReaderTests-1606700179 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 14:08:20 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-0a6e06d2-060e-4f11-8a23-23fb7b9d7eae tempest-ProjectReaderTests-1606700179 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 14:08:20 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-0a6e06d2-060e-4f11-8a23-23fb7b9d7eae tempest-ProjectReaderTests-1606700179 None] Selected osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 14:08:20 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-0a6e06d2-060e-4f11-8a23-23fb7b9d7eae tempest-ProjectReaderTests-1606700179 None] casted to osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 Jul 13 14:08:20 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-0a6e06d2-060e-4f11-8a23-23fb7b9d7eae tempest-ProjectReaderTests-1606700179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-443916f8-a391-492e-9f88-2793dfbbeb03 1073741824 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:08:20 devstack sudo[106399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-443916f8-a391-492e-9f88-2793dfbbeb03 1073741824 Jul 13 14:08:20 devstack sudo[106399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:08:21 devstack sudo[106399]: pam_unix(sudo:session): session closed for user root Jul 13 14:08:21 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-0a6e06d2-060e-4f11-8a23-23fb7b9d7eae tempest-ProjectReaderTests-1606700179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-443916f8-a391-492e-9f88-2793dfbbeb03 1073741824" returned: 0 in 0.420s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:08:21 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-0a6e06d2-060e-4f11-8a23-23fb7b9d7eae tempest-ProjectReaderTests-1606700179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-443916f8-a391-492e-9f88-2793dfbbeb03 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:08:21 devstack sudo[106404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-443916f8-a391-492e-9f88-2793dfbbeb03 Jul 13 14:08:21 devstack sudo[106404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:08:21 devstack sudo[106404]: pam_unix(sudo:session): session closed for user root Jul 13 14:08:21 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-0a6e06d2-060e-4f11-8a23-23fb7b9d7eae tempest-ProjectReaderTests-1606700179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-443916f8-a391-492e-9f88-2793dfbbeb03" returned: 0 in 0.244s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:08:21 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-0a6e06d2-060e-4f11-8a23-23fb7b9d7eae tempest-ProjectReaderTests-1606700179 None] <== create_volume: return (704ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'} {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 13 14:08:21 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-0a6e06d2-060e-4f11-8a23-23fb7b9d7eae tempest-ProjectReaderTests-1606700179 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.706s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 14:08:21 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-0a6e06d2-060e-4f11-8a23-23fb7b9d7eae tempest-ProjectReaderTests-1606700179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (483472fe-c7dd-4cd8-a877-44b430d9ddb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-443916f8-a391-492e-9f88-2793dfbbeb03', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:08:21 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-0a6e06d2-060e-4f11-8a23-23fb7b9d7eae tempest-ProjectReaderTests-1606700179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dfe07a75-3bc2-4571-9daf-bd6aa020ef44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:08:21 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-0a6e06d2-060e-4f11-8a23-23fb7b9d7eae tempest-ProjectReaderTests-1606700179 None] Volume volume-443916f8-a391-492e-9f88-2793dfbbeb03 (443916f8-a391-492e-9f88-2793dfbbeb03): created successfully Jul 13 14:08:21 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-0a6e06d2-060e-4f11-8a23-23fb7b9d7eae tempest-ProjectReaderTests-1606700179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dfe07a75-3bc2-4571-9daf-bd6aa020ef44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:08:21 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-0a6e06d2-060e-4f11-8a23-23fb7b9d7eae tempest-ProjectReaderTests-1606700179 None] Flow 'volume_create_manager' (24a6617e-b89c-429c-8198-55dc06a0bf3e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 14:08:21 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-0a6e06d2-060e-4f11-8a23-23fb7b9d7eae tempest-ProjectReaderTests-1606700179 None] Created volume successfully. Jul 13 14:08:21 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-59bbe5b4-fda4-4e0d-b9cd-2fdd712c4a59 tempest-ProjectReaderTests-1606700179 None] Acquiring lock "cinder-443916f8-a391-492e-9f88-2793dfbbeb03-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 14:08:21 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-59bbe5b4-fda4-4e0d-b9cd-2fdd712c4a59 tempest-ProjectReaderTests-1606700179 None] Lock "cinder-443916f8-a391-492e-9f88-2793dfbbeb03-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 14:08:21 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-59bbe5b4-fda4-4e0d-b9cd-2fdd712c4a59 tempest-ProjectReaderTests-1606700179 None] Acquiring lock "cinder-quobyte-443916f8-a391-492e-9f88-2793dfbbeb03" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 14:08:21 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-59bbe5b4-fda4-4e0d-b9cd-2fdd712c4a59 tempest-ProjectReaderTests-1606700179 None] Lock "cinder-quobyte-443916f8-a391-492e-9f88-2793dfbbeb03" acquired by "delete_volume" :: waited 0.014s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 14:08:22 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[09339813-d519-456b-b2cb-cd9a10618703]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 14:08:22 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-59bbe5b4-fda4-4e0d-b9cd-2fdd712c4a59 tempest-ProjectReaderTests-1606700179 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-443916f8-a391-492e-9f88-2793dfbbeb03 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:08:22 devstack sudo[106407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-443916f8-a391-492e-9f88-2793dfbbeb03 Jul 13 14:08:22 devstack sudo[106407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:08:22 devstack sudo[106407]: pam_unix(sudo:session): session closed for user root Jul 13 14:08:22 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-59bbe5b4-fda4-4e0d-b9cd-2fdd712c4a59 tempest-ProjectReaderTests-1606700179 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-443916f8-a391-492e-9f88-2793dfbbeb03" returned: 0 in 0.365s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:08:22 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-59bbe5b4-fda4-4e0d-b9cd-2fdd712c4a59 tempest-ProjectReaderTests-1606700179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-443916f8-a391-492e-9f88-2793dfbbeb03 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:08:22 devstack sudo[106412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-443916f8-a391-492e-9f88-2793dfbbeb03 Jul 13 14:08:22 devstack sudo[106412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:08:22 devstack sudo[106412]: pam_unix(sudo:session): session closed for user root Jul 13 14:08:22 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-59bbe5b4-fda4-4e0d-b9cd-2fdd712c4a59 tempest-ProjectReaderTests-1606700179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-443916f8-a391-492e-9f88-2793dfbbeb03" returned: 0 in 0.236s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:08:22 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-59bbe5b4-fda4-4e0d-b9cd-2fdd712c4a59 tempest-ProjectReaderTests-1606700179 None] Lock "cinder-quobyte-443916f8-a391-492e-9f88-2793dfbbeb03" released by "delete_volume" :: held 0.636s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 14:08:22 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-59bbe5b4-fda4-4e0d-b9cd-2fdd712c4a59 tempest-ProjectReaderTests-1606700179 None] Created reservations ['3d43b5d6-af44-48bf-8b1a-0982b42807b5', '4f9b25eb-2993-4602-94ef-32e367be71c3', '9cd37fa0-742c-4115-acca-26cf41d1f1a2', '915c8f2a-60b6-4e1b-b398-b3ca8d0bd5e4'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 14:08:22 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-59bbe5b4-fda4-4e0d-b9cd-2fdd712c4a59 tempest-ProjectReaderTests-1606700179 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 14:08:22 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-59bbe5b4-fda4-4e0d-b9cd-2fdd712c4a59 tempest-ProjectReaderTests-1606700179 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 14:08:22 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-59bbe5b4-fda4-4e0d-b9cd-2fdd712c4a59 tempest-ProjectReaderTests-1606700179 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 14:08:22 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-59bbe5b4-fda4-4e0d-b9cd-2fdd712c4a59 tempest-ProjectReaderTests-1606700179 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 14:08:22 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-59bbe5b4-fda4-4e0d-b9cd-2fdd712c4a59 tempest-ProjectReaderTests-1606700179 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 14:08:22 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-59bbe5b4-fda4-4e0d-b9cd-2fdd712c4a59 tempest-ProjectReaderTests-1606700179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:08:22 devstack sudo[106415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 Jul 13 14:08:22 devstack sudo[106415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:08:22 devstack sudo[106415]: pam_unix(sudo:session): session closed for user root Jul 13 14:08:22 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-59bbe5b4-fda4-4e0d-b9cd-2fdd712c4a59 tempest-ProjectReaderTests-1606700179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78" returned: 0 in 0.238s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:08:22 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-59bbe5b4-fda4-4e0d-b9cd-2fdd712c4a59 tempest-ProjectReaderTests-1606700179 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 14:08:22 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-59bbe5b4-fda4-4e0d-b9cd-2fdd712c4a59 tempest-ProjectReaderTests-1606700179 None] Deleted volume successfully. Jul 13 14:08:23 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-59bbe5b4-fda4-4e0d-b9cd-2fdd712c4a59 tempest-ProjectReaderTests-1606700179 None] Lock "cinder-443916f8-a391-492e-9f88-2793dfbbeb03-delete_volume" released by "delete_volume" :: held 1.072s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 14:08:23 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-318d9f44-264c-41af-9636-72d771061ded tempest-ProjectReaderTests-1606700179 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 13 14:08:23 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-318d9f44-264c-41af-9636-72d771061ded tempest-ProjectReaderTests-1606700179 None] Flow 'volume_create_manager' (7bbce0b2-209f-4881-8844-7a8c23a388b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 14:08:23 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-318d9f44-264c-41af-9636-72d771061ded tempest-ProjectReaderTests-1606700179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6040674-eb22-4005-89bc-8b207f326967) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:08:23 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-318d9f44-264c-41af-9636-72d771061ded tempest-ProjectReaderTests-1606700179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6040674-eb22-4005-89bc-8b207f326967) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T12:08:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-254545932',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=320f6bd2-c47f-43a4-8f6c-822d09bac6db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38da0a0ef5e64c5b9939f2813e98e277',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T12:08:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T12:08:23Z,use_quota=True,user_id='0f7e4e969b834f318872ab140abbe5fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1147de8b-623b-426c-a13d-7fc824a80f67),volume_type_id=1147de8b-623b-426c-a13d-7fc824a80f67)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:08:23 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-318d9f44-264c-41af-9636-72d771061ded tempest-ProjectReaderTests-1606700179 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1a8fb33-5a79-4508-a33c-ccb19229cecf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:08:23 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-318d9f44-264c-41af-9636-72d771061ded tempest-ProjectReaderTests-1606700179 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1a8fb33-5a79-4508-a33c-ccb19229cecf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:08:23 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-318d9f44-264c-41af-9636-72d771061ded tempest-ProjectReaderTests-1606700179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11e0d98c-8681-42c2-b7a1-3efe925636b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:08:23 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-318d9f44-264c-41af-9636-72d771061ded tempest-ProjectReaderTests-1606700179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11e0d98c-8681-42c2-b7a1-3efe925636b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '320f6bd2-c47f-43a4-8f6c-822d09bac6db', 'volume_name': 'volume-320f6bd2-c47f-43a4-8f6c-822d09bac6db', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:08:23 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-318d9f44-264c-41af-9636-72d771061ded tempest-ProjectReaderTests-1606700179 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (621d7c5f-b320-42f1-a316-25d1fc310a72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:08:23 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-318d9f44-264c-41af-9636-72d771061ded tempest-ProjectReaderTests-1606700179 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (621d7c5f-b320-42f1-a316-25d1fc310a72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:08:23 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-318d9f44-264c-41af-9636-72d771061ded tempest-ProjectReaderTests-1606700179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d145d5c-12de-4971-8b88-9273eda35e1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:08:23 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-318d9f44-264c-41af-9636-72d771061ded tempest-ProjectReaderTests-1606700179 None] Volume 320f6bd2-c47f-43a4-8f6c-822d09bac6db: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-320f6bd2-c47f-43a4-8f6c-822d09bac6db', 'volume_size': 1} Jul 13 14:08:23 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-318d9f44-264c-41af-9636-72d771061ded tempest-ProjectReaderTests-1606700179 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 14:08:23 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-318d9f44-264c-41af-9636-72d771061ded tempest-ProjectReaderTests-1606700179 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 14:08:23 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-318d9f44-264c-41af-9636-72d771061ded tempest-ProjectReaderTests-1606700179 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-13T12:08:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-254545932',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=320f6bd2-c47f-43a4-8f6c-822d09bac6db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38da0a0ef5e64c5b9939f2813e98e277',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-13T12:08:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-13T12:08:23Z,use_quota=True,user_id='0f7e4e969b834f318872ab140abbe5fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1147de8b-623b-426c-a13d-7fc824a80f67),volume_type_id=1147de8b-623b-426c-a13d-7fc824a80f67)}" {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 13 14:08:23 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-318d9f44-264c-41af-9636-72d771061ded tempest-ProjectReaderTests-1606700179 None] Creating volume 320f6bd2-c47f-43a4-8f6c-822d09bac6db {{(pid=87098) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 13 14:08:23 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-318d9f44-264c-41af-9636-72d771061ded tempest-ProjectReaderTests-1606700179 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 14:08:23 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-318d9f44-264c-41af-9636-72d771061ded tempest-ProjectReaderTests-1606700179 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 14:08:23 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-318d9f44-264c-41af-9636-72d771061ded tempest-ProjectReaderTests-1606700179 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 14:08:23 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-318d9f44-264c-41af-9636-72d771061ded tempest-ProjectReaderTests-1606700179 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 14:08:23 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-318d9f44-264c-41af-9636-72d771061ded tempest-ProjectReaderTests-1606700179 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 14:08:23 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-318d9f44-264c-41af-9636-72d771061ded tempest-ProjectReaderTests-1606700179 None] Selected osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 13 14:08:23 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-318d9f44-264c-41af-9636-72d771061ded tempest-ProjectReaderTests-1606700179 None] casted to osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654 Jul 13 14:08:23 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-318d9f44-264c-41af-9636-72d771061ded tempest-ProjectReaderTests-1606700179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-320f6bd2-c47f-43a4-8f6c-822d09bac6db 1073741824 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:08:23 devstack sudo[106418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-320f6bd2-c47f-43a4-8f6c-822d09bac6db 1073741824 Jul 13 14:08:23 devstack sudo[106418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:08:24 devstack sudo[106418]: pam_unix(sudo:session): session closed for user root Jul 13 14:08:24 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-318d9f44-264c-41af-9636-72d771061ded tempest-ProjectReaderTests-1606700179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-320f6bd2-c47f-43a4-8f6c-822d09bac6db 1073741824" returned: 0 in 0.402s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:08:24 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-318d9f44-264c-41af-9636-72d771061ded tempest-ProjectReaderTests-1606700179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-320f6bd2-c47f-43a4-8f6c-822d09bac6db {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:08:24 devstack sudo[106423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-320f6bd2-c47f-43a4-8f6c-822d09bac6db Jul 13 14:08:24 devstack sudo[106423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:08:24 devstack sudo[106423]: pam_unix(sudo:session): session closed for user root Jul 13 14:08:24 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-318d9f44-264c-41af-9636-72d771061ded tempest-ProjectReaderTests-1606700179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-320f6bd2-c47f-43a4-8f6c-822d09bac6db" returned: 0 in 0.239s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:08:24 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-318d9f44-264c-41af-9636-72d771061ded tempest-ProjectReaderTests-1606700179 None] <== create_volume: return (686ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'} {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 13 14:08:24 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-318d9f44-264c-41af-9636-72d771061ded tempest-ProjectReaderTests-1606700179 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.689s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 14:08:24 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-318d9f44-264c-41af-9636-72d771061ded tempest-ProjectReaderTests-1606700179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d145d5c-12de-4971-8b88-9273eda35e1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-320f6bd2-c47f-43a4-8f6c-822d09bac6db', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:08:24 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-318d9f44-264c-41af-9636-72d771061ded tempest-ProjectReaderTests-1606700179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11213c75-2517-4744-8652-f92d7fde639c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 13 14:08:24 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-318d9f44-264c-41af-9636-72d771061ded tempest-ProjectReaderTests-1606700179 None] Volume volume-320f6bd2-c47f-43a4-8f6c-822d09bac6db (320f6bd2-c47f-43a4-8f6c-822d09bac6db): created successfully Jul 13 14:08:24 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-318d9f44-264c-41af-9636-72d771061ded tempest-ProjectReaderTests-1606700179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11213c75-2517-4744-8652-f92d7fde639c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 13 14:08:24 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-318d9f44-264c-41af-9636-72d771061ded tempest-ProjectReaderTests-1606700179 None] Flow 'volume_create_manager' (7bbce0b2-209f-4881-8844-7a8c23a388b2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 13 14:08:24 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-318d9f44-264c-41af-9636-72d771061ded tempest-ProjectReaderTests-1606700179 None] Created volume successfully. Jul 13 14:08:24 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-b7825df4-6d39-4bc5-9747-cb22995fbefe tempest-ProjectReaderTests-1606700179 None] Acquiring lock "cinder-320f6bd2-c47f-43a4-8f6c-822d09bac6db-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 14:08:24 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-b7825df4-6d39-4bc5-9747-cb22995fbefe tempest-ProjectReaderTests-1606700179 None] Lock "cinder-320f6bd2-c47f-43a4-8f6c-822d09bac6db-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 14:08:24 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-b7825df4-6d39-4bc5-9747-cb22995fbefe tempest-ProjectReaderTests-1606700179 None] Acquiring lock "cinder-quobyte-320f6bd2-c47f-43a4-8f6c-822d09bac6db" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 13 14:08:24 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-b7825df4-6d39-4bc5-9747-cb22995fbefe tempest-ProjectReaderTests-1606700179 None] Lock "cinder-quobyte-320f6bd2-c47f-43a4-8f6c-822d09bac6db" acquired by "delete_volume" :: waited 0.015s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 13 14:08:24 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[18bc5396-2b40-42e0-997a-6d2a7573f5bb]: (4, 'qcow2') {{(pid=88154) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 13 14:08:24 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-b7825df4-6d39-4bc5-9747-cb22995fbefe tempest-ProjectReaderTests-1606700179 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-320f6bd2-c47f-43a4-8f6c-822d09bac6db {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:08:24 devstack sudo[106426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-320f6bd2-c47f-43a4-8f6c-822d09bac6db Jul 13 14:08:24 devstack sudo[106426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:08:25 devstack sudo[106426]: pam_unix(sudo:session): session closed for user root Jul 13 14:08:25 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-b7825df4-6d39-4bc5-9747-cb22995fbefe tempest-ProjectReaderTests-1606700179 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-320f6bd2-c47f-43a4-8f6c-822d09bac6db" returned: 0 in 0.349s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:08:25 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-b7825df4-6d39-4bc5-9747-cb22995fbefe tempest-ProjectReaderTests-1606700179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-320f6bd2-c47f-43a4-8f6c-822d09bac6db {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:08:25 devstack sudo[106431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-320f6bd2-c47f-43a4-8f6c-822d09bac6db Jul 13 14:08:25 devstack sudo[106431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:08:25 devstack sudo[106431]: pam_unix(sudo:session): session closed for user root Jul 13 14:08:25 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-b7825df4-6d39-4bc5-9747-cb22995fbefe tempest-ProjectReaderTests-1606700179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78/volume-320f6bd2-c47f-43a4-8f6c-822d09bac6db" returned: 0 in 0.244s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:08:25 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-b7825df4-6d39-4bc5-9747-cb22995fbefe tempest-ProjectReaderTests-1606700179 None] Lock "cinder-quobyte-320f6bd2-c47f-43a4-8f6c-822d09bac6db" released by "delete_volume" :: held 0.628s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 14:08:25 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-b7825df4-6d39-4bc5-9747-cb22995fbefe tempest-ProjectReaderTests-1606700179 None] Created reservations ['08c7e7c9-8795-4215-bbb4-4b230d5090a8', '9a1a260b-baa3-4389-8c5e-7002727656de', 'edd31a8d-6bb4-42b0-ad46-b6ebe562f2c5', '545d927b-ead1-430a-abc6-6d876125d096'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 13 14:08:25 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-b7825df4-6d39-4bc5-9747-cb22995fbefe tempest-ProjectReaderTests-1606700179 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 14:08:25 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-b7825df4-6d39-4bc5-9747-cb22995fbefe tempest-ProjectReaderTests-1606700179 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 14:08:25 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-b7825df4-6d39-4bc5-9747-cb22995fbefe tempest-ProjectReaderTests-1606700179 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 14:08:25 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-b7825df4-6d39-4bc5-9747-cb22995fbefe tempest-ProjectReaderTests-1606700179 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 14:08:25 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-b7825df4-6d39-4bc5-9747-cb22995fbefe tempest-ProjectReaderTests-1606700179 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 14:08:25 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-b7825df4-6d39-4bc5-9747-cb22995fbefe tempest-ProjectReaderTests-1606700179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:08:25 devstack sudo[106434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 Jul 13 14:08:25 devstack sudo[106434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:08:25 devstack sudo[106434]: pam_unix(sudo:session): session closed for user root Jul 13 14:08:25 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-b7825df4-6d39-4bc5-9747-cb22995fbefe tempest-ProjectReaderTests-1606700179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78" returned: 0 in 0.240s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:08:25 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-b7825df4-6d39-4bc5-9747-cb22995fbefe tempest-ProjectReaderTests-1606700179 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 14:08:25 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-b7825df4-6d39-4bc5-9747-cb22995fbefe tempest-ProjectReaderTests-1606700179 None] Deleted volume successfully. Jul 13 14:08:25 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-b7825df4-6d39-4bc5-9747-cb22995fbefe tempest-ProjectReaderTests-1606700179 None] Lock "cinder-320f6bd2-c47f-43a4-8f6c-822d09bac6db-delete_volume" released by "delete_volume" :: held 1.096s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 13 14:08:29 devstack cinder-volume[87098]: DEBUG oslo_service.periodic_task [None req-727a1692-ea28-4a77-b327-0d94e8f01efb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87098) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 13 14:08:29 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-727a1692-ea28-4a77-b327-0d94e8f01efb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 13 14:08:29 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-727a1692-ea28-4a77-b327-0d94e8f01efb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 13 14:08:29 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-727a1692-ea28-4a77-b327-0d94e8f01efb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 13 14:08:29 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-727a1692-ea28-4a77-b327-0d94e8f01efb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-60f3971a-2ede-4526-9b18-1598d72d4654'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 13 14:08:29 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-727a1692-ea28-4a77-b327-0d94e8f01efb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 13 14:08:29 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-727a1692-ea28-4a77-b327-0d94e8f01efb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 13 14:08:29 devstack sudo[106442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78 Jul 13 14:08:29 devstack sudo[106442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 13 14:08:29 devstack sudo[106442]: pam_unix(sudo:session): session closed for user root Jul 13 14:08:29 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-727a1692-ea28-4a77-b327-0d94e8f01efb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e2afc6a449296549b3c7b5e28bdac78" returned: 0 in 0.237s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 13 14:08:29 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-727a1692-ea28-4a77-b327-0d94e8f01efb None None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 13 14:08:29 devstack cinder-volume[87098]: DEBUG oslo_service.periodic_task [None req-727a1692-ea28-4a77-b327-0d94e8f01efb None None] Running periodic task VolumeManager._thread_info {{(pid=87098) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 13 14:08:29 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-727a1692-ea28-4a77-b327-0d94e8f01efb None None] thread count: 28 {{(pid=87098) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 13 14:08:29 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-727a1692-ea28-4a77-b327-0d94e8f01efb None None] thread info: [<_MainThread(MainThread, started 127988054597760)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87098) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 13 14:08:35 devstack cinder-volume[87098]: DEBUG dbcounter [-] [87098] Writing DB stats cinder:UPDATE=45,cinder:INSERT=9,cinder:DELETE=5,cinder:SELECT=24 {{(pid=87098) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 13 14:08:35 devstack cinder-volume[87098]: DEBUG dbcounter [-] [87098] Writing DB stats cinder:SELECT=32,cinder:UPDATE=43,cinder:INSERT=11,cinder:DELETE=3 {{(pid=87098) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}